Attachment 884913 Details for Bug 1086210 – vdsm log

vdsm log

vdsm.log (text/x-log), 11.57 MB, created by Shanzhi Yu on 2014-04-10 11:51:02 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Shanzhi Yu

Created: 2014-04-10 11:51:02 UTC

Size: 11.57 MB

patch

obsolete

>Thread-28::DEBUG::2014-04-10 14:01:04,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:04,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000250001 s, 1.5 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:05,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:05,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259349 s, 2.6 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:05,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:05,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000401728 s, 916 kB/s\n'; <rc> = 0
>Thread-54600::DEBUG::2014-04-10 14:01:07,638::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-54600::DEBUG::2014-04-10 14:01:07,638::task::579::TaskManager.Task::(_updateState) Task=`e2444c36-a7b9-4667-a451-0fc44f918b61`::moving from state init -> state preparing
>Thread-54600::INFO::2014-04-10 14:01:07,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54600::INFO::2014-04-10 14:01:07,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54600::DEBUG::2014-04-10 14:01:07,639::task::1168::TaskManager.Task::(prepare) Task=`e2444c36-a7b9-4667-a451-0fc44f918b61`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54600::DEBUG::2014-04-10 14:01:07,639::task::579::TaskManager.Task::(_updateState) Task=`e2444c36-a7b9-4667-a451-0fc44f918b61`::moving from state preparing -> state finished
>Thread-54600::DEBUG::2014-04-10 14:01:07,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54600::DEBUG::2014-04-10 14:01:07,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54600::DEBUG::2014-04-10 14:01:07,640::task::974::TaskManager.Task::(_decref) Task=`e2444c36-a7b9-4667-a451-0fc44f918b61`::ref 0 aborting False
>Thread-54601::DEBUG::2014-04-10 14:01:07,647::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-54601::DEBUG::2014-04-10 14:01:07,647::task::579::TaskManager.Task::(_updateState) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::moving from state init -> state preparing
>Thread-54601::INFO::2014-04-10 14:01:07,647::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54601::DEBUG::2014-04-10 14:01:07,648::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63da74c7-2acb-4204-9119-7911fc985eb8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54601::DEBUG::2014-04-10 14:01:07,648::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54601::DEBUG::2014-04-10 14:01:07,648::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54601::DEBUG::2014-04-10 14:01:07,649::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63da74c7-2acb-4204-9119-7911fc985eb8`::Granted request
>Thread-54601::DEBUG::2014-04-10 14:01:07,649::task::811::TaskManager.Task::(resourceAcquired) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54601::DEBUG::2014-04-10 14:01:07,649::task::974::TaskManager.Task::(_decref) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::ref 1 aborting False
>Thread-54601::INFO::2014-04-10 14:01:07,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652166144', 'isoprefix': '', 'alerts': [], 'disktotal': '910948696064', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652166144', 'isoprefix': '', 'alerts': [], 'disktotal': '910948696064', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54601::DEBUG::2014-04-10 14:01:07,652::task::1168::TaskManager.Task::(prepare) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652166144', 'isoprefix': '', 'alerts': [], 'disktotal': '910948696064', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652166144', 'isoprefix': '', 'alerts': [], 'disktotal': '910948696064', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54601::DEBUG::2014-04-10 14:01:07,652::task::579::TaskManager.Task::(_updateState) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::moving from state preparing -> state finished
>Thread-54601::DEBUG::2014-04-10 14:01:07,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54601::DEBUG::2014-04-10 14:01:07,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54601::DEBUG::2014-04-10 14:01:07,653::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54601::DEBUG::2014-04-10 14:01:07,653::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54601::DEBUG::2014-04-10 14:01:07,653::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54601::DEBUG::2014-04-10 14:01:07,653::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54601::DEBUG::2014-04-10 14:01:07,653::task::974::TaskManager.Task::(_decref) Task=`9029de23-fca8-4fa8-8eaf-3f6f9d9fb012`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:01:07,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:07,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000372628 s, 988 kB/s\n'; <rc> = 0
>Thread-54602::DEBUG::2014-04-10 14:01:10,455::task::579::TaskManager.Task::(_updateState) Task=`079c8d8b-2e6e-49c1-a0a7-e8f659cab99f`::moving from state init -> state preparing
>Thread-54602::INFO::2014-04-10 14:01:10,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54602::INFO::2014-04-10 14:01:10,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250001', 'lastCheck': '5.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401728', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259349', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372628', 'lastCheck': '2.5', 'valid': True}}
>Thread-54602::DEBUG::2014-04-10 14:01:10,456::task::1168::TaskManager.Task::(prepare) Task=`079c8d8b-2e6e-49c1-a0a7-e8f659cab99f`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250001', 'lastCheck': '5.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401728', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259349', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372628', 'lastCheck': '2.5', 'valid': True}}
>Thread-54602::DEBUG::2014-04-10 14:01:10,456::task::579::TaskManager.Task::(_updateState) Task=`079c8d8b-2e6e-49c1-a0a7-e8f659cab99f`::moving from state preparing -> state finished
>Thread-54602::DEBUG::2014-04-10 14:01:10,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54602::DEBUG::2014-04-10 14:01:10,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54602::DEBUG::2014-04-10 14:01:10,457::task::974::TaskManager.Task::(_decref) Task=`079c8d8b-2e6e-49c1-a0a7-e8f659cab99f`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:01:14,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:14,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000369432 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:15,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:15,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363526 s, 1.8 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:15,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:15,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000439906 s, 837 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:01:17,319::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-54606::DEBUG::2014-04-10 14:01:17,786::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [127d87cf]
>Thread-54606::DEBUG::2014-04-10 14:01:17,787::task::579::TaskManager.Task::(_updateState) Task=`5df1cf52-5a1b-468a-8ab1-a90bfaff37f1`::moving from state init -> state preparing
>Thread-54606::INFO::2014-04-10 14:01:17,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54606::INFO::2014-04-10 14:01:17,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54606::DEBUG::2014-04-10 14:01:17,787::task::1168::TaskManager.Task::(prepare) Task=`5df1cf52-5a1b-468a-8ab1-a90bfaff37f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54606::DEBUG::2014-04-10 14:01:17,787::task::579::TaskManager.Task::(_updateState) Task=`5df1cf52-5a1b-468a-8ab1-a90bfaff37f1`::moving from state preparing -> state finished
>Thread-54606::DEBUG::2014-04-10 14:01:17,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54606::DEBUG::2014-04-10 14:01:17,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54606::DEBUG::2014-04-10 14:01:17,788::task::974::TaskManager.Task::(_decref) Task=`5df1cf52-5a1b-468a-8ab1-a90bfaff37f1`::ref 0 aborting False
>Thread-54607::DEBUG::2014-04-10 14:01:17,795::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [127d87cf]
>Thread-54607::DEBUG::2014-04-10 14:01:17,795::task::579::TaskManager.Task::(_updateState) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::moving from state init -> state preparing
>Thread-54607::INFO::2014-04-10 14:01:17,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54607::DEBUG::2014-04-10 14:01:17,796::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f96ef8b4-6e8c-4ca0-9bf6-917fc4fe8bf3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54607::DEBUG::2014-04-10 14:01:17,796::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54607::DEBUG::2014-04-10 14:01:17,796::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54607::DEBUG::2014-04-10 14:01:17,796::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f96ef8b4-6e8c-4ca0-9bf6-917fc4fe8bf3`::Granted request
>Thread-54607::DEBUG::2014-04-10 14:01:17,797::task::811::TaskManager.Task::(resourceAcquired) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54607::DEBUG::2014-04-10 14:01:17,797::task::974::TaskManager.Task::(_decref) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::ref 1 aborting False
>Thread-54607::INFO::2014-04-10 14:01:17,799::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54607::DEBUG::2014-04-10 14:01:17,799::task::1168::TaskManager.Task::(prepare) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54607::DEBUG::2014-04-10 14:01:17,799::task::579::TaskManager.Task::(_updateState) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::moving from state preparing -> state finished
>Thread-54607::DEBUG::2014-04-10 14:01:17,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54607::DEBUG::2014-04-10 14:01:17,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54607::DEBUG::2014-04-10 14:01:17,800::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54607::DEBUG::2014-04-10 14:01:17,800::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54607::DEBUG::2014-04-10 14:01:17,800::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54607::DEBUG::2014-04-10 14:01:17,800::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54607::DEBUG::2014-04-10 14:01:17,800::task::974::TaskManager.Task::(_decref) Task=`75a11bf1-cfbe-43b4-9fb7-85c7f23502ab`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:01:17,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:17,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045399 s, 811 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:01:18,320::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-28::DEBUG::2014-04-10 14:01:24,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:24,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000424455 s, 898 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:25,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:25,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393062 s, 1.7 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:25,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:25,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000370822 s, 992 kB/s\n'; <rc> = 0
>Thread-54610::DEBUG::2014-04-10 14:01:25,730::task::579::TaskManager.Task::(_updateState) Task=`b24d1cd1-3ce3-412b-a154-9025f8c28589`::moving from state init -> state preparing
>Thread-54610::INFO::2014-04-10 14:01:25,730::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54610::INFO::2014-04-10 14:01:25,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424455', 'lastCheck': '1.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370822', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393062', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045399', 'lastCheck': '7.8', 'valid': True}}
>Thread-54610::DEBUG::2014-04-10 14:01:25,731::task::1168::TaskManager.Task::(prepare) Task=`b24d1cd1-3ce3-412b-a154-9025f8c28589`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424455', 'lastCheck': '1.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370822', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393062', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045399', 'lastCheck': '7.8', 'valid': True}}
>Thread-54610::DEBUG::2014-04-10 14:01:25,731::task::579::TaskManager.Task::(_updateState) Task=`b24d1cd1-3ce3-412b-a154-9025f8c28589`::moving from state preparing -> state finished
>Thread-54610::DEBUG::2014-04-10 14:01:25,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54610::DEBUG::2014-04-10 14:01:25,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54610::DEBUG::2014-04-10 14:01:25,732::task::974::TaskManager.Task::(_decref) Task=`b24d1cd1-3ce3-412b-a154-9025f8c28589`::ref 0 aborting False
>Thread-54612::DEBUG::2014-04-10 14:01:27,891::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54612::DEBUG::2014-04-10 14:01:27,891::task::579::TaskManager.Task::(_updateState) Task=`41359927-b0b6-48d0-83b6-f391a3db6146`::moving from state init -> state preparing
>Thread-54612::INFO::2014-04-10 14:01:27,891::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54612::INFO::2014-04-10 14:01:27,891::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54612::DEBUG::2014-04-10 14:01:27,892::task::1168::TaskManager.Task::(prepare) Task=`41359927-b0b6-48d0-83b6-f391a3db6146`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54612::DEBUG::2014-04-10 14:01:27,892::task::579::TaskManager.Task::(_updateState) Task=`41359927-b0b6-48d0-83b6-f391a3db6146`::moving from state preparing -> state finished
>Thread-54612::DEBUG::2014-04-10 14:01:27,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54612::DEBUG::2014-04-10 14:01:27,892::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54612::DEBUG::2014-04-10 14:01:27,892::task::974::TaskManager.Task::(_decref) Task=`41359927-b0b6-48d0-83b6-f391a3db6146`::ref 0 aborting False
>Thread-54613::DEBUG::2014-04-10 14:01:27,898::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54613::DEBUG::2014-04-10 14:01:27,899::task::579::TaskManager.Task::(_updateState) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::moving from state init -> state preparing
>Thread-54613::INFO::2014-04-10 14:01:27,899::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54613::DEBUG::2014-04-10 14:01:27,899::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2905e37-fa00-4bca-a55b-10dea2abf6fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54613::DEBUG::2014-04-10 14:01:27,899::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54613::DEBUG::2014-04-10 14:01:27,900::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54613::DEBUG::2014-04-10 14:01:27,900::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2905e37-fa00-4bca-a55b-10dea2abf6fa`::Granted request
>Thread-54613::DEBUG::2014-04-10 14:01:27,900::task::811::TaskManager.Task::(resourceAcquired) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54613::DEBUG::2014-04-10 14:01:27,900::task::974::TaskManager.Task::(_decref) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::ref 1 aborting False
>Thread-54613::INFO::2014-04-10 14:01:27,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54613::DEBUG::2014-04-10 14:01:27,902::task::1168::TaskManager.Task::(prepare) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54613::DEBUG::2014-04-10 14:01:27,902::task::579::TaskManager.Task::(_updateState) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::moving from state preparing -> state finished
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54613::DEBUG::2014-04-10 14:01:27,903::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54613::DEBUG::2014-04-10 14:01:27,904::task::974::TaskManager.Task::(_decref) Task=`8a34bbfa-711f-45fc-bf39-650bb974b372`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:01:27,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:27,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000498411 s, 738 kB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 14:01:34,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:34,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000354793 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:35,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:35,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396794 s, 1.7 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:35,473::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:35,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000396023 s, 929 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:01:37,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:37,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366955 s, 1.0 MB/s\n'; <rc> = 0
>Thread-54618::DEBUG::2014-04-10 14:01:38,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54618::DEBUG::2014-04-10 14:01:38,013::task::579::TaskManager.Task::(_updateState) Task=`9fd1f3ca-03dd-42b3-843e-b82cdcc5449f`::moving from state init -> state preparing
>Thread-54618::INFO::2014-04-10 14:01:38,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54618::INFO::2014-04-10 14:01:38,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54618::DEBUG::2014-04-10 14:01:38,014::task::1168::TaskManager.Task::(prepare) Task=`9fd1f3ca-03dd-42b3-843e-b82cdcc5449f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54618::DEBUG::2014-04-10 14:01:38,014::task::579::TaskManager.Task::(_updateState) Task=`9fd1f3ca-03dd-42b3-843e-b82cdcc5449f`::moving from state preparing -> state finished
>Thread-54618::DEBUG::2014-04-10 14:01:38,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54618::DEBUG::2014-04-10 14:01:38,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54618::DEBUG::2014-04-10 14:01:38,015::task::974::TaskManager.Task::(_decref) Task=`9fd1f3ca-03dd-42b3-843e-b82cdcc5449f`::ref 0 aborting False
>Thread-54619::DEBUG::2014-04-10 14:01:38,021::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54619::DEBUG::2014-04-10 14:01:38,022::task::579::TaskManager.Task::(_updateState) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::moving from state init -> state preparing
>Thread-54619::INFO::2014-04-10 14:01:38,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54619::DEBUG::2014-04-10 14:01:38,022::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f644e8a2-68e3-4c82-bce0-a42c8dea5c9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54619::DEBUG::2014-04-10 14:01:38,023::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54619::DEBUG::2014-04-10 14:01:38,023::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54619::DEBUG::2014-04-10 14:01:38,023::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f644e8a2-68e3-4c82-bce0-a42c8dea5c9d`::Granted request
>Thread-54619::DEBUG::2014-04-10 14:01:38,023::task::811::TaskManager.Task::(resourceAcquired) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54619::DEBUG::2014-04-10 14:01:38,024::task::974::TaskManager.Task::(_decref) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::ref 1 aborting False
>Thread-54619::INFO::2014-04-10 14:01:38,026::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54619::DEBUG::2014-04-10 14:01:38,026::task::1168::TaskManager.Task::(prepare) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54619::DEBUG::2014-04-10 14:01:38,026::task::579::TaskManager.Task::(_updateState) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::moving from state preparing -> state finished
>Thread-54619::DEBUG::2014-04-10 14:01:38,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54619::DEBUG::2014-04-10 14:01:38,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54619::DEBUG::2014-04-10 14:01:38,027::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54619::DEBUG::2014-04-10 14:01:38,027::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54619::DEBUG::2014-04-10 14:01:38,027::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54619::DEBUG::2014-04-10 14:01:38,027::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54619::DEBUG::2014-04-10 14:01:38,028::task::974::TaskManager.Task::(_decref) Task=`81a6c084-bf4e-4d34-b949-9cb4159d7629`::ref 0 aborting False
>Thread-54620::DEBUG::2014-04-10 14:01:41,020::task::579::TaskManager.Task::(_updateState) Task=`9d2397c1-9bf9-459e-8a73-2990f76aba15`::moving from state init -> state preparing
>Thread-54620::INFO::2014-04-10 14:01:41,020::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54620::INFO::2014-04-10 14:01:41,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354793', 'lastCheck': '6.4', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396023', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396794', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366955', 'lastCheck': '3.0', 'valid': True}}
>Thread-54620::DEBUG::2014-04-10 14:01:41,021::task::1168::TaskManager.Task::(prepare) Task=`9d2397c1-9bf9-459e-8a73-2990f76aba15`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354793', 'lastCheck': '6.4', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396023', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396794', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366955', 'lastCheck': '3.0', 'valid': True}}
>Thread-54620::DEBUG::2014-04-10 14:01:41,021::task::579::TaskManager.Task::(_updateState) Task=`9d2397c1-9bf9-459e-8a73-2990f76aba15`::moving from state preparing -> state finished
>Thread-54620::DEBUG::2014-04-10 14:01:41,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54620::DEBUG::2014-04-10 14:01:41,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54620::DEBUG::2014-04-10 14:01:41,021::task::974::TaskManager.Task::(_decref) Task=`9d2397c1-9bf9-459e-8a73-2990f76aba15`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:01:44,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:44,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000303199 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:45,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:45,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000487319 s, 1.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:45,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:45,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000557789 s, 660 kB/s\n'; <rc> = 0
>Thread-859::DEBUG::2014-04-10 14:01:46,327::task::579::TaskManager.Task::(_updateState) Task=`d953cf4a-23e7-4b5d-a03f-0df1afe9903e`::moving from state init -> state preparing
>Thread-859::INFO::2014-04-10 14:01:46,349::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', volUUID='70bf7589-51a3-471d-bb14-93ecaaff1e0f', options=None)
>Thread-859::INFO::2014-04-10 14:01:46,357::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:01:46,358::task::1168::TaskManager.Task::(prepare) Task=`d953cf4a-23e7-4b5d-a03f-0df1afe9903e`::finished: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:01:46,358::task::579::TaskManager.Task::(_updateState) Task=`d953cf4a-23e7-4b5d-a03f-0df1afe9903e`::moving from state preparing -> state finished
>Thread-859::DEBUG::2014-04-10 14:01:46,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-859::DEBUG::2014-04-10 14:01:46,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-859::DEBUG::2014-04-10 14:01:46,358::task::974::TaskManager.Task::(_decref) Task=`d953cf4a-23e7-4b5d-a03f-0df1afe9903e`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 14:01:47,353::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:01:48,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:48,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462555 s, 796 kB/s\n'; <rc> = 0
>Thread-54624::DEBUG::2014-04-10 14:01:48,107::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54624::DEBUG::2014-04-10 14:01:48,107::task::579::TaskManager.Task::(_updateState) Task=`19b1e06a-07cf-41e3-8a01-7ce2f2390617`::moving from state init -> state preparing
>Thread-54624::INFO::2014-04-10 14:01:48,108::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54624::INFO::2014-04-10 14:01:48,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54624::DEBUG::2014-04-10 14:01:48,108::task::1168::TaskManager.Task::(prepare) Task=`19b1e06a-07cf-41e3-8a01-7ce2f2390617`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54624::DEBUG::2014-04-10 14:01:48,108::task::579::TaskManager.Task::(_updateState) Task=`19b1e06a-07cf-41e3-8a01-7ce2f2390617`::moving from state preparing -> state finished
>Thread-54624::DEBUG::2014-04-10 14:01:48,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54624::DEBUG::2014-04-10 14:01:48,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54624::DEBUG::2014-04-10 14:01:48,109::task::974::TaskManager.Task::(_decref) Task=`19b1e06a-07cf-41e3-8a01-7ce2f2390617`::ref 0 aborting False
>Thread-54625::DEBUG::2014-04-10 14:01:48,116::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54625::DEBUG::2014-04-10 14:01:48,116::task::579::TaskManager.Task::(_updateState) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::moving from state init -> state preparing
>Thread-54625::INFO::2014-04-10 14:01:48,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54625::DEBUG::2014-04-10 14:01:48,117::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe5c58b1-f8d4-4586-b1a2-d1ac1cc0dac3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54625::DEBUG::2014-04-10 14:01:48,117::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54625::DEBUG::2014-04-10 14:01:48,117::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54625::DEBUG::2014-04-10 14:01:48,117::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe5c58b1-f8d4-4586-b1a2-d1ac1cc0dac3`::Granted request
>Thread-54625::DEBUG::2014-04-10 14:01:48,118::task::811::TaskManager.Task::(resourceAcquired) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54625::DEBUG::2014-04-10 14:01:48,118::task::974::TaskManager.Task::(_decref) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::ref 1 aborting False
>Thread-54625::INFO::2014-04-10 14:01:48,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54625::DEBUG::2014-04-10 14:01:48,120::task::1168::TaskManager.Task::(prepare) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::task::579::TaskManager.Task::(_updateState) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::moving from state preparing -> state finished
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54625::DEBUG::2014-04-10 14:01:48,121::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54625::DEBUG::2014-04-10 14:01:48,122::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54625::DEBUG::2014-04-10 14:01:48,122::task::974::TaskManager.Task::(_decref) Task=`45ac9456-fff4-427f-99c7-1a703dcc5879`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 14:01:48,354::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-28::DEBUG::2014-04-10 14:01:54,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:01:54,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000385955 s, 987 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:01:55,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:01:55,104::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000709502 s, 946 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:01:55,496::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-27::DEBUG::2014-04-10 14:01:55,510::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-27::DEBUG::2014-04-10 14:01:55,511::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-27::DEBUG::2014-04-10 14:01:55,517::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Regular', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=3b2fcd0a0b940e46c081d4a2b994fad4b928c35a']
>Thread-27::DEBUG::2014-04-10 14:01:55,518::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-27::INFO::2014-04-10 14:01:55,518::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-27::INFO::2014-04-10 14:01:55,518::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-27::DEBUG::2014-04-10 14:01:55,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:01:55,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000425891 s, 864 kB/s\n'; <rc> = 0
>Thread-54632::DEBUG::2014-04-10 14:01:56,275::task::579::TaskManager.Task::(_updateState) Task=`1a4243b7-a2fa-4891-987e-8b191c3aa94c`::moving from state init -> state preparing
>Thread-54632::INFO::2014-04-10 14:01:56,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54632::INFO::2014-04-10 14:01:56,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385955', 'lastCheck': '1.6', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425891', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709502', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462555', 'lastCheck': '8.3', 'valid': True}}
>Thread-54632::DEBUG::2014-04-10 14:01:56,276::task::1168::TaskManager.Task::(prepare) Task=`1a4243b7-a2fa-4891-987e-8b191c3aa94c`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385955', 'lastCheck': '1.6', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425891', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709502', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462555', 'lastCheck': '8.3', 'valid': True}}
>Thread-54632::DEBUG::2014-04-10 14:01:56,276::task::579::TaskManager.Task::(_updateState) Task=`1a4243b7-a2fa-4891-987e-8b191c3aa94c`::moving from state preparing -> state finished
>Thread-54632::DEBUG::2014-04-10 14:01:56,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54632::DEBUG::2014-04-10 14:01:56,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54632::DEBUG::2014-04-10 14:01:56,277::task::974::TaskManager.Task::(_decref) Task=`1a4243b7-a2fa-4891-987e-8b191c3aa94c`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:01:58,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:01:58,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000584204 s, 630 kB/s\n'; <rc> = 0
>Thread-54634::DEBUG::2014-04-10 14:01:58,205::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54634::DEBUG::2014-04-10 14:01:58,206::task::579::TaskManager.Task::(_updateState) Task=`f869542f-72ce-450a-b209-41bbef5844ef`::moving from state init -> state preparing
>Thread-54634::INFO::2014-04-10 14:01:58,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54634::INFO::2014-04-10 14:01:58,206::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54634::DEBUG::2014-04-10 14:01:58,206::task::1168::TaskManager.Task::(prepare) Task=`f869542f-72ce-450a-b209-41bbef5844ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54634::DEBUG::2014-04-10 14:01:58,207::task::579::TaskManager.Task::(_updateState) Task=`f869542f-72ce-450a-b209-41bbef5844ef`::moving from state preparing -> state finished
>Thread-54634::DEBUG::2014-04-10 14:01:58,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54634::DEBUG::2014-04-10 14:01:58,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54634::DEBUG::2014-04-10 14:01:58,207::task::974::TaskManager.Task::(_decref) Task=`f869542f-72ce-450a-b209-41bbef5844ef`::ref 0 aborting False
>Thread-54635::DEBUG::2014-04-10 14:01:58,213::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54635::DEBUG::2014-04-10 14:01:58,213::task::579::TaskManager.Task::(_updateState) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::moving from state init -> state preparing
>Thread-54635::INFO::2014-04-10 14:01:58,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54635::DEBUG::2014-04-10 14:01:58,214::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`00820d36-60e9-4732-b743-cfb9d7ef1897`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54635::DEBUG::2014-04-10 14:01:58,214::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54635::DEBUG::2014-04-10 14:01:58,215::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54635::DEBUG::2014-04-10 14:01:58,215::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`00820d36-60e9-4732-b743-cfb9d7ef1897`::Granted request
>Thread-54635::DEBUG::2014-04-10 14:01:58,215::task::811::TaskManager.Task::(resourceAcquired) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54635::DEBUG::2014-04-10 14:01:58,215::task::974::TaskManager.Task::(_decref) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::ref 1 aborting False
>Thread-54635::INFO::2014-04-10 14:01:58,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54635::DEBUG::2014-04-10 14:01:58,218::task::1168::TaskManager.Task::(prepare) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54635::DEBUG::2014-04-10 14:01:58,218::task::579::TaskManager.Task::(_updateState) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::moving from state preparing -> state finished
>Thread-54635::DEBUG::2014-04-10 14:01:58,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54635::DEBUG::2014-04-10 14:01:58,219::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54635::DEBUG::2014-04-10 14:01:58,219::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54635::DEBUG::2014-04-10 14:01:58,219::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54635::DEBUG::2014-04-10 14:01:58,219::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54635::DEBUG::2014-04-10 14:01:58,219::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54635::DEBUG::2014-04-10 14:01:58,220::task::974::TaskManager.Task::(_decref) Task=`f2b177ae-375c-4fef-9d54-25c72313020c`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:04,651::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:04,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000358284 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:05,114::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:05,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380602 s, 1.8 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:05,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:05,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481533 s, 764 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:02:08,033::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-38::DEBUG::2014-04-10 14:02:08,049::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-38::DEBUG::2014-04-10 14:02:08,051::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-38::DEBUG::2014-04-10 14:02:08,056::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-38::DEBUG::2014-04-10 14:02:08,058::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-38::INFO::2014-04-10 14:02:08,058::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-38::INFO::2014-04-10 14:02:08,058::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-38::DEBUG::2014-04-10 14:02:08,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:08,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000310849 s, 1.2 MB/s\n'; <rc> = 0
>Thread-54643::DEBUG::2014-04-10 14:02:08,397::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54643::DEBUG::2014-04-10 14:02:08,397::task::579::TaskManager.Task::(_updateState) Task=`337fe0b8-2450-4f2f-a07e-f7a6c42c6e4f`::moving from state init -> state preparing
>Thread-54643::INFO::2014-04-10 14:02:08,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54643::INFO::2014-04-10 14:02:08,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54643::DEBUG::2014-04-10 14:02:08,398::task::1168::TaskManager.Task::(prepare) Task=`337fe0b8-2450-4f2f-a07e-f7a6c42c6e4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54643::DEBUG::2014-04-10 14:02:08,398::task::579::TaskManager.Task::(_updateState) Task=`337fe0b8-2450-4f2f-a07e-f7a6c42c6e4f`::moving from state preparing -> state finished
>Thread-54643::DEBUG::2014-04-10 14:02:08,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54643::DEBUG::2014-04-10 14:02:08,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54643::DEBUG::2014-04-10 14:02:08,399::task::974::TaskManager.Task::(_decref) Task=`337fe0b8-2450-4f2f-a07e-f7a6c42c6e4f`::ref 0 aborting False
>Thread-54644::DEBUG::2014-04-10 14:02:08,405::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54644::DEBUG::2014-04-10 14:02:08,405::task::579::TaskManager.Task::(_updateState) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::moving from state init -> state preparing
>Thread-54644::INFO::2014-04-10 14:02:08,406::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54644::DEBUG::2014-04-10 14:02:08,406::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7a9c7ced-b8d5-479f-9505-5ae3c0b76688`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54644::DEBUG::2014-04-10 14:02:08,406::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54644::DEBUG::2014-04-10 14:02:08,406::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54644::DEBUG::2014-04-10 14:02:08,407::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7a9c7ced-b8d5-479f-9505-5ae3c0b76688`::Granted request
>Thread-54644::DEBUG::2014-04-10 14:02:08,408::task::811::TaskManager.Task::(resourceAcquired) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54644::DEBUG::2014-04-10 14:02:08,408::task::974::TaskManager.Task::(_decref) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::ref 1 aborting False
>Thread-54644::INFO::2014-04-10 14:02:08,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54644::DEBUG::2014-04-10 14:02:08,410::task::1168::TaskManager.Task::(prepare) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54644::DEBUG::2014-04-10 14:02:08,410::task::579::TaskManager.Task::(_updateState) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::moving from state preparing -> state finished
>Thread-54644::DEBUG::2014-04-10 14:02:08,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54644::DEBUG::2014-04-10 14:02:08,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54644::DEBUG::2014-04-10 14:02:08,411::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54644::DEBUG::2014-04-10 14:02:08,411::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54644::DEBUG::2014-04-10 14:02:08,411::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54644::DEBUG::2014-04-10 14:02:08,411::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54644::DEBUG::2014-04-10 14:02:08,411::task::974::TaskManager.Task::(_decref) Task=`19c193ea-374f-48c9-967d-e7cdb08cdfd8`::ref 0 aborting False
>Thread-54646::DEBUG::2014-04-10 14:02:11,516::task::579::TaskManager.Task::(_updateState) Task=`2cb10636-b1ab-4e3e-a881-e1d95e638fa7`::moving from state init -> state preparing
>Thread-54646::INFO::2014-04-10 14:02:11,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54646::INFO::2014-04-10 14:02:11,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358284', 'lastCheck': '6.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481533', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380602', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310849', 'lastCheck': '3.4', 'valid': True}}
>Thread-54646::DEBUG::2014-04-10 14:02:11,517::task::1168::TaskManager.Task::(prepare) Task=`2cb10636-b1ab-4e3e-a881-e1d95e638fa7`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358284', 'lastCheck': '6.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481533', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380602', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310849', 'lastCheck': '3.4', 'valid': True}}
>Thread-54646::DEBUG::2014-04-10 14:02:11,517::task::579::TaskManager.Task::(_updateState) Task=`2cb10636-b1ab-4e3e-a881-e1d95e638fa7`::moving from state preparing -> state finished
>Thread-54646::DEBUG::2014-04-10 14:02:11,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54646::DEBUG::2014-04-10 14:02:11,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54646::DEBUG::2014-04-10 14:02:11,517::task::974::TaskManager.Task::(_decref) Task=`2cb10636-b1ab-4e3e-a881-e1d95e638fa7`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:14,661::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-28::DEBUG::2014-04-10 14:02:14,666::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-28::DEBUG::2014-04-10 14:02:14,668::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-28::DEBUG::2014-04-10 14:02:14,672::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-28::DEBUG::2014-04-10 14:02:14,674::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-28::INFO::2014-04-10 14:02:14,674::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-28::INFO::2014-04-10 14:02:14,674::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-28::DEBUG::2014-04-10 14:02:14,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:14,686::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00023195 s, 1.6 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:15,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:15,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286057 s, 2.3 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:15,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:15,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484173 s, 760 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:02:17,393::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:02:18,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:18,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462529 s, 796 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:02:18,395::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54654::DEBUG::2014-04-10 14:02:18,513::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2f699e05]
>Thread-54654::DEBUG::2014-04-10 14:02:18,514::task::579::TaskManager.Task::(_updateState) Task=`6357d495-d078-4fb0-89a3-36b4e3682153`::moving from state init -> state preparing
>Thread-54654::INFO::2014-04-10 14:02:18,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54654::INFO::2014-04-10 14:02:18,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54654::DEBUG::2014-04-10 14:02:18,515::task::1168::TaskManager.Task::(prepare) Task=`6357d495-d078-4fb0-89a3-36b4e3682153`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54654::DEBUG::2014-04-10 14:02:18,515::task::579::TaskManager.Task::(_updateState) Task=`6357d495-d078-4fb0-89a3-36b4e3682153`::moving from state preparing -> state finished
>Thread-54654::DEBUG::2014-04-10 14:02:18,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54654::DEBUG::2014-04-10 14:02:18,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54654::DEBUG::2014-04-10 14:02:18,516::task::974::TaskManager.Task::(_decref) Task=`6357d495-d078-4fb0-89a3-36b4e3682153`::ref 0 aborting False
>Thread-54655::DEBUG::2014-04-10 14:02:18,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2f699e05]
>Thread-54655::DEBUG::2014-04-10 14:02:18,523::task::579::TaskManager.Task::(_updateState) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::moving from state init -> state preparing
>Thread-54655::INFO::2014-04-10 14:02:18,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54655::DEBUG::2014-04-10 14:02:18,524::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b04f28ed-3819-447b-aaed-c4b8f3e3706d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54655::DEBUG::2014-04-10 14:02:18,524::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54655::DEBUG::2014-04-10 14:02:18,524::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54655::DEBUG::2014-04-10 14:02:18,524::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b04f28ed-3819-447b-aaed-c4b8f3e3706d`::Granted request
>Thread-54655::DEBUG::2014-04-10 14:02:18,525::task::811::TaskManager.Task::(resourceAcquired) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54655::DEBUG::2014-04-10 14:02:18,525::task::974::TaskManager.Task::(_decref) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::ref 1 aborting False
>Thread-54655::INFO::2014-04-10 14:02:18,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54655::DEBUG::2014-04-10 14:02:18,527::task::1168::TaskManager.Task::(prepare) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54655::DEBUG::2014-04-10 14:02:18,527::task::579::TaskManager.Task::(_updateState) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::moving from state preparing -> state finished
>Thread-54655::DEBUG::2014-04-10 14:02:18,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54655::DEBUG::2014-04-10 14:02:18,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54655::DEBUG::2014-04-10 14:02:18,528::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54655::DEBUG::2014-04-10 14:02:18,528::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54655::DEBUG::2014-04-10 14:02:18,528::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54655::DEBUG::2014-04-10 14:02:18,529::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54655::DEBUG::2014-04-10 14:02:18,529::task::974::TaskManager.Task::(_decref) Task=`5985f516-ceb5-4b6c-a26f-04029b9b0773`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:24,693::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:24,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00029667 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:25,141::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 14:02:25,156::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 14:02:25,157::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-33::DEBUG::2014-04-10 14:02:25,162::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=dedd19c984e373f2ca074aac9b33a05f62980d06']
>Thread-33::DEBUG::2014-04-10 14:02:25,164::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-33::INFO::2014-04-10 14:02:25,164::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-33::INFO::2014-04-10 14:02:25,164::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-33::DEBUG::2014-04-10 14:02:25,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:25,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284089 s, 2.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:25,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:25,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000350764 s, 1.0 MB/s\n'; <rc> = 0
>Thread-54662::DEBUG::2014-04-10 14:02:26,800::task::579::TaskManager.Task::(_updateState) Task=`7cd7a90d-0575-4c65-b93e-bfa0fe5587da`::moving from state init -> state preparing
>Thread-54662::INFO::2014-04-10 14:02:26,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54662::INFO::2014-04-10 14:02:26,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029667', 'lastCheck': '2.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350764', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284089', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462529', 'lastCheck': '8.7', 'valid': True}}
>Thread-54662::DEBUG::2014-04-10 14:02:26,800::task::1168::TaskManager.Task::(prepare) Task=`7cd7a90d-0575-4c65-b93e-bfa0fe5587da`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029667', 'lastCheck': '2.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350764', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284089', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462529', 'lastCheck': '8.7', 'valid': True}}
>Thread-54662::DEBUG::2014-04-10 14:02:26,801::task::579::TaskManager.Task::(_updateState) Task=`7cd7a90d-0575-4c65-b93e-bfa0fe5587da`::moving from state preparing -> state finished
>Thread-54662::DEBUG::2014-04-10 14:02:26,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54662::DEBUG::2014-04-10 14:02:26,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54662::DEBUG::2014-04-10 14:02:26,801::task::974::TaskManager.Task::(_decref) Task=`7cd7a90d-0575-4c65-b93e-bfa0fe5587da`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:02:28,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:28,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000380772 s, 966 kB/s\n'; <rc> = 0
>Thread-54664::DEBUG::2014-04-10 14:02:28,619::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-54664::DEBUG::2014-04-10 14:02:28,619::task::579::TaskManager.Task::(_updateState) Task=`dba1efd5-7207-4687-9187-a84859b99c04`::moving from state init -> state preparing
>Thread-54664::INFO::2014-04-10 14:02:28,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54664::INFO::2014-04-10 14:02:28,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54664::DEBUG::2014-04-10 14:02:28,620::task::1168::TaskManager.Task::(prepare) Task=`dba1efd5-7207-4687-9187-a84859b99c04`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54664::DEBUG::2014-04-10 14:02:28,620::task::579::TaskManager.Task::(_updateState) Task=`dba1efd5-7207-4687-9187-a84859b99c04`::moving from state preparing -> state finished
>Thread-54664::DEBUG::2014-04-10 14:02:28,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54664::DEBUG::2014-04-10 14:02:28,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54664::DEBUG::2014-04-10 14:02:28,621::task::974::TaskManager.Task::(_decref) Task=`dba1efd5-7207-4687-9187-a84859b99c04`::ref 0 aborting False
>Thread-54665::DEBUG::2014-04-10 14:02:28,631::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-54665::DEBUG::2014-04-10 14:02:28,631::task::579::TaskManager.Task::(_updateState) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::moving from state init -> state preparing
>Thread-54665::INFO::2014-04-10 14:02:28,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54665::DEBUG::2014-04-10 14:02:28,632::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59565371-bb93-46ee-a44f-c72d31c82146`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54665::DEBUG::2014-04-10 14:02:28,632::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54665::DEBUG::2014-04-10 14:02:28,632::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54665::DEBUG::2014-04-10 14:02:28,633::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59565371-bb93-46ee-a44f-c72d31c82146`::Granted request
>Thread-54665::DEBUG::2014-04-10 14:02:28,633::task::811::TaskManager.Task::(resourceAcquired) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54665::DEBUG::2014-04-10 14:02:28,633::task::974::TaskManager.Task::(_decref) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::ref 1 aborting False
>Thread-54665::INFO::2014-04-10 14:02:28,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54665::DEBUG::2014-04-10 14:02:28,636::task::1168::TaskManager.Task::(prepare) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54665::DEBUG::2014-04-10 14:02:28,636::task::579::TaskManager.Task::(_updateState) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::moving from state preparing -> state finished
>Thread-54665::DEBUG::2014-04-10 14:02:28,636::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54665::DEBUG::2014-04-10 14:02:28,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54665::DEBUG::2014-04-10 14:02:28,636::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54665::DEBUG::2014-04-10 14:02:28,637::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54665::DEBUG::2014-04-10 14:02:28,637::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54665::DEBUG::2014-04-10 14:02:28,637::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54665::DEBUG::2014-04-10 14:02:28,637::task::974::TaskManager.Task::(_decref) Task=`6ff4a168-90f5-46ca-bb11-a34624740b33`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:34,709::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:34,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000356459 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:35,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:35,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347693 s, 1.9 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:35,584::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:35,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043826 s, 840 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:02:38,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:38,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477271 s, 771 kB/s\n'; <rc> = 0
>Thread-54669::DEBUG::2014-04-10 14:02:38,793::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54669::DEBUG::2014-04-10 14:02:38,794::task::579::TaskManager.Task::(_updateState) Task=`db6962eb-fea1-4e2d-b709-d31c6297b631`::moving from state init -> state preparing
>Thread-54669::INFO::2014-04-10 14:02:38,794::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54669::INFO::2014-04-10 14:02:38,795::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54669::DEBUG::2014-04-10 14:02:38,795::task::1168::TaskManager.Task::(prepare) Task=`db6962eb-fea1-4e2d-b709-d31c6297b631`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54669::DEBUG::2014-04-10 14:02:38,795::task::579::TaskManager.Task::(_updateState) Task=`db6962eb-fea1-4e2d-b709-d31c6297b631`::moving from state preparing -> state finished
>Thread-54669::DEBUG::2014-04-10 14:02:38,795::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54669::DEBUG::2014-04-10 14:02:38,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54669::DEBUG::2014-04-10 14:02:38,795::task::974::TaskManager.Task::(_decref) Task=`db6962eb-fea1-4e2d-b709-d31c6297b631`::ref 0 aborting False
>Thread-54670::DEBUG::2014-04-10 14:02:38,802::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54670::DEBUG::2014-04-10 14:02:38,803::task::579::TaskManager.Task::(_updateState) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::moving from state init -> state preparing
>Thread-54670::INFO::2014-04-10 14:02:38,803::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54670::DEBUG::2014-04-10 14:02:38,803::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`94860293-4d86-4e85-8dd6-e4629b9573ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54670::DEBUG::2014-04-10 14:02:38,803::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54670::DEBUG::2014-04-10 14:02:38,804::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54670::DEBUG::2014-04-10 14:02:38,804::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`94860293-4d86-4e85-8dd6-e4629b9573ca`::Granted request
>Thread-54670::DEBUG::2014-04-10 14:02:38,804::task::811::TaskManager.Task::(resourceAcquired) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54670::DEBUG::2014-04-10 14:02:38,804::task::974::TaskManager.Task::(_decref) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::ref 1 aborting False
>Thread-54670::INFO::2014-04-10 14:02:38,806::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54670::DEBUG::2014-04-10 14:02:38,806::task::1168::TaskManager.Task::(prepare) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::task::579::TaskManager.Task::(_updateState) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::moving from state preparing -> state finished
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54670::DEBUG::2014-04-10 14:02:38,807::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54670::DEBUG::2014-04-10 14:02:38,808::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54670::DEBUG::2014-04-10 14:02:38,808::task::974::TaskManager.Task::(_decref) Task=`5d24ce77-4f84-4f99-8e5b-91bb07cc7236`::ref 0 aborting False
>Thread-54672::DEBUG::2014-04-10 14:02:42,042::task::579::TaskManager.Task::(_updateState) Task=`7e53d842-ea05-4d36-9d33-93622d8c97aa`::moving from state init -> state preparing
>Thread-54672::INFO::2014-04-10 14:02:42,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54672::INFO::2014-04-10 14:02:42,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356459', 'lastCheck': '7.3', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043826', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347693', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477271', 'lastCheck': '3.9', 'valid': True}}
>Thread-54672::DEBUG::2014-04-10 14:02:42,042::task::1168::TaskManager.Task::(prepare) Task=`7e53d842-ea05-4d36-9d33-93622d8c97aa`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356459', 'lastCheck': '7.3', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043826', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347693', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477271', 'lastCheck': '3.9', 'valid': True}}
>Thread-54672::DEBUG::2014-04-10 14:02:42,043::task::579::TaskManager.Task::(_updateState) Task=`7e53d842-ea05-4d36-9d33-93622d8c97aa`::moving from state preparing -> state finished
>Thread-54672::DEBUG::2014-04-10 14:02:42,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54672::DEBUG::2014-04-10 14:02:42,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54672::DEBUG::2014-04-10 14:02:42,043::task::974::TaskManager.Task::(_decref) Task=`7e53d842-ea05-4d36-9d33-93622d8c97aa`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:44,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:44,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000396323 s, 961 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:45,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:45,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397008 s, 1.7 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:45,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:45,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000401288 s, 917 kB/s\n'; <rc> = 0
>Thread-859::DEBUG::2014-04-10 14:02:46,549::task::579::TaskManager.Task::(_updateState) Task=`cdbd169a-5f12-4385-abe7-a48685b1a1e0`::moving from state init -> state preparing
>Thread-859::INFO::2014-04-10 14:02:46,563::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', volUUID='70bf7589-51a3-471d-bb14-93ecaaff1e0f', options=None)
>Thread-859::INFO::2014-04-10 14:02:46,570::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:02:46,570::task::1168::TaskManager.Task::(prepare) Task=`cdbd169a-5f12-4385-abe7-a48685b1a1e0`::finished: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:02:46,570::task::579::TaskManager.Task::(_updateState) Task=`cdbd169a-5f12-4385-abe7-a48685b1a1e0`::moving from state preparing -> state finished
>Thread-859::DEBUG::2014-04-10 14:02:46,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-859::DEBUG::2014-04-10 14:02:46,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-859::DEBUG::2014-04-10 14:02:46,571::task::974::TaskManager.Task::(_decref) Task=`cdbd169a-5f12-4385-abe7-a48685b1a1e0`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 14:02:47,428::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:02:48,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:48,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449144 s, 819 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:02:48,429::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54676::DEBUG::2014-04-10 14:02:48,960::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54676::DEBUG::2014-04-10 14:02:48,961::task::579::TaskManager.Task::(_updateState) Task=`73e4387e-c617-4afd-9660-14b3b09fe975`::moving from state init -> state preparing
>Thread-54676::INFO::2014-04-10 14:02:48,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54676::INFO::2014-04-10 14:02:48,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54676::DEBUG::2014-04-10 14:02:48,962::task::1168::TaskManager.Task::(prepare) Task=`73e4387e-c617-4afd-9660-14b3b09fe975`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54676::DEBUG::2014-04-10 14:02:48,962::task::579::TaskManager.Task::(_updateState) Task=`73e4387e-c617-4afd-9660-14b3b09fe975`::moving from state preparing -> state finished
>Thread-54676::DEBUG::2014-04-10 14:02:48,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54676::DEBUG::2014-04-10 14:02:48,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54676::DEBUG::2014-04-10 14:02:48,962::task::974::TaskManager.Task::(_decref) Task=`73e4387e-c617-4afd-9660-14b3b09fe975`::ref 0 aborting False
>Thread-54677::DEBUG::2014-04-10 14:02:48,969::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54677::DEBUG::2014-04-10 14:02:48,969::task::579::TaskManager.Task::(_updateState) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::moving from state init -> state preparing
>Thread-54677::INFO::2014-04-10 14:02:48,969::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54677::DEBUG::2014-04-10 14:02:48,970::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4b1baa94-0bd5-4278-83b4-94146459c1fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54677::DEBUG::2014-04-10 14:02:48,970::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54677::DEBUG::2014-04-10 14:02:48,970::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54677::DEBUG::2014-04-10 14:02:48,971::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4b1baa94-0bd5-4278-83b4-94146459c1fa`::Granted request
>Thread-54677::DEBUG::2014-04-10 14:02:48,972::task::811::TaskManager.Task::(resourceAcquired) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54677::DEBUG::2014-04-10 14:02:48,972::task::974::TaskManager.Task::(_decref) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::ref 1 aborting False
>Thread-54677::INFO::2014-04-10 14:02:48,974::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54677::DEBUG::2014-04-10 14:02:48,974::task::1168::TaskManager.Task::(prepare) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::task::579::TaskManager.Task::(_updateState) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::moving from state preparing -> state finished
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54677::DEBUG::2014-04-10 14:02:48,975::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54677::DEBUG::2014-04-10 14:02:48,976::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54677::DEBUG::2014-04-10 14:02:48,976::task::974::TaskManager.Task::(_decref) Task=`3485a176-f771-42d7-92b0-596c015b09bc`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:02:54,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:02:54,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000334453 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:02:55,218::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:02:55,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386989 s, 1.7 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:02:55,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:02:55,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000429731 s, 856 kB/s\n'; <rc> = 0
>Thread-54680::DEBUG::2014-04-10 14:02:57,277::task::579::TaskManager.Task::(_updateState) Task=`a4a33738-aa4c-489a-90f3-afd847d4f212`::moving from state init -> state preparing
>Thread-54680::INFO::2014-04-10 14:02:57,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54680::INFO::2014-04-10 14:02:57,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334453', 'lastCheck': '2.5', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429731', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386989', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449144', 'lastCheck': '9.1', 'valid': True}}
>Thread-54680::DEBUG::2014-04-10 14:02:57,278::task::1168::TaskManager.Task::(prepare) Task=`a4a33738-aa4c-489a-90f3-afd847d4f212`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334453', 'lastCheck': '2.5', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429731', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386989', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449144', 'lastCheck': '9.1', 'valid': True}}
>Thread-54680::DEBUG::2014-04-10 14:02:57,278::task::579::TaskManager.Task::(_updateState) Task=`a4a33738-aa4c-489a-90f3-afd847d4f212`::moving from state preparing -> state finished
>Thread-54680::DEBUG::2014-04-10 14:02:57,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54680::DEBUG::2014-04-10 14:02:57,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54680::DEBUG::2014-04-10 14:02:57,279::task::974::TaskManager.Task::(_decref) Task=`a4a33738-aa4c-489a-90f3-afd847d4f212`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:02:58,138::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:02:58,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000345797 s, 1.1 MB/s\n'; <rc> = 0
>Thread-54682::DEBUG::2014-04-10 14:02:59,117::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-54682::DEBUG::2014-04-10 14:02:59,118::task::579::TaskManager.Task::(_updateState) Task=`8838590b-8dd8-4cee-9b4d-53e475e855e9`::moving from state init -> state preparing
>Thread-54682::INFO::2014-04-10 14:02:59,118::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54682::INFO::2014-04-10 14:02:59,118::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54682::DEBUG::2014-04-10 14:02:59,119::task::1168::TaskManager.Task::(prepare) Task=`8838590b-8dd8-4cee-9b4d-53e475e855e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54682::DEBUG::2014-04-10 14:02:59,119::task::579::TaskManager.Task::(_updateState) Task=`8838590b-8dd8-4cee-9b4d-53e475e855e9`::moving from state preparing -> state finished
>Thread-54682::DEBUG::2014-04-10 14:02:59,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54682::DEBUG::2014-04-10 14:02:59,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54682::DEBUG::2014-04-10 14:02:59,119::task::974::TaskManager.Task::(_decref) Task=`8838590b-8dd8-4cee-9b4d-53e475e855e9`::ref 0 aborting False
>Thread-54683::DEBUG::2014-04-10 14:02:59,127::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-54683::DEBUG::2014-04-10 14:02:59,127::task::579::TaskManager.Task::(_updateState) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::moving from state init -> state preparing
>Thread-54683::INFO::2014-04-10 14:02:59,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54683::DEBUG::2014-04-10 14:02:59,128::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9ebce5d9-e866-4d79-b283-1a9010e2460d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54683::DEBUG::2014-04-10 14:02:59,128::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54683::DEBUG::2014-04-10 14:02:59,128::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54683::DEBUG::2014-04-10 14:02:59,128::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9ebce5d9-e866-4d79-b283-1a9010e2460d`::Granted request
>Thread-54683::DEBUG::2014-04-10 14:02:59,129::task::811::TaskManager.Task::(resourceAcquired) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54683::DEBUG::2014-04-10 14:02:59,129::task::974::TaskManager.Task::(_decref) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::ref 1 aborting False
>Thread-54683::INFO::2014-04-10 14:02:59,131::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54683::DEBUG::2014-04-10 14:02:59,132::task::1168::TaskManager.Task::(prepare) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54683::DEBUG::2014-04-10 14:02:59,132::task::579::TaskManager.Task::(_updateState) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::moving from state preparing -> state finished
>Thread-54683::DEBUG::2014-04-10 14:02:59,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54683::DEBUG::2014-04-10 14:02:59,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54683::DEBUG::2014-04-10 14:02:59,133::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54683::DEBUG::2014-04-10 14:02:59,133::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54683::DEBUG::2014-04-10 14:02:59,133::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54683::DEBUG::2014-04-10 14:02:59,133::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54683::DEBUG::2014-04-10 14:02:59,133::task::974::TaskManager.Task::(_decref) Task=`ea7420ea-8260-4212-9c5d-84110f8996be`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:04,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:04,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00038372 s, 993 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:05,234::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:05,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306609 s, 2.2 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:05,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:05,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466777 s, 788 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:03:08,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:08,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493028 s, 746 kB/s\n'; <rc> = 0
>Thread-54687::DEBUG::2014-04-10 14:03:09,206::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54687::DEBUG::2014-04-10 14:03:09,206::task::579::TaskManager.Task::(_updateState) Task=`a20dc6d9-55ea-4f53-be0e-36ccb5cde98c`::moving from state init -> state preparing
>Thread-54687::INFO::2014-04-10 14:03:09,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54687::INFO::2014-04-10 14:03:09,207::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54687::DEBUG::2014-04-10 14:03:09,207::task::1168::TaskManager.Task::(prepare) Task=`a20dc6d9-55ea-4f53-be0e-36ccb5cde98c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54687::DEBUG::2014-04-10 14:03:09,207::task::579::TaskManager.Task::(_updateState) Task=`a20dc6d9-55ea-4f53-be0e-36ccb5cde98c`::moving from state preparing -> state finished
>Thread-54687::DEBUG::2014-04-10 14:03:09,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54687::DEBUG::2014-04-10 14:03:09,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54687::DEBUG::2014-04-10 14:03:09,208::task::974::TaskManager.Task::(_decref) Task=`a20dc6d9-55ea-4f53-be0e-36ccb5cde98c`::ref 0 aborting False
>Thread-54688::DEBUG::2014-04-10 14:03:09,214::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54688::DEBUG::2014-04-10 14:03:09,215::task::579::TaskManager.Task::(_updateState) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::moving from state init -> state preparing
>Thread-54688::INFO::2014-04-10 14:03:09,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54688::DEBUG::2014-04-10 14:03:09,215::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13ee0f1d-f9ed-434f-95e4-156779095bce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54688::DEBUG::2014-04-10 14:03:09,216::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54688::DEBUG::2014-04-10 14:03:09,216::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54688::DEBUG::2014-04-10 14:03:09,216::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13ee0f1d-f9ed-434f-95e4-156779095bce`::Granted request
>Thread-54688::DEBUG::2014-04-10 14:03:09,216::task::811::TaskManager.Task::(resourceAcquired) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54688::DEBUG::2014-04-10 14:03:09,216::task::974::TaskManager.Task::(_decref) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::ref 1 aborting False
>Thread-54688::INFO::2014-04-10 14:03:09,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652559360', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652559360', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54688::DEBUG::2014-04-10 14:03:09,218::task::1168::TaskManager.Task::(prepare) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652559360', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652559360', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54688::DEBUG::2014-04-10 14:03:09,219::task::579::TaskManager.Task::(_updateState) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::moving from state preparing -> state finished
>Thread-54688::DEBUG::2014-04-10 14:03:09,219::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54688::DEBUG::2014-04-10 14:03:09,219::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54688::DEBUG::2014-04-10 14:03:09,219::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54688::DEBUG::2014-04-10 14:03:09,219::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54688::DEBUG::2014-04-10 14:03:09,220::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54688::DEBUG::2014-04-10 14:03:09,220::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54688::DEBUG::2014-04-10 14:03:09,220::task::974::TaskManager.Task::(_decref) Task=`5aa2000f-ef1f-4b33-9c61-140de9237022`::ref 0 aborting False
>Thread-54690::DEBUG::2014-04-10 14:03:12,497::task::579::TaskManager.Task::(_updateState) Task=`f8deb1ce-74af-4ea0-b374-ea5538507cbc`::moving from state init -> state preparing
>Thread-54690::INFO::2014-04-10 14:03:12,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54690::INFO::2014-04-10 14:03:12,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038372', 'lastCheck': '7.7', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466777', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306609', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493028', 'lastCheck': '4.3', 'valid': True}}
>Thread-54690::DEBUG::2014-04-10 14:03:12,498::task::1168::TaskManager.Task::(prepare) Task=`f8deb1ce-74af-4ea0-b374-ea5538507cbc`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038372', 'lastCheck': '7.7', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466777', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306609', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493028', 'lastCheck': '4.3', 'valid': True}}
>Thread-54690::DEBUG::2014-04-10 14:03:12,498::task::579::TaskManager.Task::(_updateState) Task=`f8deb1ce-74af-4ea0-b374-ea5538507cbc`::moving from state preparing -> state finished
>Thread-54690::DEBUG::2014-04-10 14:03:12,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54690::DEBUG::2014-04-10 14:03:12,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54690::DEBUG::2014-04-10 14:03:12,498::task::974::TaskManager.Task::(_decref) Task=`f8deb1ce-74af-4ea0-b374-ea5538507cbc`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:14,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:14,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000406285 s, 938 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:15,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:15,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328634 s, 2.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:15,651::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:15,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000519056 s, 709 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:03:17,463::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:03:18,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:18,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000450317 s, 817 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:03:18,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54694::DEBUG::2014-04-10 14:03:19,315::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54694::DEBUG::2014-04-10 14:03:19,315::task::579::TaskManager.Task::(_updateState) Task=`a6065f8b-2dbc-4cb9-97b7-bf5835f14536`::moving from state init -> state preparing
>Thread-54694::INFO::2014-04-10 14:03:19,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54694::INFO::2014-04-10 14:03:19,316::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54694::DEBUG::2014-04-10 14:03:19,316::task::1168::TaskManager.Task::(prepare) Task=`a6065f8b-2dbc-4cb9-97b7-bf5835f14536`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54694::DEBUG::2014-04-10 14:03:19,316::task::579::TaskManager.Task::(_updateState) Task=`a6065f8b-2dbc-4cb9-97b7-bf5835f14536`::moving from state preparing -> state finished
>Thread-54694::DEBUG::2014-04-10 14:03:19,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54694::DEBUG::2014-04-10 14:03:19,317::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54694::DEBUG::2014-04-10 14:03:19,317::task::974::TaskManager.Task::(_decref) Task=`a6065f8b-2dbc-4cb9-97b7-bf5835f14536`::ref 0 aborting False
>Thread-54695::DEBUG::2014-04-10 14:03:19,324::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54695::DEBUG::2014-04-10 14:03:19,324::task::579::TaskManager.Task::(_updateState) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::moving from state init -> state preparing
>Thread-54695::INFO::2014-04-10 14:03:19,325::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54695::DEBUG::2014-04-10 14:03:19,325::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`21186562-56e8-4221-83f6-1c97f39c01e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54695::DEBUG::2014-04-10 14:03:19,325::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54695::DEBUG::2014-04-10 14:03:19,325::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54695::DEBUG::2014-04-10 14:03:19,326::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`21186562-56e8-4221-83f6-1c97f39c01e6`::Granted request
>Thread-54695::DEBUG::2014-04-10 14:03:19,326::task::811::TaskManager.Task::(resourceAcquired) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54695::DEBUG::2014-04-10 14:03:19,326::task::974::TaskManager.Task::(_decref) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::ref 1 aborting False
>Thread-54695::INFO::2014-04-10 14:03:19,328::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54695::DEBUG::2014-04-10 14:03:19,328::task::1168::TaskManager.Task::(prepare) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54695::DEBUG::2014-04-10 14:03:19,329::task::579::TaskManager.Task::(_updateState) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::moving from state preparing -> state finished
>Thread-54695::DEBUG::2014-04-10 14:03:19,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54695::DEBUG::2014-04-10 14:03:19,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54695::DEBUG::2014-04-10 14:03:19,329::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54695::DEBUG::2014-04-10 14:03:19,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54695::DEBUG::2014-04-10 14:03:19,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54695::DEBUG::2014-04-10 14:03:19,330::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54695::DEBUG::2014-04-10 14:03:19,330::task::974::TaskManager.Task::(_decref) Task=`3f2b8392-03d0-4a50-84a3-dfd1037bfaa4`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:24,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:24,790::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000303716 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:25,265::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:25,271::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297512 s, 2.3 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:25,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:25,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000576247 s, 639 kB/s\n'; <rc> = 0
>Thread-54698::DEBUG::2014-04-10 14:03:27,732::task::579::TaskManager.Task::(_updateState) Task=`6bb92ae3-57f7-4d4a-a4a8-631d719783c5`::moving from state init -> state preparing
>Thread-54698::INFO::2014-04-10 14:03:27,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54698::INFO::2014-04-10 14:03:27,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303716', 'lastCheck': '2.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576247', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297512', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450317', 'lastCheck': '9.6', 'valid': True}}
>Thread-54698::DEBUG::2014-04-10 14:03:27,732::task::1168::TaskManager.Task::(prepare) Task=`6bb92ae3-57f7-4d4a-a4a8-631d719783c5`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303716', 'lastCheck': '2.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576247', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297512', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450317', 'lastCheck': '9.6', 'valid': True}}
>Thread-54698::DEBUG::2014-04-10 14:03:27,733::task::579::TaskManager.Task::(_updateState) Task=`6bb92ae3-57f7-4d4a-a4a8-631d719783c5`::moving from state preparing -> state finished
>Thread-54698::DEBUG::2014-04-10 14:03:27,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54698::DEBUG::2014-04-10 14:03:27,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54698::DEBUG::2014-04-10 14:03:27,733::task::974::TaskManager.Task::(_decref) Task=`6bb92ae3-57f7-4d4a-a4a8-631d719783c5`::ref 0 aborting False
>Thread-38::DEBUG::2014-04-10 14:03:28,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:28,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000436711 s, 843 kB/s\n'; <rc> = 0
>Thread-54700::DEBUG::2014-04-10 14:03:29,421::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54700::DEBUG::2014-04-10 14:03:29,422::task::579::TaskManager.Task::(_updateState) Task=`fde16eb8-7f8f-4d52-9285-c237c9d32256`::moving from state init -> state preparing
>Thread-54700::INFO::2014-04-10 14:03:29,422::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54700::INFO::2014-04-10 14:03:29,422::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54700::DEBUG::2014-04-10 14:03:29,423::task::1168::TaskManager.Task::(prepare) Task=`fde16eb8-7f8f-4d52-9285-c237c9d32256`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54700::DEBUG::2014-04-10 14:03:29,423::task::579::TaskManager.Task::(_updateState) Task=`fde16eb8-7f8f-4d52-9285-c237c9d32256`::moving from state preparing -> state finished
>Thread-54700::DEBUG::2014-04-10 14:03:29,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54700::DEBUG::2014-04-10 14:03:29,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54700::DEBUG::2014-04-10 14:03:29,423::task::974::TaskManager.Task::(_decref) Task=`fde16eb8-7f8f-4d52-9285-c237c9d32256`::ref 0 aborting False
>Thread-54701::DEBUG::2014-04-10 14:03:29,430::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54701::DEBUG::2014-04-10 14:03:29,431::task::579::TaskManager.Task::(_updateState) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::moving from state init -> state preparing
>Thread-54701::INFO::2014-04-10 14:03:29,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54701::DEBUG::2014-04-10 14:03:29,431::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`adc1d87f-2dba-497c-805e-89bf644898e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54701::DEBUG::2014-04-10 14:03:29,431::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54701::DEBUG::2014-04-10 14:03:29,432::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54701::DEBUG::2014-04-10 14:03:29,432::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`adc1d87f-2dba-497c-805e-89bf644898e3`::Granted request
>Thread-54701::DEBUG::2014-04-10 14:03:29,433::task::811::TaskManager.Task::(resourceAcquired) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54701::DEBUG::2014-04-10 14:03:29,433::task::974::TaskManager.Task::(_decref) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::ref 1 aborting False
>Thread-54701::INFO::2014-04-10 14:03:29,435::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54701::DEBUG::2014-04-10 14:03:29,435::task::1168::TaskManager.Task::(prepare) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::task::579::TaskManager.Task::(_updateState) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::moving from state preparing -> state finished
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54701::DEBUG::2014-04-10 14:03:29,436::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54701::DEBUG::2014-04-10 14:03:29,437::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54701::DEBUG::2014-04-10 14:03:29,437::task::974::TaskManager.Task::(_decref) Task=`925f5b08-23a5-4896-8e1b-5cdf911c1b07`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:34,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:34,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000474039 s, 804 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:35,280::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:35,287::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349321 s, 1.9 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:35,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:35,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048176 s, 764 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:03:38,198::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:38,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000353198 s, 1.0 MB/s\n'; <rc> = 0
>Thread-54705::DEBUG::2014-04-10 14:03:39,535::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54705::DEBUG::2014-04-10 14:03:39,536::task::579::TaskManager.Task::(_updateState) Task=`bb1c5c16-063c-4cc8-9ba4-e1e8a0b24252`::moving from state init -> state preparing
>Thread-54705::INFO::2014-04-10 14:03:39,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54705::INFO::2014-04-10 14:03:39,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54705::DEBUG::2014-04-10 14:03:39,536::task::1168::TaskManager.Task::(prepare) Task=`bb1c5c16-063c-4cc8-9ba4-e1e8a0b24252`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54705::DEBUG::2014-04-10 14:03:39,537::task::579::TaskManager.Task::(_updateState) Task=`bb1c5c16-063c-4cc8-9ba4-e1e8a0b24252`::moving from state preparing -> state finished
>Thread-54705::DEBUG::2014-04-10 14:03:39,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54705::DEBUG::2014-04-10 14:03:39,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54705::DEBUG::2014-04-10 14:03:39,537::task::974::TaskManager.Task::(_decref) Task=`bb1c5c16-063c-4cc8-9ba4-e1e8a0b24252`::ref 0 aborting False
>Thread-54706::DEBUG::2014-04-10 14:03:39,544::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54706::DEBUG::2014-04-10 14:03:39,544::task::579::TaskManager.Task::(_updateState) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::moving from state init -> state preparing
>Thread-54706::INFO::2014-04-10 14:03:39,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54706::DEBUG::2014-04-10 14:03:39,544::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`765fd688-f38f-46a7-a983-a51321059c37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54706::DEBUG::2014-04-10 14:03:39,545::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54706::DEBUG::2014-04-10 14:03:39,545::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54706::DEBUG::2014-04-10 14:03:39,545::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`765fd688-f38f-46a7-a983-a51321059c37`::Granted request
>Thread-54706::DEBUG::2014-04-10 14:03:39,545::task::811::TaskManager.Task::(resourceAcquired) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54706::DEBUG::2014-04-10 14:03:39,546::task::974::TaskManager.Task::(_decref) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::ref 1 aborting False
>Thread-54706::INFO::2014-04-10 14:03:39,547::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54706::DEBUG::2014-04-10 14:03:39,547::task::1168::TaskManager.Task::(prepare) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::task::579::TaskManager.Task::(_updateState) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::moving from state preparing -> state finished
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54706::DEBUG::2014-04-10 14:03:39,548::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54706::DEBUG::2014-04-10 14:03:39,549::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54706::DEBUG::2014-04-10 14:03:39,549::task::974::TaskManager.Task::(_decref) Task=`75d99c45-272a-49e2-a238-3e6467a92afc`::ref 0 aborting False
>Thread-54708::DEBUG::2014-04-10 14:03:42,961::task::579::TaskManager.Task::(_updateState) Task=`c06069f5-55dd-403f-8ff6-051c054f3aa8`::moving from state init -> state preparing
>Thread-54708::INFO::2014-04-10 14:03:42,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54708::INFO::2014-04-10 14:03:42,962::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474039', 'lastCheck': '8.2', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048176', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349321', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353198', 'lastCheck': '4.8', 'valid': True}}
>Thread-54708::DEBUG::2014-04-10 14:03:42,962::task::1168::TaskManager.Task::(prepare) Task=`c06069f5-55dd-403f-8ff6-051c054f3aa8`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474039', 'lastCheck': '8.2', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048176', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349321', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353198', 'lastCheck': '4.8', 'valid': True}}
>Thread-54708::DEBUG::2014-04-10 14:03:42,962::task::579::TaskManager.Task::(_updateState) Task=`c06069f5-55dd-403f-8ff6-051c054f3aa8`::moving from state preparing -> state finished
>Thread-54708::DEBUG::2014-04-10 14:03:42,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54708::DEBUG::2014-04-10 14:03:42,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54708::DEBUG::2014-04-10 14:03:42,963::task::974::TaskManager.Task::(_decref) Task=`c06069f5-55dd-403f-8ff6-051c054f3aa8`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:44,814::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:44,821::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000330791 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:45,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:45,302::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311516 s, 2.2 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:45,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:45,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474585 s, 775 kB/s\n'; <rc> = 0
>Thread-859::DEBUG::2014-04-10 14:03:46,780::task::579::TaskManager.Task::(_updateState) Task=`e4d1b926-f6ac-490c-9601-f452cccdce7e`::moving from state init -> state preparing
>Thread-859::INFO::2014-04-10 14:03:46,780::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', volUUID='70bf7589-51a3-471d-bb14-93ecaaff1e0f', options=None)
>Thread-859::INFO::2014-04-10 14:03:46,801::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:03:46,802::task::1168::TaskManager.Task::(prepare) Task=`e4d1b926-f6ac-490c-9601-f452cccdce7e`::finished: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:03:46,802::task::579::TaskManager.Task::(_updateState) Task=`e4d1b926-f6ac-490c-9601-f452cccdce7e`::moving from state preparing -> state finished
>Thread-859::DEBUG::2014-04-10 14:03:46,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-859::DEBUG::2014-04-10 14:03:46,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-859::DEBUG::2014-04-10 14:03:46,802::task::974::TaskManager.Task::(_decref) Task=`e4d1b926-f6ac-490c-9601-f452cccdce7e`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 14:03:47,497::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:03:48,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:48,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484998 s, 759 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:03:48,498::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54712::DEBUG::2014-04-10 14:03:49,644::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54712::DEBUG::2014-04-10 14:03:49,644::task::579::TaskManager.Task::(_updateState) Task=`b251bbd7-15a4-4b8f-aad0-5432ab904bd5`::moving from state init -> state preparing
>Thread-54712::INFO::2014-04-10 14:03:49,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54712::INFO::2014-04-10 14:03:49,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54712::DEBUG::2014-04-10 14:03:49,645::task::1168::TaskManager.Task::(prepare) Task=`b251bbd7-15a4-4b8f-aad0-5432ab904bd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54712::DEBUG::2014-04-10 14:03:49,645::task::579::TaskManager.Task::(_updateState) Task=`b251bbd7-15a4-4b8f-aad0-5432ab904bd5`::moving from state preparing -> state finished
>Thread-54712::DEBUG::2014-04-10 14:03:49,645::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54712::DEBUG::2014-04-10 14:03:49,645::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54712::DEBUG::2014-04-10 14:03:49,646::task::974::TaskManager.Task::(_decref) Task=`b251bbd7-15a4-4b8f-aad0-5432ab904bd5`::ref 0 aborting False
>Thread-54713::DEBUG::2014-04-10 14:03:49,652::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54713::DEBUG::2014-04-10 14:03:49,653::task::579::TaskManager.Task::(_updateState) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::moving from state init -> state preparing
>Thread-54713::INFO::2014-04-10 14:03:49,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54713::DEBUG::2014-04-10 14:03:49,654::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed654334-446f-44f6-9d5c-30ade37877bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54713::DEBUG::2014-04-10 14:03:49,654::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54713::DEBUG::2014-04-10 14:03:49,654::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54713::DEBUG::2014-04-10 14:03:49,654::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed654334-446f-44f6-9d5c-30ade37877bb`::Granted request
>Thread-54713::DEBUG::2014-04-10 14:03:49,655::task::811::TaskManager.Task::(resourceAcquired) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54713::DEBUG::2014-04-10 14:03:49,655::task::974::TaskManager.Task::(_decref) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::ref 1 aborting False
>Thread-54713::INFO::2014-04-10 14:03:49,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54713::DEBUG::2014-04-10 14:03:49,657::task::1168::TaskManager.Task::(prepare) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54713::DEBUG::2014-04-10 14:03:49,657::task::579::TaskManager.Task::(_updateState) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::moving from state preparing -> state finished
>Thread-54713::DEBUG::2014-04-10 14:03:49,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54713::DEBUG::2014-04-10 14:03:49,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54713::DEBUG::2014-04-10 14:03:49,658::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54713::DEBUG::2014-04-10 14:03:49,658::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54713::DEBUG::2014-04-10 14:03:49,658::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54713::DEBUG::2014-04-10 14:03:49,659::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54713::DEBUG::2014-04-10 14:03:49,659::task::974::TaskManager.Task::(_decref) Task=`5e41398a-760e-42df-bc90-7dbe352761d0`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:03:54,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:03:54,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000357058 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:03:55,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:03:55,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402665 s, 1.7 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:03:55,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:03:55,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437503 s, 841 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:03:58,229::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:03:58,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000402775 s, 914 kB/s\n'; <rc> = 0
>Thread-54716::DEBUG::2014-04-10 14:03:58,265::task::579::TaskManager.Task::(_updateState) Task=`58a2f5cb-a3ff-4bf2-8ab4-bf98a8e5494e`::moving from state init -> state preparing
>Thread-54716::INFO::2014-04-10 14:03:58,266::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54716::INFO::2014-04-10 14:03:58,266::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357058', 'lastCheck': '3.4', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437503', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402665', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402775', 'lastCheck': '0.0', 'valid': True}}
>Thread-54716::DEBUG::2014-04-10 14:03:58,266::task::1168::TaskManager.Task::(prepare) Task=`58a2f5cb-a3ff-4bf2-8ab4-bf98a8e5494e`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357058', 'lastCheck': '3.4', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437503', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402665', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402775', 'lastCheck': '0.0', 'valid': True}}
>Thread-54716::DEBUG::2014-04-10 14:03:58,266::task::579::TaskManager.Task::(_updateState) Task=`58a2f5cb-a3ff-4bf2-8ab4-bf98a8e5494e`::moving from state preparing -> state finished
>Thread-54716::DEBUG::2014-04-10 14:03:58,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54716::DEBUG::2014-04-10 14:03:58,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54716::DEBUG::2014-04-10 14:03:58,267::task::974::TaskManager.Task::(_decref) Task=`58a2f5cb-a3ff-4bf2-8ab4-bf98a8e5494e`::ref 0 aborting False
>Thread-54718::DEBUG::2014-04-10 14:03:59,748::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54718::DEBUG::2014-04-10 14:03:59,748::task::579::TaskManager.Task::(_updateState) Task=`186b4ef0-6e14-40ea-a863-ba1ccaaf726a`::moving from state init -> state preparing
>Thread-54718::INFO::2014-04-10 14:03:59,748::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54718::INFO::2014-04-10 14:03:59,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54718::DEBUG::2014-04-10 14:03:59,749::task::1168::TaskManager.Task::(prepare) Task=`186b4ef0-6e14-40ea-a863-ba1ccaaf726a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54718::DEBUG::2014-04-10 14:03:59,749::task::579::TaskManager.Task::(_updateState) Task=`186b4ef0-6e14-40ea-a863-ba1ccaaf726a`::moving from state preparing -> state finished
>Thread-54718::DEBUG::2014-04-10 14:03:59,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54718::DEBUG::2014-04-10 14:03:59,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54718::DEBUG::2014-04-10 14:03:59,749::task::974::TaskManager.Task::(_decref) Task=`186b4ef0-6e14-40ea-a863-ba1ccaaf726a`::ref 0 aborting False
>Thread-54719::DEBUG::2014-04-10 14:03:59,756::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54719::DEBUG::2014-04-10 14:03:59,756::task::579::TaskManager.Task::(_updateState) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::moving from state init -> state preparing
>Thread-54719::INFO::2014-04-10 14:03:59,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54719::DEBUG::2014-04-10 14:03:59,757::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`56b1de46-6d63-4a2b-8548-d4a84e8b981d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54719::DEBUG::2014-04-10 14:03:59,757::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54719::DEBUG::2014-04-10 14:03:59,757::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54719::DEBUG::2014-04-10 14:03:59,758::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`56b1de46-6d63-4a2b-8548-d4a84e8b981d`::Granted request
>Thread-54719::DEBUG::2014-04-10 14:03:59,758::task::811::TaskManager.Task::(resourceAcquired) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54719::DEBUG::2014-04-10 14:03:59,758::task::974::TaskManager.Task::(_decref) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::ref 1 aborting False
>Thread-54719::INFO::2014-04-10 14:03:59,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54719::DEBUG::2014-04-10 14:03:59,760::task::1168::TaskManager.Task::(prepare) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652493824', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54719::DEBUG::2014-04-10 14:03:59,760::task::579::TaskManager.Task::(_updateState) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::moving from state preparing -> state finished
>Thread-54719::DEBUG::2014-04-10 14:03:59,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54719::DEBUG::2014-04-10 14:03:59,761::task::974::TaskManager.Task::(_decref) Task=`a409490d-faf5-4af4-9ed3-4bde6138d372`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:04:04,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:04,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00036743 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:04:05,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:05,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000475503 s, 1.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:04:05,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:05,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496114 s, 742 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:04:08,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:08,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502124 s, 733 kB/s\n'; <rc> = 0
>Thread-54723::DEBUG::2014-04-10 14:04:09,845::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54723::DEBUG::2014-04-10 14:04:09,845::task::579::TaskManager.Task::(_updateState) Task=`d14f832f-7882-45c7-ae9e-26396ec2157a`::moving from state init -> state preparing
>Thread-54723::INFO::2014-04-10 14:04:09,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54723::INFO::2014-04-10 14:04:09,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54723::DEBUG::2014-04-10 14:04:09,846::task::1168::TaskManager.Task::(prepare) Task=`d14f832f-7882-45c7-ae9e-26396ec2157a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54723::DEBUG::2014-04-10 14:04:09,846::task::579::TaskManager.Task::(_updateState) Task=`d14f832f-7882-45c7-ae9e-26396ec2157a`::moving from state preparing -> state finished
>Thread-54723::DEBUG::2014-04-10 14:04:09,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54723::DEBUG::2014-04-10 14:04:09,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54723::DEBUG::2014-04-10 14:04:09,847::task::974::TaskManager.Task::(_decref) Task=`d14f832f-7882-45c7-ae9e-26396ec2157a`::ref 0 aborting False
>Thread-54724::DEBUG::2014-04-10 14:04:09,854::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54724::DEBUG::2014-04-10 14:04:09,854::task::579::TaskManager.Task::(_updateState) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::moving from state init -> state preparing
>Thread-54724::INFO::2014-04-10 14:04:09,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54724::DEBUG::2014-04-10 14:04:09,855::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3d2b6089-88a8-43de-90e7-1f68ff793009`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54724::DEBUG::2014-04-10 14:04:09,855::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54724::DEBUG::2014-04-10 14:04:09,855::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54724::DEBUG::2014-04-10 14:04:09,855::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3d2b6089-88a8-43de-90e7-1f68ff793009`::Granted request
>Thread-54724::DEBUG::2014-04-10 14:04:09,856::task::811::TaskManager.Task::(resourceAcquired) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54724::DEBUG::2014-04-10 14:04:09,856::task::974::TaskManager.Task::(_decref) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::ref 1 aborting False
>Thread-54724::INFO::2014-04-10 14:04:09,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652100608', 'isoprefix': '', 'alerts': [], 'disktotal': '910948761600', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54724::DEBUG::2014-04-10 14:04:09,858::task::1168::TaskManager.Task::(prepare) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652100608', 'isoprefix': '', 'alerts': [], 'disktotal': '910948761600', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652428288', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::task::579::TaskManager.Task::(_updateState) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::moving from state preparing -> state finished
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54724::DEBUG::2014-04-10 14:04:09,859::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54724::DEBUG::2014-04-10 14:04:09,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54724::DEBUG::2014-04-10 14:04:09,860::task::974::TaskManager.Task::(_decref) Task=`e4bfe4cf-3edb-4620-b746-114543653743`::ref 0 aborting False
>Thread-54726::DEBUG::2014-04-10 14:04:13,750::task::579::TaskManager.Task::(_updateState) Task=`e23ac322-44ac-4bfd-8017-12f7ae1fa9a8`::moving from state init -> state preparing
>Thread-54726::INFO::2014-04-10 14:04:13,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54726::INFO::2014-04-10 14:04:13,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036743', 'lastCheck': '8.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496114', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475503', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502124', 'lastCheck': '5.5', 'valid': True}}
>Thread-54726::DEBUG::2014-04-10 14:04:13,751::task::1168::TaskManager.Task::(prepare) Task=`e23ac322-44ac-4bfd-8017-12f7ae1fa9a8`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036743', 'lastCheck': '8.9', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496114', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475503', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502124', 'lastCheck': '5.5', 'valid': True}}
>Thread-54726::DEBUG::2014-04-10 14:04:13,751::task::579::TaskManager.Task::(_updateState) Task=`e23ac322-44ac-4bfd-8017-12f7ae1fa9a8`::moving from state preparing -> state finished
>Thread-54726::DEBUG::2014-04-10 14:04:13,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54726::DEBUG::2014-04-10 14:04:13,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54726::DEBUG::2014-04-10 14:04:13,751::task::974::TaskManager.Task::(_decref) Task=`e23ac322-44ac-4bfd-8017-12f7ae1fa9a8`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:04:14,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:14,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000387009 s, 984 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:04:15,343::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:15,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319122 s, 2.1 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:04:15,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:15,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000503128 s, 731 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:04:17,533::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-38::DEBUG::2014-04-10 14:04:18,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:18,268::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000560595 s, 656 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:04:18,535::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54729::DEBUG::2014-04-10 14:04:19,960::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54729::DEBUG::2014-04-10 14:04:19,960::task::579::TaskManager.Task::(_updateState) Task=`e86ad25e-5c51-4ae1-811b-38139286ab52`::moving from state init -> state preparing
>Thread-54729::INFO::2014-04-10 14:04:19,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54729::INFO::2014-04-10 14:04:19,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54729::DEBUG::2014-04-10 14:04:19,961::task::1168::TaskManager.Task::(prepare) Task=`e86ad25e-5c51-4ae1-811b-38139286ab52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54729::DEBUG::2014-04-10 14:04:19,961::task::579::TaskManager.Task::(_updateState) Task=`e86ad25e-5c51-4ae1-811b-38139286ab52`::moving from state preparing -> state finished
>Thread-54729::DEBUG::2014-04-10 14:04:19,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54729::DEBUG::2014-04-10 14:04:19,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54729::DEBUG::2014-04-10 14:04:19,962::task::974::TaskManager.Task::(_decref) Task=`e86ad25e-5c51-4ae1-811b-38139286ab52`::ref 0 aborting False
>Thread-54730::DEBUG::2014-04-10 14:04:19,968::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54730::DEBUG::2014-04-10 14:04:19,969::task::579::TaskManager.Task::(_updateState) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::moving from state init -> state preparing
>Thread-54730::INFO::2014-04-10 14:04:19,969::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54730::DEBUG::2014-04-10 14:04:19,969::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29a73ef3-1310-464c-a9c1-8028f1df2843`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54730::DEBUG::2014-04-10 14:04:19,970::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54730::DEBUG::2014-04-10 14:04:19,970::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54730::DEBUG::2014-04-10 14:04:19,970::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29a73ef3-1310-464c-a9c1-8028f1df2843`::Granted request
>Thread-54730::DEBUG::2014-04-10 14:04:19,971::task::811::TaskManager.Task::(resourceAcquired) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54730::DEBUG::2014-04-10 14:04:19,971::task::974::TaskManager.Task::(_decref) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::ref 1 aborting False
>Thread-54730::INFO::2014-04-10 14:04:19,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54730::DEBUG::2014-04-10 14:04:19,973::task::1168::TaskManager.Task::(prepare) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54730::DEBUG::2014-04-10 14:04:19,973::task::579::TaskManager.Task::(_updateState) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::moving from state preparing -> state finished
>Thread-54730::DEBUG::2014-04-10 14:04:19,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54730::DEBUG::2014-04-10 14:04:19,974::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54730::DEBUG::2014-04-10 14:04:19,974::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54730::DEBUG::2014-04-10 14:04:19,974::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54730::DEBUG::2014-04-10 14:04:19,974::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54730::DEBUG::2014-04-10 14:04:19,975::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54730::DEBUG::2014-04-10 14:04:19,975::task::974::TaskManager.Task::(_decref) Task=`522e8099-8df4-4887-a34d-daed762f3dc5`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:04:24,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:24,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000370399 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:04:25,359::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:25,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027614 s, 2.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:04:25,759::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:25,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000425509 s, 865 kB/s\n'; <rc> = 0
>Thread-54734::DEBUG::2014-04-10 14:04:27,369::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [9e7a21b]
>Thread-54734::DEBUG::2014-04-10 14:04:27,370::task::579::TaskManager.Task::(_updateState) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::moving from state init -> state preparing
>Thread-54734::INFO::2014-04-10 14:04:27,370::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='0c0fd37f-6e74-4837-84c6-66e9d7ca9a89', postZero='false', force='false')
>Thread-54734::DEBUG::2014-04-10 14:04:27,371::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89`ReqID=`7ad1591a-516f-41a2-be1d-ea353b7c0623`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage'
>Thread-54734::DEBUG::2014-04-10 14:04:27,371::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89' for lock type 'exclusive'
>Thread-54734::DEBUG::2014-04-10 14:04:27,371::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89' is free. Now locking as 'exclusive' (1 active user)
>Thread-54734::DEBUG::2014-04-10 14:04:27,371::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89`ReqID=`7ad1591a-516f-41a2-be1d-ea353b7c0623`::Granted request
>Thread-54734::DEBUG::2014-04-10 14:04:27,372::task::811::TaskManager.Task::(resourceAcquired) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_resourcesAcquired: Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89 (exclusive)
>Thread-54734::DEBUG::2014-04-10 14:04:27,372::task::974::TaskManager.Task::(_decref) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::ref 1 aborting False
>Thread-54734::DEBUG::2014-04-10 14:04:27,372::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`6d8e8b8e-2363-47a4-88d7-7c170fea9fea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage'
>Thread-54734::DEBUG::2014-04-10 14:04:27,372::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-54734::DEBUG::2014-04-10 14:04:27,373::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-54734::DEBUG::2014-04-10 14:04:27,373::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`6d8e8b8e-2363-47a4-88d7-7c170fea9fea`::Granted request
>Thread-54734::DEBUG::2014-04-10 14:04:27,373::task::811::TaskManager.Task::(resourceAcquired) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-54734::DEBUG::2014-04-10 14:04:27,373::task::974::TaskManager.Task::(_decref) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::ref 1 aborting False
>Thread-54734::DEBUG::2014-04-10 14:04:27,425::task::736::TaskManager.Task::(_save) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd.temp
>Thread-54734::DEBUG::2014-04-10 14:04:27,519::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_0c0fd37f-6e74-4837-84c6-66e9d7ca9a89 for task d1737d24-ca0e-42ab-a340-746fa6c222cd 
>Thread-54734::INFO::2014-04-10 14:04:27,519::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
>Thread-54734::DEBUG::2014-04-10 14:04:27,519::task::1163::TaskManager.Task::(prepare) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::Prepare: 1 jobs exist, move to acquiring
>Thread-54734::DEBUG::2014-04-10 14:04:27,519::task::579::TaskManager.Task::(_updateState) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::moving from state preparing -> state acquiring
>Thread-54734::DEBUG::2014-04-10 14:04:27,520::task::736::TaskManager.Task::(_save) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd.temp
>Thread-54734::DEBUG::2014-04-10 14:04:27,529::task::579::TaskManager.Task::(_updateState) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::moving from state acquiring -> state queued
>Thread-54734::DEBUG::2014-04-10 14:04:27,530::task::736::TaskManager.Task::(_save) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd.temp
>Thread-54734::DEBUG::2014-04-10 14:04:27,541::taskManager::50::TaskManager::(_queueTask) queuing task: d1737d24-ca0e-42ab-a340-746fa6c222cd
>Thread-54734::DEBUG::2014-04-10 14:04:27,541::taskManager::56::TaskManager::(_queueTask) task queued: d1737d24-ca0e-42ab-a340-746fa6c222cd
>Thread-11::DEBUG::2014-04-10 14:04:27,542::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-54734::DEBUG::2014-04-10 14:04:27,542::task::1165::TaskManager.Task::(prepare) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::returning
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,542::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: d1737d24-ca0e-42ab-a340-746fa6c222cd running: <bound method Task.commit of <storage.task.Task instance at 0x7f8d702a31b8>> with: None
>Thread-54734::DEBUG::2014-04-10 14:04:27,542::task::974::TaskManager.Task::(_decref) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::ref 0 aborting False
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,542::task::1176::TaskManager.Task::(commit) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::committing task: d1737d24-ca0e-42ab-a340-746fa6c222cd
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,543::task::579::TaskManager.Task::(_updateState) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::moving from state queued -> state running
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,544::task::736::TaskManager.Task::(_save) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd.temp
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,557::task::889::TaskManager.Task::(_runJobs) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::Task.run: running job 0: deleteImage_0c0fd37f-6e74-4837-84c6-66e9d7ca9a89: <function <lambda> at 0x7f8d8c091e60> (args: () kwargs: {})
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,557::task::315::TaskManager.Task::(run) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::Job.run: running deleteImage_0c0fd37f-6e74-4837-84c6-66e9d7ca9a89: <function <lambda> at 0x7f8d8c091e60> (args: () kwargs: {}) callback None
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,557::task::579::TaskManager.Task::(_updateState) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::moving from state running -> state finished
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,557::task::736::TaskManager.Task::(_save) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/d1737d24-ca0e-42ab-a340-746fa6c222cd.temp
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89': < ResourceRef 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89', isValid: 'True' obj: 'None'>, 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,574::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89'
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,574::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89' (0 active users)
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,574::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89' is free, finding out if anyone is waiting for it.
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,574::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.0c0fd37f-6e74-4837-84c6-66e9d7ca9a89', Clearing records.
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::task::897::TaskManager.Task::(_runJobs) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::Task.run: exit - success: result True
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::task::974::TaskManager.Task::(_decref) Task=`d1737d24-ca0e-42ab-a340-746fa6c222cd`::ref 0 aborting False
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:27,575::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-38::DEBUG::2014-04-10 14:04:28,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:28,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496725 s, 741 kB/s\n'; <rc> = 0
>Thread-54735::DEBUG::2014-04-10 14:04:29,491::task::579::TaskManager.Task::(_updateState) Task=`fa27c0a8-31aa-4878-afa1-ec0041d38067`::moving from state init -> state preparing
>Thread-54735::INFO::2014-04-10 14:04:29,491::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54735::INFO::2014-04-10 14:04:29,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370399', 'lastCheck': '4.6', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425509', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027614', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496725', 'lastCheck': '1.2', 'valid': True}}
>Thread-54735::DEBUG::2014-04-10 14:04:29,492::task::1168::TaskManager.Task::(prepare) Task=`fa27c0a8-31aa-4878-afa1-ec0041d38067`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370399', 'lastCheck': '4.6', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425509', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027614', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496725', 'lastCheck': '1.2', 'valid': True}}
>Thread-54735::DEBUG::2014-04-10 14:04:29,492::task::579::TaskManager.Task::(_updateState) Task=`fa27c0a8-31aa-4878-afa1-ec0041d38067`::moving from state preparing -> state finished
>Thread-54735::DEBUG::2014-04-10 14:04:29,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54735::DEBUG::2014-04-10 14:04:29,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54735::DEBUG::2014-04-10 14:04:29,492::task::974::TaskManager.Task::(_decref) Task=`fa27c0a8-31aa-4878-afa1-ec0041d38067`::ref 0 aborting False
>Thread-54737::DEBUG::2014-04-10 14:04:30,149::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54737::DEBUG::2014-04-10 14:04:30,150::task::579::TaskManager.Task::(_updateState) Task=`227e70e9-72c2-4423-afcd-21e7113f6117`::moving from state init -> state preparing
>Thread-54737::INFO::2014-04-10 14:04:30,150::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54737::INFO::2014-04-10 14:04:30,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54737::DEBUG::2014-04-10 14:04:30,150::task::1168::TaskManager.Task::(prepare) Task=`227e70e9-72c2-4423-afcd-21e7113f6117`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54737::DEBUG::2014-04-10 14:04:30,151::task::579::TaskManager.Task::(_updateState) Task=`227e70e9-72c2-4423-afcd-21e7113f6117`::moving from state preparing -> state finished
>Thread-54737::DEBUG::2014-04-10 14:04:30,151::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54737::DEBUG::2014-04-10 14:04:30,151::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54737::DEBUG::2014-04-10 14:04:30,151::task::974::TaskManager.Task::(_decref) Task=`227e70e9-72c2-4423-afcd-21e7113f6117`::ref 0 aborting False
>Thread-54738::DEBUG::2014-04-10 14:04:30,157::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54738::DEBUG::2014-04-10 14:04:30,157::task::579::TaskManager.Task::(_updateState) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::moving from state init -> state preparing
>Thread-54738::INFO::2014-04-10 14:04:30,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54738::DEBUG::2014-04-10 14:04:30,158::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`edc64484-6a05-4b43-8475-ba67e0c429e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54738::DEBUG::2014-04-10 14:04:30,158::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54738::DEBUG::2014-04-10 14:04:30,158::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54738::DEBUG::2014-04-10 14:04:30,159::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`edc64484-6a05-4b43-8475-ba67e0c429e2`::Granted request
>Thread-54738::DEBUG::2014-04-10 14:04:30,159::task::811::TaskManager.Task::(resourceAcquired) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54738::DEBUG::2014-04-10 14:04:30,159::task::974::TaskManager.Task::(_decref) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::ref 1 aborting False
>Thread-54738::INFO::2014-04-10 14:04:30,161::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54738::DEBUG::2014-04-10 14:04:30,161::task::1168::TaskManager.Task::(prepare) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76826017792', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652362752', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54738::DEBUG::2014-04-10 14:04:30,161::task::579::TaskManager.Task::(_updateState) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::moving from state preparing -> state finished
>Thread-54738::DEBUG::2014-04-10 14:04:30,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54738::DEBUG::2014-04-10 14:04:30,162::task::974::TaskManager.Task::(_decref) Task=`14bfc8ca-701c-4443-aa5a-eb555edd9065`::ref 0 aborting False
>Thread-54739::DEBUG::2014-04-10 14:04:31,680::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-54739::DEBUG::2014-04-10 14:04:31,680::task::579::TaskManager.Task::(_updateState) Task=`4300a485-f5aa-4cf5-8935-3aba1ac8fd7b`::moving from state init -> state preparing
>Thread-54739::INFO::2014-04-10 14:04:31,681::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-54739::DEBUG::2014-04-10 14:04:31,681::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-54739::DEBUG::2014-04-10 14:04:31,681::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: d1737d24-ca0e-42ab-a340-746fa6c222cd
>Thread-54739::DEBUG::2014-04-10 14:04:31,681::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1737d24-ca0e-42ab-a340-746fa6c222cd'}
>Thread-54739::DEBUG::2014-04-10 14:04:31,681::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'d1737d24-ca0e-42ab-a340-746fa6c222cd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1737d24-ca0e-42ab-a340-746fa6c222cd'}}
>Thread-54739::INFO::2014-04-10 14:04:31,682::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'d1737d24-ca0e-42ab-a340-746fa6c222cd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1737d24-ca0e-42ab-a340-746fa6c222cd'}}}
>Thread-54739::DEBUG::2014-04-10 14:04:31,682::task::1168::TaskManager.Task::(prepare) Task=`4300a485-f5aa-4cf5-8935-3aba1ac8fd7b`::finished: {'allTasksStatus': {'d1737d24-ca0e-42ab-a340-746fa6c222cd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1737d24-ca0e-42ab-a340-746fa6c222cd'}}}
>Thread-54739::DEBUG::2014-04-10 14:04:31,682::task::579::TaskManager.Task::(_updateState) Task=`4300a485-f5aa-4cf5-8935-3aba1ac8fd7b`::moving from state preparing -> state finished
>Thread-54739::DEBUG::2014-04-10 14:04:31,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54739::DEBUG::2014-04-10 14:04:31,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54739::DEBUG::2014-04-10 14:04:31,682::task::974::TaskManager.Task::(_decref) Task=`4300a485-f5aa-4cf5-8935-3aba1ac8fd7b`::ref 0 aborting False
>Thread-54740::DEBUG::2014-04-10 14:04:31,855::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54740::DEBUG::2014-04-10 14:04:31,856::task::579::TaskManager.Task::(_updateState) Task=`2b1877e5-1150-4c7e-b4ea-0198352666d6`::moving from state init -> state preparing
>Thread-54740::INFO::2014-04-10 14:04:31,856::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='d1737d24-ca0e-42ab-a340-746fa6c222cd', spUUID=None, options=None)
>Thread-54740::DEBUG::2014-04-10 14:04:31,856::taskManager::161::TaskManager::(clearTask) Entry. taskID: d1737d24-ca0e-42ab-a340-746fa6c222cd
>Thread-54740::DEBUG::2014-04-10 14:04:31,860::taskManager::166::TaskManager::(clearTask) Return.
>Thread-54740::INFO::2014-04-10 14:04:31,860::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-54740::DEBUG::2014-04-10 14:04:31,861::task::1168::TaskManager.Task::(prepare) Task=`2b1877e5-1150-4c7e-b4ea-0198352666d6`::finished: None
>Thread-54740::DEBUG::2014-04-10 14:04:31,861::task::579::TaskManager.Task::(_updateState) Task=`2b1877e5-1150-4c7e-b4ea-0198352666d6`::moving from state preparing -> state finished
>Thread-54740::DEBUG::2014-04-10 14:04:31,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54740::DEBUG::2014-04-10 14:04:31,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54740::DEBUG::2014-04-10 14:04:31,861::task::974::TaskManager.Task::(_decref) Task=`2b1877e5-1150-4c7e-b4ea-0198352666d6`::ref 0 aborting False
>Thread-54742::DEBUG::2014-04-10 14:04:34,058::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmShutdown with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a', '30', 'System Administrator has initiated shutdown of this Virtual Machine. Virtual Machine is shutting down.') {} flowID [71701bb]
>Thread-54742::DEBUG::2014-04-10 14:04:34,060::BindingXMLRPC::982::vds::(wrapper) return vmShutdown with {'status': {'message': 'Machine shut down', 'code': 0}}
>Thread-28::DEBUG::2014-04-10 14:04:34,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:34,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000291584 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:04:35,374::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:35,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325093 s, 2.1 MB/s\n'; <rc> = 0
>Thread-54744::DEBUG::2014-04-10 14:04:35,748::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54744::DEBUG::2014-04-10 14:04:35,750::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '-0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.79', 'elapsedTime': '83906', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 14:04:35,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:35,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00039052 s, 942 kB/s\n'; <rc> = 0
>Thread-54745::DEBUG::2014-04-10 14:04:37,839::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmShutdown with ('e7983b62-8992-42a8-afd7-f7b815d80bbb', '30', 'System Administrator has initiated shutdown of this Virtual Machine. Virtual Machine is shutting down.') {} flowID [4b3f6d5b]
>Thread-54745::DEBUG::2014-04-10 14:04:37,842::BindingXMLRPC::982::vds::(wrapper) return vmShutdown with {'status': {'message': 'Machine shut down', 'code': 0}}
>Thread-38::DEBUG::2014-04-10 14:04:38,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:38,299::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000352904 s, 1.0 MB/s\n'; <rc> = 0
>Thread-54747::DEBUG::2014-04-10 14:04:38,824::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {} flowID [4902995d]
>Thread-54747::DEBUG::2014-04-10 14:04:38,826::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '-0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.87', 'elapsedTime': '83909', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-54748::DEBUG::2014-04-10 14:04:38,834::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {} flowID [4902995d]
>Thread-54748::DEBUG::2014-04-10 14:04:38,835::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.51', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.88', 'elapsedTime': '86389', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-54749::DEBUG::2014-04-10 14:04:40,266::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54749::DEBUG::2014-04-10 14:04:40,266::task::579::TaskManager.Task::(_updateState) Task=`c9763799-565d-44fd-882b-41f47c86e804`::moving from state init -> state preparing
>Thread-54749::INFO::2014-04-10 14:04:40,266::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54749::INFO::2014-04-10 14:04:40,267::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54749::DEBUG::2014-04-10 14:04:40,267::task::1168::TaskManager.Task::(prepare) Task=`c9763799-565d-44fd-882b-41f47c86e804`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54749::DEBUG::2014-04-10 14:04:40,267::task::579::TaskManager.Task::(_updateState) Task=`c9763799-565d-44fd-882b-41f47c86e804`::moving from state preparing -> state finished
>Thread-54749::DEBUG::2014-04-10 14:04:40,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54749::DEBUG::2014-04-10 14:04:40,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54749::DEBUG::2014-04-10 14:04:40,267::task::974::TaskManager.Task::(_decref) Task=`c9763799-565d-44fd-882b-41f47c86e804`::ref 0 aborting False
>Thread-54750::DEBUG::2014-04-10 14:04:40,274::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54750::DEBUG::2014-04-10 14:04:40,274::task::579::TaskManager.Task::(_updateState) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::moving from state init -> state preparing
>Thread-54750::INFO::2014-04-10 14:04:40,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54750::DEBUG::2014-04-10 14:04:40,275::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a392a0d-6f53-43c3-b7b6-76584ad095d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54750::DEBUG::2014-04-10 14:04:40,275::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54750::DEBUG::2014-04-10 14:04:40,275::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54750::DEBUG::2014-04-10 14:04:40,275::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a392a0d-6f53-43c3-b7b6-76584ad095d8`::Granted request
>Thread-54750::DEBUG::2014-04-10 14:04:40,276::task::811::TaskManager.Task::(resourceAcquired) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54750::DEBUG::2014-04-10 14:04:40,276::task::974::TaskManager.Task::(_decref) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::ref 1 aborting False
>Thread-54750::INFO::2014-04-10 14:04:40,278::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652297216', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652297216', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54750::DEBUG::2014-04-10 14:04:40,278::task::1168::TaskManager.Task::(prepare) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652297216', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652297216', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54750::DEBUG::2014-04-10 14:04:40,278::task::579::TaskManager.Task::(_updateState) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::moving from state preparing -> state finished
>Thread-54750::DEBUG::2014-04-10 14:04:40,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54750::DEBUG::2014-04-10 14:04:40,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54750::DEBUG::2014-04-10 14:04:40,279::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54750::DEBUG::2014-04-10 14:04:40,279::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54750::DEBUG::2014-04-10 14:04:40,279::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54750::DEBUG::2014-04-10 14:04:40,279::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54750::DEBUG::2014-04-10 14:04:40,279::task::974::TaskManager.Task::(_decref) Task=`ad578709-90f8-464d-ba50-5e70e4db2475`::ref 0 aborting False
>Thread-54752::DEBUG::2014-04-10 14:04:41,906::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54752::DEBUG::2014-04-10 14:04:41,907::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '-0.50', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.93', 'elapsedTime': '83912', 'vmType': 'kvm', 'cpuSys': '1.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-54753::DEBUG::2014-04-10 14:04:41,916::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54753::DEBUG::2014-04-10 14:04:41,917::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.51', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.94', 'elapsedTime': '86392', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-28::DEBUG::2014-04-10 14:04:44,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:44,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000399198 s, 954 kB/s\n'; <rc> = 0
>Thread-54754::DEBUG::2014-04-10 14:04:44,988::task::579::TaskManager.Task::(_updateState) Task=`3ddb3584-e770-4809-8e89-ee5a7a0a6e7a`::moving from state init -> state preparing
>Thread-54754::INFO::2014-04-10 14:04:44,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54754::INFO::2014-04-10 14:04:44,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399198', 'lastCheck': '0.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039052', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325093', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352904', 'lastCheck': '6.7', 'valid': True}}
>Thread-54754::DEBUG::2014-04-10 14:04:44,989::task::1168::TaskManager.Task::(prepare) Task=`3ddb3584-e770-4809-8e89-ee5a7a0a6e7a`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399198', 'lastCheck': '0.1', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039052', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325093', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352904', 'lastCheck': '6.7', 'valid': True}}
>Thread-54754::DEBUG::2014-04-10 14:04:44,989::task::579::TaskManager.Task::(_updateState) Task=`3ddb3584-e770-4809-8e89-ee5a7a0a6e7a`::moving from state preparing -> state finished
>Thread-54754::DEBUG::2014-04-10 14:04:44,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54754::DEBUG::2014-04-10 14:04:44,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54754::DEBUG::2014-04-10 14:04:44,990::task::974::TaskManager.Task::(_decref) Task=`3ddb3584-e770-4809-8e89-ee5a7a0a6e7a`::ref 0 aborting False
>Thread-33::DEBUG::2014-04-10 14:04:45,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:45,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000472422 s, 1.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:04:45,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:45,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000459523 s, 801 kB/s\n'; <rc> = 0
>Thread-859::DEBUG::2014-04-10 14:04:46,997::task::579::TaskManager.Task::(_updateState) Task=`b31aad41-8dd8-4b13-b30c-9627d94cdbc3`::moving from state init -> state preparing
>Thread-859::INFO::2014-04-10 14:04:47,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', volUUID='70bf7589-51a3-471d-bb14-93ecaaff1e0f', options=None)
>Thread-859::INFO::2014-04-10 14:04:47,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:04:47,023::task::1168::TaskManager.Task::(prepare) Task=`b31aad41-8dd8-4b13-b30c-9627d94cdbc3`::finished: {'truesize': '0', 'apparentsize': '10737418240'}
>Thread-859::DEBUG::2014-04-10 14:04:47,023::task::579::TaskManager.Task::(_updateState) Task=`b31aad41-8dd8-4b13-b30c-9627d94cdbc3`::moving from state preparing -> state finished
>Thread-859::DEBUG::2014-04-10 14:04:47,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-859::DEBUG::2014-04-10 14:04:47,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-859::DEBUG::2014-04-10 14:04:47,024::task::974::TaskManager.Task::(_decref) Task=`b31aad41-8dd8-4b13-b30c-9627d94cdbc3`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 14:04:47,568::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 62.
>Thread-54757::DEBUG::2014-04-10 14:04:48,124::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54757::DEBUG::2014-04-10 14:04:48,125::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.84', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.13', 'elapsedTime': '83918', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-54758::DEBUG::2014-04-10 14:04:48,133::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54758::DEBUG::2014-04-10 14:04:48,135::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.14', 'elapsedTime': '86398', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-38::DEBUG::2014-04-10 14:04:48,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:48,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000395288 s, 931 kB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 14:04:48,569::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-54759::DEBUG::2014-04-10 14:04:50,400::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54759::DEBUG::2014-04-10 14:04:50,401::task::579::TaskManager.Task::(_updateState) Task=`d5162f5e-2cc3-40a2-ac1e-452f1c1c6786`::moving from state init -> state preparing
>Thread-54759::INFO::2014-04-10 14:04:50,401::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54759::INFO::2014-04-10 14:04:50,401::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54759::DEBUG::2014-04-10 14:04:50,402::task::1168::TaskManager.Task::(prepare) Task=`d5162f5e-2cc3-40a2-ac1e-452f1c1c6786`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54759::DEBUG::2014-04-10 14:04:50,402::task::579::TaskManager.Task::(_updateState) Task=`d5162f5e-2cc3-40a2-ac1e-452f1c1c6786`::moving from state preparing -> state finished
>Thread-54759::DEBUG::2014-04-10 14:04:50,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54759::DEBUG::2014-04-10 14:04:50,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54759::DEBUG::2014-04-10 14:04:50,402::task::974::TaskManager.Task::(_decref) Task=`d5162f5e-2cc3-40a2-ac1e-452f1c1c6786`::ref 0 aborting False
>Thread-54760::DEBUG::2014-04-10 14:04:50,409::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54760::DEBUG::2014-04-10 14:04:50,409::task::579::TaskManager.Task::(_updateState) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::moving from state init -> state preparing
>Thread-54760::INFO::2014-04-10 14:04:50,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54760::DEBUG::2014-04-10 14:04:50,410::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae7776c9-8be9-4d3c-b75d-868c9a8448ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54760::DEBUG::2014-04-10 14:04:50,410::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54760::DEBUG::2014-04-10 14:04:50,410::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54760::DEBUG::2014-04-10 14:04:50,410::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae7776c9-8be9-4d3c-b75d-868c9a8448ab`::Granted request
>Thread-54760::DEBUG::2014-04-10 14:04:50,411::task::811::TaskManager.Task::(resourceAcquired) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54760::DEBUG::2014-04-10 14:04:50,411::task::974::TaskManager.Task::(_decref) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::ref 1 aborting False
>Thread-54760::INFO::2014-04-10 14:04:50,413::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652231680', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652231680', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54760::DEBUG::2014-04-10 14:04:50,413::task::1168::TaskManager.Task::(prepare) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134652231680', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134652231680', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54760::DEBUG::2014-04-10 14:04:50,413::task::579::TaskManager.Task::(_updateState) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::moving from state preparing -> state finished
>Thread-54760::DEBUG::2014-04-10 14:04:50,413::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54760::DEBUG::2014-04-10 14:04:50,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54760::DEBUG::2014-04-10 14:04:50,414::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54760::DEBUG::2014-04-10 14:04:50,414::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54760::DEBUG::2014-04-10 14:04:50,414::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54760::DEBUG::2014-04-10 14:04:50,414::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54760::DEBUG::2014-04-10 14:04:50,414::task::974::TaskManager.Task::(_decref) Task=`282e532e-4460-4c6c-aca3-55ee09fab109`::ref 0 aborting False
>Thread-54762::DEBUG::2014-04-10 14:04:51,184::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54762::DEBUG::2014-04-10 14:04:51,185::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.84', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.13', 'elapsedTime': '83921', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-54763::DEBUG::2014-04-10 14:04:51,193::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54763::DEBUG::2014-04-10 14:04:51,194::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.17', 'elapsedTime': '86401', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-54765::DEBUG::2014-04-10 14:04:54,256::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {} flowID [29d39d31]
>Thread-54765::DEBUG::2014-04-10 14:04:54,257::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.84', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.20', 'elapsedTime': '83924', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-54766::DEBUG::2014-04-10 14:04:54,266::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {} flowID [29d39d31]
>Thread-54766::DEBUG::2014-04-10 14:04:54,267::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.23', 'elapsedTime': '86404', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-28::DEBUG::2014-04-10 14:04:54,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:04:54,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00029362 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:04:55,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:04:55,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276015 s, 2.4 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:04:55,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:04:55,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00039225 s, 938 kB/s\n'; <rc> = 0
>Thread-54767::DEBUG::2014-04-10 14:04:56,576::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7b62e43e]
>Thread-54767::DEBUG::2014-04-10 14:04:56,576::task::579::TaskManager.Task::(_updateState) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::moving from state init -> state preparing
>Thread-54767::INFO::2014-04-10 14:04:56,577::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='d84232e1-e105-4c7e-8657-28d777960e4e', postZero='false', force='false')
>Thread-54767::DEBUG::2014-04-10 14:04:56,577::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.d84232e1-e105-4c7e-8657-28d777960e4e`ReqID=`6ae85889-49c0-49e4-9326-6074d49dc4a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage'
>Thread-54767::DEBUG::2014-04-10 14:04:56,577::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e' for lock type 'exclusive'
>Thread-54767::DEBUG::2014-04-10 14:04:56,578::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e' is free. Now locking as 'exclusive' (1 active user)
>Thread-54767::DEBUG::2014-04-10 14:04:56,578::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.d84232e1-e105-4c7e-8657-28d777960e4e`ReqID=`6ae85889-49c0-49e4-9326-6074d49dc4a4`::Granted request
>Thread-54767::DEBUG::2014-04-10 14:04:56,579::task::811::TaskManager.Task::(resourceAcquired) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_resourcesAcquired: Storage.d84232e1-e105-4c7e-8657-28d777960e4e (exclusive)
>Thread-54767::DEBUG::2014-04-10 14:04:56,579::task::974::TaskManager.Task::(_decref) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::ref 1 aborting False
>Thread-54767::DEBUG::2014-04-10 14:04:56,579::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`3c52f3c2-3892-4942-a89f-a3985a32befe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage'
>Thread-54767::DEBUG::2014-04-10 14:04:56,580::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-54767::DEBUG::2014-04-10 14:04:56,580::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-54767::DEBUG::2014-04-10 14:04:56,580::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`3c52f3c2-3892-4942-a89f-a3985a32befe`::Granted request
>Thread-54767::DEBUG::2014-04-10 14:04:56,580::task::811::TaskManager.Task::(resourceAcquired) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-54767::DEBUG::2014-04-10 14:04:56,581::task::974::TaskManager.Task::(_decref) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::ref 1 aborting False
>Thread-54767::DEBUG::2014-04-10 14:04:56,621::task::736::TaskManager.Task::(_save) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429.temp
>Thread-54767::DEBUG::2014-04-10 14:04:56,629::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_d84232e1-e105-4c7e-8657-28d777960e4e for task 37f9af5d-9958-4332-80b7-62f823de6429 
>Thread-54767::INFO::2014-04-10 14:04:56,629::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
>Thread-54767::DEBUG::2014-04-10 14:04:56,629::task::1163::TaskManager.Task::(prepare) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::Prepare: 1 jobs exist, move to acquiring
>Thread-54767::DEBUG::2014-04-10 14:04:56,629::task::579::TaskManager.Task::(_updateState) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::moving from state preparing -> state acquiring
>Thread-54767::DEBUG::2014-04-10 14:04:56,630::task::736::TaskManager.Task::(_save) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429.temp
>Thread-54767::DEBUG::2014-04-10 14:04:56,639::task::579::TaskManager.Task::(_updateState) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::moving from state acquiring -> state queued
>Thread-54767::DEBUG::2014-04-10 14:04:56,640::task::736::TaskManager.Task::(_save) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429.temp
>Thread-54767::DEBUG::2014-04-10 14:04:56,650::taskManager::50::TaskManager::(_queueTask) queuing task: 37f9af5d-9958-4332-80b7-62f823de6429
>Thread-54767::DEBUG::2014-04-10 14:04:56,650::taskManager::56::TaskManager::(_queueTask) task queued: 37f9af5d-9958-4332-80b7-62f823de6429
>d1737d24-ca0e-42ab-a340-746fa6c222cd::DEBUG::2014-04-10 14:04:56,650::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,651::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 37f9af5d-9958-4332-80b7-62f823de6429 running: <bound method Task.commit of <storage.task.Task instance at 0x7f8d70337bd8>> with: None
>Thread-54767::DEBUG::2014-04-10 14:04:56,651::task::1165::TaskManager.Task::(prepare) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::returning
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,652::task::1176::TaskManager.Task::(commit) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::committing task: 37f9af5d-9958-4332-80b7-62f823de6429
>Thread-54767::DEBUG::2014-04-10 14:04:56,653::task::974::TaskManager.Task::(_decref) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::ref 0 aborting False
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,654::task::579::TaskManager.Task::(_updateState) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::moving from state queued -> state running
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,658::task::736::TaskManager.Task::(_save) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429.temp
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,669::task::889::TaskManager.Task::(_runJobs) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::Task.run: running job 0: deleteImage_d84232e1-e105-4c7e-8657-28d777960e4e: <function <lambda> at 0x7f8d8c0a6a28> (args: () kwargs: {})
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,669::task::315::TaskManager.Task::(run) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::Job.run: running deleteImage_d84232e1-e105-4c7e-8657-28d777960e4e: <function <lambda> at 0x7f8d8c0a6a28> (args: () kwargs: {}) callback None
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,669::task::579::TaskManager.Task::(_updateState) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::moving from state running -> state finished
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,669::task::736::TaskManager.Task::(_save) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/37f9af5d-9958-4332-80b7-62f823de6429.temp
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>, 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e': < ResourceRef 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e', isValid: 'True' obj: 'None'>}
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,681::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,681::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,682::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,682::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,682::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e'
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,682::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e' (0 active users)
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,682::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e' is free, finding out if anyone is waiting for it.
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,683::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.d84232e1-e105-4c7e-8657-28d777960e4e', Clearing records.
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,683::task::897::TaskManager.Task::(_runJobs) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::Task.run: exit - success: result True
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,683::task::974::TaskManager.Task::(_decref) Task=`37f9af5d-9958-4332-80b7-62f823de6429`::ref 0 aborting False
>37f9af5d-9958-4332-80b7-62f823de6429::DEBUG::2014-04-10 14:04:56,683::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-54769::DEBUG::2014-04-10 14:04:57,358::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54769::DEBUG::2014-04-10 14:04:57,359::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.84', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.31', 'elapsedTime': '83927', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-54770::DEBUG::2014-04-10 14:04:57,368::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54770::DEBUG::2014-04-10 14:04:57,370::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.33', 'elapsedTime': '86407', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-38::DEBUG::2014-04-10 14:04:58,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:04:58,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000536522 s, 686 kB/s\n'; <rc> = 0
>Thread-54771::DEBUG::2014-04-10 14:05:00,399::task::579::TaskManager.Task::(_updateState) Task=`40b51e6a-067c-4d8b-8d38-5b29ee30ff58`::moving from state init -> state preparing
>Thread-54771::INFO::2014-04-10 14:05:00,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54771::INFO::2014-04-10 14:05:00,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029362', 'lastCheck': '5.5', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039225', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276015', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536522', 'lastCheck': '2.1', 'valid': True}}
>Thread-54771::DEBUG::2014-04-10 14:05:00,400::task::1168::TaskManager.Task::(prepare) Task=`40b51e6a-067c-4d8b-8d38-5b29ee30ff58`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029362', 'lastCheck': '5.5', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039225', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276015', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536522', 'lastCheck': '2.1', 'valid': True}}
>Thread-54771::DEBUG::2014-04-10 14:05:00,400::task::579::TaskManager.Task::(_updateState) Task=`40b51e6a-067c-4d8b-8d38-5b29ee30ff58`::moving from state preparing -> state finished
>Thread-54771::DEBUG::2014-04-10 14:05:00,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54771::DEBUG::2014-04-10 14:05:00,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54771::DEBUG::2014-04-10 14:05:00,400::task::974::TaskManager.Task::(_decref) Task=`40b51e6a-067c-4d8b-8d38-5b29ee30ff58`::ref 0 aborting False
>Thread-54773::DEBUG::2014-04-10 14:05:00,521::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54773::DEBUG::2014-04-10 14:05:00,522::task::579::TaskManager.Task::(_updateState) Task=`f3423dac-ca7a-4665-a057-f8a4aaa062f1`::moving from state init -> state preparing
>Thread-54773::INFO::2014-04-10 14:05:00,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54773::INFO::2014-04-10 14:05:00,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54773::DEBUG::2014-04-10 14:05:00,522::task::1168::TaskManager.Task::(prepare) Task=`f3423dac-ca7a-4665-a057-f8a4aaa062f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54773::DEBUG::2014-04-10 14:05:00,522::task::579::TaskManager.Task::(_updateState) Task=`f3423dac-ca7a-4665-a057-f8a4aaa062f1`::moving from state preparing -> state finished
>Thread-54773::DEBUG::2014-04-10 14:05:00,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54773::DEBUG::2014-04-10 14:05:00,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54773::DEBUG::2014-04-10 14:05:00,523::task::974::TaskManager.Task::(_decref) Task=`f3423dac-ca7a-4665-a057-f8a4aaa062f1`::ref 0 aborting False
>Thread-54774::DEBUG::2014-04-10 14:05:00,529::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54774::DEBUG::2014-04-10 14:05:00,529::task::579::TaskManager.Task::(_updateState) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::moving from state init -> state preparing
>Thread-54774::INFO::2014-04-10 14:05:00,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54774::DEBUG::2014-04-10 14:05:00,530::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e4507057-9964-4690-bc50-49bcb7233a8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54774::DEBUG::2014-04-10 14:05:00,530::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54774::DEBUG::2014-04-10 14:05:00,530::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54774::DEBUG::2014-04-10 14:05:00,530::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e4507057-9964-4690-bc50-49bcb7233a8e`::Granted request
>Thread-54774::DEBUG::2014-04-10 14:05:00,531::task::811::TaskManager.Task::(resourceAcquired) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54774::DEBUG::2014-04-10 14:05:00,531::task::974::TaskManager.Task::(_decref) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::ref 1 aborting False
>Thread-54774::INFO::2014-04-10 14:05:00,532::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134649806848', 'isoprefix': '', 'alerts': [], 'disktotal': '910947647488', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134649741312', 'isoprefix': '', 'alerts': [], 'disktotal': '910947581952', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54774::DEBUG::2014-04-10 14:05:00,533::task::1168::TaskManager.Task::(prepare) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '134649806848', 'isoprefix': '', 'alerts': [], 'disktotal': '910947647488', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '134649741312', 'isoprefix': '', 'alerts': [], 'disktotal': '910947581952', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54774::DEBUG::2014-04-10 14:05:00,533::task::579::TaskManager.Task::(_updateState) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::moving from state preparing -> state finished
>Thread-54774::DEBUG::2014-04-10 14:05:00,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54774::DEBUG::2014-04-10 14:05:00,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54774::DEBUG::2014-04-10 14:05:00,533::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54774::DEBUG::2014-04-10 14:05:00,534::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54774::DEBUG::2014-04-10 14:05:00,534::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54774::DEBUG::2014-04-10 14:05:00,534::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54774::DEBUG::2014-04-10 14:05:00,534::task::974::TaskManager.Task::(_decref) Task=`8c586785-7efe-45f5-952b-b79dff27976a`::ref 0 aborting False
>Thread-54775::DEBUG::2014-04-10 14:05:01,725::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54775::DEBUG::2014-04-10 14:05:01,725::task::579::TaskManager.Task::(_updateState) Task=`2e09c60d-4b4d-4ee1-9c17-8ee85893bb53`::moving from state init -> state preparing
>Thread-54775::INFO::2014-04-10 14:05:01,726::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-54775::DEBUG::2014-04-10 14:05:01,726::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-54775::DEBUG::2014-04-10 14:05:01,726::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 37f9af5d-9958-4332-80b7-62f823de6429
>Thread-54775::DEBUG::2014-04-10 14:05:01,726::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '37f9af5d-9958-4332-80b7-62f823de6429'}
>Thread-54775::DEBUG::2014-04-10 14:05:01,726::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'37f9af5d-9958-4332-80b7-62f823de6429': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '37f9af5d-9958-4332-80b7-62f823de6429'}}
>Thread-54775::INFO::2014-04-10 14:05:01,727::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'37f9af5d-9958-4332-80b7-62f823de6429': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '37f9af5d-9958-4332-80b7-62f823de6429'}}}
>Thread-54775::DEBUG::2014-04-10 14:05:01,727::task::1168::TaskManager.Task::(prepare) Task=`2e09c60d-4b4d-4ee1-9c17-8ee85893bb53`::finished: {'allTasksStatus': {'37f9af5d-9958-4332-80b7-62f823de6429': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '37f9af5d-9958-4332-80b7-62f823de6429'}}}
>Thread-54775::DEBUG::2014-04-10 14:05:01,727::task::579::TaskManager.Task::(_updateState) Task=`2e09c60d-4b4d-4ee1-9c17-8ee85893bb53`::moving from state preparing -> state finished
>Thread-54775::DEBUG::2014-04-10 14:05:01,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54775::DEBUG::2014-04-10 14:05:01,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54775::DEBUG::2014-04-10 14:05:01,727::task::974::TaskManager.Task::(_decref) Task=`2e09c60d-4b4d-4ee1-9c17-8ee85893bb53`::ref 0 aborting False
>Thread-54776::DEBUG::2014-04-10 14:05:01,950::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54776::DEBUG::2014-04-10 14:05:01,950::task::579::TaskManager.Task::(_updateState) Task=`eb1e16ff-286e-4a23-8c2a-5f60b65dc122`::moving from state init -> state preparing
>Thread-54776::INFO::2014-04-10 14:05:01,951::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='37f9af5d-9958-4332-80b7-62f823de6429', spUUID=None, options=None)
>Thread-54776::DEBUG::2014-04-10 14:05:01,951::taskManager::161::TaskManager::(clearTask) Entry. taskID: 37f9af5d-9958-4332-80b7-62f823de6429
>Thread-54776::DEBUG::2014-04-10 14:05:01,963::taskManager::166::TaskManager::(clearTask) Return.
>Thread-54776::INFO::2014-04-10 14:05:01,963::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-54776::DEBUG::2014-04-10 14:05:01,963::task::1168::TaskManager.Task::(prepare) Task=`eb1e16ff-286e-4a23-8c2a-5f60b65dc122`::finished: None
>Thread-54776::DEBUG::2014-04-10 14:05:01,963::task::579::TaskManager.Task::(_updateState) Task=`eb1e16ff-286e-4a23-8c2a-5f60b65dc122`::moving from state preparing -> state finished
>Thread-54776::DEBUG::2014-04-10 14:05:01,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54776::DEBUG::2014-04-10 14:05:01,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54776::DEBUG::2014-04-10 14:05:01,964::task::974::TaskManager.Task::(_decref) Task=`eb1e16ff-286e-4a23-8c2a-5f60b65dc122`::ref 0 aborting False
>Thread-54778::DEBUG::2014-04-10 14:05:03,534::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54778::DEBUG::2014-04-10 14:05:03,535::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '83934', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-54779::DEBUG::2014-04-10 14:05:03,543::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54779::DEBUG::2014-04-10 14:05:03,544::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.22', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.45', 'elapsedTime': '86414', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-28::DEBUG::2014-04-10 14:05:04,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:05:04,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000352682 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:05:05,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:05:05,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347868 s, 1.9 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:05:05,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:05:05,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442327 s, 832 kB/s\n'; <rc> = 0
>Thread-54781::DEBUG::2014-04-10 14:05:06,597::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {} flowID [40980259]
>Thread-54781::DEBUG::2014-04-10 14:05:06,599::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.50', 'elapsedTime': '83937', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-54782::DEBUG::2014-04-10 14:05:06,608::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {} flowID [40980259]
>Thread-54782::DEBUG::2014-04-10 14:05:06,609::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.22', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'elapsedTime': '86417', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-38::DEBUG::2014-04-10 14:05:08,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:05:08,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000673843 s, 546 kB/s\n'; <rc> = 0
>Thread-54784::DEBUG::2014-04-10 14:05:09,662::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54784::DEBUG::2014-04-10 14:05:09,664::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'elapsedTime': '83940', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-54785::DEBUG::2014-04-10 14:05:09,672::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {}
>Thread-54785::DEBUG::2014-04-10 14:05:09,673::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '10467', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '617040364547488653', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:05', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayType': 'qxl', 'cpuUser': '0.22', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.55', 'elapsedTime': '86420', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-54786::DEBUG::2014-04-10 14:05:10,152::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {} flowID [3686bf87]
>Thread-54786::INFO::2014-04-10 14:05:10,152::API::324::vds::(destroy) vmContainerLock acquired by vm e7983b62-8992-42a8-afd7-f7b815d80bbb
>Thread-54786::DEBUG::2014-04-10 14:05:10,152::vm::4533::vm.Vm::(destroy) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::destroy Called
>Thread-54786::INFO::2014-04-10 14:05:10,153::vm::4479::vm.Vm::(releaseVm) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Release VM resources
>Thread-54786::DEBUG::2014-04-10 14:05:10,161::sampling::292::vm.Vm::(stop) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Stop statistics collection
>Thread-16::DEBUG::2014-04-10 14:05:10,161::sampling::323::vm.Vm::(run) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Stats thread finished
>Thread-54786::DEBUG::2014-04-10 14:05:10,161::vmChannels::205::vds::(unregister) Delete fileno 9 from listener.
>VM Channels Listener::DEBUG::2014-04-10 14:05:10,595::vmChannels::112::vds::(_do_del_channels) fileno 9 was removed from listener.
>libvirtEventLoop::DEBUG::2014-04-10 14:05:10,596::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::event Stopped detail 1 opaque None
>Thread-54787::DEBUG::2014-04-10 14:05:10,599::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54786::WARNING::2014-04-10 14:05:10,597::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7f8d880da1d0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7f8d880da1d0>> _deviceXML:None _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7f8d880da1d0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7f8d880da1d0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7f8d880da1d0>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'username': 'Unknown', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'afterMigrationStatus': '', 'pid': '10467', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'pauseCode': 'NOERR', 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'vmName': 'vm2', 'nice': '0', 'guestFQDN': '', 'custom': {'device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6': 'VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=81c0f662-628a-46eb-a120-af0564ccf0b6, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393': 'VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6': 'VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=c1ed2d60-8ac3-4a54-a28f-130a6b1484d6, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393device_dd7e8d59-db54-4af8-8057-88de79e551e6': 'VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=dd7e8d59-db54-4af8-8057-88de79e551e6, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_c1ed2d60-8ac3-4a54-a28f-130a6b1484d6device_81c0f662-628a-46eb-a120-af0564ccf0b6device_b8e5b9c5-e5e3-4ff8-9aef-09aff71f0393device_dd7e8d59-db54-4af8-8057-88de79e551e6device_27141e9c-b22f-49a1-8250-f14f47399713': 'VmDevice {vmId=e7983b62-8992-42a8-afd7-f7b815d80bbb, deviceId=27141e9c-b22f-49a1-8250-f14f47399713, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}'}, 'vmId': 'e7983b62-8992-42a8-afd7-f7b815d80bbb', 'displayIp': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'guestIPs': '', 'smartcardEnable': 'false', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smpCoresPerSocket': '1', 'kvmEnable': 'true', 'devices': [{'device': 'unix', 'alias': 'channel0', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '1'}}, {'device': 'unix', 'alias': 'channel1', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '2'}}, {'device': 'spicevmc', 'alias': 'channel2', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '3'}}, {'specParams': {}, 'alias': u'scsi0', 'deviceId': '68a9ca55-f994-4e6f-b425-cb6bf319ecac', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': 'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': 'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'specParams': {'vram': '32768', 'heads': '1'}, 'alias': 'video0', 'deviceId': 'c54d3bdd-4ba2-4bd5-b7ea-392ec068297d', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:05', 'linkActive': True, 'network': 'rhevm', 'specParams': {}, 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'alias': u'net0', 'deviceId': 'e95f11fc-0012-4619-8a69-c2f6f0086518', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '98ecfc20-e836-480e-a07c-bb9494bda42c', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'target': 1048576, 'specParams': {'model': 'virtio'}, 'alias': 'balloon0', 'deviceId': '2491b314-5a52-4196-893f-d07d4fa06335', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'memballoon', 'type': 'balloon'}], 'status': 'Up', 'timeOffset': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7f8d880da1d0>> device:cdrom deviceId:98ecfc20-e836-480e-a07c-bb9494bda42c drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7f8d880da1d0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7f8d880da1d0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7f8d880da1d0>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7f8d880da1d0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7f8d880da1d0>> log:<logUtils.SimpleLogAdapter instance at 0x1a9cef0> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>libvirtEventLoop::INFO::2014-04-10 14:05:10,603::vm::2238::vm.Vm::(_onQemuDeath) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::underlying process disconnected
>Thread-54787::DEBUG::2014-04-10 14:05:10,604::task::579::TaskManager.Task::(_updateState) Task=`36f4e342-4e20-4b9d-b2bf-cf6c0987085e`::moving from state init -> state preparing
>Thread-54787::INFO::2014-04-10 14:05:10,604::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54786::DEBUG::2014-04-10 14:05:10,605::task::579::TaskManager.Task::(_updateState) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::moving from state init -> state preparing
>Thread-54787::INFO::2014-04-10 14:05:10,605::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54786::INFO::2014-04-10 14:05:10,605::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='e7983b62-8992-42a8-afd7-f7b815d80bbb')
>Thread-54787::DEBUG::2014-04-10 14:05:10,605::task::1168::TaskManager.Task::(prepare) Task=`36f4e342-4e20-4b9d-b2bf-cf6c0987085e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54787::DEBUG::2014-04-10 14:05:10,606::task::579::TaskManager.Task::(_updateState) Task=`36f4e342-4e20-4b9d-b2bf-cf6c0987085e`::moving from state preparing -> state finished
>Thread-54787::DEBUG::2014-04-10 14:05:10,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54787::DEBUG::2014-04-10 14:05:10,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54787::DEBUG::2014-04-10 14:05:10,606::task::974::TaskManager.Task::(_decref) Task=`36f4e342-4e20-4b9d-b2bf-cf6c0987085e`::ref 0 aborting False
>Thread-54788::DEBUG::2014-04-10 14:05:10,613::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54788::DEBUG::2014-04-10 14:05:10,613::task::579::TaskManager.Task::(_updateState) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::moving from state init -> state preparing
>Thread-54788::INFO::2014-04-10 14:05:10,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54788::DEBUG::2014-04-10 14:05:10,614::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47ebb800-2d2c-4467-9fbb-3f3648e47ce0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54788::DEBUG::2014-04-10 14:05:10,614::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54788::DEBUG::2014-04-10 14:05:10,614::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54788::DEBUG::2014-04-10 14:05:10,615::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47ebb800-2d2c-4467-9fbb-3f3648e47ce0`::Granted request
>Thread-54788::DEBUG::2014-04-10 14:05:10,615::task::811::TaskManager.Task::(resourceAcquired) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54788::DEBUG::2014-04-10 14:05:10,615::task::974::TaskManager.Task::(_decref) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::ref 1 aborting False
>Thread-54788::INFO::2014-04-10 14:05:10,617::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '137765847040', 'isoprefix': '', 'alerts': [], 'disktotal': '909621198848', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '137991880704', 'isoprefix': '', 'alerts': [], 'disktotal': '909847232512', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54788::DEBUG::2014-04-10 14:05:10,617::task::1168::TaskManager.Task::(prepare) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '137765847040', 'isoprefix': '', 'alerts': [], 'disktotal': '909621198848', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '137991880704', 'isoprefix': '', 'alerts': [], 'disktotal': '909847232512', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54788::DEBUG::2014-04-10 14:05:10,618::task::579::TaskManager.Task::(_updateState) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::moving from state preparing -> state finished
>Thread-54788::DEBUG::2014-04-10 14:05:10,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54788::DEBUG::2014-04-10 14:05:10,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54788::DEBUG::2014-04-10 14:05:10,618::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54788::DEBUG::2014-04-10 14:05:10,618::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54788::DEBUG::2014-04-10 14:05:10,619::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54788::DEBUG::2014-04-10 14:05:10,619::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54788::DEBUG::2014-04-10 14:05:10,619::task::974::TaskManager.Task::(_decref) Task=`0dcbeef0-7959-4c34-90e7-eb2746f399c7`::ref 0 aborting False
>Thread-54786::DEBUG::2014-04-10 14:05:10,621::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>Thread-54786::ERROR::2014-04-10 14:05:10,626::task::850::TaskManager.Task::(_setError) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3157, in inappropriateDevices
>    fails = supervdsm.getProxy().rmAppropriateRules(thiefId)
>  File "/usr/share/vdsm/supervdsm.py", line 55, in __call__
>    % self._funcName)
>RuntimeError: Broken communication with supervdsm. Failed call to rmAppropriateRules
>Thread-54786::DEBUG::2014-04-10 14:05:10,627::task::869::TaskManager.Task::(_run) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::Task._run: 1962f306-405d-41b6-8ef4-f4ff396d4ae0 ('e7983b62-8992-42a8-afd7-f7b815d80bbb',) {} failed - stopping task
>Thread-54786::DEBUG::2014-04-10 14:05:10,628::task::1194::TaskManager.Task::(stop) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::stopping in state preparing (force False)
>Thread-54786::DEBUG::2014-04-10 14:05:10,628::task::974::TaskManager.Task::(_decref) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::ref 1 aborting True
>Thread-54786::INFO::2014-04-10 14:05:10,628::task::1151::TaskManager.Task::(prepare) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::aborting: Task is aborted: u'Broken communication with supervdsm. Failed call to rmAppropriateRules' - code 100
>Thread-54786::DEBUG::2014-04-10 14:05:10,628::task::1156::TaskManager.Task::(prepare) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::Prepare: aborted: Broken communication with supervdsm. Failed call to rmAppropriateRules
>Thread-54786::DEBUG::2014-04-10 14:05:10,628::task::974::TaskManager.Task::(_decref) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::ref 0 aborting True
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::task::909::TaskManager.Task::(_doAbort) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::Task._doAbort: force False
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::task::579::TaskManager.Task::(_updateState) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::moving from state preparing -> state aborting
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::task::534::TaskManager.Task::(__state_aborting) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::_aborting: recover policy none
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::task::579::TaskManager.Task::(_updateState) Task=`1962f306-405d-41b6-8ef4-f4ff396d4ae0`::moving from state aborting -> state failed
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54786::DEBUG::2014-04-10 14:05:10,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54786::ERROR::2014-04-10 14:05:10,630::dispatcher::70::Storage.Dispatcher.Protect::(run) Broken communication with supervdsm. Failed call to rmAppropriateRules
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/dispatcher.py", line 62, in run
>    result = ctask.prepare(self.func, *args, **kwargs)
>  File "/usr/share/vdsm/storage/task.py", line 1159, in prepare
>    raise self.error
>RuntimeError: Broken communication with supervdsm. Failed call to rmAppropriateRules
>Thread-54786::DEBUG::2014-04-10 14:05:10,630::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-54786::DEBUG::2014-04-10 14:05:10,903::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-54786::INFO::2014-04-10 14:05:10,904::hooks::100::root::(_runHooksDir) 
>Thread-54786::DEBUG::2014-04-10 14:05:10,905::vm::4527::vm.Vm::(deleteVm) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Total desktops after destroy of e7983b62-8992-42a8-afd7-f7b815d80bbb is 1
>Thread-54786::DEBUG::2014-04-10 14:05:10,905::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>libvirtEventLoop::DEBUG::2014-04-10 14:05:10,907::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'e7983b62-8992-42a8-afd7-f7b815d80bbb'
>libvirtEventLoop::DEBUG::2014-04-10 14:05:10,908::vm::2657::vm.Vm::(setDownStatus) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Changed state to Down: Admin shut down
>libvirtEventLoop::DEBUG::2014-04-10 14:05:10,908::sampling::292::vm.Vm::(stop) vmId=`e7983b62-8992-42a8-afd7-f7b815d80bbb`::Stop statistics collection
>libvirtEventLoop::DEBUG::2014-04-10 14:05:10,909::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'e7983b62-8992-42a8-afd7-f7b815d80bbb'
>Thread-54791::DEBUG::2014-04-10 14:05:12,730::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {}
>Thread-54791::DEBUG::2014-04-10 14:05:12,731::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '15084', 'displayIp': '0', 'displayPort': u'5902', 'session': 'Unknown', 'displaySecurePort': u'5903', 'timeOffset': '0', 'hash': '-9001486259542964570', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet1': {'macAddr': '00:01:a4:a5:a5:04', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet1'}}, 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayType': 'qxl', 'cpuUser': '0.32', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.61', 'elapsedTime': '83943', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-28::DEBUG::2014-04-10 14:05:14,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:05:14,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000344408 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:05:15,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:05:15,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250594 s, 2.7 MB/s\n'; <rc> = 0
>Thread-54792::DEBUG::2014-04-10 14:05:15,779::task::579::TaskManager.Task::(_updateState) Task=`84df188d-d540-4945-91f5-6f6a2976440a`::moving from state init -> state preparing
>Thread-54792::INFO::2014-04-10 14:05:15,780::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54792::INFO::2014-04-10 14:05:15,780::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344408', 'lastCheck': '0.8', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442327', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250594', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673843', 'lastCheck': '7.4', 'valid': True}}
>Thread-54792::DEBUG::2014-04-10 14:05:15,780::task::1168::TaskManager.Task::(prepare) Task=`84df188d-d540-4945-91f5-6f6a2976440a`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344408', 'lastCheck': '0.8', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442327', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250594', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673843', 'lastCheck': '7.4', 'valid': True}}
>Thread-54792::DEBUG::2014-04-10 14:05:15,780::task::579::TaskManager.Task::(_updateState) Task=`84df188d-d540-4945-91f5-6f6a2976440a`::moving from state preparing -> state finished
>Thread-54792::DEBUG::2014-04-10 14:05:15,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54792::DEBUG::2014-04-10 14:05:15,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54792::DEBUG::2014-04-10 14:05:15,781::task::974::TaskManager.Task::(_decref) Task=`84df188d-d540-4945-91f5-6f6a2976440a`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 14:05:15,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:05:15,841::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0010737 s, 343 kB/s\n'; <rc> = 0
>Thread-54794::DEBUG::2014-04-10 14:05:16,173::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('c9ccfdfe-0f0d-4c96-8bd7-47723067081a',) {} flowID [6c1eab12]
>Thread-54794::INFO::2014-04-10 14:05:16,173::API::324::vds::(destroy) vmContainerLock acquired by vm c9ccfdfe-0f0d-4c96-8bd7-47723067081a
>Thread-54794::DEBUG::2014-04-10 14:05:16,173::vm::4533::vm.Vm::(destroy) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::destroy Called
>Thread-54794::INFO::2014-04-10 14:05:16,174::vm::4479::vm.Vm::(releaseVm) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Release VM resources
>Thread-54794::DEBUG::2014-04-10 14:05:16,185::sampling::292::vm.Vm::(stop) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Stop statistics collection
>Thread-54794::DEBUG::2014-04-10 14:05:16,186::vmChannels::205::vds::(unregister) Delete fileno 62 from listener.
>Thread-859::DEBUG::2014-04-10 14:05:16,186::sampling::323::vm.Vm::(run) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Stats thread finished
>libvirtEventLoop::DEBUG::2014-04-10 14:05:16,598::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::event Stopped detail 1 opaque None
>libvirtEventLoop::INFO::2014-04-10 14:05:16,599::vm::2238::vm.Vm::(_onQemuDeath) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::underlying process disconnected
>Thread-54794::WARNING::2014-04-10 14:05:16,598::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7f8d94096210>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7f8d94096210>> _deviceXML:<disk device="cdrom" type="file">
>      <driver name="qemu" type="raw"/>
>      <source file="/rhev/data-center/mnt/rhevm3.3-shyu.nay.redhat.com:_var_lib_exports_iso/22e307a4-41f0-4c25-8c1a-ef6aa5117e2b/images/11111111-1111-1111-1111-111111111111/rhev-tools-setup.iso" startupPolicy="optional">
>        <seclabel model="selinux" relabel="no"/>
>      </source>
>      <target bus="ide" dev="hdc"/>
>      <readonly/>
>      <serial/>
>      <boot order="2"/>
>      <alias name="ide0-1-0"/>
>      <address bus="1" controller="0" target="0" type="drive" unit="0"/>
>    </disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7f8d94096210>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7f8d94096210>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7f8d94096210>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False bootOrder:2 cache:none conf:{'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'afterMigrationStatus': '', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'pid': '15084', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5903', 'timeOffset': '0', 'cpuType': 'Conroe', 'smp': '1', 'custom': {'device_0c6bf43b-a8a5-4d74-aeaa-b122450e445c': 'VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=0c6bf43b-a8a5-4d74-aeaa-b122450e445c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5device_07bda9a0-705c-4958-a74c-71b23efde600': 'VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=07bda9a0-705c-4958-a74c-71b23efde600, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5device_07bda9a0-705c-4958-a74c-71b23efde600device_d04ac436-bc13-4e3a-a526-e3d7e21156ff': 'VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=d04ac436-bc13-4e3a-a526-e3d7e21156ff, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39device_87f9a9ab-6f66-499e-b511-54bc31d2c5e5': 'VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=87f9a9ab-6f66-499e-b511-54bc31d2c5e5, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_0c6bf43b-a8a5-4d74-aeaa-b122450e445cdevice_9ea104df-d190-4ee8-90c0-4396974f2d39': 'VmDevice {vmId=c9ccfdfe-0f0d-4c96-8bd7-47723067081a, deviceId=9ea104df-d190-4ee8-90c0-4396974f2d39, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'vmType': 'kvm', 'spiceSslCipherSuite': 'DEFAULT', 'memSize': 1024, 'vmName': 'vm3', 'nice': '0', 'vmId': 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a', 'displayIp': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5902', 'smartcardEnable': 'false', 'nicModel': 'rtl8139,pv', 'smpCoresPerSocket': '1', 'kvmEnable': 'true', 'devices': [{'device': 'unix', 'alias': 'channel0', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '1'}}, {'device': 'unix', 'alias': 'channel1', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '2'}}, {'device': 'spicevmc', 'alias': 'channel2', 'type': 'channel', 'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial', 'port': '3'}}, {'specParams': {}, 'alias': u'scsi0', 'deviceId': '9c46ac20-5b23-4460-b2cb-6290036b733e', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': 'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': 'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'specParams': {'vram': '32768', 'heads': '1'}, 'alias': 'video0', 'deviceId': '77c39801-84fa-4765-88de-e3111dd7f455', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:04', 'linkActive': True, 'network': 'rhevm', 'specParams': {}, 'bootOrder': '3', 'filter': 'vdsm-no-mac-spoofing', 'alias': u'net0', 'deviceId': '1de76dfc-35d6-47a9-8463-a8454895018d', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet1'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'specParams': {}, 'shared': 'false', 'bootOrder': u'2', 'alias': u'ide0-1-0', 'readonly': 'True', 'deviceId': '8ffcb11a-2962-43c2-a6d3-ec867ca9fb34', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device': 'cdrom', 'path': '', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'reqsize': '0', 'index': 0, 'iface': 'virtio', 'apparentsize': '10737418240', 'specParams': {}, 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372', 'readonly': 'False', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volumeInfo': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/75fbb675-c45b-4977-a046-84ac78c9c372/70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'volumeID': '70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/75fbb675-c45b-4977-a046-84ac78c9c372/70bf7589-51a3-471d-bb14-93ecaaff1e0f.lease', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372'}, 'format': 'raw', 'deviceId': '75fbb675-c45b-4977-a046-84ac78c9c372', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/75fbb675-c45b-4977-a046-84ac78c9c372/70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'bootOrder': u'1', 'volumeID': '70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'alias': u'virtio-disk0', 'volumeChain': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/75fbb675-c45b-4977-a046-84ac78c9c372/70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'volumeID': '70bf7589-51a3-471d-bb14-93ecaaff1e0f', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/75fbb675-c45b-4977-a046-84ac78c9c372/70bf7589-51a3-471d-bb14-93ecaaff1e0f.lease', 'imageID': '75fbb675-c45b-4977-a046-84ac78c9c372'}]}, {'target': 1048576, 'specParams': {'model': 'virtio'}, 'alias': 'balloon0', 'deviceId': 'e6da8d83-907a-4936-b869-23d837413138', 'address': {'slot': '0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'memballoon', 'type': 'balloon'}], 'status': 'Up', 'clientIp': '', 'display': 'qxl'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7f8d94096210>> device:cdrom deviceId:8ffcb11a-2962-43c2-a6d3-ec867ca9fb34 drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7f8d94096210>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7f8d94096210>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7f8d94096210>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7f8d94096210>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7f8d94096210>> log:<logUtils.SimpleLogAdapter instance at 0x7f8d7035ebd8> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>Thread-54794::DEBUG::2014-04-10 14:05:16,601::task::579::TaskManager.Task::(_updateState) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::moving from state init -> state preparing
>Thread-54794::INFO::2014-04-10 14:05:16,602::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', volUUID=None)
>Thread-54794::DEBUG::2014-04-10 14:05:16,602::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`d789ab01-6e2f-4b1d-85c9-797bc1fc4a5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage'
>Thread-54794::DEBUG::2014-04-10 14:05:16,602::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-54794::DEBUG::2014-04-10 14:05:16,603::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-54794::DEBUG::2014-04-10 14:05:16,603::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`d789ab01-6e2f-4b1d-85c9-797bc1fc4a5e`::Granted request
>Thread-54794::DEBUG::2014-04-10 14:05:16,603::task::811::TaskManager.Task::(resourceAcquired) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-54794::DEBUG::2014-04-10 14:05:16,603::task::974::TaskManager.Task::(_decref) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::ref 1 aborting False
>Thread-54794::INFO::2014-04-10 14:05:16,604::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None
>Thread-54794::DEBUG::2014-04-10 14:05:16,604::task::1168::TaskManager.Task::(prepare) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::finished: None
>Thread-54794::DEBUG::2014-04-10 14:05:16,604::task::579::TaskManager.Task::(_updateState) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::moving from state preparing -> state finished
>Thread-54794::DEBUG::2014-04-10 14:05:16,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>Thread-54794::DEBUG::2014-04-10 14:05:16,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54794::DEBUG::2014-04-10 14:05:16,605::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-54794::DEBUG::2014-04-10 14:05:16,605::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-54794::DEBUG::2014-04-10 14:05:16,605::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-54794::DEBUG::2014-04-10 14:05:16,605::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-54794::DEBUG::2014-04-10 14:05:16,605::task::974::TaskManager.Task::(_decref) Task=`839b7790-2608-46dc-b4e6-243b30ae6ee6`::ref 0 aborting False
>Thread-54794::DEBUG::2014-04-10 14:05:16,606::task::579::TaskManager.Task::(_updateState) Task=`2c671e85-cd79-494c-a7dc-e8bbd550b1ef`::moving from state init -> state preparing
>Thread-54794::INFO::2014-04-10 14:05:16,606::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='c9ccfdfe-0f0d-4c96-8bd7-47723067081a')
>VM Channels Listener::DEBUG::2014-04-10 14:05:16,610::vmChannels::112::vds::(_do_del_channels) fileno 62 was removed from listener.
>Thread-54794::INFO::2014-04-10 14:05:16,610::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None
>Thread-54794::DEBUG::2014-04-10 14:05:16,611::task::1168::TaskManager.Task::(prepare) Task=`2c671e85-cd79-494c-a7dc-e8bbd550b1ef`::finished: None
>Thread-54794::DEBUG::2014-04-10 14:05:16,611::task::579::TaskManager.Task::(_updateState) Task=`2c671e85-cd79-494c-a7dc-e8bbd550b1ef`::moving from state preparing -> state finished
>Thread-54794::DEBUG::2014-04-10 14:05:16,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54794::DEBUG::2014-04-10 14:05:16,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54794::DEBUG::2014-04-10 14:05:16,611::task::974::TaskManager.Task::(_decref) Task=`2c671e85-cd79-494c-a7dc-e8bbd550b1ef`::ref 0 aborting False
>Thread-54794::DEBUG::2014-04-10 14:05:16,612::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-54794::DEBUG::2014-04-10 14:05:16,850::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-54794::INFO::2014-04-10 14:05:16,867::hooks::100::root::(_runHooksDir) 
>Thread-54794::DEBUG::2014-04-10 14:05:16,868::vm::4527::vm.Vm::(deleteVm) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Total desktops after destroy of c9ccfdfe-0f0d-4c96-8bd7-47723067081a is 0
>Thread-54794::DEBUG::2014-04-10 14:05:16,868::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>libvirtEventLoop::DEBUG::2014-04-10 14:05:16,870::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a'
>libvirtEventLoop::DEBUG::2014-04-10 14:05:16,870::vm::2657::vm.Vm::(setDownStatus) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Changed state to Down: Admin shut down
>libvirtEventLoop::DEBUG::2014-04-10 14:05:16,870::sampling::292::vm.Vm::(stop) vmId=`c9ccfdfe-0f0d-4c96-8bd7-47723067081a`::Stop statistics collection
>libvirtEventLoop::DEBUG::2014-04-10 14:05:16,871::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'c9ccfdfe-0f0d-4c96-8bd7-47723067081a'
>Thread-38::DEBUG::2014-04-10 14:05:18,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:05:18,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000532804 s, 691 kB/s\n'; <rc> = 0
>Thread-54797::DEBUG::2014-04-10 14:05:20,699::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-54797::DEBUG::2014-04-10 14:05:20,700::task::579::TaskManager.Task::(_updateState) Task=`d11d5749-931f-461e-aeb8-487c41b8fd3a`::moving from state init -> state preparing
>Thread-54797::INFO::2014-04-10 14:05:20,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54797::INFO::2014-04-10 14:05:20,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54797::DEBUG::2014-04-10 14:05:20,701::task::1168::TaskManager.Task::(prepare) Task=`d11d5749-931f-461e-aeb8-487c41b8fd3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54797::DEBUG::2014-04-10 14:05:20,701::task::579::TaskManager.Task::(_updateState) Task=`d11d5749-931f-461e-aeb8-487c41b8fd3a`::moving from state preparing -> state finished
>Thread-54797::DEBUG::2014-04-10 14:05:20,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54797::DEBUG::2014-04-10 14:05:20,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54797::DEBUG::2014-04-10 14:05:20,701::task::974::TaskManager.Task::(_decref) Task=`d11d5749-931f-461e-aeb8-487c41b8fd3a`::ref 0 aborting False
>Thread-54798::DEBUG::2014-04-10 14:05:20,708::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-54798::DEBUG::2014-04-10 14:05:20,708::task::579::TaskManager.Task::(_updateState) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::moving from state init -> state preparing
>Thread-54798::INFO::2014-04-10 14:05:20,708::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54798::DEBUG::2014-04-10 14:05:20,709::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e62e7a5f-7d7d-4e26-a47c-cf519a03db2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54798::DEBUG::2014-04-10 14:05:20,709::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54798::DEBUG::2014-04-10 14:05:20,709::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54798::DEBUG::2014-04-10 14:05:20,709::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e62e7a5f-7d7d-4e26-a47c-cf519a03db2c`::Granted request
>Thread-54798::DEBUG::2014-04-10 14:05:20,710::task::811::TaskManager.Task::(resourceAcquired) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54798::DEBUG::2014-04-10 14:05:20,710::task::974::TaskManager.Task::(_decref) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::ref 1 aborting False
>Thread-54798::INFO::2014-04-10 14:05:20,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093606400', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093606400', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54798::DEBUG::2014-04-10 14:05:20,712::task::1168::TaskManager.Task::(prepare) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093606400', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093606400', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54798::DEBUG::2014-04-10 14:05:20,712::task::579::TaskManager.Task::(_updateState) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::moving from state preparing -> state finished
>Thread-54798::DEBUG::2014-04-10 14:05:20,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54798::DEBUG::2014-04-10 14:05:20,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54798::DEBUG::2014-04-10 14:05:20,712::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54798::DEBUG::2014-04-10 14:05:20,713::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54798::DEBUG::2014-04-10 14:05:20,713::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54798::DEBUG::2014-04-10 14:05:20,713::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54798::DEBUG::2014-04-10 14:05:20,713::task::974::TaskManager.Task::(_decref) Task=`37ae82b7-6b1a-435e-bca5-c8b9efc04d72`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:05:24,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:05:24,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000276309 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:05:25,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:05:25,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288901 s, 2.3 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:05:25,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:05:25,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000424655 s, 867 kB/s\n'; <rc> = 0
>Thread-54801::DEBUG::2014-04-10 14:05:26,937::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [5e0066ad]
>Thread-54801::DEBUG::2014-04-10 14:05:26,938::task::579::TaskManager.Task::(_updateState) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::moving from state init -> state preparing
>Thread-54801::INFO::2014-04-10 14:05:26,938::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='75fbb675-c45b-4977-a046-84ac78c9c372', postZero='false', force='false')
>Thread-54801::DEBUG::2014-04-10 14:05:26,939::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.75fbb675-c45b-4977-a046-84ac78c9c372`ReqID=`3b8d3b40-853b-4d37-ad25-33f4ff9c7d14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage'
>Thread-54801::DEBUG::2014-04-10 14:05:26,939::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372' for lock type 'exclusive'
>Thread-54801::DEBUG::2014-04-10 14:05:26,939::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372' is free. Now locking as 'exclusive' (1 active user)
>Thread-54801::DEBUG::2014-04-10 14:05:26,940::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.75fbb675-c45b-4977-a046-84ac78c9c372`ReqID=`3b8d3b40-853b-4d37-ad25-33f4ff9c7d14`::Granted request
>Thread-54801::DEBUG::2014-04-10 14:05:26,940::task::811::TaskManager.Task::(resourceAcquired) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_resourcesAcquired: Storage.75fbb675-c45b-4977-a046-84ac78c9c372 (exclusive)
>Thread-54801::DEBUG::2014-04-10 14:05:26,940::task::974::TaskManager.Task::(_decref) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::ref 1 aborting False
>Thread-54801::DEBUG::2014-04-10 14:05:26,940::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`61635623-6e17-42b4-8b9b-0cd89a4c922b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage'
>Thread-54801::DEBUG::2014-04-10 14:05:26,941::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-54801::DEBUG::2014-04-10 14:05:26,941::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-54801::DEBUG::2014-04-10 14:05:26,941::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`61635623-6e17-42b4-8b9b-0cd89a4c922b`::Granted request
>Thread-54801::DEBUG::2014-04-10 14:05:26,941::task::811::TaskManager.Task::(resourceAcquired) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-54801::DEBUG::2014-04-10 14:05:26,942::task::974::TaskManager.Task::(_decref) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::ref 1 aborting False
>Thread-54801::DEBUG::2014-04-10 14:05:26,953::task::736::TaskManager.Task::(_save) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632.temp
>Thread-54801::DEBUG::2014-04-10 14:05:26,961::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_75fbb675-c45b-4977-a046-84ac78c9c372 for task 5015ff27-cde8-47bb-bc6c-6f061851e632 
>Thread-54801::INFO::2014-04-10 14:05:26,961::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
>Thread-54801::DEBUG::2014-04-10 14:05:26,962::task::1163::TaskManager.Task::(prepare) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::Prepare: 1 jobs exist, move to acquiring
>Thread-54801::DEBUG::2014-04-10 14:05:26,962::task::579::TaskManager.Task::(_updateState) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::moving from state preparing -> state acquiring
>Thread-54801::DEBUG::2014-04-10 14:05:26,962::task::736::TaskManager.Task::(_save) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632.temp
>Thread-54801::DEBUG::2014-04-10 14:05:26,971::task::579::TaskManager.Task::(_updateState) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::moving from state acquiring -> state queued
>Thread-54801::DEBUG::2014-04-10 14:05:26,971::task::736::TaskManager.Task::(_save) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632.temp
>Thread-54801::DEBUG::2014-04-10 14:05:26,980::taskManager::50::TaskManager::(_queueTask) queuing task: 5015ff27-cde8-47bb-bc6c-6f061851e632
>Thread-54801::DEBUG::2014-04-10 14:05:26,981::taskManager::56::TaskManager::(_queueTask) task queued: 5015ff27-cde8-47bb-bc6c-6f061851e632
>Thread-4::DEBUG::2014-04-10 14:05:26,981::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-54801::DEBUG::2014-04-10 14:05:26,982::task::1165::TaskManager.Task::(prepare) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::returning
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,982::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 5015ff27-cde8-47bb-bc6c-6f061851e632 running: <bound method Task.commit of <storage.task.Task instance at 0x7f8d702b1d40>> with: None
>Thread-54801::DEBUG::2014-04-10 14:05:26,983::task::974::TaskManager.Task::(_decref) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::ref 0 aborting False
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,983::task::1176::TaskManager.Task::(commit) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::committing task: 5015ff27-cde8-47bb-bc6c-6f061851e632
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,984::task::579::TaskManager.Task::(_updateState) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::moving from state queued -> state running
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,986::task::736::TaskManager.Task::(_save) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632.temp
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,996::task::889::TaskManager.Task::(_runJobs) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::Task.run: running job 0: deleteImage_75fbb675-c45b-4977-a046-84ac78c9c372: <function <lambda> at 0x7f8d300c2668> (args: () kwargs: {})
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,996::task::315::TaskManager.Task::(run) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::Job.run: running deleteImage_75fbb675-c45b-4977-a046-84ac78c9c372: <function <lambda> at 0x7f8d300c2668> (args: () kwargs: {}) callback None
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,996::task::579::TaskManager.Task::(_updateState) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::moving from state running -> state finished
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:26,997::task::736::TaskManager.Task::(_save) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/5015ff27-cde8-47bb-bc6c-6f061851e632.temp
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.75fbb675-c45b-4977-a046-84ac78c9c372': < ResourceRef 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372', isValid: 'True' obj: 'None'>, 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,008::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372'
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,009::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372' (0 active users)
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,009::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372' is free, finding out if anyone is waiting for it.
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,009::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.75fbb675-c45b-4977-a046-84ac78c9c372', Clearing records.
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,009::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,009::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,010::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,010::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,010::task::897::TaskManager.Task::(_runJobs) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::Task.run: exit - success: result True
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,010::task::974::TaskManager.Task::(_decref) Task=`5015ff27-cde8-47bb-bc6c-6f061851e632`::ref 0 aborting False
>5015ff27-cde8-47bb-bc6c-6f061851e632::DEBUG::2014-04-10 14:05:27,010::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-38::DEBUG::2014-04-10 14:05:28,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:05:28,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000398527 s, 923 kB/s\n'; <rc> = 0
>Thread-54803::DEBUG::2014-04-10 14:05:30,840::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54803::DEBUG::2014-04-10 14:05:30,840::task::579::TaskManager.Task::(_updateState) Task=`7654b924-3b9a-494d-97e3-c3d546b8b1d7`::moving from state init -> state preparing
>Thread-54803::INFO::2014-04-10 14:05:30,841::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54803::INFO::2014-04-10 14:05:30,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54803::DEBUG::2014-04-10 14:05:30,841::task::1168::TaskManager.Task::(prepare) Task=`7654b924-3b9a-494d-97e3-c3d546b8b1d7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54803::DEBUG::2014-04-10 14:05:30,841::task::579::TaskManager.Task::(_updateState) Task=`7654b924-3b9a-494d-97e3-c3d546b8b1d7`::moving from state preparing -> state finished
>Thread-54803::DEBUG::2014-04-10 14:05:30,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54803::DEBUG::2014-04-10 14:05:30,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54803::DEBUG::2014-04-10 14:05:30,842::task::974::TaskManager.Task::(_decref) Task=`7654b924-3b9a-494d-97e3-c3d546b8b1d7`::ref 0 aborting False
>Thread-54804::DEBUG::2014-04-10 14:05:30,848::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54804::DEBUG::2014-04-10 14:05:30,849::task::579::TaskManager.Task::(_updateState) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::moving from state init -> state preparing
>Thread-54804::INFO::2014-04-10 14:05:30,849::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54804::DEBUG::2014-04-10 14:05:30,850::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4d4bde83-d531-4284-af10-98330a56e836`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54804::DEBUG::2014-04-10 14:05:30,850::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54804::DEBUG::2014-04-10 14:05:30,850::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54804::DEBUG::2014-04-10 14:05:30,850::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4d4bde83-d531-4284-af10-98330a56e836`::Granted request
>Thread-54804::DEBUG::2014-04-10 14:05:30,850::task::811::TaskManager.Task::(resourceAcquired) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54804::DEBUG::2014-04-10 14:05:30,851::task::974::TaskManager.Task::(_decref) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::ref 1 aborting False
>Thread-54804::INFO::2014-04-10 14:05:30,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54804::DEBUG::2014-04-10 14:05:30,853::task::1168::TaskManager.Task::(prepare) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54804::DEBUG::2014-04-10 14:05:30,853::task::579::TaskManager.Task::(_updateState) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::moving from state preparing -> state finished
>Thread-54804::DEBUG::2014-04-10 14:05:30,853::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54804::DEBUG::2014-04-10 14:05:30,853::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54804::DEBUG::2014-04-10 14:05:30,853::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54804::DEBUG::2014-04-10 14:05:30,854::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54804::DEBUG::2014-04-10 14:05:30,854::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54804::DEBUG::2014-04-10 14:05:30,854::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54804::DEBUG::2014-04-10 14:05:30,854::task::974::TaskManager.Task::(_decref) Task=`a88b81aa-f766-4308-ae40-0dccb6199a63`::ref 0 aborting False
>Thread-54805::DEBUG::2014-04-10 14:05:31,247::task::579::TaskManager.Task::(_updateState) Task=`1184b424-e4a2-4f03-bb73-720237e617e0`::moving from state init -> state preparing
>Thread-54805::INFO::2014-04-10 14:05:31,247::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54805::INFO::2014-04-10 14:05:31,248::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276309', 'lastCheck': '6.3', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424655', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288901', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398527', 'lastCheck': '2.9', 'valid': True}}
>Thread-54805::DEBUG::2014-04-10 14:05:31,248::task::1168::TaskManager.Task::(prepare) Task=`1184b424-e4a2-4f03-bb73-720237e617e0`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276309', 'lastCheck': '6.3', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424655', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288901', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398527', 'lastCheck': '2.9', 'valid': True}}
>Thread-54805::DEBUG::2014-04-10 14:05:31,248::task::579::TaskManager.Task::(_updateState) Task=`1184b424-e4a2-4f03-bb73-720237e617e0`::moving from state preparing -> state finished
>Thread-54805::DEBUG::2014-04-10 14:05:31,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54805::DEBUG::2014-04-10 14:05:31,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54805::DEBUG::2014-04-10 14:05:31,248::task::974::TaskManager.Task::(_decref) Task=`1184b424-e4a2-4f03-bb73-720237e617e0`::ref 0 aborting False
>Thread-54807::DEBUG::2014-04-10 14:05:31,829::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54807::DEBUG::2014-04-10 14:05:31,829::task::579::TaskManager.Task::(_updateState) Task=`189beadd-e321-4c63-a79a-b8fa1b4f8d04`::moving from state init -> state preparing
>Thread-54807::INFO::2014-04-10 14:05:31,830::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-54807::DEBUG::2014-04-10 14:05:31,830::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-54807::DEBUG::2014-04-10 14:05:31,830::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 5015ff27-cde8-47bb-bc6c-6f061851e632
>Thread-54807::DEBUG::2014-04-10 14:05:31,830::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5015ff27-cde8-47bb-bc6c-6f061851e632'}
>Thread-54807::DEBUG::2014-04-10 14:05:31,830::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'5015ff27-cde8-47bb-bc6c-6f061851e632': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5015ff27-cde8-47bb-bc6c-6f061851e632'}}
>Thread-54807::INFO::2014-04-10 14:05:31,831::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'5015ff27-cde8-47bb-bc6c-6f061851e632': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5015ff27-cde8-47bb-bc6c-6f061851e632'}}}
>Thread-54807::DEBUG::2014-04-10 14:05:31,831::task::1168::TaskManager.Task::(prepare) Task=`189beadd-e321-4c63-a79a-b8fa1b4f8d04`::finished: {'allTasksStatus': {'5015ff27-cde8-47bb-bc6c-6f061851e632': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5015ff27-cde8-47bb-bc6c-6f061851e632'}}}
>Thread-54807::DEBUG::2014-04-10 14:05:31,831::task::579::TaskManager.Task::(_updateState) Task=`189beadd-e321-4c63-a79a-b8fa1b4f8d04`::moving from state preparing -> state finished
>Thread-54807::DEBUG::2014-04-10 14:05:31,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54807::DEBUG::2014-04-10 14:05:31,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54807::DEBUG::2014-04-10 14:05:31,831::task::974::TaskManager.Task::(_decref) Task=`189beadd-e321-4c63-a79a-b8fa1b4f8d04`::ref 0 aborting False
>Thread-54808::DEBUG::2014-04-10 14:05:31,884::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54808::DEBUG::2014-04-10 14:05:31,884::task::579::TaskManager.Task::(_updateState) Task=`c0d35eb2-f67c-4f07-b95c-3d3ae50403fd`::moving from state init -> state preparing
>Thread-54808::INFO::2014-04-10 14:05:31,885::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='5015ff27-cde8-47bb-bc6c-6f061851e632', spUUID=None, options=None)
>Thread-54808::DEBUG::2014-04-10 14:05:31,885::taskManager::161::TaskManager::(clearTask) Entry. taskID: 5015ff27-cde8-47bb-bc6c-6f061851e632
>Thread-54808::DEBUG::2014-04-10 14:05:31,888::taskManager::166::TaskManager::(clearTask) Return.
>Thread-54808::INFO::2014-04-10 14:05:31,889::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-54808::DEBUG::2014-04-10 14:05:31,889::task::1168::TaskManager.Task::(prepare) Task=`c0d35eb2-f67c-4f07-b95c-3d3ae50403fd`::finished: None
>Thread-54808::DEBUG::2014-04-10 14:05:31,889::task::579::TaskManager.Task::(_updateState) Task=`c0d35eb2-f67c-4f07-b95c-3d3ae50403fd`::moving from state preparing -> state finished
>Thread-54808::DEBUG::2014-04-10 14:05:31,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54808::DEBUG::2014-04-10 14:05:31,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54808::DEBUG::2014-04-10 14:05:31,890::task::974::TaskManager.Task::(_decref) Task=`c0d35eb2-f67c-4f07-b95c-3d3ae50403fd`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 14:05:34,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 14:05:34,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000332923 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:05:35,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:05:35,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310884 s, 2.2 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:05:35,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:05:35,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000506794 s, 726 kB/s\n'; <rc> = 0
>Thread-38::DEBUG::2014-04-10 14:05:38,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:05:38,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000530395 s, 694 kB/s\n'; <rc> = 0
>Thread-54812::DEBUG::2014-04-10 14:05:41,002::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-54812::DEBUG::2014-04-10 14:05:41,003::task::579::TaskManager.Task::(_updateState) Task=`606bd49f-49e0-4437-a6b2-634ae183f354`::moving from state init -> state preparing
>Thread-54812::INFO::2014-04-10 14:05:41,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54812::INFO::2014-04-10 14:05:41,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54812::DEBUG::2014-04-10 14:05:41,004::task::1168::TaskManager.Task::(prepare) Task=`606bd49f-49e0-4437-a6b2-634ae183f354`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-54812::DEBUG::2014-04-10 14:05:41,004::task::579::TaskManager.Task::(_updateState) Task=`606bd49f-49e0-4437-a6b2-634ae183f354`::moving from state preparing -> state finished
>Thread-54812::DEBUG::2014-04-10 14:05:41,004::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54812::DEBUG::2014-04-10 14:05:41,004::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54812::DEBUG::2014-04-10 14:05:41,004::task::974::TaskManager.Task::(_decref) Task=`606bd49f-49e0-4437-a6b2-634ae183f354`::ref 0 aborting False
>Thread-54813::DEBUG::2014-04-10 14:05:41,011::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-54813::DEBUG::2014-04-10 14:05:41,011::task::579::TaskManager.Task::(_updateState) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::moving from state init -> state preparing
>Thread-54813::INFO::2014-04-10 14:05:41,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54813::DEBUG::2014-04-10 14:05:41,012::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1046cfac-97e6-4843-9e06-540f613c924c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-54813::DEBUG::2014-04-10 14:05:41,012::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-54813::DEBUG::2014-04-10 14:05:41,012::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-54813::DEBUG::2014-04-10 14:05:41,012::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1046cfac-97e6-4843-9e06-540f613c924c`::Granted request
>Thread-54813::DEBUG::2014-04-10 14:05:41,013::task::811::TaskManager.Task::(resourceAcquired) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-54813::DEBUG::2014-04-10 14:05:41,013::task::974::TaskManager.Task::(_decref) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::ref 1 aborting False
>Thread-54813::INFO::2014-04-10 14:05:41,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54813::DEBUG::2014-04-10 14:05:41,015::task::1168::TaskManager.Task::(prepare) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::finished: {'info': {'spm_id': 1, 'master_uuid': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 1, 'lver': 1}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139093671936', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-54813::DEBUG::2014-04-10 14:05:41,015::task::579::TaskManager.Task::(_updateState) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::moving from state preparing -> state finished
>Thread-54813::DEBUG::2014-04-10 14:05:41,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54813::DEBUG::2014-04-10 14:05:41,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54813::DEBUG::2014-04-10 14:05:41,016::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54813::DEBUG::2014-04-10 14:05:41,016::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54813::DEBUG::2014-04-10 14:05:41,016::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54813::DEBUG::2014-04-10 14:05:41,016::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54813::DEBUG::2014-04-10 14:05:41,016::task::974::TaskManager.Task::(_decref) Task=`f4b16e69-1615-4ee7-8b2f-62bb1178e1fa`::ref 0 aborting False
>Thread-54814::DEBUG::2014-04-10 14:05:43,169::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [249ab6d3]
>Thread-54814::DEBUG::2014-04-10 14:05:43,170::task::579::TaskManager.Task::(_updateState) Task=`a7f553bd-cbc2-4b14-a0de-bb5d016a8e25`::moving from state init -> state preparing
>Thread-54814::INFO::2014-04-10 14:05:43,170::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-54814::DEBUG::2014-04-10 14:05:43,171::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-54814::DEBUG::2014-04-10 14:05:43,171::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {}
>Thread-54814::INFO::2014-04-10 14:05:43,171::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}}
>Thread-54814::DEBUG::2014-04-10 14:05:43,171::task::1168::TaskManager.Task::(prepare) Task=`a7f553bd-cbc2-4b14-a0de-bb5d016a8e25`::finished: {'allTasksStatus': {}}
>Thread-54814::DEBUG::2014-04-10 14:05:43,171::task::579::TaskManager.Task::(_updateState) Task=`a7f553bd-cbc2-4b14-a0de-bb5d016a8e25`::moving from state preparing -> state finished
>Thread-54814::DEBUG::2014-04-10 14:05:43,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54814::DEBUG::2014-04-10 14:05:43,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54814::DEBUG::2014-04-10 14:05:43,172::task::974::TaskManager.Task::(_decref) Task=`a7f553bd-cbc2-4b14-a0de-bb5d016a8e25`::ref 0 aborting False
>Thread-54815::DEBUG::2014-04-10 14:05:43,179::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [249ab6d3]
>Thread-54815::DEBUG::2014-04-10 14:05:43,180::task::579::TaskManager.Task::(_updateState) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::moving from state init -> state preparing
>Thread-54815::INFO::2014-04-10 14:05:43,180::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-54815::DEBUG::2014-04-10 14:05:43,180::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18e50d30-d56b-4a99-ae77-5a94e90d7962`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '615' at 'spmStop'
>Thread-54815::DEBUG::2014-04-10 14:05:43,180::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-54815::DEBUG::2014-04-10 14:05:43,181::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-54815::DEBUG::2014-04-10 14:05:43,181::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18e50d30-d56b-4a99-ae77-5a94e90d7962`::Granted request
>Thread-54815::DEBUG::2014-04-10 14:05:43,181::task::811::TaskManager.Task::(resourceAcquired) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-54815::DEBUG::2014-04-10 14:05:43,181::task::974::TaskManager.Task::(_decref) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::ref 1 aborting False
>Thread-54815::DEBUG::2014-04-10 14:05:43,182::sp::343::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process
>Thread-54815::DEBUG::2014-04-10 14:05:43,182::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24bae7bb-05b1-4fb9-96f4-712cfe5c7047`::Request was made in '/usr/share/vdsm/storage/sp.py' line '345' at '_shutDownUpgrade'
>Thread-54815::DEBUG::2014-04-10 14:05:43,182::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-54815::DEBUG::2014-04-10 14:05:43,182::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-54815::DEBUG::2014-04-10 14:05:43,183::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24bae7bb-05b1-4fb9-96f4-712cfe5c7047`::Granted request
>Thread-54815::DEBUG::2014-04-10 14:05:43,183::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54815::DEBUG::2014-04-10 14:05:43,183::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54815::DEBUG::2014-04-10 14:05:43,183::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54815::DEBUG::2014-04-10 14:05:43,183::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54815::DEBUG::2014-04-10 14:05:43,184::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-54815::DEBUG::2014-04-10 14:05:43,184::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-54815::DEBUG::2014-04-10 14:05:43,184::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1c61a8afba50351e1e845af7b5c80d41e61b6b4a']
>Thread-54815::DEBUG::2014-04-10 14:05:43,218::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-54815::INFO::2014-04-10 14:05:43,218::clusterlock::255::SANLock::(release) Releasing cluster lock for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-54815::DEBUG::2014-04-10 14:05:43,242::clusterlock::266::SANLock::(release) Cluster lock for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 successfully released
>Thread-54815::INFO::2014-04-10 14:05:43,242::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None
>Thread-54815::DEBUG::2014-04-10 14:05:43,242::task::1168::TaskManager.Task::(prepare) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::finished: None
>Thread-54815::DEBUG::2014-04-10 14:05:43,242::task::579::TaskManager.Task::(_updateState) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::moving from state preparing -> state finished
>Thread-54815::DEBUG::2014-04-10 14:05:43,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54815::DEBUG::2014-04-10 14:05:43,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54815::DEBUG::2014-04-10 14:05:43,243::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54815::DEBUG::2014-04-10 14:05:43,243::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54815::DEBUG::2014-04-10 14:05:43,243::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54815::DEBUG::2014-04-10 14:05:43,244::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54815::DEBUG::2014-04-10 14:05:43,244::task::974::TaskManager.Task::(_decref) Task=`e5200907-6e8e-49f3-966d-4af94bb12b74`::ref 0 aborting False
>Thread-54816::DEBUG::2014-04-10 14:05:43,745::task::579::TaskManager.Task::(_updateState) Task=`6b7f5374-e349-4bc5-88b0-7e2f4a8d4d36`::moving from state init -> state preparing
>Thread-54816::INFO::2014-04-10 14:05:43,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-54816::INFO::2014-04-10 14:05:43,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332923', 'lastCheck': '8.8', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506794', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310884', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530395', 'lastCheck': '5.3', 'valid': True}}
>Thread-54816::DEBUG::2014-04-10 14:05:43,746::task::1168::TaskManager.Task::(prepare) Task=`6b7f5374-e349-4bc5-88b0-7e2f4a8d4d36`::finished: {'55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332923', 'lastCheck': '8.8', 'valid': True}, 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506794', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310884', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530395', 'lastCheck': '5.3', 'valid': True}}
>Thread-54816::DEBUG::2014-04-10 14:05:43,746::task::579::TaskManager.Task::(_updateState) Task=`6b7f5374-e349-4bc5-88b0-7e2f4a8d4d36`::moving from state preparing -> state finished
>Thread-54816::DEBUG::2014-04-10 14:05:43,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54816::DEBUG::2014-04-10 14:05:43,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54816::DEBUG::2014-04-10 14:05:43,747::task::974::TaskManager.Task::(_decref) Task=`6b7f5374-e349-4bc5-88b0-7e2f4a8d4d36`::ref 0 aborting False
>Thread-54818::DEBUG::2014-04-10 14:05:43,831::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-54818::DEBUG::2014-04-10 14:05:43,831::task::579::TaskManager.Task::(_updateState) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::moving from state init -> state preparing
>Thread-54818::INFO::2014-04-10 14:05:43,831::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=1, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-54818::DEBUG::2014-04-10 14:05:43,832::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb29859c-1f9d-446e-be1b-c08483fb052e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1111' at 'disconnectStoragePool'
>Thread-54818::DEBUG::2014-04-10 14:05:43,832::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-54818::DEBUG::2014-04-10 14:05:43,832::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-54818::DEBUG::2014-04-10 14:05:43,832::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb29859c-1f9d-446e-be1b-c08483fb052e`::Granted request
>Thread-54818::DEBUG::2014-04-10 14:05:43,833::task::811::TaskManager.Task::(resourceAcquired) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-54818::DEBUG::2014-04-10 14:05:43,833::task::974::TaskManager.Task::(_decref) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::ref 1 aborting False
>Thread-54818::DEBUG::2014-04-10 14:05:43,833::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`26c46207-b74c-4f71-a0e9-9ff8b6001084`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1119' at '_disconnectPool'
>Thread-54818::DEBUG::2014-04-10 14:05:43,833::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-54818::DEBUG::2014-04-10 14:05:43,834::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-54818::DEBUG::2014-04-10 14:05:43,834::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`26c46207-b74c-4f71-a0e9-9ff8b6001084`::Granted request
>Thread-54818::INFO::2014-04-10 14:05:43,834::sp::711::Storage.StoragePool::(disconnect) Disconnect from the storage pool f721168f-5edd-4f5f-8976-591eb93f960e
>Thread-54818::INFO::2014-04-10 14:05:43,876::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-28::DEBUG::2014-04-10 14:05:43,876::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-28::INFO::2014-04-10 14:05:43,877::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 1)
>Thread-33::DEBUG::2014-04-10 14:05:45,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 14:05:45,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n672 bytes (672 B) copied, 0.000321877 s, 2.1 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 14:05:45,878::clusterlock::207::SANLock::(releaseHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f released successfully (id: 1)
>Thread-54818::INFO::2014-04-10 14:05:45,881::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-27::DEBUG::2014-04-10 14:05:45,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 14:05:45,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043429 s, 847 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 14:05:45,898::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-27::INFO::2014-04-10 14:05:45,899::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 1)
>Thread-27::DEBUG::2014-04-10 14:05:47,899::clusterlock::207::SANLock::(releaseHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 released successfully (id: 1)
>Thread-54818::INFO::2014-04-10 14:05:47,900::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 14:05:47,900::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::INFO::2014-04-10 14:05:47,900::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 1)
>Thread-38::DEBUG::2014-04-10 14:05:48,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-38::DEBUG::2014-04-10 14:05:48,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000441009 s, 834 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 14:05:50,901::clusterlock::207::SANLock::(releaseHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 released successfully (id: 1)
>Thread-54818::INFO::2014-04-10 14:05:50,902::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-38::DEBUG::2014-04-10 14:05:50,917::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-38::INFO::2014-04-10 14:05:50,918::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 (id: 1)
>Thread-38::DEBUG::2014-04-10 14:05:52,918::clusterlock::207::SANLock::(releaseHostId) Host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 released successfully (id: 1)
>Thread-54818::DEBUG::2014-04-10 14:05:52,919::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-54818::DEBUG::2014-04-10 14:05:52,919::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-54818::DEBUG::2014-04-10 14:05:52,920::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-54818::DEBUG::2014-04-10 14:05:52,920::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-54818::INFO::2014-04-10 14:05:52,920::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True
>Thread-54818::DEBUG::2014-04-10 14:05:52,920::task::1168::TaskManager.Task::(prepare) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::finished: True
>Thread-54818::DEBUG::2014-04-10 14:05:52,921::task::579::TaskManager.Task::(_updateState) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::moving from state preparing -> state finished
>Thread-54818::DEBUG::2014-04-10 14:05:52,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-54818::DEBUG::2014-04-10 14:05:52,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54818::DEBUG::2014-04-10 14:05:52,921::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-54818::DEBUG::2014-04-10 14:05:52,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-54818::DEBUG::2014-04-10 14:05:52,922::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-54818::DEBUG::2014-04-10 14:05:52,922::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-54818::DEBUG::2014-04-10 14:05:52,922::task::974::TaskManager.Task::(_decref) Task=`ab8016d8-bcae-4392-9ecf-4cca836b14f5`::ref 0 aborting False
>Thread-54819::DEBUG::2014-04-10 14:05:53,377::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [12be6d12]
>Thread-54819::DEBUG::2014-04-10 14:05:53,378::task::579::TaskManager.Task::(_updateState) Task=`83732f8e-317a-4aa4-9079-e9fece663029`::moving from state init -> state preparing
>Thread-54819::INFO::2014-04-10 14:05:53,378::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}, {'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,379::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,419::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,457::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,477::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,509::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-54819::DEBUG::2014-04-10 14:05:53,510::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-54819::DEBUG::2014-04-10 14:05:53,510::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-54819::DEBUG::2014-04-10 14:05:53,510::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-54819::DEBUG::2014-04-10 14:05:53,510::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:53,522::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-54819::DEBUG::2014-04-10 14:05:53,528::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-54819::DEBUG::2014-04-10 14:05:59,572::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-54819::DEBUG::2014-04-10 14:05:59,648::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-54819::DEBUG::2014-04-10 14:05:59,648::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,648::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,649::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,649::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,649::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,649::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-54819::DEBUG::2014-04-10 14:05:59,650::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-54819::INFO::2014-04-10 14:05:59,650::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-54819::DEBUG::2014-04-10 14:05:59,650::task::1168::TaskManager.Task::(prepare) Task=`83732f8e-317a-4aa4-9079-e9fece663029`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-54819::DEBUG::2014-04-10 14:05:59,650::task::579::TaskManager.Task::(_updateState) Task=`83732f8e-317a-4aa4-9079-e9fece663029`::moving from state preparing -> state finished
>Thread-54819::DEBUG::2014-04-10 14:05:59,650::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-54819::DEBUG::2014-04-10 14:05:59,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-54819::DEBUG::2014-04-10 14:05:59,651::task::974::TaskManager.Task::(_decref) Task=`83732f8e-317a-4aa4-9079-e9fece663029`::ref 0 aborting False
>MainThread::DEBUG::2014-04-10 16:24:57,442::vdsm::45::vds::(sigtermHandler) Received signal 15
>MainThread::INFO::2014-04-10 16:24:58,282::vmChannels::183::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-04-10 16:24:58,282::momIF::84::MOM::(stop) Shutting down MOM
>MainThread::DEBUG::2014-04-10 16:24:58,283::task::579::TaskManager.Task::(_updateState) Task=`f9c327cb-035e-4df7-9395-3145f21ad119`::moving from state init -> state preparing
>MainThread::INFO::2014-04-10 16:24:58,284::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>Thread-12::DEBUG::2014-04-10 16:24:58,284::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped
>VM Channels Listener::INFO::2014-04-10 16:24:58,541::vmChannels::178::vds::(run) VM channels listener thread has ended.
>MainThread::INFO::2014-04-10 16:24:59,378::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::DEBUG::2014-04-10 16:24:59,379::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks
>MainThread::INFO::2014-04-10 16:24:59,379::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
>MainThread::DEBUG::2014-04-10 16:24:59,379::task::1168::TaskManager.Task::(prepare) Task=`f9c327cb-035e-4df7-9395-3145f21ad119`::finished: None
>MainThread::DEBUG::2014-04-10 16:24:59,379::task::579::TaskManager.Task::(_updateState) Task=`f9c327cb-035e-4df7-9395-3145f21ad119`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-04-10 16:24:59,379::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-04-10 16:24:59,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-04-10 16:24:59,380::task::974::TaskManager.Task::(_decref) Task=`f9c327cb-035e-4df7-9395-3145f21ad119`::ref 0 aborting False
>MainThread::INFO::2014-04-10 16:24:59,380::vdsm::107::vds::(run) VDSM main thread ended. Waiting for 16 other threads...
>MainThread::INFO::2014-04-10 16:24:59,380::vdsm::111::vds::(run) <_MainThread(MainThread, started 140247370032896)>
>MainThread::INFO::2014-04-10 16:24:59,380::vdsm::111::vds::(run) <Thread(Thread-1, started daemon 140247309416192)>
>MainThread::INFO::2014-04-10 16:24:59,380::vdsm::111::vds::(run) <WorkerThread(23701148-2ea0-4945-9393-0ceb1ddfb8f7, started daemon 140247146903296)>
>MainThread::INFO::2014-04-10 16:24:59,380::vdsm::111::vds::(run) <Thread(libvirtEventLoop, started daemon 140247190992640)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(197538eb-a2e0-4250-9778-ec3e7766fdb8, started daemon 140246870107904)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(bb87bbeb-9ba9-4b54-a625-f55d44f45391, started daemon 140246891087616)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(e53cc008-d273-4dea-ab2e-a793d7667e97, started daemon 140246901577472)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(Thread-8, started daemon 140246880597760)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(37f9af5d-9958-4332-80b7-62f823de6429, started daemon 140246509414144)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(061af95c-c66f-4dd9-b12c-01fa825a0637, started daemon 140246519904000)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <GuestManager(GuestManager, started daemon 140245999675136)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <HostMonitor(HostMonitor, started daemon 140246010164992)>
>MainThread::INFO::2014-04-10 16:24:59,381::vdsm::111::vds::(run) <WorkerThread(5015ff27-cde8-47bb-bc6c-6f061851e632, started daemon 140246922557184)>
>MainThread::INFO::2014-04-10 16:24:59,382::vdsm::111::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140245559400192)>
>MainThread::INFO::2014-04-10 16:24:59,382::momIF::84::MOM::(stop) Shutting down MOM
>MainThread::INFO::2014-04-10 16:24:59,382::vdsm::111::vds::(run) <MomThread(MOM, started 140246467454720)>
>MainThread::INFO::2014-04-10 16:24:59,382::vdsm::111::vds::(run) <WorkerThread(Thread-5, started daemon 140246912067328)>
>MainThread::INFO::2014-04-10 16:24:59,382::vdsm::111::vds::(run) <WorkerThread(2995aa0e-64bd-4dd3-95e6-68b266218ffc, started daemon 140247136413440)>
>MainThread::WARNING::2014-04-10 16:24:49,454::vdsmDebugPlugin::40::DebugInterpreter::(__turnOnDebugPlugin) Starting Debug Interpreter. Tread lightly!
>MainThread::INFO::2014-04-10 16:24:49,457::vdsm::101::vds::(run) (PID: 10161) I am the actual vdsm 4.13.2-0.13.el6ev ibm-x3650m4-06.qe.lab.eng.nay.redhat.com (2.6.32-456.el6.x86_64)
>MainThread::DEBUG::2014-04-10 16:24:49,696::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-04-10 16:24:49,697::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
>MainThread::WARNING::2014-04-10 16:24:49,701::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-04-10 16:24:50,869::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-04-10 16:24:50,888::multipath::144::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-04-10 16:24:50,889::hsm::427::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
>MainThread::DEBUG::2014-04-10 16:24:51,043::hsm::427::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-04-10 16:24:51,044::hsm::451::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-04-10 16:24:51,046::hsm::483::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-04-10 16:24:51,046::hsm::484::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-04-10 16:24:51,046::hsm::486::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-04-10 16:24:51,048::hsm::529::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-04-10 16:24:51,049::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>MainThread::INFO::2014-04-10 16:24:51,051::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>MainThread::DEBUG::2014-04-10 16:24:51,053::task::579::TaskManager.Task::(_updateState) Task=`e398b421-4c00-40a0-b377-82ff29347c73`::moving from state init -> state preparing
>MainThread::INFO::2014-04-10 16:24:51,053::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7f3781c13290>>)
>MainThread::INFO::2014-04-10 16:24:51,053::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-04-10 16:24:51,053::task::1168::TaskManager.Task::(prepare) Task=`e398b421-4c00-40a0-b377-82ff29347c73`::finished: None
>MainThread::DEBUG::2014-04-10 16:24:51,054::task::579::TaskManager.Task::(_updateState) Task=`e398b421-4c00-40a0-b377-82ff29347c73`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-04-10 16:24:51,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>storageRefresh::DEBUG::2014-04-10 16:24:51,054::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>MainThread::DEBUG::2014-04-10 16:24:51,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-04-10 16:24:51,055::task::974::TaskManager.Task::(_decref) Task=`e398b421-4c00-40a0-b377-82ff29347c73`::ref 0 aborting False
>MainThread::INFO::2014-04-10 16:24:51,066::momIF::47::MOM::(__init__) Starting up MOM
>clientIFinit::DEBUG::2014-04-10 16:24:51,086::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt
>MainThread::INFO::2014-04-10 16:24:51,086::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
>VM Channels Listener::INFO::2014-04-10 16:24:51,089::vmChannels::170::vds::(run) Starting VM channels listener thread.
>storageRefresh::DEBUG::2014-04-10 16:24:51,203::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 16:24:51,206::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:51,209::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:51,215::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>storageRefresh::DEBUG::2014-04-10 16:24:51,350::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 16:24:51,350::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:51,351::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
>storageRefresh::DEBUG::2014-04-10 16:24:51,472::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 16:24:51,473::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:51,474::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>storageRefresh::DEBUG::2014-04-10 16:24:51,595::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 16:24:51,595::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:51,595::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>storageRefresh::DEBUG::2014-04-10 16:24:51,595::misc::811::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-04-10 16:24:51,596::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-04-10 16:24:51,596::misc::811::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-04-10 16:24:51,596::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>storageRefresh::DEBUG::2014-04-10 16:24:51,607::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>storageRefresh::DEBUG::2014-04-10 16:24:51,611::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-14::DEBUG::2014-04-10 16:24:51,814::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call ping with () {} flowID [6f6164ed]
>Thread-14::DEBUG::2014-04-10 16:24:51,815::BindingXMLRPC::982::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}}
>Thread-15::DEBUG::2014-04-10 16:24:51,822::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {} flowID [6f6164ed]
>Thread-15::DEBUG::2014-04-10 16:24:51,886::utils::505::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-15::DEBUG::2014-04-10 16:24:51,896::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-15::DEBUG::2014-04-10 16:24:51,940::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:libvirt'}], 'FC': []}, 'packages2': {'kernel': {'release': '456.el6.x86_64', 'buildtime': 1396920867.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6', 'buildtime': 1381834773L, 'version': '0.12.4'}, 'vdsm': {'release': '0.13.el6ev', 'buildtime': 1395572343L, 'version': '4.13.2'}, 'qemu-kvm': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'libvirt': {'release': '31.el6', 'buildtime': 1396956996L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz', 'hooks': {'before_vm_start': {'50_qemucmdline': {'md5': 'a884929ad6f5eb039887157288867409'}, '50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}, '10_faqemu': {'md5': '5bf2bb20a269b3f87e35adeb173ff5e8'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'after_device_migrate_destination': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_device_create': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'after_device_create': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_nic_hotplug': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_nic_hotplug': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'gateway': '10.66.111.254', 'netmask': '255.255.248.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'mtu': '1500', 'netmask': '255.255.248.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.66.111.254', 'ports': ['eth0']}}, 'uuid': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:85', 'cfg': {'UUID': '12a4e2bf-6097-40a1-b63e-d011f33e6a0a', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:85', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:84', 'cfg': {'UUID': '5d727cbd-fa15-4e3b-974e-73b003650876', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:84', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:83', 'cfg': {'UUID': '1a5fab89-fb19-451a-8c23-c74c9177ba4b', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:83', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:82', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': '6C:AE:8B:20:80:82', 'DEVICE': 'eth0'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.13', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:libvirt', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '48117', 'cpuSpeed': '2001.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.66.4.132'}}
>Thread-16::DEBUG::2014-04-10 16:24:53,161::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {}
>Thread-16::DEBUG::2014-04-10 16:24:53,167::utils::505::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-16::DEBUG::2014-04-10 16:24:53,173::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-16::DEBUG::2014-04-10 16:24:53,200::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:libvirt'}], 'FC': []}, 'packages2': {'kernel': {'release': '456.el6.x86_64', 'buildtime': 1396920867.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6', 'buildtime': 1381834773L, 'version': '0.12.4'}, 'vdsm': {'release': '0.13.el6ev', 'buildtime': 1395572343L, 'version': '4.13.2'}, 'qemu-kvm': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'libvirt': {'release': '31.el6', 'buildtime': 1396956996L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz', 'hooks': {'before_vm_start': {'50_qemucmdline': {'md5': 'a884929ad6f5eb039887157288867409'}, '50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}, '10_faqemu': {'md5': '5bf2bb20a269b3f87e35adeb173ff5e8'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'after_device_migrate_destination': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_device_create': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'after_device_create': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_nic_hotplug': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_nic_hotplug': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'gateway': '10.66.111.254', 'netmask': '255.255.248.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'mtu': '1500', 'netmask': '255.255.248.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.66.111.254', 'ports': ['eth0']}}, 'uuid': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:85', 'cfg': {'UUID': '12a4e2bf-6097-40a1-b63e-d011f33e6a0a', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:85', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:84', 'cfg': {'UUID': '5d727cbd-fa15-4e3b-974e-73b003650876', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:84', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:83', 'cfg': {'UUID': '1a5fab89-fb19-451a-8c23-c74c9177ba4b', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:83', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:82', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': '6C:AE:8B:20:80:82', 'DEVICE': 'eth0'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.13', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:libvirt', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '48117', 'cpuSpeed': '2001.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.66.4.132'}}
>Thread-17::DEBUG::2014-04-10 16:24:53,220::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getHardwareInfo with () {}
>Thread-17::DEBUG::2014-04-10 16:24:53,285::BindingXMLRPC::982::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'System x3650 M4 -[7915I31]-', 'systemSerialNumber': '06FHNX8', 'systemFamily': 'System X', 'systemVersion': '0A', 'systemUUID': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'systemManufacturer': 'IBM'}}
>Thread-18::DEBUG::2014-04-10 16:24:53,323::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {}
>Thread-18::DEBUG::2014-04-10 16:24:53,325::utils::505::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-18::DEBUG::2014-04-10 16:24:53,331::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-18::DEBUG::2014-04-10 16:24:53,359::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:libvirt'}], 'FC': []}, 'packages2': {'kernel': {'release': '456.el6.x86_64', 'buildtime': 1396920867.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6', 'buildtime': 1381834773L, 'version': '0.12.4'}, 'vdsm': {'release': '0.13.el6ev', 'buildtime': 1395572343L, 'version': '4.13.2'}, 'qemu-kvm': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'libvirt': {'release': '31.el6', 'buildtime': 1396956996L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz', 'hooks': {'before_vm_start': {'50_qemucmdline': {'md5': 'a884929ad6f5eb039887157288867409'}, '50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}, '10_faqemu': {'md5': '5bf2bb20a269b3f87e35adeb173ff5e8'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'after_device_migrate_destination': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_device_create': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'after_device_create': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_nic_hotplug': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_nic_hotplug': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'gateway': '10.66.111.254', 'netmask': '255.255.248.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'mtu': '1500', 'netmask': '255.255.248.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.66.111.254', 'ports': ['eth0']}}, 'uuid': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:85', 'cfg': {'UUID': '12a4e2bf-6097-40a1-b63e-d011f33e6a0a', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:85', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:84', 'cfg': {'UUID': '5d727cbd-fa15-4e3b-974e-73b003650876', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:84', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:83', 'cfg': {'UUID': '1a5fab89-fb19-451a-8c23-c74c9177ba4b', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:83', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:82', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': '6C:AE:8B:20:80:82', 'DEVICE': 'eth0'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.13', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:libvirt', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '48117', 'cpuSpeed': '2001.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.66.4.132'}}
>Thread-19::DEBUG::2014-04-10 16:24:53,378::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getHardwareInfo with () {}
>Thread-19::DEBUG::2014-04-10 16:24:53,380::BindingXMLRPC::982::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'System x3650 M4 -[7915I31]-', 'systemSerialNumber': '06FHNX8', 'systemFamily': 'System X', 'systemVersion': '0A', 'systemUUID': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'systemManufacturer': 'IBM'}}
>Thread-21::DEBUG::2014-04-10 16:24:53,451::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [75bef237]
>Thread-21::DEBUG::2014-04-10 16:24:53,452::task::579::TaskManager.Task::(_updateState) Task=`e62db061-a5f0-489f-9e1a-52e42dd66fd0`::moving from state init -> state preparing
>Thread-21::INFO::2014-04-10 16:24:53,452::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}, {'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-21::DEBUG::2014-04-10 16:24:53,454::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2 /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2' (cwd None)
>Thread-21::DEBUG::2014-04-10 16:24:53,599::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2
>Thread-21::DEBUG::2014-04-10 16:24:53,622::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-21::DEBUG::2014-04-10 16:24:53,622::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 16:24:53,624::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2 /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2' (cwd None)
>Thread-21::DEBUG::2014-04-10 16:24:53,661::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2
>Thread-21::DEBUG::2014-04-10 16:24:53,662::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-21::DEBUG::2014-04-10 16:24:53,681::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 16:24:53,682::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1 /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1' (cwd None)
>Thread-21::DEBUG::2014-04-10 16:24:53,706::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1
>Thread-21::DEBUG::2014-04-10 16:24:53,728::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-21::DEBUG::2014-04-10 16:24:53,728::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 16:24:53,730::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1 /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1' (cwd None)
>Thread-21::DEBUG::2014-04-10 16:24:53,755::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-21::DEBUG::2014-04-10 16:24:53,756::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-21::DEBUG::2014-04-10 16:24:53,756::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-21::INFO::2014-04-10 16:24:53,757::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-21::DEBUG::2014-04-10 16:24:53,757::task::1168::TaskManager.Task::(prepare) Task=`e62db061-a5f0-489f-9e1a-52e42dd66fd0`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-21::DEBUG::2014-04-10 16:24:53,757::task::579::TaskManager.Task::(_updateState) Task=`e62db061-a5f0-489f-9e1a-52e42dd66fd0`::moving from state preparing -> state finished
>Thread-21::DEBUG::2014-04-10 16:24:53,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-21::DEBUG::2014-04-10 16:24:53,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-21::DEBUG::2014-04-10 16:24:53,758::task::974::TaskManager.Task::(_decref) Task=`e62db061-a5f0-489f-9e1a-52e42dd66fd0`::ref 0 aborting False
>Thread-22::DEBUG::2014-04-10 16:24:53,776::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-22::DEBUG::2014-04-10 16:24:53,776::task::579::TaskManager.Task::(_updateState) Task=`11bbac39-bc8d-45fd-b577-201f328abd6d`::moving from state init -> state preparing
>Thread-22::INFO::2014-04-10 16:24:53,777::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', masterVersion=3, options=None)
>Thread-22::DEBUG::2014-04-10 16:24:53,777::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`cf9d2204-971e-4d43-af52-79717f3cf110`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1013' at 'connectStoragePool'
>Thread-22::DEBUG::2014-04-10 16:24:53,777::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-22::DEBUG::2014-04-10 16:24:53,778::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-22::DEBUG::2014-04-10 16:24:53,778::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`cf9d2204-971e-4d43-af52-79717f3cf110`::Granted request
>Thread-22::DEBUG::2014-04-10 16:24:53,778::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93da6fe7-50a5-431f-a569-186449bd50fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1044' at '_connectStoragePool'
>Thread-22::DEBUG::2014-04-10 16:24:53,779::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-22::DEBUG::2014-04-10 16:24:53,779::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-22::DEBUG::2014-04-10 16:24:53,779::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93da6fe7-50a5-431f-a569-186449bd50fa`::Granted request
>Thread-22::INFO::2014-04-10 16:24:53,779::sp::674::Storage.StoragePool::(connect) Connect host #2 to the storage pool f721168f-5edd-4f5f-8976-591eb93f960e with master domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (ver = 3)
>Thread-22::DEBUG::2014-04-10 16:24:53,780::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,780::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,780::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,781::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,781::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,781::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:53,781::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>storageRefresh::DEBUG::2014-04-10 16:24:54,643::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>storageRefresh::DEBUG::2014-04-10 16:24:54,721::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 16:24:54,722::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,722::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,722::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,722::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,723::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,723::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 16:24:54,723::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-22::DEBUG::2014-04-10 16:24:54,724::misc::811::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::WARNING::2014-04-10 16:24:54,725::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
>Thread-22::DEBUG::2014-04-10 16:24:54,726::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-22::DEBUG::2014-04-10 16:24:54,728::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-22::DEBUG::2014-04-10 16:24:54,729::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-22::DEBUG::2014-04-10 16:24:54,740::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-22::DEBUG::2014-04-10 16:24:54,741::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-22::DEBUG::2014-04-10 16:24:56,776::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-22::DEBUG::2014-04-10 16:24:56,804::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-22::DEBUG::2014-04-10 16:24:56,804::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,805::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,805::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,805::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,805::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,805::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-22::DEBUG::2014-04-10 16:24:56,806::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-22::DEBUG::2014-04-10 16:24:56,903::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-22::DEBUG::2014-04-10 16:24:56,978::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-22::DEBUG::2014-04-10 16:24:56,984::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=39f03d98b3740fea3ea937b3dfe88cdd8d4a9274']
>Thread-22::DEBUG::2014-04-10 16:24:56,986::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-22::DEBUG::2014-04-10 16:24:56,987::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS'
>Thread-22::DEBUG::2014-04-10 16:24:56,987::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS'
>Thread-22::DEBUG::2014-04-10 16:24:56,987::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 verified, version 3
>Thread-22::DEBUG::2014-04-10 16:24:56,988::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-22::DEBUG::2014-04-10 16:24:56,988::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-22::DEBUG::2014-04-10 16:24:56,993::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=39f03d98b3740fea3ea937b3dfe88cdd8d4a9274']
>Thread-22::INFO::2014-04-10 16:24:56,993::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-22::DEBUG::2014-04-10 16:24:56,994::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `55cb7668-7c5e-4553-b263-c6f3f86b358f`
>Thread-27::DEBUG::2014-04-10 16:24:56,994::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-22::INFO::2014-04-10 16:24:56,995::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-28::DEBUG::2014-04-10 16:24:56,998::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-22::DEBUG::2014-04-10 16:24:56,998::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`
>Thread-22::INFO::2014-04-10 16:24:57,002::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-22::DEBUG::2014-04-10 16:24:57,013::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `dbec8cee-b5e4-4011-9dd5-7c122389a878`
>Thread-33::DEBUG::2014-04-10 16:24:57,013::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-22::INFO::2014-04-10 16:24:57,018::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-22::DEBUG::2014-04-10 16:24:57,027::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `65eafe2b-4fa9-4ea1-a869-7deb5afd4654`
>Thread-34::DEBUG::2014-04-10 16:24:57,027::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-22::DEBUG::2014-04-10 16:24:57,034::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-22::DEBUG::2014-04-10 16:24:57,092::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-27::DEBUG::2014-04-10 16:24:57,096::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-22::DEBUG::2014-04-10 16:24:57,105::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:24:57,106::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-33::DEBUG::2014-04-10 16:24:57,106::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-28::DEBUG::2014-04-10 16:24:57,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:24:57,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000392984 s, 1.7 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:24:57,142::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 changed its status to Valid
>Thread-43::DEBUG::2014-04-10 16:24:57,143::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-28::INFO::2014-04-10 16:24:57,143::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>Thread-43::DEBUG::2014-04-10 16:24:57,145::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-28::DEBUG::2014-04-10 16:24:57,146::clusterlock::192::SANLock::(acquireHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>Thread-43::DEBUG::2014-04-10 16:24:57,147::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-44::INFO::2014-04-10 16:24:57,148::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-27::DEBUG::2014-04-10 16:24:57,192::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-34::DEBUG::2014-04-10 16:24:57,197::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-27::DEBUG::2014-04-10 16:24:57,199::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-33::DEBUG::2014-04-10 16:24:57,200::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-34::DEBUG::2014-04-10 16:24:57,204::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-34::DEBUG::2014-04-10 16:24:57,207::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-34::DEBUG::2014-04-10 16:24:57,209::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS'
>Thread-34::DEBUG::2014-04-10 16:24:57,211::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS'
>Thread-33::DEBUG::2014-04-10 16:24:57,211::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-34::DEBUG::2014-04-10 16:24:57,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:24:57,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000324811 s, 1.1 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:24:57,232::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 changed its status to Valid
>Thread-45::DEBUG::2014-04-10 16:24:57,233::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-34::INFO::2014-04-10 16:24:57,233::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 (id: 2)
>Thread-45::DEBUG::2014-04-10 16:24:57,235::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-34::DEBUG::2014-04-10 16:24:57,235::clusterlock::192::SANLock::(acquireHostId) Host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 successfully acquired (id: 2)
>Thread-45::DEBUG::2014-04-10 16:24:57,237::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-46::INFO::2014-04-10 16:24:57,239::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-33::DEBUG::2014-04-10 16:24:57,241::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-27::DEBUG::2014-04-10 16:24:57,242::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-33::DEBUG::2014-04-10 16:24:57,244::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS'
>Thread-27::DEBUG::2014-04-10 16:24:57,245::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS'
>Thread-33::DEBUG::2014-04-10 16:24:57,245::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS'
>Thread-27::DEBUG::2014-04-10 16:24:57,246::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS'
>Thread-22::DEBUG::2014-04-10 16:24:57,281::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-22::WARNING::2014-04-10 16:24:57,286::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-22::DEBUG::2014-04-10 16:24:57,290::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-27::DEBUG::2014-04-10 16:24:57,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-22::INFO::2014-04-10 16:24:57,314::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-33::DEBUG::2014-04-10 16:24:57,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-22::INFO::2014-04-10 16:24:57,321::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-22::INFO::2014-04-10 16:24:57,327::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-22::INFO::2014-04-10 16:24:57,330::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-22::INFO::2014-04-10 16:24:57,332::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-22::DEBUG::2014-04-10 16:24:57,336::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-22::DEBUG::2014-04-10 16:24:57,339::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-22::DEBUG::2014-04-10 16:24:57,341::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-27::DEBUG::2014-04-10 16:24:57,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.0002402 s, 1.6 MB/s\n'; <rc> = 0
>Thread-22::DEBUG::2014-04-10 16:24:57,342::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-33::DEBUG::2014-04-10 16:24:57,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240847 s, 2.8 MB/s\n'; <rc> = 0
>Thread-22::DEBUG::2014-04-10 16:24:57,347::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-22::DEBUG::2014-04-10 16:24:57,350::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-27::DEBUG::2014-04-10 16:24:57,351::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f changed its status to Valid
>Thread-22::DEBUG::2014-04-10 16:24:57,352::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-51::DEBUG::2014-04-10 16:24:57,354::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-27::INFO::2014-04-10 16:24:57,354::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>Thread-22::DEBUG::2014-04-10 16:24:57,355::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-51::DEBUG::2014-04-10 16:24:57,358::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-27::DEBUG::2014-04-10 16:24:57,359::clusterlock::192::SANLock::(acquireHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>Thread-22::INFO::2014-04-10 16:24:57,362::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-51::DEBUG::2014-04-10 16:24:57,364::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-52::INFO::2014-04-10 16:24:57,366::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-22::DEBUG::2014-04-10 16:24:57,367::task::1168::TaskManager.Task::(prepare) Task=`11bbac39-bc8d-45fd-b577-201f328abd6d`::finished: True
>Thread-22::DEBUG::2014-04-10 16:24:57,370::task::579::TaskManager.Task::(_updateState) Task=`11bbac39-bc8d-45fd-b577-201f328abd6d`::moving from state preparing -> state finished
>Thread-22::DEBUG::2014-04-10 16:24:57,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-22::DEBUG::2014-04-10 16:24:57,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-33::DEBUG::2014-04-10 16:24:57,372::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878 changed its status to Valid
>Thread-22::DEBUG::2014-04-10 16:24:57,372::task::974::TaskManager.Task::(_decref) Task=`11bbac39-bc8d-45fd-b577-201f328abd6d`::ref 0 aborting False
>Thread-53::DEBUG::2014-04-10 16:24:57,374::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-33::INFO::2014-04-10 16:24:57,374::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 2)
>Thread-53::DEBUG::2014-04-10 16:24:57,378::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-33::DEBUG::2014-04-10 16:24:57,378::clusterlock::192::SANLock::(acquireHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 successfully acquired (id: 2)
>Thread-53::DEBUG::2014-04-10 16:24:57,383::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-54::INFO::2014-04-10 16:24:57,383::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-55::DEBUG::2014-04-10 16:24:57,388::task::579::TaskManager.Task::(_updateState) Task=`4af88d31-6248-40fe-9266-68bb26e98108`::moving from state init -> state preparing
>Thread-55::INFO::2014-04-10 16:24:57,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-55::INFO::2014-04-10 16:24:57,389::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000392984', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0002402', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000240847', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000324811', 'lastCheck': '0.2', 'valid': True}}
>Thread-55::DEBUG::2014-04-10 16:24:57,389::task::1168::TaskManager.Task::(prepare) Task=`4af88d31-6248-40fe-9266-68bb26e98108`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000392984', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0002402', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000240847', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000324811', 'lastCheck': '0.2', 'valid': True}}
>Thread-55::DEBUG::2014-04-10 16:24:57,389::task::579::TaskManager.Task::(_updateState) Task=`4af88d31-6248-40fe-9266-68bb26e98108`::moving from state preparing -> state finished
>Thread-55::DEBUG::2014-04-10 16:24:57,390::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-55::DEBUG::2014-04-10 16:24:57,390::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-55::DEBUG::2014-04-10 16:24:57,390::task::974::TaskManager.Task::(_decref) Task=`4af88d31-6248-40fe-9266-68bb26e98108`::ref 0 aborting False
>Thread-56::DEBUG::2014-04-10 16:24:57,418::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call setMOMPolicyParameters with ({'balloonEnabled': False},) {} flowID [75bef237]
>Thread-56::DEBUG::2014-04-10 16:24:57,488::BindingXMLRPC::982::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-28::DEBUG::2014-04-10 16:25:07,157::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:07,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000392845 s, 1.7 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:07,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:07,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000438204 s, 840 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:07,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:07,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000285588 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:07,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:07,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321647 s, 2.1 MB/s\n'; <rc> = 0
>Thread-60::DEBUG::2014-04-10 16:25:09,617::task::579::TaskManager.Task::(_updateState) Task=`28ae526f-0b64-4b8b-a648-1e2b1a90f87b`::moving from state init -> state preparing
>Thread-60::INFO::2014-04-10 16:25:09,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-60::INFO::2014-04-10 16:25:09,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000392845', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000285588', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000321647', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000438204', 'lastCheck': '2.4', 'valid': True}}
>Thread-60::DEBUG::2014-04-10 16:25:09,618::task::1168::TaskManager.Task::(prepare) Task=`28ae526f-0b64-4b8b-a648-1e2b1a90f87b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000392845', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000285588', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000321647', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000438204', 'lastCheck': '2.4', 'valid': True}}
>Thread-60::DEBUG::2014-04-10 16:25:09,618::task::579::TaskManager.Task::(_updateState) Task=`28ae526f-0b64-4b8b-a648-1e2b1a90f87b`::moving from state preparing -> state finished
>Thread-60::DEBUG::2014-04-10 16:25:09,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-60::DEBUG::2014-04-10 16:25:09,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-60::DEBUG::2014-04-10 16:25:09,619::task::974::TaskManager.Task::(_decref) Task=`28ae526f-0b64-4b8b-a648-1e2b1a90f87b`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:25:17,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:17,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000418379 s, 1.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:17,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:17,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457954 s, 804 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:17,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:17,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000375208 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:17,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:17,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300341 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 16:25:24,768::task::579::TaskManager.Task::(_updateState) Task=`8ab8f91f-c60a-4554-82aa-b83f3c52952e`::moving from state init -> state preparing
>Thread-66::INFO::2014-04-10 16:25:24,769::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-66::INFO::2014-04-10 16:25:24,769::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000418379', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375208', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000300341', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000457954', 'lastCheck': '7.5', 'valid': True}}
>Thread-66::DEBUG::2014-04-10 16:25:24,769::task::1168::TaskManager.Task::(prepare) Task=`8ab8f91f-c60a-4554-82aa-b83f3c52952e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000418379', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375208', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000300341', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000457954', 'lastCheck': '7.5', 'valid': True}}
>Thread-66::DEBUG::2014-04-10 16:25:24,769::task::579::TaskManager.Task::(_updateState) Task=`8ab8f91f-c60a-4554-82aa-b83f3c52952e`::moving from state preparing -> state finished
>Thread-66::DEBUG::2014-04-10 16:25:24,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-66::DEBUG::2014-04-10 16:25:24,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-66::DEBUG::2014-04-10 16:25:24,770::task::974::TaskManager.Task::(_decref) Task=`8ab8f91f-c60a-4554-82aa-b83f3c52952e`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:25:27,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:27,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000562301 s, 1.2 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:27,271::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:27,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442958 s, 831 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:27,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:27,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000368187 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:27,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:27,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336275 s, 2.0 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:25:37,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:37,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000473961 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:37,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:37,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000507026 s, 726 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:37,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:37,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.0003986 s, 956 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:37,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:37,432::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272385 s, 2.5 MB/s\n'; <rc> = 0
>Thread-72::DEBUG::2014-04-10 16:25:40,130::task::579::TaskManager.Task::(_updateState) Task=`587325e9-daa8-4daf-840e-69ffbf0625d7`::moving from state init -> state preparing
>Thread-72::INFO::2014-04-10 16:25:40,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-72::INFO::2014-04-10 16:25:40,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473961', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003986', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272385', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507026', 'lastCheck': '2.8', 'valid': True}}
>Thread-72::DEBUG::2014-04-10 16:25:40,131::task::1168::TaskManager.Task::(prepare) Task=`587325e9-daa8-4daf-840e-69ffbf0625d7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473961', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003986', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272385', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507026', 'lastCheck': '2.8', 'valid': True}}
>Thread-72::DEBUG::2014-04-10 16:25:40,131::task::579::TaskManager.Task::(_updateState) Task=`587325e9-daa8-4daf-840e-69ffbf0625d7`::moving from state preparing -> state finished
>Thread-72::DEBUG::2014-04-10 16:25:40,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-72::DEBUG::2014-04-10 16:25:40,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-72::DEBUG::2014-04-10 16:25:40,132::task::974::TaskManager.Task::(_decref) Task=`587325e9-daa8-4daf-840e-69ffbf0625d7`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:25:47,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:47,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000531494 s, 1.2 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:47,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:47,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000424009 s, 868 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:47,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:47,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000337122 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:47,439::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:47,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326242 s, 2.1 MB/s\n'; <rc> = 0
>Thread-78::DEBUG::2014-04-10 16:25:55,301::task::579::TaskManager.Task::(_updateState) Task=`f5d86733-8548-4a03-951d-a3dcba1910e1`::moving from state init -> state preparing
>Thread-78::INFO::2014-04-10 16:25:55,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-78::INFO::2014-04-10 16:25:55,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531494', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337122', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326242', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424009', 'lastCheck': '8.0', 'valid': True}}
>Thread-78::DEBUG::2014-04-10 16:25:55,301::task::1168::TaskManager.Task::(prepare) Task=`f5d86733-8548-4a03-951d-a3dcba1910e1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531494', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337122', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326242', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424009', 'lastCheck': '8.0', 'valid': True}}
>Thread-78::DEBUG::2014-04-10 16:25:55,302::task::579::TaskManager.Task::(_updateState) Task=`f5d86733-8548-4a03-951d-a3dcba1910e1`::moving from state preparing -> state finished
>Thread-78::DEBUG::2014-04-10 16:25:55,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-78::DEBUG::2014-04-10 16:25:55,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-78::DEBUG::2014-04-10 16:25:55,302::task::974::TaskManager.Task::(_decref) Task=`f5d86733-8548-4a03-951d-a3dcba1910e1`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:25:57,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:25:57,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000470031 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:25:57,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:25:57,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000404609 s, 910 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:25:57,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:25:57,433::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000342029 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:25:57,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:25:57,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000327064 s, 2.1 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:26:07,257::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:07,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000489699 s, 1.3 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:07,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:07,335::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000397123 s, 927 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:07,439::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:07,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000344345 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:07,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:07,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000351536 s, 1.9 MB/s\n'; <rc> = 0
>Thread-84::DEBUG::2014-04-10 16:26:10,488::task::579::TaskManager.Task::(_updateState) Task=`6b793724-c9ee-4ab3-8438-76536b8d82ec`::moving from state init -> state preparing
>Thread-84::INFO::2014-04-10 16:26:10,489::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-84::INFO::2014-04-10 16:26:10,489::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489699', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344345', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351536', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397123', 'lastCheck': '3.2', 'valid': True}}
>Thread-84::DEBUG::2014-04-10 16:26:10,489::task::1168::TaskManager.Task::(prepare) Task=`6b793724-c9ee-4ab3-8438-76536b8d82ec`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489699', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344345', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351536', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397123', 'lastCheck': '3.2', 'valid': True}}
>Thread-84::DEBUG::2014-04-10 16:26:10,489::task::579::TaskManager.Task::(_updateState) Task=`6b793724-c9ee-4ab3-8438-76536b8d82ec`::moving from state preparing -> state finished
>Thread-84::DEBUG::2014-04-10 16:26:10,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-84::DEBUG::2014-04-10 16:26:10,490::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-84::DEBUG::2014-04-10 16:26:10,490::task::974::TaskManager.Task::(_decref) Task=`6b793724-c9ee-4ab3-8438-76536b8d82ec`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:26:17,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:17,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000474723 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:17,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:17,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447261 s, 823 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:17,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:17,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000320148 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:17,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:17,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294439 s, 2.3 MB/s\n'; <rc> = 0
>Thread-90::DEBUG::2014-04-10 16:26:25,882::task::579::TaskManager.Task::(_updateState) Task=`3aec9d82-6f6c-4a74-919e-5ba47d78e9dd`::moving from state init -> state preparing
>Thread-90::INFO::2014-04-10 16:26:25,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-90::INFO::2014-04-10 16:26:25,883::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474723', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320148', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294439', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447261', 'lastCheck': '8.5', 'valid': True}}
>Thread-90::DEBUG::2014-04-10 16:26:25,883::task::1168::TaskManager.Task::(prepare) Task=`3aec9d82-6f6c-4a74-919e-5ba47d78e9dd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474723', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320148', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294439', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447261', 'lastCheck': '8.5', 'valid': True}}
>Thread-90::DEBUG::2014-04-10 16:26:25,883::task::579::TaskManager.Task::(_updateState) Task=`3aec9d82-6f6c-4a74-919e-5ba47d78e9dd`::moving from state preparing -> state finished
>Thread-90::DEBUG::2014-04-10 16:26:25,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-90::DEBUG::2014-04-10 16:26:25,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-90::DEBUG::2014-04-10 16:26:25,884::task::974::TaskManager.Task::(_decref) Task=`3aec9d82-6f6c-4a74-919e-5ba47d78e9dd`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:26:27,288::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:27,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000470442 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:27,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:27,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000379631 s, 969 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:27,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:27,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000321411 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:27,497::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:27,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410688 s, 1.6 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:26:37,304::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:37,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00051701 s, 1.3 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:37,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:37,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000469407 s, 784 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:37,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:37,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000320486 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:37,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:37,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374299 s, 1.8 MB/s\n'; <rc> = 0
>Thread-96::DEBUG::2014-04-10 16:26:41,098::task::579::TaskManager.Task::(_updateState) Task=`b4d891e6-532f-4880-995c-2970dfdfc277`::moving from state init -> state preparing
>Thread-96::INFO::2014-04-10 16:26:41,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-96::INFO::2014-04-10 16:26:41,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051701', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320486', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374299', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469407', 'lastCheck': '3.7', 'valid': True}}
>Thread-96::DEBUG::2014-04-10 16:26:41,098::task::1168::TaskManager.Task::(prepare) Task=`b4d891e6-532f-4880-995c-2970dfdfc277`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051701', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320486', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374299', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469407', 'lastCheck': '3.7', 'valid': True}}
>Thread-96::DEBUG::2014-04-10 16:26:41,099::task::579::TaskManager.Task::(_updateState) Task=`b4d891e6-532f-4880-995c-2970dfdfc277`::moving from state preparing -> state finished
>Thread-96::DEBUG::2014-04-10 16:26:41,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-96::DEBUG::2014-04-10 16:26:41,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-96::DEBUG::2014-04-10 16:26:41,099::task::974::TaskManager.Task::(_decref) Task=`b4d891e6-532f-4880-995c-2970dfdfc277`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:26:47,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:47,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000403677 s, 1.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:47,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:47,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000352372 s, 1.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:47,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:47,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000325748 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:47,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:47,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364885 s, 1.8 MB/s\n'; <rc> = 0
>Thread-102::DEBUG::2014-04-10 16:26:56,248::task::579::TaskManager.Task::(_updateState) Task=`23d486f4-5e6d-484a-9965-5b8d3811a59d`::moving from state init -> state preparing
>Thread-102::INFO::2014-04-10 16:26:56,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-102::INFO::2014-04-10 16:26:56,249::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403677', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325748', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364885', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352372', 'lastCheck': '8.9', 'valid': True}}
>Thread-102::DEBUG::2014-04-10 16:26:56,249::task::1168::TaskManager.Task::(prepare) Task=`23d486f4-5e6d-484a-9965-5b8d3811a59d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403677', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325748', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364885', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352372', 'lastCheck': '8.9', 'valid': True}}
>Thread-102::DEBUG::2014-04-10 16:26:56,249::task::579::TaskManager.Task::(_updateState) Task=`23d486f4-5e6d-484a-9965-5b8d3811a59d`::moving from state preparing -> state finished
>Thread-102::DEBUG::2014-04-10 16:26:56,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-102::DEBUG::2014-04-10 16:26:56,250::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-102::DEBUG::2014-04-10 16:26:56,250::task::974::TaskManager.Task::(_decref) Task=`23d486f4-5e6d-484a-9965-5b8d3811a59d`::ref 0 aborting False
>Thread-104::DEBUG::2014-04-10 16:26:56,833::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmCreate with ({'custom': {}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Conroe', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'specParams': {}, 'readonly': 'false', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c'}], 'smp': '1', 'vmType': 'kvm', 'smartcardEnable': 'false', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'vm2', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [1576206b]
>Thread-104::INFO::2014-04-10 16:26:56,836::API::648::vds::(_getNetworkIp) network None: using 0
>Thread-104::INFO::2014-04-10 16:26:56,836::clientIF::394::vds::(createVm) vmContainerLock acquired by vm af1debb5-7b64-4d09-8455-850ddba3e546
>Thread-104::DEBUG::2014-04-10 16:26:56,837::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt
>Thread-105::DEBUG::2014-04-10 16:26:56,874::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Start
>Thread-104::DEBUG::2014-04-10 16:26:56,874::clientIF::407::vds::(createVm) Total desktops after creation of af1debb5-7b64-4d09-8455-850ddba3e546 is 1
>Thread-104::DEBUG::2014-04-10 16:26:56,875::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'specParams': {}, 'readonly': 'false', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm2', 'display': 'qxl', 'nice': '0'}}
>Thread-105::DEBUG::2014-04-10 16:26:56,876::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::_ongoingCreations acquired
>Thread-105::INFO::2014-04-10 16:26:56,877::vm::3011::vm.Vm::(_run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::VM wrapper has started
>Thread-105::DEBUG::2014-04-10 16:26:56,878::task::579::TaskManager.Task::(_updateState) Task=`6cf33ef6-a13f-480a-ae0e-32bb3234ce9c`::moving from state init -> state preparing
>Thread-105::INFO::2014-04-10 16:26:56,879::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-105::INFO::2014-04-10 16:26:56,885::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-105::DEBUG::2014-04-10 16:26:56,886::task::1168::TaskManager.Task::(prepare) Task=`6cf33ef6-a13f-480a-ae0e-32bb3234ce9c`::finished: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-105::DEBUG::2014-04-10 16:26:56,886::task::579::TaskManager.Task::(_updateState) Task=`6cf33ef6-a13f-480a-ae0e-32bb3234ce9c`::moving from state preparing -> state finished
>Thread-105::DEBUG::2014-04-10 16:26:56,886::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-105::DEBUG::2014-04-10 16:26:56,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-105::DEBUG::2014-04-10 16:26:56,886::task::974::TaskManager.Task::(_decref) Task=`6cf33ef6-a13f-480a-ae0e-32bb3234ce9c`::ref 0 aborting False
>Thread-105::INFO::2014-04-10 16:26:56,886::clientIF::353::vds::(prepareVolumePath) prepared volume path: 
>Thread-105::DEBUG::2014-04-10 16:26:56,887::task::579::TaskManager.Task::(_updateState) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::moving from state init -> state preparing
>Thread-105::INFO::2014-04-10 16:26:56,887::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', leafUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc')
>Thread-105::DEBUG::2014-04-10 16:26:56,888::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`5ac4ff11-12ab-42b5-ace9-81ebb07edc0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage'
>Thread-105::DEBUG::2014-04-10 16:26:56,888::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-105::DEBUG::2014-04-10 16:26:56,888::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-105::DEBUG::2014-04-10 16:26:56,888::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`5ac4ff11-12ab-42b5-ace9-81ebb07edc0e`::Granted request
>Thread-105::DEBUG::2014-04-10 16:26:56,889::task::811::TaskManager.Task::(resourceAcquired) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-105::DEBUG::2014-04-10 16:26:56,889::task::974::TaskManager.Task::(_decref) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::ref 1 aborting False
>Thread-105::WARNING::2014-04-10 16:26:56,892::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 already exists
>Thread-105::DEBUG::2014-04-10 16:26:56,893::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 7879e1b7-c238-4222-95eb-e922c5cf80dc
>Thread-105::INFO::2014-04-10 16:26:56,894::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imgVolumesInfo': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}
>Thread-105::DEBUG::2014-04-10 16:26:56,894::task::1168::TaskManager.Task::(prepare) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::finished: {'info': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imgVolumesInfo': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}
>Thread-105::DEBUG::2014-04-10 16:26:56,895::task::579::TaskManager.Task::(_updateState) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::moving from state preparing -> state finished
>Thread-105::DEBUG::2014-04-10 16:26:56,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>Thread-105::DEBUG::2014-04-10 16:26:56,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-105::DEBUG::2014-04-10 16:26:56,895::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-105::DEBUG::2014-04-10 16:26:56,895::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-105::DEBUG::2014-04-10 16:26:56,895::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-105::DEBUG::2014-04-10 16:26:56,896::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-105::DEBUG::2014-04-10 16:26:56,896::task::974::TaskManager.Task::(_decref) Task=`e5c2050a-0d55-4c81-b064-c82c9a05d37b`::ref 0 aborting False
>Thread-105::INFO::2014-04-10 16:26:56,896::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc
>Thread-105::DEBUG::2014-04-10 16:26:56,909::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/10_faqemu' (cwd None)
>Thread-105::DEBUG::2014-04-10 16:26:56,963::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-105::INFO::2014-04-10 16:26:56,964::hooks::100::root::(_runHooksDir) 
>Thread-105::DEBUG::2014-04-10 16:26:56,964::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_qemucmdline' (cwd None)
>Thread-105::DEBUG::2014-04-10 16:26:57,022::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-105::INFO::2014-04-10 16:26:57,022::hooks::100::root::(_runHooksDir) 
>Thread-105::DEBUG::2014-04-10 16:26:57,022::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
>Thread-105::DEBUG::2014-04-10 16:26:57,074::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-105::INFO::2014-04-10 16:26:57,074::hooks::100::root::(_runHooksDir) 
>Thread-105::DEBUG::2014-04-10 16:26:57,075::vm::3073::vm.Vm::(_run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::<?xml version="1.0" encoding="utf-8"?>
><domain type="kvm">
>	<name>vm2</name>
>	<uuid>af1debb5-7b64-4d09-8455-850ddba3e546</uuid>
>	<memory>1048576</memory>
>	<currentMemory>1048576</currentMemory>
>	<vcpu>1</vcpu>
>	<memtune>
>		<min_guarantee>1048576</min_guarantee>
>	</memtune>
>	<devices>
>		<channel type="unix">
>			<target name="com.redhat.rhevm.vdsm" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.com.redhat.rhevm.vdsm"/>
>		</channel>
>		<channel type="unix">
>			<target name="org.qemu.guest_agent.0" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.org.qemu.guest_agent.0"/>
>		</channel>
>		<input bus="ps2" type="mouse"/>
>		<channel type="spicevmc">
>			<target name="com.redhat.spice.0" type="virtio"/>
>		</channel>
>		<graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice">
>			<channel mode="secure" name="main"/>
>			<channel mode="secure" name="inputs"/>
>			<channel mode="secure" name="cursor"/>
>			<channel mode="secure" name="playback"/>
>			<channel mode="secure" name="record"/>
>			<channel mode="secure" name="display"/>
>			<channel mode="secure" name="usbredir"/>
>			<channel mode="secure" name="smartcard"/>
>		</graphics>
>		<controller model="virtio-scsi" type="scsi"/>
>		<video>
>			<model heads="1" type="qxl" vram="32768"/>
>		</video>
>		<interface type="bridge">
>			<mac address="00:01:a4:a5:a5:06"/>
>			<model type="virtio"/>
>			<source bridge="rhevm"/>
>			<filterref filter="vdsm-no-mac-spoofing"/>
>			<link state="up"/>
>		</interface>
>		<disk device="cdrom" snapshot="no" type="file">
>			<source file="" startupPolicy="optional"/>
>			<target bus="ide" dev="hdc"/>
>			<readonly/>
>			<serial/>
>		</disk>
>		<disk device="disk" snapshot="no" type="file">
>			<source file="/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc"/>
>			<target bus="virtio" dev="vda"/>
>			<serial>fe90abc5-8638-40e8-b394-9082b3217731</serial>
>			<driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/>
>		</disk>
>		<memballoon model="virtio"/>
>	</devices>
>	<os>
>		<type arch="x86_64" machine="rhel6.5.0">hvm</type>
>		<smbios mode="sysinfo"/>
>	</os>
>	<sysinfo type="smbios">
>		<system>
>			<entry name="manufacturer">Red Hat</entry>
>			<entry name="product">RHEV Hypervisor</entry>
>			<entry name="version">6Server-6.5.0.1.el6</entry>
>			<entry name="serial">94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082</entry>
>			<entry name="uuid">af1debb5-7b64-4d09-8455-850ddba3e546</entry>
>		</system>
>	</sysinfo>
>	<clock adjustment="0" offset="variable">
>		<timer name="rtc" tickpolicy="catchup"/>
>	</clock>
>	<features>
>		<acpi/>
>	</features>
>	<cpu match="exact">
>		<model>Conroe</model>
>		<topology cores="1" sockets="1" threads="1"/>
>	</cpu>
></domain>
>
>Thread-28::DEBUG::2014-04-10 16:26:57,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:26:57,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000409436 s, 1.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:26:57,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:26:57,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004277 s, 860 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:26:57,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:26:57,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000379141 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:26:57,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:26:57,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266114 s, 2.5 MB/s\n'; <rc> = 0
>libvirtEventLoop::DEBUG::2014-04-10 16:26:57,666::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::event Started detail 0 opaque None
>Thread-105::DEBUG::2014-04-10 16:26:57,742::sampling::285::vm.Vm::(start) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Start statistics collection
>Thread-107::DEBUG::2014-04-10 16:26:57,743::sampling::314::vm.Vm::(run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Stats thread started
>Thread-107::DEBUG::2014-04-10 16:26:57,745::task::579::TaskManager.Task::(_updateState) Task=`4da4b5e0-fc9b-4e6f-84ef-2df11ef5d2a8`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:26:57,745::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-107::INFO::2014-04-10 16:26:57,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-107::DEBUG::2014-04-10 16:26:57,747::task::1168::TaskManager.Task::(prepare) Task=`4da4b5e0-fc9b-4e6f-84ef-2df11ef5d2a8`::finished: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-107::DEBUG::2014-04-10 16:26:57,747::task::579::TaskManager.Task::(_updateState) Task=`4da4b5e0-fc9b-4e6f-84ef-2df11ef5d2a8`::moving from state preparing -> state finished
>Thread-107::DEBUG::2014-04-10 16:26:57,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:26:57,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:26:57,748::task::974::TaskManager.Task::(_decref) Task=`4da4b5e0-fc9b-4e6f-84ef-2df11ef5d2a8`::ref 0 aborting False
>Thread-105::DEBUG::2014-04-10 16:26:57,752::vmChannels::194::vds::(register) Add fileno 9 to listener's channels.
>Thread-105::WARNING::2014-04-10 16:26:57,755::vm::3578::vm.Vm::(_readPauseCode) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::_readPauseCode unsupported by libvirt vm
>Thread-105::DEBUG::2014-04-10 16:26:57,791::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::_ongoingCreations released
>VM Channels Listener::DEBUG::2014-04-10 16:26:58,245::vmChannels::102::vds::(_do_add_channels) fileno 9 was added to unconnected channels.
>VM Channels Listener::DEBUG::2014-04-10 16:26:58,245::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 9.
>VM Channels Listener::DEBUG::2014-04-10 16:26:58,245::guestIF::147::vm.Vm::(_connect) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Attempting connection to /var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 16:26:58,245::guestIF::150::vm.Vm::(_connect) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Connected to /var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 16:26:58,246::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 9 succeeded.
>Thread-109::DEBUG::2014-04-10 16:26:59,354::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-109::DEBUG::2014-04-10 16:26:59,354::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-109::DEBUG::2014-04-10 16:26:59,355::vm::636::vm.Vm::(_getNetworkStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Network stats not available
>Thread-109::DEBUG::2014-04-10 16:26:59,355::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-109::DEBUG::2014-04-10 16:26:59,355::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-109::DEBUG::2014-04-10 16:26:59,355::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-109::DEBUG::2014-04-10 16:26:59,355::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-109::DEBUG::2014-04-10 16:26:59,357::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:01:a4:a5:a5:06', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.61', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,303::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,303::vm::636::vm.Vm::(_getNetworkStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Network stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,304::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,304::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,304::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,304::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,306::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,306::vm::636::vm.Vm::(_getNetworkStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Network stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,306::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,306::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,307::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:01,307::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-112::DEBUG::2014-04-10 16:27:02,490::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-112::DEBUG::2014-04-10 16:27:02,490::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-112::DEBUG::2014-04-10 16:27:02,490::vm::636::vm.Vm::(_getNetworkStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Network stats not available
>Thread-112::DEBUG::2014-04-10 16:27:02,491::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-112::DEBUG::2014-04-10 16:27:02,491::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-112::DEBUG::2014-04-10 16:27:02,491::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-112::DEBUG::2014-04-10 16:27:02,491::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-112::DEBUG::2014-04-10 16:27:02,493::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:01:a4:a5:a5:06', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.69', 'elapsedTime': '5', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-114::DEBUG::2014-04-10 16:27:05,532::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-114::DEBUG::2014-04-10 16:27:05,532::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-114::DEBUG::2014-04-10 16:27:05,532::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-114::DEBUG::2014-04-10 16:27:05,532::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-114::DEBUG::2014-04-10 16:27:05,532::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-114::DEBUG::2014-04-10 16:27:05,533::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-114::DEBUG::2014-04-10 16:27:05,534::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.71', 'elapsedTime': '8', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,313::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,313::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,314::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,314::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,314::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,315::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,316::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,316::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,316::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:06,316::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:07,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:07,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000476504 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:27:07,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:07,413::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430824 s, 854 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:27:07,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:07,516::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000291135 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:07,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:07,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328115 s, 2.0 MB/s\n'; <rc> = 0
>Thread-116::DEBUG::2014-04-10 16:27:08,561::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [2f699e05]
>Thread-116::DEBUG::2014-04-10 16:27:08,562::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-116::DEBUG::2014-04-10 16:27:08,562::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-116::DEBUG::2014-04-10 16:27:08,562::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-116::DEBUG::2014-04-10 16:27:08,562::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-116::DEBUG::2014-04-10 16:27:08,562::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-116::DEBUG::2014-04-10 16:27:08,564::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.74', 'elapsedTime': '11', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,323::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,323::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,323::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,323::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,324::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,325::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,325::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,325::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,325::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:11,325::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-117::DEBUG::2014-04-10 16:27:11,585::task::579::TaskManager.Task::(_updateState) Task=`0df9c73a-0a7f-413d-95ec-76bbfefcf860`::moving from state init -> state preparing
>Thread-117::INFO::2014-04-10 16:27:11,586::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-117::INFO::2014-04-10 16:27:11,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476504', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291135', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328115', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430824', 'lastCheck': '4.2', 'valid': True}}
>Thread-117::DEBUG::2014-04-10 16:27:11,586::task::1168::TaskManager.Task::(prepare) Task=`0df9c73a-0a7f-413d-95ec-76bbfefcf860`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476504', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291135', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328115', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430824', 'lastCheck': '4.2', 'valid': True}}
>Thread-117::DEBUG::2014-04-10 16:27:11,586::task::579::TaskManager.Task::(_updateState) Task=`0df9c73a-0a7f-413d-95ec-76bbfefcf860`::moving from state preparing -> state finished
>Thread-117::DEBUG::2014-04-10 16:27:11,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-117::DEBUG::2014-04-10 16:27:11,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-117::DEBUG::2014-04-10 16:27:11,587::task::974::TaskManager.Task::(_decref) Task=`0df9c73a-0a7f-413d-95ec-76bbfefcf860`::ref 0 aborting False
>Thread-118::DEBUG::2014-04-10 16:27:11,606::vm::600::vm.Vm::(_getCpuStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-118::DEBUG::2014-04-10 16:27:11,606::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-118::DEBUG::2014-04-10 16:27:11,606::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-118::DEBUG::2014-04-10 16:27:11,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-118::DEBUG::2014-04-10 16:27:11,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-120::DEBUG::2014-04-10 16:27:14,740::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-120::DEBUG::2014-04-10 16:27:14,740::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-120::DEBUG::2014-04-10 16:27:14,740::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-120::DEBUG::2014-04-10 16:27:14,741::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-120::DEBUG::2014-04-10 16:27:14,741::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-120::DEBUG::2014-04-10 16:27:14,742::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.1', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '35.47', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.89', 'elapsedTime': '17', 'vmType': 'kvm', 'cpuSys': '39.35', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,332::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,332::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,332::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,332::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,334::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,334::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,334::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:16,334::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:17,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:17,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000366652 s, 1.8 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:27:17,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:17,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000683468 s, 538 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:27:17,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:17,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000250493 s, 1.5 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:17,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:17,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000251868 s, 2.7 MB/s\n'; <rc> = 0
>Thread-122::DEBUG::2014-04-10 16:27:17,770::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [4902995d]
>Thread-122::DEBUG::2014-04-10 16:27:17,770::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-122::DEBUG::2014-04-10 16:27:17,771::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-122::DEBUG::2014-04-10 16:27:17,771::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-122::DEBUG::2014-04-10 16:27:17,771::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-122::DEBUG::2014-04-10 16:27:17,773::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.1', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '35.47', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.92', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '39.35', 'appsList': [], 'guestIPs': ''}]}
>Thread-124::DEBUG::2014-04-10 16:27:20,803::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-124::DEBUG::2014-04-10 16:27:20,803::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-124::DEBUG::2014-04-10 16:27:20,804::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-124::DEBUG::2014-04-10 16:27:20,804::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-124::DEBUG::2014-04-10 16:27:20,804::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-124::DEBUG::2014-04-10 16:27:20,805::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.1', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '35.47', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '39.35', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,341::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,341::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,341::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,341::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,343::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,343::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,343::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:21,343::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-126::DEBUG::2014-04-10 16:27:23,873::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-126::DEBUG::2014-04-10 16:27:23,873::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-126::DEBUG::2014-04-10 16:27:23,873::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-126::DEBUG::2014-04-10 16:27:23,874::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-126::DEBUG::2014-04-10 16:27:23,874::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-126::DEBUG::2014-04-10 16:27:23,875::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '35.47', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'elapsedTime': '27', 'vmType': 'kvm', 'cpuSys': '39.35', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,349::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,350::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,350::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,350::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,351::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,352::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,352::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:26,352::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-127::DEBUG::2014-04-10 16:27:26,929::task::579::TaskManager.Task::(_updateState) Task=`5696c852-3d1c-42d8-ab1e-9d52320aae9f`::moving from state init -> state preparing
>Thread-127::INFO::2014-04-10 16:27:26,930::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-127::INFO::2014-04-10 16:27:26,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366652', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250493', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251868', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683468', 'lastCheck': '9.5', 'valid': True}}
>Thread-127::DEBUG::2014-04-10 16:27:26,930::task::1168::TaskManager.Task::(prepare) Task=`5696c852-3d1c-42d8-ab1e-9d52320aae9f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366652', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250493', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251868', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683468', 'lastCheck': '9.5', 'valid': True}}
>Thread-127::DEBUG::2014-04-10 16:27:26,930::task::579::TaskManager.Task::(_updateState) Task=`5696c852-3d1c-42d8-ab1e-9d52320aae9f`::moving from state preparing -> state finished
>Thread-127::DEBUG::2014-04-10 16:27:26,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-127::DEBUG::2014-04-10 16:27:26,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-127::DEBUG::2014-04-10 16:27:26,931::task::974::TaskManager.Task::(_decref) Task=`5696c852-3d1c-42d8-ab1e-9d52320aae9f`::ref 0 aborting False
>Thread-128::DEBUG::2014-04-10 16:27:26,950::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-128::DEBUG::2014-04-10 16:27:26,951::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-128::DEBUG::2014-04-10 16:27:26,951::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-128::DEBUG::2014-04-10 16:27:26,951::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:27,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:27,407::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000897785 s, 733 kB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:27:27,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:27,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000949189 s, 388 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:27:27,535::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:27,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000357581 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:27,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:27,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000212279 s, 3.2 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:27:28,281::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-130::DEBUG::2014-04-10 16:27:30,098::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [610954fd]
>Thread-130::DEBUG::2014-04-10 16:27:30,099::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-130::DEBUG::2014-04-10 16:27:30,099::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-130::DEBUG::2014-04-10 16:27:30,099::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-130::DEBUG::2014-04-10 16:27:30,099::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-130::DEBUG::2014-04-10 16:27:30,100::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '89.49', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.23', 'elapsedTime': '33', 'vmType': 'kvm', 'cpuSys': '11.18', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,359::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,359::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,359::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,359::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,361::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,361::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,361::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:31,361::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-132::DEBUG::2014-04-10 16:27:33,129::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-132::DEBUG::2014-04-10 16:27:33,129::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-132::DEBUG::2014-04-10 16:27:33,129::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-132::DEBUG::2014-04-10 16:27:33,130::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-132::DEBUG::2014-04-10 16:27:33,130::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-132::DEBUG::2014-04-10 16:27:33,131::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '89.49', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.26', 'elapsedTime': '36', 'vmType': 'kvm', 'cpuSys': '11.18', 'appsList': [], 'guestIPs': ''}]}
>Thread-134::DEBUG::2014-04-10 16:27:36,157::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [45e79bf3]
>Thread-134::DEBUG::2014-04-10 16:27:36,157::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-134::DEBUG::2014-04-10 16:27:36,157::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-134::DEBUG::2014-04-10 16:27:36,157::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-134::DEBUG::2014-04-10 16:27:36,157::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-134::DEBUG::2014-04-10 16:27:36,158::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '89.49', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.27', 'elapsedTime': '39', 'vmType': 'kvm', 'cpuSys': '11.18', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,367::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,367::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,368::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,368::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,369::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,370::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,370::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:36,370::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:37,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:37,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000418052 s, 1.6 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:27:37,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:37,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000330297 s, 1.1 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:27:37,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:37,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00032445 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:37,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:37,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269164 s, 2.5 MB/s\n'; <rc> = 0
>Thread-136::DEBUG::2014-04-10 16:27:39,186::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-136::DEBUG::2014-04-10 16:27:39,186::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-136::DEBUG::2014-04-10 16:27:39,187::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-136::DEBUG::2014-04-10 16:27:39,187::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-136::DEBUG::2014-04-10 16:27:39,187::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-136::DEBUG::2014-04-10 16:27:39,188::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '89.49', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.30', 'elapsedTime': '42', 'vmType': 'kvm', 'cpuSys': '11.18', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,375::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,375::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,375::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,375::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,377::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,377::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,377::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:41,377::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-137::DEBUG::2014-04-10 16:27:42,210::task::579::TaskManager.Task::(_updateState) Task=`5992f013-e6ee-4b7f-ba94-8ef4442992fe`::moving from state init -> state preparing
>Thread-137::INFO::2014-04-10 16:27:42,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-137::INFO::2014-04-10 16:27:42,211::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418052', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032445', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269164', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330297', 'lastCheck': '4.8', 'valid': True}}
>Thread-137::DEBUG::2014-04-10 16:27:42,211::task::1168::TaskManager.Task::(prepare) Task=`5992f013-e6ee-4b7f-ba94-8ef4442992fe`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418052', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032445', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269164', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330297', 'lastCheck': '4.8', 'valid': True}}
>Thread-137::DEBUG::2014-04-10 16:27:42,211::task::579::TaskManager.Task::(_updateState) Task=`5992f013-e6ee-4b7f-ba94-8ef4442992fe`::moving from state preparing -> state finished
>Thread-137::DEBUG::2014-04-10 16:27:42,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-137::DEBUG::2014-04-10 16:27:42,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-137::DEBUG::2014-04-10 16:27:42,211::task::974::TaskManager.Task::(_decref) Task=`5992f013-e6ee-4b7f-ba94-8ef4442992fe`::ref 0 aborting False
>Thread-138::DEBUG::2014-04-10 16:27:42,231::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-138::DEBUG::2014-04-10 16:27:42,231::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-138::DEBUG::2014-04-10 16:27:42,231::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-138::DEBUG::2014-04-10 16:27:42,231::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-140::DEBUG::2014-04-10 16:27:45,339::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-140::DEBUG::2014-04-10 16:27:45,339::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-140::DEBUG::2014-04-10 16:27:45,340::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-140::DEBUG::2014-04-10 16:27:45,340::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-140::DEBUG::2014-04-10 16:27:45,340::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-140::DEBUG::2014-04-10 16:27:45,352::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '53.58', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'elapsedTime': '48', 'vmType': 'kvm', 'cpuSys': '9.58', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,384::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,384::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,384::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,385::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,386::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,386::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,386::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:46,387::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:47,438::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:47,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000387002 s, 1.7 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:27:47,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:47,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000371254 s, 991 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:27:47,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:47,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000404185 s, 943 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:47,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:47,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319299 s, 2.1 MB/s\n'; <rc> = 0
>Thread-142::DEBUG::2014-04-10 16:27:48,383::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-142::DEBUG::2014-04-10 16:27:48,383::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-142::DEBUG::2014-04-10 16:27:48,383::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-142::DEBUG::2014-04-10 16:27:48,384::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-142::DEBUG::2014-04-10 16:27:48,384::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-142::DEBUG::2014-04-10 16:27:48,385::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '53.58', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.48', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '9.58', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,393::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,393::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,394::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,394::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,395::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,395::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,395::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:51,396::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-144::DEBUG::2014-04-10 16:27:51,414::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-144::DEBUG::2014-04-10 16:27:51,415::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-144::DEBUG::2014-04-10 16:27:51,415::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-144::DEBUG::2014-04-10 16:27:51,415::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-144::DEBUG::2014-04-10 16:27:51,415::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-144::DEBUG::2014-04-10 16:27:51,416::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '53.58', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.50', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '9.58', 'appsList': [], 'guestIPs': ''}]}
>Thread-146::DEBUG::2014-04-10 16:27:54,444::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-146::DEBUG::2014-04-10 16:27:54,444::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-146::DEBUG::2014-04-10 16:27:54,444::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-146::DEBUG::2014-04-10 16:27:54,444::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-146::DEBUG::2014-04-10 16:27:54,444::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-146::DEBUG::2014-04-10 16:27:54,446::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '53.58', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.53', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '9.58', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,402::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,402::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,403::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,403::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,404::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,404::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,404::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>GuestMonitor-vm2::DEBUG::2014-04-10 16:27:56,405::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-28::DEBUG::2014-04-10 16:27:57,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:27:57,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000449016 s, 1.5 MB/s\n'; <rc> = 0
>Thread-147::DEBUG::2014-04-10 16:27:57,473::task::579::TaskManager.Task::(_updateState) Task=`c78947ec-5660-4766-b161-da5314ea2c83`::moving from state init -> state preparing
>Thread-147::INFO::2014-04-10 16:27:57,476::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-147::INFO::2014-04-10 16:27:57,480::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387002', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404185', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319299', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371254', 'lastCheck': '10.0', 'valid': True}}
>Thread-147::DEBUG::2014-04-10 16:27:57,482::task::1168::TaskManager.Task::(prepare) Task=`c78947ec-5660-4766-b161-da5314ea2c83`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387002', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404185', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319299', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371254', 'lastCheck': '10.0', 'valid': True}}
>Thread-147::DEBUG::2014-04-10 16:27:57,483::task::579::TaskManager.Task::(_updateState) Task=`c78947ec-5660-4766-b161-da5314ea2c83`::moving from state preparing -> state finished
>Thread-147::DEBUG::2014-04-10 16:27:57,484::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-147::DEBUG::2014-04-10 16:27:57,486::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-147::DEBUG::2014-04-10 16:27:57,487::task::974::TaskManager.Task::(_decref) Task=`c78947ec-5660-4766-b161-da5314ea2c83`::ref 0 aborting False
>Thread-34::DEBUG::2014-04-10 16:27:57,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:27:57,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000361584 s, 1.0 MB/s\n'; <rc> = 0
>Thread-148::DEBUG::2014-04-10 16:27:57,522::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc stats not available
>Thread-148::DEBUG::2014-04-10 16:27:57,522::vm::656::vm.Vm::(_getDiskStats) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda stats not available
>Thread-148::DEBUG::2014-04-10 16:27:57,522::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk hdc latency not available
>Thread-148::DEBUG::2014-04-10 16:27:57,522::vm::695::vm.Vm::(_getDiskLatency) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Disk vda latency not available
>Thread-27::DEBUG::2014-04-10 16:27:57,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:27:57,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000345982 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:27:57,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:27:57,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000352643 s, 1.9 MB/s\n'; <rc> = 0
>Thread-107::DEBUG::2014-04-10 16:27:57,915::task::579::TaskManager.Task::(_updateState) Task=`c4d82fd9-9d9d-4f42-8cac-803250a0d0cc`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:27:57,915::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-107::INFO::2014-04-10 16:27:57,926::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-107::DEBUG::2014-04-10 16:27:57,926::task::1168::TaskManager.Task::(prepare) Task=`c4d82fd9-9d9d-4f42-8cac-803250a0d0cc`::finished: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-107::DEBUG::2014-04-10 16:27:57,926::task::579::TaskManager.Task::(_updateState) Task=`c4d82fd9-9d9d-4f42-8cac-803250a0d0cc`::moving from state preparing -> state finished
>Thread-107::DEBUG::2014-04-10 16:27:57,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:27:57,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:27:57,927::task::974::TaskManager.Task::(_decref) Task=`c4d82fd9-9d9d-4f42-8cac-803250a0d0cc`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:27:58,317::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-28::DEBUG::2014-04-10 16:28:07,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:28:07,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000437983 s, 1.5 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:28:07,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:28:07,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000397731 s, 925 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:28:07,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:07,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000340568 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:07,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:07,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265258 s, 2.5 MB/s\n'; <rc> = 0
>Thread-153::DEBUG::2014-04-10 16:28:12,757::task::579::TaskManager.Task::(_updateState) Task=`f25be9f6-52c8-46a0-af9a-b7aa46e837e6`::moving from state init -> state preparing
>Thread-153::INFO::2014-04-10 16:28:12,757::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-153::INFO::2014-04-10 16:28:12,758::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437983', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340568', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265258', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397731', 'lastCheck': '5.2', 'valid': True}}
>Thread-153::DEBUG::2014-04-10 16:28:12,758::task::1168::TaskManager.Task::(prepare) Task=`f25be9f6-52c8-46a0-af9a-b7aa46e837e6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437983', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340568', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265258', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397731', 'lastCheck': '5.2', 'valid': True}}
>Thread-153::DEBUG::2014-04-10 16:28:12,758::task::579::TaskManager.Task::(_updateState) Task=`f25be9f6-52c8-46a0-af9a-b7aa46e837e6`::moving from state preparing -> state finished
>Thread-153::DEBUG::2014-04-10 16:28:12,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-153::DEBUG::2014-04-10 16:28:12,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-153::DEBUG::2014-04-10 16:28:12,759::task::974::TaskManager.Task::(_decref) Task=`f25be9f6-52c8-46a0-af9a-b7aa46e837e6`::ref 0 aborting False
>Thread-28::DEBUG::2014-04-10 16:28:17,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:28:17,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000490003 s, 1.3 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:28:17,530::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:28:17,535::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000417454 s, 882 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:28:17,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:17,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000411918 s, 925 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:17,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:17,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033627 s, 2.0 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:28:27,516::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-28::DEBUG::2014-04-10 16:28:27,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000457245 s, 1.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:28:27,543::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:28:27,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437267 s, 842 kB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:28:27,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:27,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000322965 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:27,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:27,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371896 s, 1.8 MB/s\n'; <rc> = 0
>Thread-159::DEBUG::2014-04-10 16:28:27,949::task::579::TaskManager.Task::(_updateState) Task=`f680742e-3d49-423b-b00f-e8ec55d23b47`::moving from state init -> state preparing
>Thread-159::INFO::2014-04-10 16:28:27,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-159::INFO::2014-04-10 16:28:27,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322965', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371896', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '0.4', 'valid': True}}
>Thread-159::DEBUG::2014-04-10 16:28:27,949::task::1168::TaskManager.Task::(prepare) Task=`f680742e-3d49-423b-b00f-e8ec55d23b47`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322965', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371896', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '0.4', 'valid': True}}
>Thread-159::DEBUG::2014-04-10 16:28:27,950::task::579::TaskManager.Task::(_updateState) Task=`f680742e-3d49-423b-b00f-e8ec55d23b47`::moving from state preparing -> state finished
>Thread-159::DEBUG::2014-04-10 16:28:27,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-159::DEBUG::2014-04-10 16:28:27,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-159::DEBUG::2014-04-10 16:28:27,950::task::974::TaskManager.Task::(_decref) Task=`f680742e-3d49-423b-b00f-e8ec55d23b47`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:28:28,352::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-27::DEBUG::2014-04-10 16:28:37,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:37,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00030992 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:37,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:37,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000298083 s, 2.3 MB/s\n'; <rc> = 0
>Thread-165::DEBUG::2014-04-10 16:28:43,184::task::579::TaskManager.Task::(_updateState) Task=`03b6d02f-8847-47e9-b033-a6697df5910e`::moving from state init -> state preparing
>Thread-165::INFO::2014-04-10 16:28:43,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-165::INFO::2014-04-10 16:28:43,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '15.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030992', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298083', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '15.6', 'valid': True}}
>Thread-165::DEBUG::2014-04-10 16:28:43,185::task::1168::TaskManager.Task::(prepare) Task=`03b6d02f-8847-47e9-b033-a6697df5910e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '15.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030992', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298083', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '15.6', 'valid': True}}
>Thread-165::DEBUG::2014-04-10 16:28:43,185::task::579::TaskManager.Task::(_updateState) Task=`03b6d02f-8847-47e9-b033-a6697df5910e`::moving from state preparing -> state finished
>Thread-165::DEBUG::2014-04-10 16:28:43,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-165::DEBUG::2014-04-10 16:28:43,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-165::DEBUG::2014-04-10 16:28:43,185::task::974::TaskManager.Task::(_decref) Task=`03b6d02f-8847-47e9-b033-a6697df5910e`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:28:47,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:47,641::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000287528 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:47,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:47,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330254 s, 2.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:28:57,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:28:57,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000299221 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:28:57,703::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:28:57,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031927 s, 2.1 MB/s\n'; <rc> = 0
>Thread-107::DEBUG::2014-04-10 16:28:58,133::task::579::TaskManager.Task::(_updateState) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:28:58,134::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>VM Channels Listener::DEBUG::2014-04-10 16:28:58,389::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-171::DEBUG::2014-04-10 16:28:58,393::task::579::TaskManager.Task::(_updateState) Task=`9cea3ae0-4761-4613-968f-fade80a17897`::moving from state init -> state preparing
>Thread-171::INFO::2014-04-10 16:28:58,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-171::INFO::2014-04-10 16:28:58,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '30.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299221', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031927', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '30.8', 'valid': True}}
>Thread-171::DEBUG::2014-04-10 16:28:58,394::task::1168::TaskManager.Task::(prepare) Task=`9cea3ae0-4761-4613-968f-fade80a17897`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '30.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299221', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031927', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '30.8', 'valid': True}}
>Thread-171::DEBUG::2014-04-10 16:28:58,394::task::579::TaskManager.Task::(_updateState) Task=`9cea3ae0-4761-4613-968f-fade80a17897`::moving from state preparing -> state finished
>Thread-171::DEBUG::2014-04-10 16:28:58,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-171::DEBUG::2014-04-10 16:28:58,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-171::DEBUG::2014-04-10 16:28:58,394::task::974::TaskManager.Task::(_decref) Task=`9cea3ae0-4761-4613-968f-fade80a17897`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:29:07,663::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:07,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00035615 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:07,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:07,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303158 s, 2.2 MB/s\n'; <rc> = 0
>Thread-177::DEBUG::2014-04-10 16:29:13,933::task::579::TaskManager.Task::(_updateState) Task=`dcddc1da-0623-4153-adb6-28bfcb6857a4`::moving from state init -> state preparing
>Thread-177::INFO::2014-04-10 16:29:13,933::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-177::INFO::2014-04-10 16:29:13,934::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '46.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035615', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303158', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '46.4', 'valid': True}}
>Thread-177::DEBUG::2014-04-10 16:29:13,934::task::1168::TaskManager.Task::(prepare) Task=`dcddc1da-0623-4153-adb6-28bfcb6857a4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '46.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035615', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303158', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '46.4', 'valid': True}}
>Thread-177::DEBUG::2014-04-10 16:29:13,934::task::579::TaskManager.Task::(_updateState) Task=`dcddc1da-0623-4153-adb6-28bfcb6857a4`::moving from state preparing -> state finished
>Thread-177::DEBUG::2014-04-10 16:29:13,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-177::DEBUG::2014-04-10 16:29:13,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-177::DEBUG::2014-04-10 16:29:13,935::task::974::TaskManager.Task::(_decref) Task=`dcddc1da-0623-4153-adb6-28bfcb6857a4`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:29:17,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:17,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00038832 s, 981 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:17,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:17,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032167 s, 2.1 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:29:27,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:27,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000272837 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:27,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:27,748::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000231172 s, 2.9 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:29:28,428::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-183::DEBUG::2014-04-10 16:29:29,150::task::579::TaskManager.Task::(_updateState) Task=`c34554ec-9a5c-4026-9ed9-8c7a04403584`::moving from state init -> state preparing
>Thread-183::INFO::2014-04-10 16:29:29,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-183::INFO::2014-04-10 16:29:29,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '61.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272837', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231172', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '61.6', 'valid': True}}
>Thread-183::DEBUG::2014-04-10 16:29:29,150::task::1168::TaskManager.Task::(prepare) Task=`c34554ec-9a5c-4026-9ed9-8c7a04403584`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457245', 'lastCheck': '61.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272837', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231172', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437267', 'lastCheck': '61.6', 'valid': True}}
>Thread-183::DEBUG::2014-04-10 16:29:29,151::task::579::TaskManager.Task::(_updateState) Task=`c34554ec-9a5c-4026-9ed9-8c7a04403584`::moving from state preparing -> state finished
>Thread-183::DEBUG::2014-04-10 16:29:29,151::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-183::DEBUG::2014-04-10 16:29:29,151::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-183::DEBUG::2014-04-10 16:29:29,151::task::974::TaskManager.Task::(_decref) Task=`c34554ec-9a5c-4026-9ed9-8c7a04403584`::ref 0 aborting False
>Thread-28::ERROR::2014-04-10 16:29:37,528::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-28::DEBUG::2014-04-10 16:29:37,531::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 changed its status to Invalid
>Thread-187::DEBUG::2014-04-10 16:29:37,533::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-28::DEBUG::2014-04-10 16:29:37,533::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-187::DEBUG::2014-04-10 16:29:37,536::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-187::DEBUG::2014-04-10 16:29:37,540::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-34::ERROR::2014-04-10 16:29:37,551::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::DEBUG::2014-04-10 16:29:37,551::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 changed its status to Invalid
>Thread-189::DEBUG::2014-04-10 16:29:37,552::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-34::DEBUG::2014-04-10 16:29:37,552::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-189::DEBUG::2014-04-10 16:29:37,553::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-189::DEBUG::2014-04-10 16:29:37,555::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-27::DEBUG::2014-04-10 16:29:37,703::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:37,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00039108 s, 974 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:37,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:37,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029016 s, 2.3 MB/s\n'; <rc> = 0
>Thread-193::DEBUG::2014-04-10 16:29:44,370::task::579::TaskManager.Task::(_updateState) Task=`97dc08f9-436d-49b4-a1e2-fdde9106c1a5`::moving from state init -> state preparing
>Thread-193::INFO::2014-04-10 16:29:44,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-193::INFO::2014-04-10 16:29:44,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039108', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029016', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.8', 'valid': False}}
>Thread-193::DEBUG::2014-04-10 16:29:44,371::task::1168::TaskManager.Task::(prepare) Task=`97dc08f9-436d-49b4-a1e2-fdde9106c1a5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039108', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029016', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.8', 'valid': False}}
>Thread-193::DEBUG::2014-04-10 16:29:44,371::task::579::TaskManager.Task::(_updateState) Task=`97dc08f9-436d-49b4-a1e2-fdde9106c1a5`::moving from state preparing -> state finished
>Thread-193::DEBUG::2014-04-10 16:29:44,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-193::DEBUG::2014-04-10 16:29:44,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-193::DEBUG::2014-04-10 16:29:44,372::task::974::TaskManager.Task::(_decref) Task=`97dc08f9-436d-49b4-a1e2-fdde9106c1a5`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:29:47,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:47,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000370779 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:47,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:47,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337115 s, 2.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:29:57,725::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::DEBUG::2014-04-10 16:29:57,735::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::DEBUG::2014-04-10 16:29:57,736::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-27::DEBUG::2014-04-10 16:29:57,741::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-27::DEBUG::2014-04-10 16:29:57,743::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-27::INFO::2014-04-10 16:29:57,744::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-27::INFO::2014-04-10 16:29:57,744::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-27::DEBUG::2014-04-10 16:29:57,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:29:57,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000249145 s, 1.5 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:29:57,778::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 16:29:57,821::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 16:29:57,825::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-33::DEBUG::2014-04-10 16:29:57,833::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-33::DEBUG::2014-04-10 16:29:57,839::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-33::INFO::2014-04-10 16:29:57,840::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-33::INFO::2014-04-10 16:29:57,840::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-33::DEBUG::2014-04-10 16:29:57,876::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:29:57,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000221347 s, 3.0 MB/s\n'; <rc> = 0
>Thread-107::ERROR::2014-04-10 16:29:58,154::task::850::TaskManager.Task::(_setError) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3070, in getVolumeSize
>    apparentsize = str(volClass.getVSize(dom, imgUUID, volUUID, bs=1))
>  File "/usr/share/vdsm/storage/fileVolume.py", line 418, in getVSize
>    return int(sdobj.oop.os.stat(volPath).st_size / bs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-107::DEBUG::2014-04-10 16:29:58,161::task::869::TaskManager.Task::(_run) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::Task._run: b5cba5f2-f337-46cd-a52b-f254b2abe92b ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:29:58,161::task::1194::TaskManager.Task::(stop) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:29:58,162::task::974::TaskManager.Task::(_decref) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::ref 1 aborting True
>Thread-107::DEBUG::2014-04-10 16:29:58,162::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-107::INFO::2014-04-10 16:29:58,162::task::1151::TaskManager.Task::(prepare) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::aborting: Task is aborted: u'' - code 100
>Thread-107::DEBUG::2014-04-10 16:29:58,163::task::1156::TaskManager.Task::(prepare) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::Prepare: aborted: 
>Thread-107::DEBUG::2014-04-10 16:29:58,163::task::974::TaskManager.Task::(_decref) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:29:58,163::task::909::TaskManager.Task::(_doAbort) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:29:58,163::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:29:58,163::task::579::TaskManager.Task::(_updateState) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:29:58,163::task::534::TaskManager.Task::(__state_aborting) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:29:58,164::task::579::TaskManager.Task::(_updateState) Task=`b5cba5f2-f337-46cd-a52b-f254b2abe92b`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:29:58,164::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:29:58,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:29:58,164::dispatcher::70::Storage.Dispatcher.Protect::(run) 
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/dispatcher.py", line 62, in run
>    result = ctask.prepare(self.func, *args, **kwargs)
>  File "/usr/share/vdsm/storage/task.py", line 1159, in prepare
>    raise self.error
>Timeout
>Thread-107::ERROR::2014-04-10 16:29:58,165::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>VM Channels Listener::DEBUG::2014-04-10 16:29:58,464::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-207::DEBUG::2014-04-10 16:30:00,037::task::579::TaskManager.Task::(_updateState) Task=`48c0f752-84dc-4c16-a267-96fbd0097ef5`::moving from state init -> state preparing
>Thread-207::INFO::2014-04-10 16:30:00,037::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-207::INFO::2014-04-10 16:30:00,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249145', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221347', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.5', 'valid': False}}
>Thread-207::DEBUG::2014-04-10 16:30:00,038::task::1168::TaskManager.Task::(prepare) Task=`48c0f752-84dc-4c16-a267-96fbd0097ef5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249145', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221347', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.5', 'valid': False}}
>Thread-207::DEBUG::2014-04-10 16:30:00,038::task::579::TaskManager.Task::(_updateState) Task=`48c0f752-84dc-4c16-a267-96fbd0097ef5`::moving from state preparing -> state finished
>Thread-207::DEBUG::2014-04-10 16:30:00,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-207::DEBUG::2014-04-10 16:30:00,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-207::DEBUG::2014-04-10 16:30:00,038::task::974::TaskManager.Task::(_decref) Task=`48c0f752-84dc-4c16-a267-96fbd0097ef5`::ref 0 aborting False
>Thread-210::DEBUG::2014-04-10 16:30:03,340::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-210::DEBUG::2014-04-10 16:30:03,341::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.20', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.15', 'elapsedTime': '186', 'vmType': 'kvm', 'cpuSys': '0.64', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 16:30:07,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:07,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000349252 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:07,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:07,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339667 s, 2.0 MB/s\n'; <rc> = 0
>Thread-214::DEBUG::2014-04-10 16:30:15,448::task::579::TaskManager.Task::(_updateState) Task=`e8b05495-3035-4254-98fe-cbd8d5b09400`::moving from state init -> state preparing
>Thread-214::INFO::2014-04-10 16:30:15,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-214::INFO::2014-04-10 16:30:15,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349252', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339667', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}}
>Thread-214::DEBUG::2014-04-10 16:30:15,449::task::1168::TaskManager.Task::(prepare) Task=`e8b05495-3035-4254-98fe-cbd8d5b09400`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349252', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339667', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}}
>Thread-214::DEBUG::2014-04-10 16:30:15,449::task::579::TaskManager.Task::(_updateState) Task=`e8b05495-3035-4254-98fe-cbd8d5b09400`::moving from state preparing -> state finished
>Thread-214::DEBUG::2014-04-10 16:30:15,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-214::DEBUG::2014-04-10 16:30:15,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-214::DEBUG::2014-04-10 16:30:15,449::task::974::TaskManager.Task::(_decref) Task=`e8b05495-3035-4254-98fe-cbd8d5b09400`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:30:17,791::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:17,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000282852 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:17,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:17,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316372 s, 2.1 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:30:27,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:27,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00039082 s, 975 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:27,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:27,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032848 s, 2.0 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:30:28,500::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-220::DEBUG::2014-04-10 16:30:30,648::task::579::TaskManager.Task::(_updateState) Task=`19549e11-1733-44fb-a418-c7b47d7a1308`::moving from state init -> state preparing
>Thread-220::INFO::2014-04-10 16:30:30,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-220::INFO::2014-04-10 16:30:30,649::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039082', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032848', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.1', 'valid': False}}
>Thread-220::DEBUG::2014-04-10 16:30:30,649::task::1168::TaskManager.Task::(prepare) Task=`19549e11-1733-44fb-a418-c7b47d7a1308`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039082', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032848', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.1', 'valid': False}}
>Thread-220::DEBUG::2014-04-10 16:30:30,649::task::579::TaskManager.Task::(_updateState) Task=`19549e11-1733-44fb-a418-c7b47d7a1308`::moving from state preparing -> state finished
>Thread-220::DEBUG::2014-04-10 16:30:30,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-220::DEBUG::2014-04-10 16:30:30,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-220::DEBUG::2014-04-10 16:30:30,649::task::974::TaskManager.Task::(_decref) Task=`19549e11-1733-44fb-a418-c7b47d7a1308`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:30:37,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:37,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000390009 s, 977 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:37,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:37,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025864 s, 2.6 MB/s\n'; <rc> = 0
>Thread-226::DEBUG::2014-04-10 16:30:45,859::task::579::TaskManager.Task::(_updateState) Task=`d1e3a4b0-9690-4be5-a6b8-40a0f9139eaf`::moving from state init -> state preparing
>Thread-226::INFO::2014-04-10 16:30:45,860::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-226::INFO::2014-04-10 16:30:45,860::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390009', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025864', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.3', 'valid': False}}
>Thread-226::DEBUG::2014-04-10 16:30:45,860::task::1168::TaskManager.Task::(prepare) Task=`d1e3a4b0-9690-4be5-a6b8-40a0f9139eaf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390009', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025864', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.3', 'valid': False}}
>Thread-226::DEBUG::2014-04-10 16:30:45,860::task::579::TaskManager.Task::(_updateState) Task=`d1e3a4b0-9690-4be5-a6b8-40a0f9139eaf`::moving from state preparing -> state finished
>Thread-226::DEBUG::2014-04-10 16:30:45,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-226::DEBUG::2014-04-10 16:30:45,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-226::DEBUG::2014-04-10 16:30:45,861::task::974::TaskManager.Task::(_decref) Task=`d1e3a4b0-9690-4be5-a6b8-40a0f9139eaf`::ref 0 aborting False
>Thread-28::ERROR::2014-04-10 16:30:47,545::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-28::DEBUG::2014-04-10 16:30:47,547::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-34::ERROR::2014-04-10 16:30:47,560::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-27::DEBUG::2014-04-10 16:30:47,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:47,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000304912 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:47,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:47,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302036 s, 2.2 MB/s\n'; <rc> = 0
>Thread-28::DEBUG::2014-04-10 16:30:57,550::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-34::DEBUG::2014-04-10 16:30:57,565::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-199::WARNING::2014-04-10 16:30:57,729::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-201::WARNING::2014-04-10 16:30:57,731::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-203::WARNING::2014-04-10 16:30:57,805::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-205::WARNING::2014-04-10 16:30:57,810::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-27::DEBUG::2014-04-10 16:30:57,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:30:57,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000445198 s, 856 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:30:57,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:30:57,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361877 s, 1.9 MB/s\n'; <rc> = 0
>Thread-107::DEBUG::2014-04-10 16:30:58,369::task::579::TaskManager.Task::(_updateState) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:30:58,370::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>VM Channels Listener::DEBUG::2014-04-10 16:30:58,537::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-240::DEBUG::2014-04-10 16:31:01,069::task::579::TaskManager.Task::(_updateState) Task=`7914d3fd-79f7-49e5-8609-26a8b6c37e5a`::moving from state init -> state preparing
>Thread-240::INFO::2014-04-10 16:31:01,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-240::INFO::2014-04-10 16:31:01,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445198', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361877', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.5', 'valid': False}}
>Thread-240::DEBUG::2014-04-10 16:31:01,071::task::1168::TaskManager.Task::(prepare) Task=`7914d3fd-79f7-49e5-8609-26a8b6c37e5a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445198', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361877', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.5', 'valid': False}}
>Thread-240::DEBUG::2014-04-10 16:31:01,071::task::579::TaskManager.Task::(_updateState) Task=`7914d3fd-79f7-49e5-8609-26a8b6c37e5a`::moving from state preparing -> state finished
>Thread-240::DEBUG::2014-04-10 16:31:01,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-240::DEBUG::2014-04-10 16:31:01,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-240::DEBUG::2014-04-10 16:31:01,071::task::974::TaskManager.Task::(_decref) Task=`7914d3fd-79f7-49e5-8609-26a8b6c37e5a`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:31:07,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:07,871::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000361402 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:07,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:07,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314154 s, 2.1 MB/s\n'; <rc> = 0
>Thread-246::DEBUG::2014-04-10 16:31:16,518::task::579::TaskManager.Task::(_updateState) Task=`951d5b98-2cf4-440e-b386-3d062832e4b8`::moving from state init -> state preparing
>Thread-246::INFO::2014-04-10 16:31:16,519::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-246::INFO::2014-04-10 16:31:16,519::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361402', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314154', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.0', 'valid': False}}
>Thread-246::DEBUG::2014-04-10 16:31:16,519::task::1168::TaskManager.Task::(prepare) Task=`951d5b98-2cf4-440e-b386-3d062832e4b8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361402', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314154', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.0', 'valid': False}}
>Thread-246::DEBUG::2014-04-10 16:31:16,520::task::579::TaskManager.Task::(_updateState) Task=`951d5b98-2cf4-440e-b386-3d062832e4b8`::moving from state preparing -> state finished
>Thread-246::DEBUG::2014-04-10 16:31:16,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-246::DEBUG::2014-04-10 16:31:16,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-246::DEBUG::2014-04-10 16:31:16,520::task::974::TaskManager.Task::(_decref) Task=`951d5b98-2cf4-440e-b386-3d062832e4b8`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:31:17,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:17,885::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000403873 s, 943 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:18,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:18,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348291 s, 1.9 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:31:27,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:27,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000279109 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:28,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:28,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372388 s, 1.8 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:31:28,573::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-252::DEBUG::2014-04-10 16:31:31,970::task::579::TaskManager.Task::(_updateState) Task=`d96bcebc-0d4e-474b-b8fd-4f14ce10c91c`::moving from state init -> state preparing
>Thread-252::INFO::2014-04-10 16:31:31,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-252::INFO::2014-04-10 16:31:31,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279109', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372388', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.4', 'valid': False}}
>Thread-252::DEBUG::2014-04-10 16:31:31,971::task::1168::TaskManager.Task::(prepare) Task=`d96bcebc-0d4e-474b-b8fd-4f14ce10c91c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279109', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372388', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.4', 'valid': False}}
>Thread-252::DEBUG::2014-04-10 16:31:31,971::task::579::TaskManager.Task::(_updateState) Task=`d96bcebc-0d4e-474b-b8fd-4f14ce10c91c`::moving from state preparing -> state finished
>Thread-252::DEBUG::2014-04-10 16:31:31,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-252::DEBUG::2014-04-10 16:31:31,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-252::DEBUG::2014-04-10 16:31:31,971::task::974::TaskManager.Task::(_decref) Task=`d96bcebc-0d4e-474b-b8fd-4f14ce10c91c`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:31:37,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:37,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000300107 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:38,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:38,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000238244 s, 2.8 MB/s\n'; <rc> = 0
>Thread-258::DEBUG::2014-04-10 16:31:47,199::task::579::TaskManager.Task::(_updateState) Task=`fbfaf8f3-60c7-45f3-a21a-2b4592bdeb44`::moving from state init -> state preparing
>Thread-258::INFO::2014-04-10 16:31:47,199::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-258::INFO::2014-04-10 16:31:47,199::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.7', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300107', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238244', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.6', 'valid': False}}
>Thread-258::DEBUG::2014-04-10 16:31:47,200::task::1168::TaskManager.Task::(prepare) Task=`fbfaf8f3-60c7-45f3-a21a-2b4592bdeb44`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.7', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300107', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238244', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.6', 'valid': False}}
>Thread-258::DEBUG::2014-04-10 16:31:47,200::task::579::TaskManager.Task::(_updateState) Task=`fbfaf8f3-60c7-45f3-a21a-2b4592bdeb44`::moving from state preparing -> state finished
>Thread-258::DEBUG::2014-04-10 16:31:47,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-258::DEBUG::2014-04-10 16:31:47,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-258::DEBUG::2014-04-10 16:31:47,201::task::974::TaskManager.Task::(_decref) Task=`fbfaf8f3-60c7-45f3-a21a-2b4592bdeb44`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:31:47,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:47,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000330648 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:48,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:48,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000817828 s, 820 kB/s\n'; <rc> = 0
>Thread-231::WARNING::2014-04-10 16:31:57,568::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-231::DEBUG::2014-04-10 16:31:57,573::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-233::WARNING::2014-04-10 16:31:57,576::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-233::DEBUG::2014-04-10 16:31:57,581::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-28::ERROR::2014-04-10 16:31:57,584::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-28::ERROR::2014-04-10 16:31:57,587::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-235::WARNING::2014-04-10 16:31:57,589::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-235::DEBUG::2014-04-10 16:31:57,607::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-237::WARNING::2014-04-10 16:31:57,603::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-237::DEBUG::2014-04-10 16:31:57,624::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-34::ERROR::2014-04-10 16:31:57,628::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:31:57,628::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-27::DEBUG::2014-04-10 16:31:57,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:31:57,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00026825 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:31:58,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:31:58,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294702 s, 2.3 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:31:58,607::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-268::DEBUG::2014-04-10 16:32:07,514::task::579::TaskManager.Task::(_updateState) Task=`1c92bb8f-3821-4779-bf0f-cf62b1cc479e`::moving from state init -> state preparing
>Thread-268::INFO::2014-04-10 16:32:07,514::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-268::INFO::2014-04-10 16:32:07,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '9.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026825', 'lastCheck': '9.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294702', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '9.9', 'valid': False}}
>Thread-268::DEBUG::2014-04-10 16:32:07,515::task::1168::TaskManager.Task::(prepare) Task=`1c92bb8f-3821-4779-bf0f-cf62b1cc479e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '9.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026825', 'lastCheck': '9.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294702', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '9.9', 'valid': False}}
>Thread-268::DEBUG::2014-04-10 16:32:07,515::task::579::TaskManager.Task::(_updateState) Task=`1c92bb8f-3821-4779-bf0f-cf62b1cc479e`::moving from state preparing -> state finished
>Thread-268::DEBUG::2014-04-10 16:32:07,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-268::DEBUG::2014-04-10 16:32:07,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-268::DEBUG::2014-04-10 16:32:07,515::task::974::TaskManager.Task::(_decref) Task=`1c92bb8f-3821-4779-bf0f-cf62b1cc479e`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:32:07,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:07,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00027832 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:08,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:08,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343495 s, 2.0 MB/s\n'; <rc> = 0
>Thread-275::DEBUG::2014-04-10 16:32:10,735::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-275::DEBUG::2014-04-10 16:32:10,736::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '72.37', 'elapsedTime': '313', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-277::DEBUG::2014-04-10 16:32:13,763::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [1a9b4afc]
>Thread-277::DEBUG::2014-04-10 16:32:13,765::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '75.39', 'elapsedTime': '316', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-279::DEBUG::2014-04-10 16:32:16,791::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [472a160c]
>Thread-279::DEBUG::2014-04-10 16:32:16,793::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '78.42', 'elapsedTime': '319', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 16:32:17,966::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:17,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000296059 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:18,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:18,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314879 s, 2.1 MB/s\n'; <rc> = 0
>Thread-281::DEBUG::2014-04-10 16:32:20,324::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [1e736b86]
>Thread-281::DEBUG::2014-04-10 16:32:20,325::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '81.96', 'elapsedTime': '323', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-282::DEBUG::2014-04-10 16:32:23,347::task::579::TaskManager.Task::(_updateState) Task=`bef31f28-4a0d-4ab2-93da-d4331f54b231`::moving from state init -> state preparing
>Thread-282::INFO::2014-04-10 16:32:23,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-282::INFO::2014-04-10 16:32:23,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296059', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314879', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.7', 'valid': False}}
>Thread-282::DEBUG::2014-04-10 16:32:23,348::task::1168::TaskManager.Task::(prepare) Task=`bef31f28-4a0d-4ab2-93da-d4331f54b231`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296059', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314879', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.7', 'valid': False}}
>Thread-282::DEBUG::2014-04-10 16:32:23,348::task::579::TaskManager.Task::(_updateState) Task=`bef31f28-4a0d-4ab2-93da-d4331f54b231`::moving from state preparing -> state finished
>Thread-282::DEBUG::2014-04-10 16:32:23,348::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-282::DEBUG::2014-04-10 16:32:23,348::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-282::DEBUG::2014-04-10 16:32:23,348::task::974::TaskManager.Task::(_decref) Task=`bef31f28-4a0d-4ab2-93da-d4331f54b231`::ref 0 aborting False
>Thread-285::DEBUG::2014-04-10 16:32:26,469::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-285::DEBUG::2014-04-10 16:32:26,470::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '88.10', 'elapsedTime': '329', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 16:32:27,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:27,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000265032 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:28,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:28,127::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289434 s, 2.3 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:32:28,640::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-287::DEBUG::2014-04-10 16:32:29,506::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-287::DEBUG::2014-04-10 16:32:29,508::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '91.14', 'elapsedTime': '332', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-289::DEBUG::2014-04-10 16:32:32,537::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-289::DEBUG::2014-04-10 16:32:32,538::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '94.17', 'elapsedTime': '335', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-291::DEBUG::2014-04-10 16:32:35,570::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-291::DEBUG::2014-04-10 16:32:35,572::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '97.20', 'elapsedTime': '338', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 16:32:37,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:38,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000273076 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:38,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:38,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284068 s, 2.4 MB/s\n'; <rc> = 0
>Thread-292::DEBUG::2014-04-10 16:32:38,594::task::579::TaskManager.Task::(_updateState) Task=`e65eb988-a5df-476b-ae54-327df2cccc18`::moving from state init -> state preparing
>Thread-292::INFO::2014-04-10 16:32:38,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-292::INFO::2014-04-10 16:32:38,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '41.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273076', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284068', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '41.0', 'valid': False}}
>Thread-292::DEBUG::2014-04-10 16:32:38,594::task::1168::TaskManager.Task::(prepare) Task=`e65eb988-a5df-476b-ae54-327df2cccc18`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '41.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273076', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284068', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '41.0', 'valid': False}}
>Thread-292::DEBUG::2014-04-10 16:32:38,595::task::579::TaskManager.Task::(_updateState) Task=`e65eb988-a5df-476b-ae54-327df2cccc18`::moving from state preparing -> state finished
>Thread-292::DEBUG::2014-04-10 16:32:38,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-292::DEBUG::2014-04-10 16:32:38,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-292::DEBUG::2014-04-10 16:32:38,595::task::974::TaskManager.Task::(_decref) Task=`e65eb988-a5df-476b-ae54-327df2cccc18`::ref 0 aborting False
>Thread-295::DEBUG::2014-04-10 16:32:41,762::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [cc3164a]
>Thread-295::DEBUG::2014-04-10 16:32:41,764::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '103.39', 'elapsedTime': '344', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-297::DEBUG::2014-04-10 16:32:44,791::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-297::DEBUG::2014-04-10 16:32:44,792::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '106.42', 'elapsedTime': '347', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-299::DEBUG::2014-04-10 16:32:47,820::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-299::DEBUG::2014-04-10 16:32:47,821::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '109.45', 'elapsedTime': '350', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-27::DEBUG::2014-04-10 16:32:48,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:48,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000379678 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:48,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:48,156::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000293494 s, 2.3 MB/s\n'; <rc> = 0
>Thread-301::DEBUG::2014-04-10 16:32:50,850::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-301::DEBUG::2014-04-10 16:32:50,852::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '112.48', 'elapsedTime': '354', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-302::DEBUG::2014-04-10 16:32:53,874::task::579::TaskManager.Task::(_updateState) Task=`beb2a1a9-a21f-496d-8ac3-ae3b2951166a`::moving from state init -> state preparing
>Thread-302::INFO::2014-04-10 16:32:53,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-302::INFO::2014-04-10 16:32:53,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '56.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379678', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293494', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '56.2', 'valid': False}}
>Thread-302::DEBUG::2014-04-10 16:32:53,875::task::1168::TaskManager.Task::(prepare) Task=`beb2a1a9-a21f-496d-8ac3-ae3b2951166a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '56.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379678', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293494', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '56.2', 'valid': False}}
>Thread-302::DEBUG::2014-04-10 16:32:53,875::task::579::TaskManager.Task::(_updateState) Task=`beb2a1a9-a21f-496d-8ac3-ae3b2951166a`::moving from state preparing -> state finished
>Thread-302::DEBUG::2014-04-10 16:32:53,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-302::DEBUG::2014-04-10 16:32:53,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-302::DEBUG::2014-04-10 16:32:53,875::task::974::TaskManager.Task::(_decref) Task=`beb2a1a9-a21f-496d-8ac3-ae3b2951166a`::ref 0 aborting False
>Thread-305::DEBUG::2014-04-10 16:32:57,060::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-305::DEBUG::2014-04-10 16:32:57,071::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '-0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '118.69', 'elapsedTime': '360', 'vmType': 'kvm', 'cpuSys': '1.26', 'appsList': [], 'guestIPs': ''}]}
>Thread-261::WARNING::2014-04-10 16:32:57,617::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-261::DEBUG::2014-04-10 16:32:57,622::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-263::WARNING::2014-04-10 16:32:57,625::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-107::ERROR::2014-04-10 16:32:57,627::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:32:57,627::task::850::TaskManager.Task::(_setError) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:32:57,641::task::869::TaskManager.Task::(_run) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::Task._run: b6761530-4919-4087-82b0-9796fcd7dfc7 ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:32:57,653::task::1194::TaskManager.Task::(stop) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:32:57,658::task::974::TaskManager.Task::(_decref) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:32:57,659::task::1151::TaskManager.Task::(prepare) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:32:57,660::task::1156::TaskManager.Task::(prepare) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:32:57,660::task::974::TaskManager.Task::(_decref) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:32:57,661::task::909::TaskManager.Task::(_doAbort) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:32:57,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:32:57,661::task::579::TaskManager.Task::(_updateState) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:32:57,661::task::534::TaskManager.Task::(__state_aborting) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:32:57,661::task::579::TaskManager.Task::(_updateState) Task=`b6761530-4919-4087-82b0-9796fcd7dfc7`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:32:57,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:32:57,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:32:57,662::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:32:57,662::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>Thread-27::DEBUG::2014-04-10 16:32:58,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:32:58,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000325988 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:32:58,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:32:58,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274168 s, 2.4 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:32:58,673::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-311::DEBUG::2014-04-10 16:33:00,127::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [29d39d31]
>Thread-311::DEBUG::2014-04-10 16:33:00,129::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.11', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.44', 'elapsedTime': '363', 'vmType': 'kvm', 'cpuSys': '0.75', 'appsList': [], 'guestIPs': ''}]}
>Thread-270::WARNING::2014-04-10 16:33:07,634::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-270::DEBUG::2014-04-10 16:33:07,636::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-272::WARNING::2014-04-10 16:33:07,643::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::ERROR::2014-04-10 16:33:07,644::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:33:07,644::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-27::DEBUG::2014-04-10 16:33:08,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:08,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000379239 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:08,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:08,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255216 s, 2.6 MB/s\n'; <rc> = 0
>Thread-314::DEBUG::2014-04-10 16:33:09,216::task::579::TaskManager.Task::(_updateState) Task=`f501f9bf-ef4b-4c0d-9bbb-983370a1dcfa`::moving from state init -> state preparing
>Thread-314::INFO::2014-04-10 16:33:09,216::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-314::INFO::2014-04-10 16:33:09,217::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '71.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379239', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255216', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.6', 'valid': False}}
>Thread-314::DEBUG::2014-04-10 16:33:09,217::task::1168::TaskManager.Task::(prepare) Task=`f501f9bf-ef4b-4c0d-9bbb-983370a1dcfa`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '71.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379239', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255216', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '1.6', 'valid': False}}
>Thread-314::DEBUG::2014-04-10 16:33:09,217::task::579::TaskManager.Task::(_updateState) Task=`f501f9bf-ef4b-4c0d-9bbb-983370a1dcfa`::moving from state preparing -> state finished
>Thread-314::DEBUG::2014-04-10 16:33:09,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-314::DEBUG::2014-04-10 16:33:09,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-314::DEBUG::2014-04-10 16:33:09,218::task::974::TaskManager.Task::(_decref) Task=`f501f9bf-ef4b-4c0d-9bbb-983370a1dcfa`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:33:18,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:18,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000327916 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:18,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:18,198::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361294 s, 1.9 MB/s\n'; <rc> = 0
>Thread-324::DEBUG::2014-04-10 16:33:24,454::task::579::TaskManager.Task::(_updateState) Task=`eea6f6dd-cacf-4365-b104-67ddb79b703b`::moving from state init -> state preparing
>Thread-324::INFO::2014-04-10 16:33:24,454::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-324::INFO::2014-04-10 16:33:24,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '86.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327916', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361294', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '16.8', 'valid': False}}
>Thread-324::DEBUG::2014-04-10 16:33:24,454::task::1168::TaskManager.Task::(prepare) Task=`eea6f6dd-cacf-4365-b104-67ddb79b703b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '86.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327916', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361294', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '16.8', 'valid': False}}
>Thread-324::DEBUG::2014-04-10 16:33:24,455::task::579::TaskManager.Task::(_updateState) Task=`eea6f6dd-cacf-4365-b104-67ddb79b703b`::moving from state preparing -> state finished
>Thread-324::DEBUG::2014-04-10 16:33:24,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-324::DEBUG::2014-04-10 16:33:24,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-324::DEBUG::2014-04-10 16:33:24,455::task::974::TaskManager.Task::(_decref) Task=`eea6f6dd-cacf-4365-b104-67ddb79b703b`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:33:28,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:28,074::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000308544 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:28,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:28,212::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305857 s, 2.2 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:33:28,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-328::DEBUG::2014-04-10 16:33:32,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-328::DEBUG::2014-04-10 16:33:32,321::task::579::TaskManager.Task::(_updateState) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::moving from state init -> state preparing
>Thread-328::INFO::2014-04-10 16:33:32,321::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-27::DEBUG::2014-04-10 16:33:38,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:38,088::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000239817 s, 1.6 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:38,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:38,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000221685 s, 3.0 MB/s\n'; <rc> = 0
>Thread-331::DEBUG::2014-04-10 16:33:39,691::task::579::TaskManager.Task::(_updateState) Task=`1ce488a7-6a28-4296-a27d-727d395682ec`::moving from state init -> state preparing
>Thread-331::INFO::2014-04-10 16:33:39,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-331::INFO::2014-04-10 16:33:39,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '102.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239817', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221685', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '32.0', 'valid': False}}
>Thread-331::DEBUG::2014-04-10 16:33:39,692::task::1168::TaskManager.Task::(prepare) Task=`1ce488a7-6a28-4296-a27d-727d395682ec`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '102.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239817', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221685', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '32.0', 'valid': False}}
>Thread-331::DEBUG::2014-04-10 16:33:39,692::task::579::TaskManager.Task::(_updateState) Task=`1ce488a7-6a28-4296-a27d-727d395682ec`::moving from state preparing -> state finished
>Thread-331::DEBUG::2014-04-10 16:33:39,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-331::DEBUG::2014-04-10 16:33:39,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-331::DEBUG::2014-04-10 16:33:39,693::task::974::TaskManager.Task::(_decref) Task=`1ce488a7-6a28-4296-a27d-727d395682ec`::ref 0 aborting False
>Thread-27::DEBUG::2014-04-10 16:33:48,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:48,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000264698 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:48,234::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:48,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252959 s, 2.7 MB/s\n'; <rc> = 0
>Thread-337::DEBUG::2014-04-10 16:33:54,939::task::579::TaskManager.Task::(_updateState) Task=`424161a9-7475-4bc1-a7b8-1af46c0dcf42`::moving from state init -> state preparing
>Thread-337::INFO::2014-04-10 16:33:54,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-337::INFO::2014-04-10 16:33:54,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '117.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264698', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252959', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '47.3', 'valid': False}}
>Thread-337::DEBUG::2014-04-10 16:33:54,940::task::1168::TaskManager.Task::(prepare) Task=`424161a9-7475-4bc1-a7b8-1af46c0dcf42`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '117.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264698', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252959', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '47.3', 'valid': False}}
>Thread-337::DEBUG::2014-04-10 16:33:54,940::task::579::TaskManager.Task::(_updateState) Task=`424161a9-7475-4bc1-a7b8-1af46c0dcf42`::moving from state preparing -> state finished
>Thread-337::DEBUG::2014-04-10 16:33:54,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-337::DEBUG::2014-04-10 16:33:54,941::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-337::DEBUG::2014-04-10 16:33:54,941::task::974::TaskManager.Task::(_decref) Task=`424161a9-7475-4bc1-a7b8-1af46c0dcf42`::ref 0 aborting False
>Thread-306::WARNING::2014-04-10 16:33:57,647::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-306::DEBUG::2014-04-10 16:33:57,650::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-308::WARNING::2014-04-10 16:33:57,658::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-28::ERROR::2014-04-10 16:33:57,658::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-28::ERROR::2014-04-10 16:33:57,659::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:33:57,719::task::579::TaskManager.Task::(_updateState) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:33:57,719::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-27::DEBUG::2014-04-10 16:33:58,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:33:58,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000370638 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:33:58,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:33:58,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240156 s, 2.8 MB/s\n'; <rc> = 0
>Thread-344::DEBUG::2014-04-10 16:33:58,695::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2dd3e661]
>Thread-344::DEBUG::2014-04-10 16:33:58,695::task::579::TaskManager.Task::(_updateState) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::moving from state init -> state preparing
>Thread-344::INFO::2014-04-10 16:33:58,695::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-344::DEBUG::2014-04-10 16:33:58,696::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87e2f2ed-c4db-4537-ba3e-949720a13c82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1111' at 'disconnectStoragePool'
>Thread-344::DEBUG::2014-04-10 16:33:58,696::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-344::DEBUG::2014-04-10 16:33:58,696::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-344::DEBUG::2014-04-10 16:33:58,697::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87e2f2ed-c4db-4537-ba3e-949720a13c82`::Granted request
>Thread-344::DEBUG::2014-04-10 16:33:58,697::task::811::TaskManager.Task::(resourceAcquired) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-344::DEBUG::2014-04-10 16:33:58,697::task::974::TaskManager.Task::(_decref) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::ref 1 aborting False
>Thread-344::DEBUG::2014-04-10 16:33:58,698::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5fe440ae-f460-4e31-b4c8-45c4197031af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1119' at '_disconnectPool'
>Thread-344::DEBUG::2014-04-10 16:33:58,698::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-344::DEBUG::2014-04-10 16:33:58,698::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-344::DEBUG::2014-04-10 16:33:58,698::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5fe440ae-f460-4e31-b4c8-45c4197031af`::Granted request
>Thread-344::INFO::2014-04-10 16:33:58,698::sp::711::Storage.StoragePool::(disconnect) Disconnect from the storage pool f721168f-5edd-4f5f-8976-591eb93f960e
>Thread-344::INFO::2014-04-10 16:33:58,700::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-28::DEBUG::2014-04-10 16:33:58,700::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>VM Channels Listener::DEBUG::2014-04-10 16:33:58,742::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-27::DEBUG::2014-04-10 16:34:08,123::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:08,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000264104 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:08,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:08,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341402 s, 2.0 MB/s\n'; <rc> = 0
>Thread-318::WARNING::2014-04-10 16:34:17,652::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-318::DEBUG::2014-04-10 16:34:17,655::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-320::WARNING::2014-04-10 16:34:17,657::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::ERROR::2014-04-10 16:34:17,658::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:34:17,659::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-27::DEBUG::2014-04-10 16:34:18,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:18,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000274045 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:18,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:18,282::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321075 s, 2.1 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:34:28,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:28,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000323244 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:28,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:28,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000237091 s, 2.8 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:34:28,776::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-27::DEBUG::2014-04-10 16:34:38,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:38,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000418909 s, 910 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:38,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:38,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331272 s, 2.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:34:48,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:48,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000353946 s, 1.1 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:48,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:48,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000291749 s, 2.3 MB/s\n'; <rc> = 0
>Thread-339::WARNING::2014-04-10 16:34:57,672::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-339::DEBUG::2014-04-10 16:34:57,676::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-341::WARNING::2014-04-10 16:34:57,681::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-328::ERROR::2014-04-10 16:34:57,682::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-328::ERROR::2014-04-10 16:34:57,683::hsm::631::Storage.HSM::(getSpmStatus) MD read error: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 624, in getSpmStatus
>    status = {'spmStatus': pool.spmRole, 'spmLver': pool.getSpmLver(),
>  File "/usr/share/vdsm/storage/sp.py", line 138, in getSpmLver
>    return self.getMetaParam(PMDK_LVER)
>  File "/usr/share/vdsm/storage/sp.py", line 1494, in getMetaParam
>    return self._metadata[key]
>  File "/usr/share/vdsm/storage/sp.py", line 1404, in _metadata
>    return self._getPoolMD(self.masterDomain)
>  File "/usr/share/vdsm/storage/sp.py", line 1400, in _getPoolMD
>    return DictValidator(domain._metadata._dict, SP_MD_FIELDS)
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-328::ERROR::2014-04-10 16:34:57,702::task::850::TaskManager.Task::(_setError) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 632, in getSpmStatus
>    raise se.StorageDomainMasterError("MD read error")
>StorageDomainMasterError: Error validating master storage domain: ('MD read error',)
>Thread-328::DEBUG::2014-04-10 16:34:57,716::task::869::TaskManager.Task::(_run) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::Task._run: 9152988c-c0f1-4847-a9c4-f75c6a3d897a ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-328::DEBUG::2014-04-10 16:34:57,717::task::1194::TaskManager.Task::(stop) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::stopping in state preparing (force False)
>Thread-328::DEBUG::2014-04-10 16:34:57,717::task::974::TaskManager.Task::(_decref) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::ref 1 aborting True
>Thread-328::INFO::2014-04-10 16:34:57,718::task::1151::TaskManager.Task::(prepare) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::aborting: Task is aborted: 'Error validating master storage domain' - code 355
>Thread-328::DEBUG::2014-04-10 16:34:57,718::task::1156::TaskManager.Task::(prepare) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::Prepare: aborted: Error validating master storage domain
>Thread-328::DEBUG::2014-04-10 16:34:57,718::task::974::TaskManager.Task::(_decref) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::ref 0 aborting True
>Thread-328::DEBUG::2014-04-10 16:34:57,718::task::909::TaskManager.Task::(_doAbort) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::Task._doAbort: force False
>Thread-328::DEBUG::2014-04-10 16:34:57,718::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-328::DEBUG::2014-04-10 16:34:57,719::task::579::TaskManager.Task::(_updateState) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::moving from state preparing -> state aborting
>Thread-328::DEBUG::2014-04-10 16:34:57,719::task::534::TaskManager.Task::(__state_aborting) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::_aborting: recover policy none
>Thread-328::DEBUG::2014-04-10 16:34:57,719::task::579::TaskManager.Task::(_updateState) Task=`9152988c-c0f1-4847-a9c4-f75c6a3d897a`::moving from state aborting -> state failed
>Thread-328::DEBUG::2014-04-10 16:34:57,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-328::DEBUG::2014-04-10 16:34:57,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-328::ERROR::2014-04-10 16:34:57,720::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Error validating master storage domain: ('MD read error',)", 'code': 355}}
>Thread-27::DEBUG::2014-04-10 16:34:58,190::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::DEBUG::2014-04-10 16:34:58,205::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::DEBUG::2014-04-10 16:34:58,207::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-27::DEBUG::2014-04-10 16:34:58,211::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-27::DEBUG::2014-04-10 16:34:58,212::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-27::INFO::2014-04-10 16:34:58,213::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-27::INFO::2014-04-10 16:34:58,213::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-27::DEBUG::2014-04-10 16:34:58,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:34:58,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000225865 s, 1.7 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:34:58,328::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 16:34:58,352::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 16:34:58,354::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-33::DEBUG::2014-04-10 16:34:58,358::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-33::DEBUG::2014-04-10 16:34:58,360::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-33::INFO::2014-04-10 16:34:58,360::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-33::INFO::2014-04-10 16:34:58,360::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-33::DEBUG::2014-04-10 16:34:58,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:34:58,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255711 s, 2.6 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:34:58,809::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-362::DEBUG::2014-04-10 16:34:59,477::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a373660]
>Thread-362::DEBUG::2014-04-10 16:34:59,478::task::579::TaskManager.Task::(_updateState) Task=`d9e5b18f-9351-44e1-880f-a3184b21238b`::moving from state init -> state preparing
>Thread-362::INFO::2014-04-10 16:34:59,478::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-362::DEBUG::2014-04-10 16:34:59,480::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-27::DEBUG::2014-04-10 16:35:08,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:08,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000268893 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:08,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:08,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00020915 s, 3.2 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:35:18,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:18,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000274987 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:18,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:18,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026336 s, 2.5 MB/s\n'; <rc> = 0
>Thread-345::WARNING::2014-04-10 16:35:27,681::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-345::DEBUG::2014-04-10 16:35:27,684::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-347::WARNING::2014-04-10 16:35:27,687::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::ERROR::2014-04-10 16:35:27,688::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:35:27,689::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-27::DEBUG::2014-04-10 16:35:28,260::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:28,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000280545 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:28,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:28,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000212102 s, 3.2 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:35:28,844::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-27::DEBUG::2014-04-10 16:35:38,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:38,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000307435 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:38,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:38,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267771 s, 2.5 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:35:48,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:48,302::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000283791 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:48,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:48,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000624617 s, 1.1 MB/s\n'; <rc> = 0
>Thread-349::WARNING::2014-04-10 16:35:57,714::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-351::WARNING::2014-04-10 16:35:57,718::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-349::DEBUG::2014-04-10 16:35:57,728::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-351::DEBUG::2014-04-10 16:35:57,734::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-107::ERROR::2014-04-10 16:35:57,745::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:35:57,755::task::850::TaskManager.Task::(_setError) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:35:57,787::task::869::TaskManager.Task::(_run) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::Task._run: fc5c8419-70da-47c8-aab7-eb3ba2dde23c ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:35:57,806::task::1194::TaskManager.Task::(stop) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:35:57,816::task::974::TaskManager.Task::(_decref) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:35:57,822::task::1151::TaskManager.Task::(prepare) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:35:57,829::task::1156::TaskManager.Task::(prepare) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:35:57,836::task::974::TaskManager.Task::(_decref) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:35:57,842::task::909::TaskManager.Task::(_doAbort) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:35:57,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:35:57,855::task::579::TaskManager.Task::(_updateState) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:35:57,861::task::534::TaskManager.Task::(__state_aborting) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:35:57,868::task::579::TaskManager.Task::(_updateState) Task=`fc5c8419-70da-47c8-aab7-eb3ba2dde23c`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:35:57,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:35:57,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:35:57,888::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:35:57,893::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>Thread-354::WARNING::2014-04-10 16:35:58,199::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-354::DEBUG::2014-04-10 16:35:58,207::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-356::WARNING::2014-04-10 16:35:58,205::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-356::DEBUG::2014-04-10 16:35:58,215::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-358::WARNING::2014-04-10 16:35:58,343::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-358::DEBUG::2014-04-10 16:35:58,350::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-360::WARNING::2014-04-10 16:35:58,350::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-360::DEBUG::2014-04-10 16:35:58,357::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-27::DEBUG::2014-04-10 16:35:58,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:35:58,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000416995 s, 914 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:35:58,459::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:35:58,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000472664 s, 1.4 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:35:58,877::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-362::DEBUG::2014-04-10 16:35:59,481::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-362::DEBUG::2014-04-10 16:35:59,481::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-362::INFO::2014-04-10 16:35:59,482::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-362::DEBUG::2014-04-10 16:35:59,482::task::1168::TaskManager.Task::(prepare) Task=`d9e5b18f-9351-44e1-880f-a3184b21238b`::finished: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-362::DEBUG::2014-04-10 16:35:59,482::task::579::TaskManager.Task::(_updateState) Task=`d9e5b18f-9351-44e1-880f-a3184b21238b`::moving from state preparing -> state finished
>Thread-362::DEBUG::2014-04-10 16:35:59,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-362::DEBUG::2014-04-10 16:35:59,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-362::DEBUG::2014-04-10 16:35:59,483::task::974::TaskManager.Task::(_decref) Task=`d9e5b18f-9351-44e1-880f-a3184b21238b`::ref 0 aborting False
>Thread-372::DEBUG::2014-04-10 16:35:59,814::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-372::DEBUG::2014-04-10 16:35:59,814::task::579::TaskManager.Task::(_updateState) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::moving from state init -> state preparing
>Thread-372::INFO::2014-04-10 16:35:59,814::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-27::DEBUG::2014-04-10 16:36:08,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:36:08,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.000283627 s, 1.3 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:36:08,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:08,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342523 s, 2.0 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:36:18,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:36:18,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00032525 s, 1.2 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:36:18,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:18,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000448648 s, 1.5 MB/s\n'; <rc> = 0
>Thread-27::DEBUG::2014-04-10 16:36:28,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:36:28,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00192597 s, 198 kB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:36:28,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:28,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000225958 s, 3.0 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:36:28,914::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-363::WARNING::2014-04-10 16:36:37,697::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-365::WARNING::2014-04-10 16:36:37,702::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-363::DEBUG::2014-04-10 16:36:37,705::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-365::DEBUG::2014-04-10 16:36:37,707::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-34::ERROR::2014-04-10 16:36:37,708::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:36:37,708::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-27::DEBUG::2014-04-10 16:36:38,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:36:38,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00037517 s, 1.0 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:36:38,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:38,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274539 s, 2.4 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:36:47,709::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-34::DEBUG::2014-04-10 16:36:47,709::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-34::DEBUG::2014-04-10 16:36:47,710::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-34::DEBUG::2014-04-10 16:36:47,710::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-34::DEBUG::2014-04-10 16:36:47,710::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-34::DEBUG::2014-04-10 16:36:47,710::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:36:47,731::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-34::DEBUG::2014-04-10 16:36:47,731::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-27::DEBUG::2014-04-10 16:36:48,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-27::DEBUG::2014-04-10 16:36:48,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n381 bytes (381 B) copied, 0.00027154 s, 1.4 MB/s\n'; <rc> = 0
>Thread-33::DEBUG::2014-04-10 16:36:48,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:48,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308243 s, 2.2 MB/s\n'; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:36:49,779::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-34::DEBUG::2014-04-10 16:36:49,887::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-34::DEBUG::2014-04-10 16:36:49,888::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,888::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,889::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,889::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,889::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,889::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-34::DEBUG::2014-04-10 16:36:49,890::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-367::WARNING::2014-04-10 16:36:57,800::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-367::DEBUG::2014-04-10 16:36:57,803::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-369::WARNING::2014-04-10 16:36:57,809::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-28::ERROR::2014-04-10 16:36:57,810::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-28::DEBUG::2014-04-10 16:36:57,811::domainMonitor::184::Storage.DomainMonitorThread::(_monitorLoop) Unable to release the host id 2 for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 181, in _monitorLoop
>    self.domain.releaseHostId(self.hostId, unused=True)
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-344::INFO::2014-04-10 16:36:57,823::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::DEBUG::2014-04-10 16:36:57,830::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-27::INFO::2014-04-10 16:36:57,841::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>Thread-107::DEBUG::2014-04-10 16:36:57,963::task::579::TaskManager.Task::(_updateState) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:36:57,963::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-33::DEBUG::2014-04-10 16:36:58,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-33::DEBUG::2014-04-10 16:36:58,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000498299 s, 1.3 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:36:58,949::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-27::DEBUG::2014-04-10 16:36:59,844::clusterlock::207::SANLock::(releaseHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f released successfully (id: 2)
>Thread-344::INFO::2014-04-10 16:36:59,844::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::DEBUG::2014-04-10 16:36:59,844::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-33::INFO::2014-04-10 16:36:59,845::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 2)
>Thread-382::DEBUG::2014-04-10 16:37:01,824::task::579::TaskManager.Task::(_updateState) Task=`ad9bb714-39e4-46a8-9bc3-fd7b8e537abc`::moving from state init -> state preparing
>Thread-382::INFO::2014-04-10 16:37:01,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-382::INFO::2014-04-10 16:37:01,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '24.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498299', 'lastCheck': '3.3', 'valid': True}}
>Thread-382::DEBUG::2014-04-10 16:37:01,825::task::1168::TaskManager.Task::(prepare) Task=`ad9bb714-39e4-46a8-9bc3-fd7b8e537abc`::finished: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '24.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498299', 'lastCheck': '3.3', 'valid': True}}
>Thread-382::DEBUG::2014-04-10 16:37:01,825::task::579::TaskManager.Task::(_updateState) Task=`ad9bb714-39e4-46a8-9bc3-fd7b8e537abc`::moving from state preparing -> state finished
>Thread-382::DEBUG::2014-04-10 16:37:01,826::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-382::DEBUG::2014-04-10 16:37:01,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-382::DEBUG::2014-04-10 16:37:01,826::task::974::TaskManager.Task::(_decref) Task=`ad9bb714-39e4-46a8-9bc3-fd7b8e537abc`::ref 0 aborting False
>Thread-33::DEBUG::2014-04-10 16:37:02,845::clusterlock::207::SANLock::(releaseHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 released successfully (id: 2)
>Thread-344::INFO::2014-04-10 16:37:02,846::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-388::DEBUG::2014-04-10 16:37:17,026::task::579::TaskManager.Task::(_updateState) Task=`4b22c7da-1b55-487f-9bda-cd02811e7ef5`::moving from state init -> state preparing
>Thread-388::INFO::2014-04-10 16:37:17,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-388::INFO::2014-04-10 16:37:17,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '39.3', 'valid': False}}
>Thread-388::DEBUG::2014-04-10 16:37:17,027::task::1168::TaskManager.Task::(prepare) Task=`4b22c7da-1b55-487f-9bda-cd02811e7ef5`::finished: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '39.3', 'valid': False}}
>Thread-388::DEBUG::2014-04-10 16:37:17,027::task::579::TaskManager.Task::(_updateState) Task=`4b22c7da-1b55-487f-9bda-cd02811e7ef5`::moving from state preparing -> state finished
>Thread-388::DEBUG::2014-04-10 16:37:17,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-388::DEBUG::2014-04-10 16:37:17,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-388::DEBUG::2014-04-10 16:37:17,028::task::974::TaskManager.Task::(_decref) Task=`4b22c7da-1b55-487f-9bda-cd02811e7ef5`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:37:28,982::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-394::DEBUG::2014-04-10 16:37:32,268::task::579::TaskManager.Task::(_updateState) Task=`d10aa138-468a-4c04-bd41-b4f1e8cb2c1d`::moving from state init -> state preparing
>Thread-394::INFO::2014-04-10 16:37:32,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-394::INFO::2014-04-10 16:37:32,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '54.6', 'valid': False}}
>Thread-394::DEBUG::2014-04-10 16:37:32,269::task::1168::TaskManager.Task::(prepare) Task=`d10aa138-468a-4c04-bd41-b4f1e8cb2c1d`::finished: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '54.6', 'valid': False}}
>Thread-394::DEBUG::2014-04-10 16:37:32,269::task::579::TaskManager.Task::(_updateState) Task=`d10aa138-468a-4c04-bd41-b4f1e8cb2c1d`::moving from state preparing -> state finished
>Thread-394::DEBUG::2014-04-10 16:37:32,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-394::DEBUG::2014-04-10 16:37:32,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-394::DEBUG::2014-04-10 16:37:32,269::task::974::TaskManager.Task::(_decref) Task=`d10aa138-468a-4c04-bd41-b4f1e8cb2c1d`::ref 0 aborting False
>Thread-400::DEBUG::2014-04-10 16:37:47,541::task::579::TaskManager.Task::(_updateState) Task=`66c5854b-a681-4c06-a184-10d22ea02da1`::moving from state init -> state preparing
>Thread-400::INFO::2014-04-10 16:37:47,541::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-400::INFO::2014-04-10 16:37:47,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.8', 'valid': False}}
>Thread-400::DEBUG::2014-04-10 16:37:47,542::task::1168::TaskManager.Task::(prepare) Task=`66c5854b-a681-4c06-a184-10d22ea02da1`::finished: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.8', 'valid': False}}
>Thread-400::DEBUG::2014-04-10 16:37:47,542::task::579::TaskManager.Task::(_updateState) Task=`66c5854b-a681-4c06-a184-10d22ea02da1`::moving from state preparing -> state finished
>Thread-400::DEBUG::2014-04-10 16:37:47,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-400::DEBUG::2014-04-10 16:37:47,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-400::DEBUG::2014-04-10 16:37:47,542::task::974::TaskManager.Task::(_decref) Task=`66c5854b-a681-4c06-a184-10d22ea02da1`::ref 0 aborting False
>Thread-373::WARNING::2014-04-10 16:37:49,910::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-373::DEBUG::2014-04-10 16:37:49,914::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-375::WARNING::2014-04-10 16:37:49,914::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-375::DEBUG::2014-04-10 16:37:49,917::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-34::ERROR::2014-04-10 16:37:49,918::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::ERROR::2014-04-10 16:37:49,919::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::DEBUG::2014-04-10 16:37:49,919::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-377::WARNING::2014-04-10 16:37:57,838::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-377::DEBUG::2014-04-10 16:37:57,840::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-379::WARNING::2014-04-10 16:37:57,843::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-372::ERROR::2014-04-10 16:37:57,844::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-372::ERROR::2014-04-10 16:37:57,844::hsm::631::Storage.HSM::(getSpmStatus) MD read error: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 624, in getSpmStatus
>    status = {'spmStatus': pool.spmRole, 'spmLver': pool.getSpmLver(),
>  File "/usr/share/vdsm/storage/sp.py", line 138, in getSpmLver
>    return self.getMetaParam(PMDK_LVER)
>  File "/usr/share/vdsm/storage/sp.py", line 1494, in getMetaParam
>    return self._metadata[key]
>  File "/usr/share/vdsm/storage/sp.py", line 1404, in _metadata
>    return self._getPoolMD(self.masterDomain)
>  File "/usr/share/vdsm/storage/sp.py", line 1400, in _getPoolMD
>    return DictValidator(domain._metadata._dict, SP_MD_FIELDS)
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-372::ERROR::2014-04-10 16:37:57,860::task::850::TaskManager.Task::(_setError) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 632, in getSpmStatus
>    raise se.StorageDomainMasterError("MD read error")
>StorageDomainMasterError: Error validating master storage domain: ('MD read error',)
>Thread-372::DEBUG::2014-04-10 16:37:57,875::task::869::TaskManager.Task::(_run) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::Task._run: e39c78ee-56e3-4b45-82d9-61feea7ec6fa ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-372::DEBUG::2014-04-10 16:37:57,876::task::1194::TaskManager.Task::(stop) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::stopping in state preparing (force False)
>Thread-372::DEBUG::2014-04-10 16:37:57,876::task::974::TaskManager.Task::(_decref) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::ref 1 aborting True
>Thread-372::INFO::2014-04-10 16:37:57,877::task::1151::TaskManager.Task::(prepare) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::aborting: Task is aborted: 'Error validating master storage domain' - code 355
>Thread-372::DEBUG::2014-04-10 16:37:57,877::task::1156::TaskManager.Task::(prepare) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::Prepare: aborted: Error validating master storage domain
>Thread-372::DEBUG::2014-04-10 16:37:57,877::task::974::TaskManager.Task::(_decref) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::ref 0 aborting True
>Thread-372::DEBUG::2014-04-10 16:37:57,877::task::909::TaskManager.Task::(_doAbort) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::Task._doAbort: force False
>Thread-372::DEBUG::2014-04-10 16:37:57,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-372::DEBUG::2014-04-10 16:37:57,878::task::579::TaskManager.Task::(_updateState) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::moving from state preparing -> state aborting
>Thread-372::DEBUG::2014-04-10 16:37:57,878::task::534::TaskManager.Task::(__state_aborting) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::_aborting: recover policy none
>Thread-372::DEBUG::2014-04-10 16:37:57,878::task::579::TaskManager.Task::(_updateState) Task=`e39c78ee-56e3-4b45-82d9-61feea7ec6fa`::moving from state aborting -> state failed
>Thread-372::DEBUG::2014-04-10 16:37:57,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-372::DEBUG::2014-04-10 16:37:57,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-372::ERROR::2014-04-10 16:37:57,879::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Error validating master storage domain: ('MD read error',)", 'code': 355}}
>Thread-413::DEBUG::2014-04-10 16:37:58,070::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [42b34cda]
>Thread-413::DEBUG::2014-04-10 16:37:58,070::task::579::TaskManager.Task::(_updateState) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::moving from state init -> state preparing
>Thread-413::INFO::2014-04-10 16:37:58,070::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-413::DEBUG::2014-04-10 16:37:58,071::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46ffd0b5-d16c-4702-afb2-b785223b9b4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1111' at 'disconnectStoragePool'
>Thread-413::DEBUG::2014-04-10 16:37:58,071::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-413::DEBUG::2014-04-10 16:37:58,071::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>VM Channels Listener::DEBUG::2014-04-10 16:37:59,017::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-415::DEBUG::2014-04-10 16:38:02,748::task::579::TaskManager.Task::(_updateState) Task=`44dd74a1-cf67-4280-beaa-e6e650845faf`::moving from state init -> state preparing
>Thread-415::INFO::2014-04-10 16:38:02,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-415::INFO::2014-04-10 16:38:02,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '12.8', 'valid': False}}
>Thread-415::DEBUG::2014-04-10 16:38:02,749::task::1168::TaskManager.Task::(prepare) Task=`44dd74a1-cf67-4280-beaa-e6e650845faf`::finished: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '12.8', 'valid': False}}
>Thread-415::DEBUG::2014-04-10 16:38:02,749::task::579::TaskManager.Task::(_updateState) Task=`44dd74a1-cf67-4280-beaa-e6e650845faf`::moving from state preparing -> state finished
>Thread-415::DEBUG::2014-04-10 16:38:02,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-415::DEBUG::2014-04-10 16:38:02,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-415::DEBUG::2014-04-10 16:38:02,749::task::974::TaskManager.Task::(_decref) Task=`44dd74a1-cf67-4280-beaa-e6e650845faf`::ref 0 aborting False
>Thread-418::DEBUG::2014-04-10 16:38:05,934::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-418::DEBUG::2014-04-10 16:38:05,935::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '67.97', 'elapsedTime': '669', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-419::DEBUG::2014-04-10 16:38:07,960::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-419::DEBUG::2014-04-10 16:38:07,961::task::579::TaskManager.Task::(_updateState) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::moving from state init -> state preparing
>Thread-419::INFO::2014-04-10 16:38:07,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>VM Channels Listener::DEBUG::2014-04-10 16:38:29,050::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-402::WARNING::2014-04-10 16:38:49,933::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-402::DEBUG::2014-04-10 16:38:49,936::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-404::WARNING::2014-04-10 16:38:49,941::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::ERROR::2014-04-10 16:38:49,943::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-34::DEBUG::2014-04-10 16:38:49,943::domainMonitor::184::Storage.DomainMonitorThread::(_monitorLoop) Unable to release the host id 2 for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 181, in _monitorLoop
>    self.domain.releaseHostId(self.hostId, unused=True)
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-344::DEBUG::2014-04-10 16:38:49,944::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-344::DEBUG::2014-04-10 16:38:49,944::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-344::DEBUG::2014-04-10 16:38:49,944::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-344::DEBUG::2014-04-10 16:38:49,945::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-344::INFO::2014-04-10 16:38:49,945::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True
>Thread-344::DEBUG::2014-04-10 16:38:49,945::task::1168::TaskManager.Task::(prepare) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::finished: True
>Thread-344::DEBUG::2014-04-10 16:38:49,945::task::579::TaskManager.Task::(_updateState) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::moving from state preparing -> state finished
>Thread-344::DEBUG::2014-04-10 16:38:49,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-344::DEBUG::2014-04-10 16:38:49,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-344::DEBUG::2014-04-10 16:38:49,946::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-344::DEBUG::2014-04-10 16:38:49,946::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-344::DEBUG::2014-04-10 16:38:49,946::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-344::DEBUG::2014-04-10 16:38:49,946::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-344::DEBUG::2014-04-10 16:38:49,947::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46ffd0b5-d16c-4702-afb2-b785223b9b4d`::Granted request
>Thread-344::DEBUG::2014-04-10 16:38:49,947::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - exclusive: granted' was granted
>Thread-344::DEBUG::2014-04-10 16:38:49,949::task::974::TaskManager.Task::(_decref) Task=`1d0ca807-7a3f-476f-b60f-7268f63a0185`::ref 0 aborting False
>Thread-413::DEBUG::2014-04-10 16:38:49,949::task::811::TaskManager.Task::(resourceAcquired) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-413::DEBUG::2014-04-10 16:38:49,951::task::974::TaskManager.Task::(_decref) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::ref 1 aborting False
>Thread-413::ERROR::2014-04-10 16:38:49,951::task::850::TaskManager.Task::(_setError) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 1112, in disconnectStoragePool
>    pool = self.getPool(spUUID)
>  File "/usr/share/vdsm/storage/hsm.py", line 321, in getPool
>    raise se.StoragePoolUnknown(spUUID)
>StoragePoolUnknown: Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)
>Thread-413::DEBUG::2014-04-10 16:38:49,953::task::869::TaskManager.Task::(_run) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::Task._run: e238ab15-38e7-4c01-a7ea-d68334d593fc ('f721168f-5edd-4f5f-8976-591eb93f960e', 2, 'f721168f-5edd-4f5f-8976-591eb93f960e', False) {} failed - stopping task
>Thread-413::DEBUG::2014-04-10 16:38:49,953::task::1194::TaskManager.Task::(stop) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::stopping in state preparing (force False)
>Thread-413::DEBUG::2014-04-10 16:38:49,953::task::974::TaskManager.Task::(_decref) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::ref 1 aborting True
>Thread-413::INFO::2014-04-10 16:38:49,953::task::1151::TaskManager.Task::(prepare) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309
>Thread-413::DEBUG::2014-04-10 16:38:49,954::task::1156::TaskManager.Task::(prepare) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::Prepare: aborted: Unknown pool id, pool not connected
>Thread-413::DEBUG::2014-04-10 16:38:49,954::task::974::TaskManager.Task::(_decref) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::ref 0 aborting True
>Thread-413::DEBUG::2014-04-10 16:38:49,954::task::909::TaskManager.Task::(_doAbort) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::Task._doAbort: force False
>Thread-413::DEBUG::2014-04-10 16:38:49,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-413::DEBUG::2014-04-10 16:38:49,954::task::579::TaskManager.Task::(_updateState) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::moving from state preparing -> state aborting
>Thread-413::DEBUG::2014-04-10 16:38:49,955::task::534::TaskManager.Task::(__state_aborting) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::_aborting: recover policy none
>Thread-413::DEBUG::2014-04-10 16:38:49,955::task::579::TaskManager.Task::(_updateState) Task=`e238ab15-38e7-4c01-a7ea-d68334d593fc`::moving from state aborting -> state failed
>Thread-413::DEBUG::2014-04-10 16:38:49,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-413::DEBUG::2014-04-10 16:38:49,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-413::DEBUG::2014-04-10 16:38:49,956::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-413::DEBUG::2014-04-10 16:38:49,956::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-413::DEBUG::2014-04-10 16:38:49,956::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-413::DEBUG::2014-04-10 16:38:49,956::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-413::ERROR::2014-04-10 16:38:49,957::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)", 'code': 309}}
>Thread-421::DEBUG::2014-04-10 16:38:49,971::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [1a9b4afc]
>Thread-421::DEBUG::2014-04-10 16:38:49,972::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '112.01', 'elapsedTime': '713', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-423::DEBUG::2014-04-10 16:38:52,999::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-423::DEBUG::2014-04-10 16:38:53,000::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '115.04', 'elapsedTime': '716', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-425::DEBUG::2014-04-10 16:38:56,233::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-425::DEBUG::2014-04-10 16:38:56,235::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.46', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '118.27', 'elapsedTime': '719', 'vmType': 'kvm', 'cpuSys': '0.33', 'appsList': [], 'guestIPs': ''}]}
>Thread-409::WARNING::2014-04-10 16:38:57,870::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-409::DEBUG::2014-04-10 16:38:57,872::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-411::WARNING::2014-04-10 16:38:57,875::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-107::ERROR::2014-04-10 16:38:57,876::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:38:57,877::task::850::TaskManager.Task::(_setError) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:38:57,892::task::869::TaskManager.Task::(_run) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::Task._run: 43cedc8b-7126-4f0d-9464-542ba9faff37 ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:38:57,902::task::1194::TaskManager.Task::(stop) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:38:57,907::task::974::TaskManager.Task::(_decref) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:38:57,908::task::1151::TaskManager.Task::(prepare) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:38:57,908::task::1156::TaskManager.Task::(prepare) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:38:57,908::task::974::TaskManager.Task::(_decref) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:38:57,908::task::909::TaskManager.Task::(_doAbort) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:38:57,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:38:57,909::task::579::TaskManager.Task::(_updateState) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:38:57,909::task::534::TaskManager.Task::(__state_aborting) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:38:57,909::task::579::TaskManager.Task::(_updateState) Task=`43cedc8b-7126-4f0d-9464-542ba9faff37`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:38:57,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:38:57,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:38:57,910::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:38:57,910::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>VM Channels Listener::DEBUG::2014-04-10 16:38:59,082::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-430::DEBUG::2014-04-10 16:38:59,257::task::579::TaskManager.Task::(_updateState) Task=`81990676-e344-4a81-a1f3-894a44f6db71`::moving from state init -> state preparing
>Thread-430::INFO::2014-04-10 16:38:59,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-430::INFO::2014-04-10 16:38:59,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-430::DEBUG::2014-04-10 16:38:59,258::task::1168::TaskManager.Task::(prepare) Task=`81990676-e344-4a81-a1f3-894a44f6db71`::finished: {}
>Thread-430::DEBUG::2014-04-10 16:38:59,258::task::579::TaskManager.Task::(_updateState) Task=`81990676-e344-4a81-a1f3-894a44f6db71`::moving from state preparing -> state finished
>Thread-430::DEBUG::2014-04-10 16:38:59,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-430::DEBUG::2014-04-10 16:38:59,259::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-430::DEBUG::2014-04-10 16:38:59,259::task::974::TaskManager.Task::(_decref) Task=`81990676-e344-4a81-a1f3-894a44f6db71`::ref 0 aborting False
>Thread-433::DEBUG::2014-04-10 16:39:02,396::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-433::DEBUG::2014-04-10 16:39:02,397::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.29', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.45', 'elapsedTime': '725', 'vmType': 'kvm', 'cpuSys': '0.56', 'appsList': [], 'guestIPs': ''}]}
>Thread-437::DEBUG::2014-04-10 16:39:14,492::task::579::TaskManager.Task::(_updateState) Task=`59301728-3823-4f1f-9237-64c8e158e0af`::moving from state init -> state preparing
>Thread-437::INFO::2014-04-10 16:39:14,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-437::INFO::2014-04-10 16:39:14,492::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-437::DEBUG::2014-04-10 16:39:14,492::task::1168::TaskManager.Task::(prepare) Task=`59301728-3823-4f1f-9237-64c8e158e0af`::finished: {}
>Thread-437::DEBUG::2014-04-10 16:39:14,493::task::579::TaskManager.Task::(_updateState) Task=`59301728-3823-4f1f-9237-64c8e158e0af`::moving from state preparing -> state finished
>Thread-437::DEBUG::2014-04-10 16:39:14,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-437::DEBUG::2014-04-10 16:39:14,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-437::DEBUG::2014-04-10 16:39:14,493::task::974::TaskManager.Task::(_decref) Task=`59301728-3823-4f1f-9237-64c8e158e0af`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:39:29,120::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-443::DEBUG::2014-04-10 16:39:29,817::task::579::TaskManager.Task::(_updateState) Task=`5160f051-87e9-4574-91ce-fa984ed3844d`::moving from state init -> state preparing
>Thread-443::INFO::2014-04-10 16:39:29,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-443::INFO::2014-04-10 16:39:29,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-443::DEBUG::2014-04-10 16:39:29,818::task::1168::TaskManager.Task::(prepare) Task=`5160f051-87e9-4574-91ce-fa984ed3844d`::finished: {}
>Thread-443::DEBUG::2014-04-10 16:39:29,818::task::579::TaskManager.Task::(_updateState) Task=`5160f051-87e9-4574-91ce-fa984ed3844d`::moving from state preparing -> state finished
>Thread-443::DEBUG::2014-04-10 16:39:29,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-443::DEBUG::2014-04-10 16:39:29,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-443::DEBUG::2014-04-10 16:39:29,818::task::974::TaskManager.Task::(_decref) Task=`5160f051-87e9-4574-91ce-fa984ed3844d`::ref 0 aborting False
>Thread-449::DEBUG::2014-04-10 16:39:45,050::task::579::TaskManager.Task::(_updateState) Task=`e33c5354-92ad-4a45-a3e8-8145c6abee22`::moving from state init -> state preparing
>Thread-449::INFO::2014-04-10 16:39:45,051::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-449::INFO::2014-04-10 16:39:45,051::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-449::DEBUG::2014-04-10 16:39:45,051::task::1168::TaskManager.Task::(prepare) Task=`e33c5354-92ad-4a45-a3e8-8145c6abee22`::finished: {}
>Thread-449::DEBUG::2014-04-10 16:39:45,051::task::579::TaskManager.Task::(_updateState) Task=`e33c5354-92ad-4a45-a3e8-8145c6abee22`::moving from state preparing -> state finished
>Thread-449::DEBUG::2014-04-10 16:39:45,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-449::DEBUG::2014-04-10 16:39:45,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-449::DEBUG::2014-04-10 16:39:45,052::task::974::TaskManager.Task::(_decref) Task=`e33c5354-92ad-4a45-a3e8-8145c6abee22`::ref 0 aborting False
>Thread-426::WARNING::2014-04-10 16:39:57,899::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-428::WARNING::2014-04-10 16:39:57,906::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-419::ERROR::2014-04-10 16:39:57,907::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-419::ERROR::2014-04-10 16:39:57,907::hsm::631::Storage.HSM::(getSpmStatus) MD read error: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 624, in getSpmStatus
>    status = {'spmStatus': pool.spmRole, 'spmLver': pool.getSpmLver(),
>  File "/usr/share/vdsm/storage/sp.py", line 138, in getSpmLver
>    return self.getMetaParam(PMDK_LVER)
>  File "/usr/share/vdsm/storage/sp.py", line 1494, in getMetaParam
>    return self._metadata[key]
>  File "/usr/share/vdsm/storage/sp.py", line 1404, in _metadata
>    return self._getPoolMD(self.masterDomain)
>  File "/usr/share/vdsm/storage/sp.py", line 1400, in _getPoolMD
>    return DictValidator(domain._metadata._dict, SP_MD_FIELDS)
>  File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>    return getattr(self.getRealDomain(), attrName)
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-419::ERROR::2014-04-10 16:39:57,908::task::850::TaskManager.Task::(_setError) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 632, in getSpmStatus
>    raise se.StorageDomainMasterError("MD read error")
>StorageDomainMasterError: Error validating master storage domain: ('MD read error',)
>Thread-419::DEBUG::2014-04-10 16:39:57,908::task::869::TaskManager.Task::(_run) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::Task._run: cbf17c99-6e41-4ccf-88a3-0aa5b92916e6 ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-419::DEBUG::2014-04-10 16:39:57,908::task::1194::TaskManager.Task::(stop) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::stopping in state preparing (force False)
>Thread-419::DEBUG::2014-04-10 16:39:57,908::task::974::TaskManager.Task::(_decref) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::ref 1 aborting True
>Thread-419::INFO::2014-04-10 16:39:57,909::task::1151::TaskManager.Task::(prepare) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::aborting: Task is aborted: 'Error validating master storage domain' - code 355
>Thread-419::DEBUG::2014-04-10 16:39:57,909::task::1156::TaskManager.Task::(prepare) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::Prepare: aborted: Error validating master storage domain
>Thread-419::DEBUG::2014-04-10 16:39:57,909::task::974::TaskManager.Task::(_decref) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::ref 0 aborting True
>Thread-419::DEBUG::2014-04-10 16:39:57,909::task::909::TaskManager.Task::(_doAbort) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::Task._doAbort: force False
>Thread-419::DEBUG::2014-04-10 16:39:57,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-419::DEBUG::2014-04-10 16:39:57,909::task::579::TaskManager.Task::(_updateState) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::moving from state preparing -> state aborting
>Thread-419::DEBUG::2014-04-10 16:39:57,910::task::534::TaskManager.Task::(__state_aborting) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::_aborting: recover policy none
>Thread-419::DEBUG::2014-04-10 16:39:57,910::task::579::TaskManager.Task::(_updateState) Task=`cbf17c99-6e41-4ccf-88a3-0aa5b92916e6`::moving from state aborting -> state failed
>Thread-419::DEBUG::2014-04-10 16:39:57,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-419::DEBUG::2014-04-10 16:39:57,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-419::ERROR::2014-04-10 16:39:57,910::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Error validating master storage domain: ('MD read error',)", 'code': 355}}
>Thread-107::DEBUG::2014-04-10 16:39:57,971::task::579::TaskManager.Task::(_updateState) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:39:57,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-459::DEBUG::2014-04-10 16:39:58,080::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [78659dcf]
>Thread-459::DEBUG::2014-04-10 16:39:58,080::task::579::TaskManager.Task::(_updateState) Task=`e56ed3f0-96d2-4648-9478-076c2b3a5d05`::moving from state init -> state preparing
>Thread-459::INFO::2014-04-10 16:39:58,081::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-459::WARNING::2014-04-10 16:39:58,081::hsm::1106::Storage.HSM::(disconnectStoragePool) disconnect sp: f721168f-5edd-4f5f-8976-591eb93f960e failed. Known pools {}
>Thread-459::INFO::2014-04-10 16:39:58,081::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None
>Thread-459::DEBUG::2014-04-10 16:39:58,081::task::1168::TaskManager.Task::(prepare) Task=`e56ed3f0-96d2-4648-9478-076c2b3a5d05`::finished: None
>Thread-459::DEBUG::2014-04-10 16:39:58,081::task::579::TaskManager.Task::(_updateState) Task=`e56ed3f0-96d2-4648-9478-076c2b3a5d05`::moving from state preparing -> state finished
>Thread-459::DEBUG::2014-04-10 16:39:58,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-459::DEBUG::2014-04-10 16:39:58,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-459::DEBUG::2014-04-10 16:39:58,082::task::974::TaskManager.Task::(_decref) Task=`e56ed3f0-96d2-4648-9478-076c2b3a5d05`::ref 0 aborting False
>Thread-460::DEBUG::2014-04-10 16:39:58,095::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [78659dcf]
>Thread-460::DEBUG::2014-04-10 16:39:58,095::task::579::TaskManager.Task::(_updateState) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::moving from state init -> state preparing
>Thread-460::INFO::2014-04-10 16:39:58,096::logUtils::44::dispatcher::(wrapper) Run and protect: reconstructMaster(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', poolName='NFS_shyu', masterDom='55cb7668-7c5e-4553-b263-c6f3f86b358f', domDict={'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'active'}, masterVersion=6, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, hostId=2, options=None)
>Thread-460::INFO::2014-04-10 16:39:58,096::hsm::1866::Storage.HSM::(reconstructMaster) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e master=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::INFO::2014-04-10 16:39:58,096::fileSD::299::Storage.StorageDomain::(validate) sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::DEBUG::2014-04-10 16:39:58,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-460::DEBUG::2014-04-10 16:39:58,131::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`047cfc56-32a0-487f-b659-56fd60e122cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1880' at 'reconstructMaster'
>Thread-460::DEBUG::2014-04-10 16:39:58,131::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-460::DEBUG::2014-04-10 16:39:58,131::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-460::DEBUG::2014-04-10 16:39:58,131::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`047cfc56-32a0-487f-b659-56fd60e122cf`::Granted request
>Thread-460::DEBUG::2014-04-10 16:39:58,132::task::811::TaskManager.Task::(resourceAcquired) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-460::DEBUG::2014-04-10 16:39:58,132::task::974::TaskManager.Task::(_decref) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::ref 1 aborting False
>Thread-460::INFO::2014-04-10 16:39:58,132::sp::780::Storage.StoragePool::(reconstructMaster) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e hostId=2 poolName=NFS_shyu msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f domDict={'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'active'} masterVersion=6 leaseparams=({'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5})
>Thread-460::INFO::2014-04-10 16:39:58,132::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>VM Channels Listener::DEBUG::2014-04-10 16:39:59,157::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-461::DEBUG::2014-04-10 16:39:59,529::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [51ccbae3]
>Thread-461::DEBUG::2014-04-10 16:39:59,531::task::579::TaskManager.Task::(_updateState) Task=`8cc0579b-c97d-417c-a7e3-334f1b4afd7e`::moving from state init -> state preparing
>Thread-461::INFO::2014-04-10 16:39:59,531::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}], options=None)
>Thread-461::DEBUG::2014-04-10 16:39:59,533::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2
>Thread-460::DEBUG::2014-04-10 16:40:19,135::clusterlock::192::SANLock::(acquireHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>Thread-460::INFO::2014-04-10 16:40:19,135::clusterlock::225::SANLock::(acquire) Acquiring cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>Thread-460::DEBUG::2014-04-10 16:40:19,227::clusterlock::251::SANLock::(acquire) Cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>Thread-460::INFO::2014-04-10 16:40:19,228::sp::754::Storage.StoragePool::(createMaster) setting master domain for spUUID f721168f-5edd-4f5f-8976-591eb93f960e on sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::DEBUG::2014-04-10 16:40:19,228::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,228::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,238::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Regular', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fc644a6c35ebc56158e7f48e6abb193a0996f32']
>Thread-460::WARNING::2014-04-10 16:40:19,238::sd::498::Storage.StorageDomain::(attach) domain `55cb7668-7c5e-4553-b263-c6f3f86b358f` is already attached to pool `f721168f-5edd-4f5f-8976-591eb93f960e`
>Thread-460::DEBUG::2014-04-10 16:40:19,239::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,239::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,239::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-460::DEBUG::2014-04-10 16:40:19,239::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=55cb7668-7c5e-4553-b263-c6f3f86b358f:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a917d794fe01bb0cc2b580877057203b71863127']
>Thread-460::DEBUG::2014-04-10 16:40:19,250::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-460::INFO::2014-04-10 16:40:19,250::sp::810::Storage.StoragePool::(reconstructMaster) Set storage pool domains: {'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'Attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'Active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'Active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'Active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'Active'}
>Thread-460::DEBUG::2014-04-10 16:40:19,250::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,250::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-460::DEBUG::2014-04-10 16:40:19,250::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-460::DEBUG::2014-04-10 16:40:19,261::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-460::DEBUG::2014-04-10 16:40:19,262::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,262::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,262::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,262::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,262::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,263::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:19,263::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-460::DEBUG::2014-04-10 16:40:19,263::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-460::DEBUG::2014-04-10 16:40:19,263::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-460::DEBUG::2014-04-10 16:40:19,263::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-460::DEBUG::2014-04-10 16:40:19,264::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-460::DEBUG::2014-04-10 16:40:19,279::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-460::DEBUG::2014-04-10 16:40:19,279::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-460::DEBUG::2014-04-10 16:40:22,317::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-460::DEBUG::2014-04-10 16:40:22,379::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-460::DEBUG::2014-04-10 16:40:22,379::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,380::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,380::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,381::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,381::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,381::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-460::DEBUG::2014-04-10 16:40:22,381::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-460::DEBUG::2014-04-10 16:40:22,407::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::DEBUG::2014-04-10 16:40:22,408::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-460::DEBUG::2014-04-10 16:40:22,415::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-460::DEBUG::2014-04-10 16:40:22,417::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-460::INFO::2014-04-10 16:40:22,418::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-460::INFO::2014-04-10 16:40:22,418::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-460::DEBUG::2014-04-10 16:40:22,418::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain 55cb7668-7c5e-4553-b263-c6f3f86b358f verified, version 6
>Thread-460::DEBUG::2014-04-10 16:40:22,418::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-460::DEBUG::2014-04-10 16:40:22,418::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-460::DEBUG::2014-04-10 16:40:22,424::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-460::INFO::2014-04-10 16:40:22,425::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::DEBUG::2014-04-10 16:40:22,425::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `55cb7668-7c5e-4553-b263-c6f3f86b358f`
>Thread-466::DEBUG::2014-04-10 16:40:22,425::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::INFO::2014-04-10 16:40:22,426::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-460::DEBUG::2014-04-10 16:40:22,429::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`
>Thread-467::DEBUG::2014-04-10 16:40:22,429::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-460::INFO::2014-04-10 16:40:22,431::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-460::DEBUG::2014-04-10 16:40:22,435::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `dbec8cee-b5e4-4011-9dd5-7c122389a878`
>Thread-468::DEBUG::2014-04-10 16:40:22,435::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-460::INFO::2014-04-10 16:40:22,437::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 16:40:22,442::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-460::DEBUG::2014-04-10 16:40:22,442::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `65eafe2b-4fa9-4ea1-a869-7deb5afd4654`
>Thread-460::DEBUG::2014-04-10 16:40:22,455::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-460::DEBUG::2014-04-10 16:40:22,501::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-468::DEBUG::2014-04-10 16:40:22,549::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-460::DEBUG::2014-04-10 16:40:22,550::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:40:22,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 16:40:22,578::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:40:22,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000273078 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:40:22,594::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 16:40:22,596::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:40:22,596::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:40:22,596::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:40:22,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:40:22,612::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f changed its status to Valid
>Thread-478::DEBUG::2014-04-10 16:40:22,615::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-478::DEBUG::2014-04-10 16:40:22,617::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-478::DEBUG::2014-04-10 16:40:22,619::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-479::INFO::2014-04-10 16:40:22,620::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-468::DEBUG::2014-04-10 16:40:22,624::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271614 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:40:22,628::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878 changed its status to Valid
>Thread-480::DEBUG::2014-04-10 16:40:22,629::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-468::INFO::2014-04-10 16:40:22,629::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 2)
>Thread-480::DEBUG::2014-04-10 16:40:22,631::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-468::DEBUG::2014-04-10 16:40:22,631::clusterlock::192::SANLock::(acquireHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 successfully acquired (id: 2)
>Thread-480::DEBUG::2014-04-10 16:40:22,633::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-481::INFO::2014-04-10 16:40:22,634::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-460::DEBUG::2014-04-10 16:40:22,760::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found\n  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-460::WARNING::2014-04-10 16:40:22,764::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found', '  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-460::DEBUG::2014-04-10 16:40:22,764::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>VM Channels Listener::DEBUG::2014-04-10 16:40:29,192::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-466::DEBUG::2014-04-10 16:40:32,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:40:32,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000252178 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:40:32,641::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:40:32,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000230773 s, 2.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:40:42,641::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:40:42,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.00031892 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:40:42,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:40:42,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000208256 s, 3.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:40:52,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:40:52,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000649172 s, 1.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:40:52,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:40:52,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025184 s, 2.7 MB/s\n'; <rc> = 0
>Thread-455::WARNING::2014-04-10 16:40:57,978::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-457::WARNING::2014-04-10 16:40:57,982::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-455::DEBUG::2014-04-10 16:40:57,985::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-457::DEBUG::2014-04-10 16:40:57,987::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-107::ERROR::2014-04-10 16:40:57,989::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:40:57,990::task::850::TaskManager.Task::(_setError) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:40:58,011::task::869::TaskManager.Task::(_run) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::Task._run: fe732970-5ece-4cd9-90c5-8e40c9390b7e ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:40:58,025::task::1194::TaskManager.Task::(stop) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:40:58,030::task::974::TaskManager.Task::(_decref) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:40:58,031::task::1151::TaskManager.Task::(prepare) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:40:58,031::task::1156::TaskManager.Task::(prepare) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:40:58,032::task::974::TaskManager.Task::(_decref) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:40:58,032::task::909::TaskManager.Task::(_doAbort) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:40:58,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:40:58,033::task::579::TaskManager.Task::(_updateState) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:40:58,034::task::534::TaskManager.Task::(__state_aborting) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:40:58,034::task::579::TaskManager.Task::(_updateState) Task=`fe732970-5ece-4cd9-90c5-8e40c9390b7e`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:40:58,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:40:58,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:40:58,035::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:40:58,035::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>VM Channels Listener::DEBUG::2014-04-10 16:40:59,227::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-461::DEBUG::2014-04-10 16:40:59,537::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-461::DEBUG::2014-04-10 16:40:59,537::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-461::INFO::2014-04-10 16:40:59,538::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-461::DEBUG::2014-04-10 16:40:59,538::task::1168::TaskManager.Task::(prepare) Task=`8cc0579b-c97d-417c-a7e3-334f1b4afd7e`::finished: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-461::DEBUG::2014-04-10 16:40:59,538::task::579::TaskManager.Task::(_updateState) Task=`8cc0579b-c97d-417c-a7e3-334f1b4afd7e`::moving from state preparing -> state finished
>Thread-461::DEBUG::2014-04-10 16:40:59,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-461::DEBUG::2014-04-10 16:40:59,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-461::DEBUG::2014-04-10 16:40:59,539::task::974::TaskManager.Task::(_decref) Task=`8cc0579b-c97d-417c-a7e3-334f1b4afd7e`::ref 0 aborting False
>Thread-490::DEBUG::2014-04-10 16:41:00,038::task::579::TaskManager.Task::(_updateState) Task=`d88cf0c6-e280-4a70-a7a3-3b6802a9eed7`::moving from state init -> state preparing
>Thread-490::INFO::2014-04-10 16:41:00,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-490::INFO::2014-04-10 16:41:00,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649172', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025184', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.6', 'valid': True}}
>Thread-490::DEBUG::2014-04-10 16:41:00,039::task::1168::TaskManager.Task::(prepare) Task=`d88cf0c6-e280-4a70-a7a3-3b6802a9eed7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649172', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025184', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.6', 'valid': True}}
>Thread-490::DEBUG::2014-04-10 16:41:00,039::task::579::TaskManager.Task::(_updateState) Task=`d88cf0c6-e280-4a70-a7a3-3b6802a9eed7`::moving from state preparing -> state finished
>Thread-490::DEBUG::2014-04-10 16:41:00,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-490::DEBUG::2014-04-10 16:41:00,040::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-490::DEBUG::2014-04-10 16:41:00,040::task::974::TaskManager.Task::(_decref) Task=`d88cf0c6-e280-4a70-a7a3-3b6802a9eed7`::ref 0 aborting False
>Thread-491::DEBUG::2014-04-10 16:41:00,053::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-491::DEBUG::2014-04-10 16:41:00,054::task::579::TaskManager.Task::(_updateState) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::moving from state init -> state preparing
>Thread-491::INFO::2014-04-10 16:41:00,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-491::ERROR::2014-04-10 16:41:00,054::task::850::TaskManager.Task::(_setError) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 622, in getSpmStatus
>    pool = self.getPool(spUUID)
>  File "/usr/share/vdsm/storage/hsm.py", line 321, in getPool
>    raise se.StoragePoolUnknown(spUUID)
>StoragePoolUnknown: Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)
>Thread-491::DEBUG::2014-04-10 16:41:00,054::task::869::TaskManager.Task::(_run) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::Task._run: 8abf8294-3bb2-4cbf-9665-5470a50ae506 ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-491::DEBUG::2014-04-10 16:41:00,055::task::1194::TaskManager.Task::(stop) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::stopping in state preparing (force False)
>Thread-491::DEBUG::2014-04-10 16:41:00,055::task::974::TaskManager.Task::(_decref) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::ref 1 aborting True
>Thread-491::INFO::2014-04-10 16:41:00,055::task::1151::TaskManager.Task::(prepare) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309
>Thread-491::DEBUG::2014-04-10 16:41:00,056::task::1156::TaskManager.Task::(prepare) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::Prepare: aborted: Unknown pool id, pool not connected
>Thread-491::DEBUG::2014-04-10 16:41:00,056::task::974::TaskManager.Task::(_decref) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::ref 0 aborting True
>Thread-491::DEBUG::2014-04-10 16:41:00,056::task::909::TaskManager.Task::(_doAbort) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::Task._doAbort: force False
>Thread-491::DEBUG::2014-04-10 16:41:00,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-491::DEBUG::2014-04-10 16:41:00,056::task::579::TaskManager.Task::(_updateState) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::moving from state preparing -> state aborting
>Thread-491::DEBUG::2014-04-10 16:41:00,057::task::534::TaskManager.Task::(__state_aborting) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::_aborting: recover policy none
>Thread-491::DEBUG::2014-04-10 16:41:00,057::task::579::TaskManager.Task::(_updateState) Task=`8abf8294-3bb2-4cbf-9665-5470a50ae506`::moving from state aborting -> state failed
>Thread-491::DEBUG::2014-04-10 16:41:00,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-491::DEBUG::2014-04-10 16:41:00,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-491::ERROR::2014-04-10 16:41:00,057::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)", 'code': 309}}
>Thread-492::DEBUG::2014-04-10 16:41:00,065::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [5d1e7287]
>Thread-492::DEBUG::2014-04-10 16:41:00,066::task::579::TaskManager.Task::(_updateState) Task=`8f4f4ae7-ed9c-4769-8b85-fb28d15541e1`::moving from state init -> state preparing
>Thread-492::INFO::2014-04-10 16:41:00,066::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-492::DEBUG::2014-04-10 16:41:00,068::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-466::DEBUG::2014-04-10 16:41:02,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:02,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000396434 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:02,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:41:02,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265609 s, 2.5 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:41:12,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:12,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000394391 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:12,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:41:12,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000245468 s, 2.7 MB/s\n'; <rc> = 0
>Thread-462::WARNING::2014-04-10 16:41:22,397::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-464::WARNING::2014-04-10 16:41:22,406::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-462::DEBUG::2014-04-10 16:41:22,415::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-464::DEBUG::2014-04-10 16:41:22,425::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-470::WARNING::2014-04-10 16:41:22,477::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-470::DEBUG::2014-04-10 16:41:22,490::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-472::WARNING::2014-04-10 16:41:22,489::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-472::DEBUG::2014-04-10 16:41:22,502::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-474::WARNING::2014-04-10 16:41:22,515::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-474::DEBUG::2014-04-10 16:41:22,524::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-476::WARNING::2014-04-10 16:41:22,523::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-476::DEBUG::2014-04-10 16:41:22,532::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:41:22,536::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:41:22,539::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::DEBUG::2014-04-10 16:41:22,543::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 changed its status to Invalid
>Thread-493::DEBUG::2014-04-10 16:41:22,546::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-493::DEBUG::2014-04-10 16:41:22,550::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-493::DEBUG::2014-04-10 16:41:22,554::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-482::WARNING::2014-04-10 16:41:22,789::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-482::DEBUG::2014-04-10 16:41:22,799::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-484::WARNING::2014-04-10 16:41:22,797::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-484::DEBUG::2014-04-10 16:41:22,807::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-460::INFO::2014-04-10 16:41:22,813::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-460::INFO::2014-04-10 16:41:22,817::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::INFO::2014-04-10 16:41:22,819::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-460::INFO::2014-04-10 16:41:22,822::clusterlock::255::SANLock::(release) Releasing cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-460::DEBUG::2014-04-10 16:41:22,826::clusterlock::266::SANLock::(release) Cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully released
>Thread-460::INFO::2014-04-10 16:41:22,830::logUtils::47::dispatcher::(wrapper) Run and protect: reconstructMaster, Return response: None
>Thread-460::DEBUG::2014-04-10 16:41:22,834::task::1168::TaskManager.Task::(prepare) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::finished: None
>Thread-460::DEBUG::2014-04-10 16:41:22,837::task::579::TaskManager.Task::(_updateState) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::moving from state preparing -> state finished
>Thread-466::DEBUG::2014-04-10 16:41:22,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-460::DEBUG::2014-04-10 16:41:22,840::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-460::DEBUG::2014-04-10 16:41:22,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-460::DEBUG::2014-04-10 16:41:22,857::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-460::DEBUG::2014-04-10 16:41:22,863::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-460::DEBUG::2014-04-10 16:41:22,866::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-460::DEBUG::2014-04-10 16:41:22,869::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-460::DEBUG::2014-04-10 16:41:22,875::task::974::TaskManager.Task::(_decref) Task=`f7c18a41-30ad-4d87-8c1e-640033b0edd2`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:41:22,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:22,889::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000340299 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:22,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000225549 s, 3.0 MB/s\n'; <rc> = 0
>Thread-496::DEBUG::2014-04-10 16:41:22,926::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-496::DEBUG::2014-04-10 16:41:22,927::task::579::TaskManager.Task::(_updateState) Task=`8554c670-0a22-4166-8b98-f0521d24dad8`::moving from state init -> state preparing
>Thread-496::INFO::2014-04-10 16:41:22,927::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='55cb7668-7c5e-4553-b263-c6f3f86b358f', masterVersion=6, options=None)
>Thread-496::DEBUG::2014-04-10 16:41:22,927::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1d073cf9-23a3-47f8-9fec-4458dc3fb5c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1013' at 'connectStoragePool'
>Thread-496::DEBUG::2014-04-10 16:41:22,928::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-496::DEBUG::2014-04-10 16:41:22,928::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-496::DEBUG::2014-04-10 16:41:22,928::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1d073cf9-23a3-47f8-9fec-4458dc3fb5c3`::Granted request
>Thread-496::DEBUG::2014-04-10 16:41:22,929::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1018bf92-dc00-4951-9299-b9307e5cf629`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1044' at '_connectStoragePool'
>Thread-496::DEBUG::2014-04-10 16:41:22,929::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-496::DEBUG::2014-04-10 16:41:22,929::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-496::DEBUG::2014-04-10 16:41:22,929::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1018bf92-dc00-4951-9299-b9307e5cf629`::Granted request
>Thread-496::INFO::2014-04-10 16:41:22,930::sp::674::Storage.StoragePool::(connect) Connect host #2 to the storage pool f721168f-5edd-4f5f-8976-591eb93f960e with master domain: 55cb7668-7c5e-4553-b263-c6f3f86b358f (ver = 6)
>Thread-496::DEBUG::2014-04-10 16:41:22,930::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,931::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,931::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,931::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,931::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,932::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:22,932::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-496::DEBUG::2014-04-10 16:41:22,932::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-496::DEBUG::2014-04-10 16:41:22,932::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-496::DEBUG::2014-04-10 16:41:22,932::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-496::DEBUG::2014-04-10 16:41:22,933::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-496::DEBUG::2014-04-10 16:41:22,948::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-496::DEBUG::2014-04-10 16:41:22,949::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-496::DEBUG::2014-04-10 16:41:24,975::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-496::DEBUG::2014-04-10 16:41:25,054::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-496::DEBUG::2014-04-10 16:41:25,055::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,060::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,060::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,060::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,061::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,061::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,061::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-496::DEBUG::2014-04-10 16:41:25,087::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-496::DEBUG::2014-04-10 16:41:25,088::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-496::DEBUG::2014-04-10 16:41:25,093::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-496::DEBUG::2014-04-10 16:41:25,094::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-496::INFO::2014-04-10 16:41:25,094::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-496::INFO::2014-04-10 16:41:25,095::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-496::DEBUG::2014-04-10 16:41:25,095::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain 55cb7668-7c5e-4553-b263-c6f3f86b358f verified, version 6
>Thread-496::DEBUG::2014-04-10 16:41:25,095::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-496::DEBUG::2014-04-10 16:41:25,095::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-496::DEBUG::2014-04-10 16:41:25,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-496::DEBUG::2014-04-10 16:41:25,100::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-496::WARNING::2014-04-10 16:41:25,100::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e already exists
>Thread-496::DEBUG::2014-04-10 16:41:25,100::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-496::DEBUG::2014-04-10 16:41:25,101::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-496::DEBUG::2014-04-10 16:41:25,274::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found\n  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-496::WARNING::2014-04-10 16:41:25,275::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found', '  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-496::DEBUG::2014-04-10 16:41:25,275::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>VM Channels Listener::DEBUG::2014-04-10 16:41:29,263::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-466::DEBUG::2014-04-10 16:41:32,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:32,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000261885 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:32,965::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 16:41:32,967::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 16:41:32,972::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 16:41:32,974::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:41:32,974::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:41:32,974::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:41:32,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:41:32,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000230381 s, 2.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:41:42,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:42,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000264887 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:42,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:41:43,005::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000234895 s, 2.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:41:52,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:41:52,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000275419 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:41:53,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:41:53,021::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000230645 s, 2.9 MB/s\n'; <rc> = 0
>Thread-486::WARNING::2014-04-10 16:41:58,022::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-488::WARNING::2014-04-10 16:41:58,028::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-467::ERROR::2014-04-10 16:41:58,029::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::ERROR::2014-04-10 16:41:58,029::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::DEBUG::2014-04-10 16:41:58,030::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 changed its status to Invalid
>Thread-513::DEBUG::2014-04-10 16:41:58,031::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-513::DEBUG::2014-04-10 16:41:58,032::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-513::DEBUG::2014-04-10 16:41:58,032::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-107::DEBUG::2014-04-10 16:41:58,111::task::579::TaskManager.Task::(_updateState) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:41:58,112::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>VM Channels Listener::DEBUG::2014-04-10 16:41:59,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-492::DEBUG::2014-04-10 16:42:00,074::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-492::DEBUG::2014-04-10 16:42:00,074::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-492::INFO::2014-04-10 16:42:00,075::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-492::DEBUG::2014-04-10 16:42:00,075::task::1168::TaskManager.Task::(prepare) Task=`8f4f4ae7-ed9c-4769-8b85-fb28d15541e1`::finished: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-492::DEBUG::2014-04-10 16:42:00,075::task::579::TaskManager.Task::(_updateState) Task=`8f4f4ae7-ed9c-4769-8b85-fb28d15541e1`::moving from state preparing -> state finished
>Thread-492::DEBUG::2014-04-10 16:42:00,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-492::DEBUG::2014-04-10 16:42:00,075::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-492::DEBUG::2014-04-10 16:42:00,076::task::974::TaskManager.Task::(_decref) Task=`8f4f4ae7-ed9c-4769-8b85-fb28d15541e1`::ref 0 aborting False
>Thread-519::DEBUG::2014-04-10 16:42:00,084::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [78659dcf]
>Thread-519::DEBUG::2014-04-10 16:42:00,084::task::579::TaskManager.Task::(_updateState) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::moving from state init -> state preparing
>Thread-519::INFO::2014-04-10 16:42:00,085::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='55cb7668-7c5e-4553-b263-c6f3f86b358f', masterVersion=6, options=None)
>Thread-519::DEBUG::2014-04-10 16:42:00,085::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8fdb1361-72b1-4377-ab1b-569abc640372`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '867' at 'refreshStoragePool'
>Thread-519::DEBUG::2014-04-10 16:42:00,085::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-519::DEBUG::2014-04-10 16:42:00,086::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>Thread-466::DEBUG::2014-04-10 16:42:03,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:03,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000239529 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:03,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:03,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026356 s, 2.5 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:42:13,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:13,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000229111 s, 2.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:13,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:13,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000253462 s, 2.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:42:23,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:23,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000271472 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:23,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:23,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035128 s, 1.9 MB/s\n'; <rc> = 0
>Thread-497::WARNING::2014-04-10 16:42:25,076::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-497::DEBUG::2014-04-10 16:42:25,082::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-499::WARNING::2014-04-10 16:42:25,087::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-499::DEBUG::2014-04-10 16:42:25,091::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-501::WARNING::2014-04-10 16:42:25,296::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-503::WARNING::2014-04-10 16:42:25,297::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-501::DEBUG::2014-04-10 16:42:25,299::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-503::DEBUG::2014-04-10 16:42:25,300::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-496::INFO::2014-04-10 16:42:25,302::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-496::INFO::2014-04-10 16:42:25,303::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-496::INFO::2014-04-10 16:42:25,303::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-496::DEBUG::2014-04-10 16:42:25,303::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-496::DEBUG::2014-04-10 16:42:25,304::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-496::DEBUG::2014-04-10 16:42:25,304::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-496::DEBUG::2014-04-10 16:42:25,304::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-496::DEBUG::2014-04-10 16:42:25,304::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8fdb1361-72b1-4377-ab1b-569abc640372`::Granted request
>Thread-496::DEBUG::2014-04-10 16:42:25,305::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - shared: granted' was granted
>Thread-496::DEBUG::2014-04-10 16:42:25,305::resourceManager::693::ResourceManager::(releaseResource) This is a shared lock. Granting all shared requests
>Thread-519::DEBUG::2014-04-10 16:42:25,307::task::811::TaskManager.Task::(resourceAcquired) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-496::DEBUG::2014-04-10 16:42:25,309::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-519::DEBUG::2014-04-10 16:42:25,310::task::974::TaskManager.Task::(_decref) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::ref 1 aborting False
>Thread-519::INFO::2014-04-10 16:42:25,312::fileSD::299::Storage.StorageDomain::(validate) sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-496::DEBUG::2014-04-10 16:42:25,313::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-496::DEBUG::2014-04-10 16:42:25,315::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-496::DEBUG::2014-04-10 16:42:25,316::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-496::INFO::2014-04-10 16:42:25,317::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-496::DEBUG::2014-04-10 16:42:25,317::task::1168::TaskManager.Task::(prepare) Task=`8554c670-0a22-4166-8b98-f0521d24dad8`::finished: True
>Thread-496::DEBUG::2014-04-10 16:42:25,317::task::579::TaskManager.Task::(_updateState) Task=`8554c670-0a22-4166-8b98-f0521d24dad8`::moving from state preparing -> state finished
>Thread-496::DEBUG::2014-04-10 16:42:25,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-496::DEBUG::2014-04-10 16:42:25,317::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-496::DEBUG::2014-04-10 16:42:25,318::task::974::TaskManager.Task::(_decref) Task=`8554c670-0a22-4166-8b98-f0521d24dad8`::ref 0 aborting False
>Thread-519::DEBUG::2014-04-10 16:42:25,320::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-519::DEBUG::2014-04-10 16:42:25,322::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,322::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,322::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,322::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,323::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,323::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:25,324::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-519::DEBUG::2014-04-10 16:42:25,325::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-519::DEBUG::2014-04-10 16:42:25,327::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-519::DEBUG::2014-04-10 16:42:25,329::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-519::DEBUG::2014-04-10 16:42:25,333::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-521::DEBUG::2014-04-10 16:42:25,343::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-521::DEBUG::2014-04-10 16:42:25,344::task::579::TaskManager.Task::(_updateState) Task=`db69f839-8bfe-4510-a61d-cc1493359f2e`::moving from state init -> state preparing
>Thread-521::INFO::2014-04-10 16:42:25,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-519::DEBUG::2014-04-10 16:42:25,348::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-519::DEBUG::2014-04-10 16:42:25,349::misc::819::SamplingMethod::(__call__) Returning last result
>VM Channels Listener::DEBUG::2014-04-10 16:42:29,335::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-519::DEBUG::2014-04-10 16:42:29,401::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-519::DEBUG::2014-04-10 16:42:29,445::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-519::DEBUG::2014-04-10 16:42:29,446::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,446::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,447::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,447::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,448::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,448::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,448::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-519::DEBUG::2014-04-10 16:42:29,482::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-519::DEBUG::2014-04-10 16:42:29,483::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-519::DEBUG::2014-04-10 16:42:29,488::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-519::DEBUG::2014-04-10 16:42:29,490::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-519::INFO::2014-04-10 16:42:29,490::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-519::INFO::2014-04-10 16:42:29,490::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-521::INFO::2014-04-10 16:42:29,493::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}}
>Thread-519::DEBUG::2014-04-10 16:42:29,493::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain 55cb7668-7c5e-4553-b263-c6f3f86b358f verified, version 6
>Thread-521::DEBUG::2014-04-10 16:42:29,495::task::1168::TaskManager.Task::(prepare) Task=`db69f839-8bfe-4510-a61d-cc1493359f2e`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}}
>Thread-519::DEBUG::2014-04-10 16:42:29,495::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-521::DEBUG::2014-04-10 16:42:29,496::task::579::TaskManager.Task::(_updateState) Task=`db69f839-8bfe-4510-a61d-cc1493359f2e`::moving from state preparing -> state finished
>Thread-519::DEBUG::2014-04-10 16:42:29,497::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-521::DEBUG::2014-04-10 16:42:29,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-521::DEBUG::2014-04-10 16:42:29,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-521::DEBUG::2014-04-10 16:42:29,501::task::974::TaskManager.Task::(_decref) Task=`db69f839-8bfe-4510-a61d-cc1493359f2e`::ref 0 aborting False
>Thread-519::DEBUG::2014-04-10 16:42:29,507::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>Thread-519::DEBUG::2014-04-10 16:42:29,508::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-519::WARNING::2014-04-10 16:42:29,508::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e already exists
>Thread-519::DEBUG::2014-04-10 16:42:29,509::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-519::DEBUG::2014-04-10 16:42:29,511::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-527::DEBUG::2014-04-10 16:42:29,569::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-527::DEBUG::2014-04-10 16:42:29,570::task::579::TaskManager.Task::(_updateState) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::moving from state init -> state preparing
>Thread-527::INFO::2014-04-10 16:42:29,570::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None)
>Thread-527::DEBUG::2014-04-10 16:42:29,571::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c81e6671-7db7-4b5f-a43d-5f24a08a761e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '587' at 'spmStart'
>Thread-527::DEBUG::2014-04-10 16:42:29,571::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-527::DEBUG::2014-04-10 16:42:29,571::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>Thread-519::DEBUG::2014-04-10 16:42:29,670::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found\n  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-519::WARNING::2014-04-10 16:42:29,671::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76" not found', '  Skipping volume group f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-519::DEBUG::2014-04-10 16:42:29,672::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-505::WARNING::2014-04-10 16:42:32,558::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-507::WARNING::2014-04-10 16:42:32,560::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-505::DEBUG::2014-04-10 16:42:32,564::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-507::DEBUG::2014-04-10 16:42:32,566::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:42:32,572::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:42:32,577::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-509::WARNING::2014-04-10 16:42:32,945::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-509::DEBUG::2014-04-10 16:42:32,947::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-511::WARNING::2014-04-10 16:42:32,959::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-466::DEBUG::2014-04-10 16:42:33,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:33,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000274428 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:33,106::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 16:42:33,107::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 16:42:33,112::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 16:42:33,114::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:42:33,114::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:42:33,114::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:42:33,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:33,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254919 s, 2.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:42:43,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:43,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000291731 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:43,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:43,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025636 s, 2.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:42:53,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:42:53,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000260336 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:42:53,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:42:53,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000227706 s, 2.9 MB/s\n'; <rc> = 0
>Thread-515::WARNING::2014-04-10 16:42:58,131::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-515::DEBUG::2014-04-10 16:42:58,133::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-517::WARNING::2014-04-10 16:42:58,135::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-517::DEBUG::2014-04-10 16:42:58,136::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-107::ERROR::2014-04-10 16:42:58,137::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:42:58,138::task::850::TaskManager.Task::(_setError) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:42:58,156::task::869::TaskManager.Task::(_run) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::Task._run: 6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7 ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:42:58,169::task::1194::TaskManager.Task::(stop) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:42:58,173::task::974::TaskManager.Task::(_decref) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:42:58,174::task::1151::TaskManager.Task::(prepare) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:42:58,175::task::1156::TaskManager.Task::(prepare) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:42:58,175::task::974::TaskManager.Task::(_decref) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:42:58,175::task::909::TaskManager.Task::(_doAbort) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:42:58,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:42:58,176::task::579::TaskManager.Task::(_updateState) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:42:58,176::task::534::TaskManager.Task::(__state_aborting) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:42:58,176::task::579::TaskManager.Task::(_updateState) Task=`6a6b797a-f6cd-4f71-8476-1b1bd1c6d8a7`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:42:58,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:42:58,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:42:58,177::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:42:58,177::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>VM Channels Listener::DEBUG::2014-04-10 16:42:59,367::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-466::DEBUG::2014-04-10 16:43:03,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:03,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000281153 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:03,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:03,177::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252386 s, 2.7 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:43:13,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:13,127::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000294547 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:13,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:13,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000215451 s, 3.1 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:43:23,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:23,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n673 bytes (673 B) copied, 0.000302428 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:23,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:23,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000234027 s, 2.9 MB/s\n'; <rc> = 0
>VM Channels Listener::DEBUG::2014-04-10 16:43:29,401::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-522::WARNING::2014-04-10 16:43:29,475::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-522::DEBUG::2014-04-10 16:43:29,484::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-524::WARNING::2014-04-10 16:43:29,481::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-524::DEBUG::2014-04-10 16:43:29,491::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-528::WARNING::2014-04-10 16:43:29,694::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-528::DEBUG::2014-04-10 16:43:29,697::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-530::WARNING::2014-04-10 16:43:29,700::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-519::INFO::2014-04-10 16:43:29,701::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-519::INFO::2014-04-10 16:43:29,702::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-519::INFO::2014-04-10 16:43:29,702::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-519::INFO::2014-04-10 16:43:29,703::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None
>Thread-519::DEBUG::2014-04-10 16:43:29,703::task::1168::TaskManager.Task::(prepare) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::finished: None
>Thread-519::DEBUG::2014-04-10 16:43:29,703::task::579::TaskManager.Task::(_updateState) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::moving from state preparing -> state finished
>Thread-519::DEBUG::2014-04-10 16:43:29,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-519::DEBUG::2014-04-10 16:43:29,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-519::DEBUG::2014-04-10 16:43:29,704::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-519::DEBUG::2014-04-10 16:43:29,705::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-519::DEBUG::2014-04-10 16:43:29,705::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-519::DEBUG::2014-04-10 16:43:29,705::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-519::DEBUG::2014-04-10 16:43:29,705::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c81e6671-7db7-4b5f-a43d-5f24a08a761e`::Granted request
>Thread-519::DEBUG::2014-04-10 16:43:29,706::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - exclusive: granted' was granted
>Thread-527::DEBUG::2014-04-10 16:43:29,708::task::811::TaskManager.Task::(resourceAcquired) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-519::DEBUG::2014-04-10 16:43:29,709::task::974::TaskManager.Task::(_decref) Task=`b1e859ac-bf7c-4fa1-8761-55875b175e6f`::ref 0 aborting False
>Thread-527::DEBUG::2014-04-10 16:43:29,711::task::974::TaskManager.Task::(_decref) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::ref 1 aborting False
>Thread-527::INFO::2014-04-10 16:43:29,714::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
>Thread-527::DEBUG::2014-04-10 16:43:29,716::task::1163::TaskManager.Task::(prepare) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::Prepare: 1 jobs exist, move to acquiring
>Thread-527::DEBUG::2014-04-10 16:43:29,719::task::579::TaskManager.Task::(_updateState) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::moving from state preparing -> state acquiring
>Thread-527::DEBUG::2014-04-10 16:43:29,719::task::579::TaskManager.Task::(_updateState) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::moving from state acquiring -> state queued
>Thread-527::DEBUG::2014-04-10 16:43:29,719::taskManager::50::TaskManager::(_queueTask) queuing task: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-527::DEBUG::2014-04-10 16:43:29,719::taskManager::56::TaskManager::(_queueTask) task queued: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-7::DEBUG::2014-04-10 16:43:29,720::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-527::DEBUG::2014-04-10 16:43:29,722::task::1165::TaskManager.Task::(prepare) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::returning
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,723::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 14cef35a-8e4f-401f-8b32-f346397180b1 running: <bound method Task.commit of <storage.task.Task instance at 0x7f37341c93b0>> with: None
>Thread-527::DEBUG::2014-04-10 16:43:29,724::task::974::TaskManager.Task::(_decref) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::ref 0 aborting False
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,724::task::1176::TaskManager.Task::(commit) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::committing task: 14cef35a-8e4f-401f-8b32-f346397180b1
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,727::task::579::TaskManager.Task::(_updateState) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::moving from state queued -> state running
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,732::task::889::TaskManager.Task::(_runJobs) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f373829a250>> (args: (-1, '-1', 'false', 250, 3) kwargs: {})
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,736::task::315::TaskManager.Task::(run) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f373829a250>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,738::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,740::misc::811::SamplingMethod::(__call__) Got in to sampling method
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,745::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,746::misc::819::SamplingMethod::(__call__) Returning last result
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,750::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>14cef35a-8e4f-401f-8b32-f346397180b1::INFO::2014-04-10 16:43:29,751::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,751::clusterlock::192::SANLock::(acquireHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>14cef35a-8e4f-401f-8b32-f346397180b1::INFO::2014-04-10 16:43:29,752::clusterlock::225::SANLock::(acquire) Acquiring cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,784::clusterlock::251::SANLock::(acquire) Cluster lock for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,784::sp::272::Storage.StoragePool::(startSpm) spm lock acquired successfully
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,789::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ced3c9d8788c6b5d2a71fc4f6216967a8a77a8d2']
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,789::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,789::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,790::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,793::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,794::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29a6cc48-6904-4c95-bf7a-f67f96d27574`::Request was made in '/usr/share/vdsm/storage/sp.py' line '432' at '_upgradePool'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,795::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,795::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29a6cc48-6904-4c95-bf7a-f67f96d27574`::Granted request
>14cef35a-8e4f-401f-8b32-f346397180b1::INFO::2014-04-10 16:43:29,795::sp::438::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `55cb7668-7c5e-4553-b263-c6f3f86b358f`
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,796::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`6ff27aaa-d7c7-4076-a17c-eab8dcbe4402`::Request was made in '/usr/share/vdsm/storage/sp.py' line '440' at '_upgradePool'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,796::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,796::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,796::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`6ff27aaa-d7c7-4076-a17c-eab8dcbe4402`::Granted request
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,826::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,827::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,832::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,834::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>14cef35a-8e4f-401f-8b32-f346397180b1::INFO::2014-04-10 16:43:29,834::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>14cef35a-8e4f-401f-8b32-f346397180b1::INFO::2014-04-10 16:43:29,834::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,835::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,835::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,835::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,835::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,835::sp::443::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,836::sp::450::Storage.StoragePool::(_upgradePool) Registering with state change event
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,836::sp::453::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
>Thread-550::DEBUG::2014-04-10 16:43:29,838::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,840::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-550::DEBUG::2014-04-10 16:43:29,843::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`bac55c67-b171-4403-aa66-4076d4e214e7`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,844::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-550::DEBUG::2014-04-10 16:43:29,845::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'exclusive'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,869::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,872::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-550::DEBUG::2014-04-10 16:43:29,874::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'exclusive' (1 active user)
>Thread-550::DEBUG::2014-04-10 16:43:29,876::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`bac55c67-b171-4403-aa66-4076d4e214e7`::Granted request
>Thread-550::DEBUG::2014-04-10 16:43:29,882::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`8b228182-c0e3-4c03-9412-f3f2f552db91`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>Thread-550::DEBUG::2014-04-10 16:43:29,882::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'exclusive'
>Thread-550::DEBUG::2014-04-10 16:43:29,883::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'exclusive' (1 active user)
>Thread-550::DEBUG::2014-04-10 16:43:29,884::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`8b228182-c0e3-4c03-9412-f3f2f552db91`::Granted request
>Thread-550::DEBUG::2014-04-10 16:43:29,889::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-550::DEBUG::2014-04-10 16:43:29,889::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-550::DEBUG::2014-04-10 16:43:29,890::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-550::DEBUG::2014-04-10 16:43:29,890::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-550::DEBUG::2014-04-10 16:43:29,890::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-550::DEBUG::2014-04-10 16:43:29,891::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-550::DEBUG::2014-04-10 16:43:29,891::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-550::DEBUG::2014-04-10 16:43:29,891::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-550::DEBUG::2014-04-10 16:43:29,891::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,949::sd::621::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/master/vms
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:43:29,950::sd::624::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/master/tasks
>Thread-552::DEBUG::2014-04-10 16:43:30,743::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-552::DEBUG::2014-04-10 16:43:30,743::task::579::TaskManager.Task::(_updateState) Task=`76bfcba9-6787-4c48-b488-62f30127843e`::moving from state init -> state preparing
>Thread-552::INFO::2014-04-10 16:43:30,744::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-552::DEBUG::2014-04-10 16:43:30,744::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-552::DEBUG::2014-04-10 16:43:30,744::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-552::INFO::2014-04-10 16:43:30,744::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-552::DEBUG::2014-04-10 16:43:30,745::task::1168::TaskManager.Task::(prepare) Task=`76bfcba9-6787-4c48-b488-62f30127843e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-552::DEBUG::2014-04-10 16:43:30,745::task::579::TaskManager.Task::(_updateState) Task=`76bfcba9-6787-4c48-b488-62f30127843e`::moving from state preparing -> state finished
>Thread-552::DEBUG::2014-04-10 16:43:30,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-552::DEBUG::2014-04-10 16:43:30,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-552::DEBUG::2014-04-10 16:43:30,746::task::974::TaskManager.Task::(_decref) Task=`76bfcba9-6787-4c48-b488-62f30127843e`::ref 0 aborting False
>Thread-553::DEBUG::2014-04-10 16:43:31,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-553::DEBUG::2014-04-10 16:43:31,757::task::579::TaskManager.Task::(_updateState) Task=`fed90aa6-9161-4eb6-8495-328f05d85931`::moving from state init -> state preparing
>Thread-553::INFO::2014-04-10 16:43:31,757::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-553::DEBUG::2014-04-10 16:43:31,757::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-553::DEBUG::2014-04-10 16:43:31,757::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-553::INFO::2014-04-10 16:43:31,758::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-553::DEBUG::2014-04-10 16:43:31,758::task::1168::TaskManager.Task::(prepare) Task=`fed90aa6-9161-4eb6-8495-328f05d85931`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-553::DEBUG::2014-04-10 16:43:31,758::task::579::TaskManager.Task::(_updateState) Task=`fed90aa6-9161-4eb6-8495-328f05d85931`::moving from state preparing -> state finished
>Thread-553::DEBUG::2014-04-10 16:43:31,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-553::DEBUG::2014-04-10 16:43:31,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-553::DEBUG::2014-04-10 16:43:31,759::task::974::TaskManager.Task::(_decref) Task=`fed90aa6-9161-4eb6-8495-328f05d85931`::ref 0 aborting False
>Thread-555::DEBUG::2014-04-10 16:43:32,775::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-555::DEBUG::2014-04-10 16:43:32,781::task::579::TaskManager.Task::(_updateState) Task=`009cfc31-66ed-4e7a-ba63-f7bd652b19a2`::moving from state init -> state preparing
>Thread-555::INFO::2014-04-10 16:43:32,785::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-555::DEBUG::2014-04-10 16:43:32,788::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-555::DEBUG::2014-04-10 16:43:32,791::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-555::INFO::2014-04-10 16:43:32,795::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-555::DEBUG::2014-04-10 16:43:32,799::task::1168::TaskManager.Task::(prepare) Task=`009cfc31-66ed-4e7a-ba63-f7bd652b19a2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-555::DEBUG::2014-04-10 16:43:32,802::task::579::TaskManager.Task::(_updateState) Task=`009cfc31-66ed-4e7a-ba63-f7bd652b19a2`::moving from state preparing -> state finished
>Thread-555::DEBUG::2014-04-10 16:43:32,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-555::DEBUG::2014-04-10 16:43:32,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-555::DEBUG::2014-04-10 16:43:32,812::task::974::TaskManager.Task::(_decref) Task=`009cfc31-66ed-4e7a-ba63-f7bd652b19a2`::ref 0 aborting False
>Thread-532::WARNING::2014-04-10 16:43:33,095::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-532::DEBUG::2014-04-10 16:43:33,098::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-534::WARNING::2014-04-10 16:43:33,103::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-466::DEBUG::2014-04-10 16:43:33,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:33,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000407373 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:33,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:33,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284954 s, 2.4 MB/s\n'; <rc> = 0
>Thread-556::DEBUG::2014-04-10 16:43:33,832::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-556::DEBUG::2014-04-10 16:43:33,832::task::579::TaskManager.Task::(_updateState) Task=`d2146f7e-78f3-451c-881d-d562897696bc`::moving from state init -> state preparing
>Thread-556::INFO::2014-04-10 16:43:33,833::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-556::DEBUG::2014-04-10 16:43:33,833::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-556::DEBUG::2014-04-10 16:43:33,833::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-556::INFO::2014-04-10 16:43:33,833::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-556::DEBUG::2014-04-10 16:43:33,834::task::1168::TaskManager.Task::(prepare) Task=`d2146f7e-78f3-451c-881d-d562897696bc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-556::DEBUG::2014-04-10 16:43:33,834::task::579::TaskManager.Task::(_updateState) Task=`d2146f7e-78f3-451c-881d-d562897696bc`::moving from state preparing -> state finished
>Thread-556::DEBUG::2014-04-10 16:43:33,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-556::DEBUG::2014-04-10 16:43:33,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-556::DEBUG::2014-04-10 16:43:33,834::task::974::TaskManager.Task::(_decref) Task=`d2146f7e-78f3-451c-881d-d562897696bc`::ref 0 aborting False
>Thread-557::DEBUG::2014-04-10 16:43:34,841::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-557::DEBUG::2014-04-10 16:43:34,842::task::579::TaskManager.Task::(_updateState) Task=`f28de206-3b33-48bd-8682-1adf586425e7`::moving from state init -> state preparing
>Thread-557::INFO::2014-04-10 16:43:34,842::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-557::DEBUG::2014-04-10 16:43:34,842::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-557::DEBUG::2014-04-10 16:43:34,842::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-557::INFO::2014-04-10 16:43:34,842::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-557::DEBUG::2014-04-10 16:43:34,843::task::1168::TaskManager.Task::(prepare) Task=`f28de206-3b33-48bd-8682-1adf586425e7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-557::DEBUG::2014-04-10 16:43:34,843::task::579::TaskManager.Task::(_updateState) Task=`f28de206-3b33-48bd-8682-1adf586425e7`::moving from state preparing -> state finished
>Thread-557::DEBUG::2014-04-10 16:43:34,843::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-557::DEBUG::2014-04-10 16:43:34,843::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-557::DEBUG::2014-04-10 16:43:34,843::task::974::TaskManager.Task::(_decref) Task=`f28de206-3b33-48bd-8682-1adf586425e7`::ref 0 aborting False
>Thread-558::DEBUG::2014-04-10 16:43:35,792::task::579::TaskManager.Task::(_updateState) Task=`11706ebc-d804-45eb-82fe-a1017548e3f5`::moving from state init -> state preparing
>Thread-558::INFO::2014-04-10 16:43:35,793::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-558::INFO::2014-04-10 16:43:35,793::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '97.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407373', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284954', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '63.2', 'valid': False}}
>Thread-558::DEBUG::2014-04-10 16:43:35,793::task::1168::TaskManager.Task::(prepare) Task=`11706ebc-d804-45eb-82fe-a1017548e3f5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '97.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407373', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284954', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '63.2', 'valid': False}}
>Thread-558::DEBUG::2014-04-10 16:43:35,793::task::579::TaskManager.Task::(_updateState) Task=`11706ebc-d804-45eb-82fe-a1017548e3f5`::moving from state preparing -> state finished
>Thread-558::DEBUG::2014-04-10 16:43:35,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-558::DEBUG::2014-04-10 16:43:35,794::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-558::DEBUG::2014-04-10 16:43:35,794::task::974::TaskManager.Task::(_decref) Task=`11706ebc-d804-45eb-82fe-a1017548e3f5`::ref 0 aborting False
>Thread-560::DEBUG::2014-04-10 16:43:35,856::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-560::DEBUG::2014-04-10 16:43:35,856::task::579::TaskManager.Task::(_updateState) Task=`55747a46-f9d8-42ab-b34c-e8ac5cf6424a`::moving from state init -> state preparing
>Thread-560::INFO::2014-04-10 16:43:35,857::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-560::DEBUG::2014-04-10 16:43:35,857::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-560::DEBUG::2014-04-10 16:43:35,857::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-560::INFO::2014-04-10 16:43:35,857::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-560::DEBUG::2014-04-10 16:43:35,857::task::1168::TaskManager.Task::(prepare) Task=`55747a46-f9d8-42ab-b34c-e8ac5cf6424a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-560::DEBUG::2014-04-10 16:43:35,857::task::579::TaskManager.Task::(_updateState) Task=`55747a46-f9d8-42ab-b34c-e8ac5cf6424a`::moving from state preparing -> state finished
>Thread-560::DEBUG::2014-04-10 16:43:35,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-560::DEBUG::2014-04-10 16:43:35,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-560::DEBUG::2014-04-10 16:43:35,858::task::974::TaskManager.Task::(_decref) Task=`55747a46-f9d8-42ab-b34c-e8ac5cf6424a`::ref 0 aborting False
>Thread-561::DEBUG::2014-04-10 16:43:36,866::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-561::DEBUG::2014-04-10 16:43:36,867::task::579::TaskManager.Task::(_updateState) Task=`d6c275f7-7558-4d2d-ac55-2da97b7de9c5`::moving from state init -> state preparing
>Thread-561::INFO::2014-04-10 16:43:36,867::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-561::DEBUG::2014-04-10 16:43:36,868::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-561::DEBUG::2014-04-10 16:43:36,868::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-561::INFO::2014-04-10 16:43:36,868::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-561::DEBUG::2014-04-10 16:43:36,868::task::1168::TaskManager.Task::(prepare) Task=`d6c275f7-7558-4d2d-ac55-2da97b7de9c5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-561::DEBUG::2014-04-10 16:43:36,868::task::579::TaskManager.Task::(_updateState) Task=`d6c275f7-7558-4d2d-ac55-2da97b7de9c5`::moving from state preparing -> state finished
>Thread-561::DEBUG::2014-04-10 16:43:36,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-561::DEBUG::2014-04-10 16:43:36,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-561::DEBUG::2014-04-10 16:43:36,869::task::974::TaskManager.Task::(_decref) Task=`d6c275f7-7558-4d2d-ac55-2da97b7de9c5`::ref 0 aborting False
>Thread-562::DEBUG::2014-04-10 16:43:37,877::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-562::DEBUG::2014-04-10 16:43:37,877::task::579::TaskManager.Task::(_updateState) Task=`cbaffe0b-3824-4fd3-8e90-2d32a06e8741`::moving from state init -> state preparing
>Thread-562::INFO::2014-04-10 16:43:37,877::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-562::DEBUG::2014-04-10 16:43:37,877::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-562::DEBUG::2014-04-10 16:43:37,878::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-562::INFO::2014-04-10 16:43:37,878::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-562::DEBUG::2014-04-10 16:43:37,878::task::1168::TaskManager.Task::(prepare) Task=`cbaffe0b-3824-4fd3-8e90-2d32a06e8741`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-562::DEBUG::2014-04-10 16:43:37,878::task::579::TaskManager.Task::(_updateState) Task=`cbaffe0b-3824-4fd3-8e90-2d32a06e8741`::moving from state preparing -> state finished
>Thread-562::DEBUG::2014-04-10 16:43:37,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-562::DEBUG::2014-04-10 16:43:37,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-562::DEBUG::2014-04-10 16:43:37,878::task::974::TaskManager.Task::(_decref) Task=`cbaffe0b-3824-4fd3-8e90-2d32a06e8741`::ref 0 aborting False
>Thread-563::DEBUG::2014-04-10 16:43:38,886::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-563::DEBUG::2014-04-10 16:43:38,886::task::579::TaskManager.Task::(_updateState) Task=`ea01b81e-3646-44fa-a01f-e2cde0e951b8`::moving from state init -> state preparing
>Thread-563::INFO::2014-04-10 16:43:38,886::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-563::DEBUG::2014-04-10 16:43:38,886::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-563::DEBUG::2014-04-10 16:43:38,887::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-563::INFO::2014-04-10 16:43:38,887::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-563::DEBUG::2014-04-10 16:43:38,887::task::1168::TaskManager.Task::(prepare) Task=`ea01b81e-3646-44fa-a01f-e2cde0e951b8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-563::DEBUG::2014-04-10 16:43:38,887::task::579::TaskManager.Task::(_updateState) Task=`ea01b81e-3646-44fa-a01f-e2cde0e951b8`::moving from state preparing -> state finished
>Thread-563::DEBUG::2014-04-10 16:43:38,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-563::DEBUG::2014-04-10 16:43:38,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-563::DEBUG::2014-04-10 16:43:38,888::task::974::TaskManager.Task::(_decref) Task=`ea01b81e-3646-44fa-a01f-e2cde0e951b8`::ref 0 aborting False
>Thread-565::DEBUG::2014-04-10 16:43:39,895::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-565::DEBUG::2014-04-10 16:43:39,914::task::579::TaskManager.Task::(_updateState) Task=`6c05040f-9be6-48b9-b77b-b6adf297d358`::moving from state init -> state preparing
>Thread-565::INFO::2014-04-10 16:43:39,915::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-565::DEBUG::2014-04-10 16:43:39,915::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-565::DEBUG::2014-04-10 16:43:39,915::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-565::INFO::2014-04-10 16:43:39,915::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-565::DEBUG::2014-04-10 16:43:39,916::task::1168::TaskManager.Task::(prepare) Task=`6c05040f-9be6-48b9-b77b-b6adf297d358`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-565::DEBUG::2014-04-10 16:43:39,916::task::579::TaskManager.Task::(_updateState) Task=`6c05040f-9be6-48b9-b77b-b6adf297d358`::moving from state preparing -> state finished
>Thread-565::DEBUG::2014-04-10 16:43:39,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-565::DEBUG::2014-04-10 16:43:39,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-565::DEBUG::2014-04-10 16:43:39,916::task::974::TaskManager.Task::(_decref) Task=`6c05040f-9be6-48b9-b77b-b6adf297d358`::ref 0 aborting False
>Thread-566::DEBUG::2014-04-10 16:43:40,924::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-566::DEBUG::2014-04-10 16:43:40,924::task::579::TaskManager.Task::(_updateState) Task=`f9892c16-fe9b-465d-8ecf-41fffed69bfd`::moving from state init -> state preparing
>Thread-566::INFO::2014-04-10 16:43:40,924::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-566::DEBUG::2014-04-10 16:43:40,924::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-566::DEBUG::2014-04-10 16:43:40,924::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-566::INFO::2014-04-10 16:43:40,925::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-566::DEBUG::2014-04-10 16:43:40,925::task::1168::TaskManager.Task::(prepare) Task=`f9892c16-fe9b-465d-8ecf-41fffed69bfd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-566::DEBUG::2014-04-10 16:43:40,925::task::579::TaskManager.Task::(_updateState) Task=`f9892c16-fe9b-465d-8ecf-41fffed69bfd`::moving from state preparing -> state finished
>Thread-566::DEBUG::2014-04-10 16:43:40,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-566::DEBUG::2014-04-10 16:43:40,925::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-566::DEBUG::2014-04-10 16:43:40,925::task::974::TaskManager.Task::(_decref) Task=`f9892c16-fe9b-465d-8ecf-41fffed69bfd`::ref 0 aborting False
>Thread-567::DEBUG::2014-04-10 16:43:41,946::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-567::DEBUG::2014-04-10 16:43:41,955::task::579::TaskManager.Task::(_updateState) Task=`65cc8773-2303-4757-aa1c-24d4968f71df`::moving from state init -> state preparing
>Thread-567::INFO::2014-04-10 16:43:41,962::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-567::DEBUG::2014-04-10 16:43:41,966::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-567::DEBUG::2014-04-10 16:43:41,969::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-567::INFO::2014-04-10 16:43:41,972::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-567::DEBUG::2014-04-10 16:43:41,975::task::1168::TaskManager.Task::(prepare) Task=`65cc8773-2303-4757-aa1c-24d4968f71df`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-567::DEBUG::2014-04-10 16:43:41,979::task::579::TaskManager.Task::(_updateState) Task=`65cc8773-2303-4757-aa1c-24d4968f71df`::moving from state preparing -> state finished
>Thread-567::DEBUG::2014-04-10 16:43:41,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-567::DEBUG::2014-04-10 16:43:41,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-567::DEBUG::2014-04-10 16:43:41,989::task::974::TaskManager.Task::(_decref) Task=`65cc8773-2303-4757-aa1c-24d4968f71df`::ref 0 aborting False
>Thread-536::WARNING::2014-04-10 16:43:42,606::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-538::WARNING::2014-04-10 16:43:42,608::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-536::DEBUG::2014-04-10 16:43:42,608::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-538::DEBUG::2014-04-10 16:43:42,610::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:43:42,611::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:43:42,612::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-573::DEBUG::2014-04-10 16:43:43,008::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-573::DEBUG::2014-04-10 16:43:43,008::task::579::TaskManager.Task::(_updateState) Task=`a6c6a462-3117-4e88-88c6-3dbdcd202b05`::moving from state init -> state preparing
>Thread-573::INFO::2014-04-10 16:43:43,009::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-573::DEBUG::2014-04-10 16:43:43,009::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-573::DEBUG::2014-04-10 16:43:43,009::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-573::INFO::2014-04-10 16:43:43,009::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-573::DEBUG::2014-04-10 16:43:43,009::task::1168::TaskManager.Task::(prepare) Task=`a6c6a462-3117-4e88-88c6-3dbdcd202b05`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-573::DEBUG::2014-04-10 16:43:43,010::task::579::TaskManager.Task::(_updateState) Task=`a6c6a462-3117-4e88-88c6-3dbdcd202b05`::moving from state preparing -> state finished
>Thread-573::DEBUG::2014-04-10 16:43:43,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-573::DEBUG::2014-04-10 16:43:43,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-573::DEBUG::2014-04-10 16:43:43,010::task::974::TaskManager.Task::(_decref) Task=`a6c6a462-3117-4e88-88c6-3dbdcd202b05`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:43:43,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:43,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000508229 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:43,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:43,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264966 s, 2.5 MB/s\n'; <rc> = 0
>Thread-574::DEBUG::2014-04-10 16:43:44,018::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-574::DEBUG::2014-04-10 16:43:44,018::task::579::TaskManager.Task::(_updateState) Task=`d14569ef-10fe-423b-a5a5-274b7a2e5a9d`::moving from state init -> state preparing
>Thread-574::INFO::2014-04-10 16:43:44,019::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-574::DEBUG::2014-04-10 16:43:44,019::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-574::DEBUG::2014-04-10 16:43:44,019::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-574::INFO::2014-04-10 16:43:44,019::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-574::DEBUG::2014-04-10 16:43:44,019::task::1168::TaskManager.Task::(prepare) Task=`d14569ef-10fe-423b-a5a5-274b7a2e5a9d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-574::DEBUG::2014-04-10 16:43:44,020::task::579::TaskManager.Task::(_updateState) Task=`d14569ef-10fe-423b-a5a5-274b7a2e5a9d`::moving from state preparing -> state finished
>Thread-574::DEBUG::2014-04-10 16:43:44,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-574::DEBUG::2014-04-10 16:43:44,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-574::DEBUG::2014-04-10 16:43:44,020::task::974::TaskManager.Task::(_decref) Task=`d14569ef-10fe-423b-a5a5-274b7a2e5a9d`::ref 0 aborting False
>Thread-576::DEBUG::2014-04-10 16:43:45,029::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-576::DEBUG::2014-04-10 16:43:45,030::task::579::TaskManager.Task::(_updateState) Task=`3ef4cebc-e8b0-4fd4-91d8-a1ac71537ff2`::moving from state init -> state preparing
>Thread-576::INFO::2014-04-10 16:43:45,032::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-576::DEBUG::2014-04-10 16:43:45,033::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-576::DEBUG::2014-04-10 16:43:45,033::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-576::INFO::2014-04-10 16:43:45,034::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-576::DEBUG::2014-04-10 16:43:45,034::task::1168::TaskManager.Task::(prepare) Task=`3ef4cebc-e8b0-4fd4-91d8-a1ac71537ff2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-576::DEBUG::2014-04-10 16:43:45,035::task::579::TaskManager.Task::(_updateState) Task=`3ef4cebc-e8b0-4fd4-91d8-a1ac71537ff2`::moving from state preparing -> state finished
>Thread-576::DEBUG::2014-04-10 16:43:45,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-576::DEBUG::2014-04-10 16:43:45,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-576::DEBUG::2014-04-10 16:43:45,036::task::974::TaskManager.Task::(_decref) Task=`3ef4cebc-e8b0-4fd4-91d8-a1ac71537ff2`::ref 0 aborting False
>Thread-577::DEBUG::2014-04-10 16:43:46,043::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-577::DEBUG::2014-04-10 16:43:46,044::task::579::TaskManager.Task::(_updateState) Task=`d9e5d57f-ce51-40b4-8023-38b42c8374cf`::moving from state init -> state preparing
>Thread-577::INFO::2014-04-10 16:43:46,044::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-577::DEBUG::2014-04-10 16:43:46,045::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-577::DEBUG::2014-04-10 16:43:46,045::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-577::INFO::2014-04-10 16:43:46,045::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-577::DEBUG::2014-04-10 16:43:46,045::task::1168::TaskManager.Task::(prepare) Task=`d9e5d57f-ce51-40b4-8023-38b42c8374cf`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-577::DEBUG::2014-04-10 16:43:46,045::task::579::TaskManager.Task::(_updateState) Task=`d9e5d57f-ce51-40b4-8023-38b42c8374cf`::moving from state preparing -> state finished
>Thread-577::DEBUG::2014-04-10 16:43:46,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-577::DEBUG::2014-04-10 16:43:46,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-577::DEBUG::2014-04-10 16:43:46,046::task::974::TaskManager.Task::(_decref) Task=`d9e5d57f-ce51-40b4-8023-38b42c8374cf`::ref 0 aborting False
>Thread-578::DEBUG::2014-04-10 16:43:47,054::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-578::DEBUG::2014-04-10 16:43:47,054::task::579::TaskManager.Task::(_updateState) Task=`8b4b823d-70d7-4622-972f-fadce4be6884`::moving from state init -> state preparing
>Thread-578::INFO::2014-04-10 16:43:47,055::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-578::DEBUG::2014-04-10 16:43:47,055::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-578::DEBUG::2014-04-10 16:43:47,055::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-578::INFO::2014-04-10 16:43:47,055::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-578::DEBUG::2014-04-10 16:43:47,056::task::1168::TaskManager.Task::(prepare) Task=`8b4b823d-70d7-4622-972f-fadce4be6884`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-578::DEBUG::2014-04-10 16:43:47,056::task::579::TaskManager.Task::(_updateState) Task=`8b4b823d-70d7-4622-972f-fadce4be6884`::moving from state preparing -> state finished
>Thread-578::DEBUG::2014-04-10 16:43:47,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-578::DEBUG::2014-04-10 16:43:47,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-578::DEBUG::2014-04-10 16:43:47,056::task::974::TaskManager.Task::(_decref) Task=`8b4b823d-70d7-4622-972f-fadce4be6884`::ref 0 aborting False
>Thread-580::DEBUG::2014-04-10 16:43:48,064::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-580::DEBUG::2014-04-10 16:43:48,064::task::579::TaskManager.Task::(_updateState) Task=`35403c21-00d5-4f09-9aa7-7aa774b40714`::moving from state init -> state preparing
>Thread-580::INFO::2014-04-10 16:43:48,065::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-580::DEBUG::2014-04-10 16:43:48,065::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-580::DEBUG::2014-04-10 16:43:48,065::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-580::INFO::2014-04-10 16:43:48,065::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-580::DEBUG::2014-04-10 16:43:48,066::task::1168::TaskManager.Task::(prepare) Task=`35403c21-00d5-4f09-9aa7-7aa774b40714`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-580::DEBUG::2014-04-10 16:43:48,066::task::579::TaskManager.Task::(_updateState) Task=`35403c21-00d5-4f09-9aa7-7aa774b40714`::moving from state preparing -> state finished
>Thread-580::DEBUG::2014-04-10 16:43:48,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-580::DEBUG::2014-04-10 16:43:48,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-580::DEBUG::2014-04-10 16:43:48,066::task::974::TaskManager.Task::(_decref) Task=`35403c21-00d5-4f09-9aa7-7aa774b40714`::ref 0 aborting False
>Thread-581::DEBUG::2014-04-10 16:43:49,073::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-581::DEBUG::2014-04-10 16:43:49,074::task::579::TaskManager.Task::(_updateState) Task=`4c710fe1-2c10-4141-97c9-433733e27a78`::moving from state init -> state preparing
>Thread-581::INFO::2014-04-10 16:43:49,074::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-581::DEBUG::2014-04-10 16:43:49,075::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-581::DEBUG::2014-04-10 16:43:49,075::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-581::INFO::2014-04-10 16:43:49,075::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-581::DEBUG::2014-04-10 16:43:49,075::task::1168::TaskManager.Task::(prepare) Task=`4c710fe1-2c10-4141-97c9-433733e27a78`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-581::DEBUG::2014-04-10 16:43:49,075::task::579::TaskManager.Task::(_updateState) Task=`4c710fe1-2c10-4141-97c9-433733e27a78`::moving from state preparing -> state finished
>Thread-581::DEBUG::2014-04-10 16:43:49,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-581::DEBUG::2014-04-10 16:43:49,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-581::DEBUG::2014-04-10 16:43:49,076::task::974::TaskManager.Task::(_decref) Task=`4c710fe1-2c10-4141-97c9-433733e27a78`::ref 0 aborting False
>Thread-582::DEBUG::2014-04-10 16:43:50,083::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-582::DEBUG::2014-04-10 16:43:50,083::task::579::TaskManager.Task::(_updateState) Task=`4278385b-6a75-46c8-88f0-c5aa6a9bec8e`::moving from state init -> state preparing
>Thread-582::INFO::2014-04-10 16:43:50,084::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-582::DEBUG::2014-04-10 16:43:50,084::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-582::DEBUG::2014-04-10 16:43:50,084::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-582::INFO::2014-04-10 16:43:50,084::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-582::DEBUG::2014-04-10 16:43:50,084::task::1168::TaskManager.Task::(prepare) Task=`4278385b-6a75-46c8-88f0-c5aa6a9bec8e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-582::DEBUG::2014-04-10 16:43:50,085::task::579::TaskManager.Task::(_updateState) Task=`4278385b-6a75-46c8-88f0-c5aa6a9bec8e`::moving from state preparing -> state finished
>Thread-582::DEBUG::2014-04-10 16:43:50,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-582::DEBUG::2014-04-10 16:43:50,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-582::DEBUG::2014-04-10 16:43:50,085::task::974::TaskManager.Task::(_decref) Task=`4278385b-6a75-46c8-88f0-c5aa6a9bec8e`::ref 0 aborting False
>Thread-583::DEBUG::2014-04-10 16:43:51,021::task::579::TaskManager.Task::(_updateState) Task=`77154843-4e24-4b61-a478-0ad4095f7ce0`::moving from state init -> state preparing
>Thread-583::INFO::2014-04-10 16:43:51,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-583::INFO::2014-04-10 16:43:51,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '113.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508229', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264966', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '8.4', 'valid': False}}
>Thread-583::DEBUG::2014-04-10 16:43:51,022::task::1168::TaskManager.Task::(prepare) Task=`77154843-4e24-4b61-a478-0ad4095f7ce0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '113.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508229', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264966', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '8.4', 'valid': False}}
>Thread-583::DEBUG::2014-04-10 16:43:51,022::task::579::TaskManager.Task::(_updateState) Task=`77154843-4e24-4b61-a478-0ad4095f7ce0`::moving from state preparing -> state finished
>Thread-583::DEBUG::2014-04-10 16:43:51,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-583::DEBUG::2014-04-10 16:43:51,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-583::DEBUG::2014-04-10 16:43:51,022::task::974::TaskManager.Task::(_decref) Task=`77154843-4e24-4b61-a478-0ad4095f7ce0`::ref 0 aborting False
>Thread-585::DEBUG::2014-04-10 16:43:51,092::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-585::DEBUG::2014-04-10 16:43:51,092::task::579::TaskManager.Task::(_updateState) Task=`f43f3415-a1a2-40ae-b866-291b4332065e`::moving from state init -> state preparing
>Thread-585::INFO::2014-04-10 16:43:51,093::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-585::DEBUG::2014-04-10 16:43:51,093::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-585::DEBUG::2014-04-10 16:43:51,093::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-585::INFO::2014-04-10 16:43:51,093::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-585::DEBUG::2014-04-10 16:43:51,093::task::1168::TaskManager.Task::(prepare) Task=`f43f3415-a1a2-40ae-b866-291b4332065e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-585::DEBUG::2014-04-10 16:43:51,093::task::579::TaskManager.Task::(_updateState) Task=`f43f3415-a1a2-40ae-b866-291b4332065e`::moving from state preparing -> state finished
>Thread-585::DEBUG::2014-04-10 16:43:51,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-585::DEBUG::2014-04-10 16:43:51,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-585::DEBUG::2014-04-10 16:43:51,094::task::974::TaskManager.Task::(_decref) Task=`f43f3415-a1a2-40ae-b866-291b4332065e`::ref 0 aborting False
>Thread-586::DEBUG::2014-04-10 16:43:52,102::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-586::DEBUG::2014-04-10 16:43:52,102::task::579::TaskManager.Task::(_updateState) Task=`cf3c5b0b-9dd8-42ab-867e-90756857d348`::moving from state init -> state preparing
>Thread-586::INFO::2014-04-10 16:43:52,103::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-586::DEBUG::2014-04-10 16:43:52,103::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-586::DEBUG::2014-04-10 16:43:52,103::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-586::INFO::2014-04-10 16:43:52,104::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-586::DEBUG::2014-04-10 16:43:52,104::task::1168::TaskManager.Task::(prepare) Task=`cf3c5b0b-9dd8-42ab-867e-90756857d348`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-586::DEBUG::2014-04-10 16:43:52,104::task::579::TaskManager.Task::(_updateState) Task=`cf3c5b0b-9dd8-42ab-867e-90756857d348`::moving from state preparing -> state finished
>Thread-586::DEBUG::2014-04-10 16:43:52,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-586::DEBUG::2014-04-10 16:43:52,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-586::DEBUG::2014-04-10 16:43:52,104::task::974::TaskManager.Task::(_decref) Task=`cf3c5b0b-9dd8-42ab-867e-90756857d348`::ref 0 aborting False
>Thread-587::DEBUG::2014-04-10 16:43:53,112::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-587::DEBUG::2014-04-10 16:43:53,112::task::579::TaskManager.Task::(_updateState) Task=`c702294e-b3aa-4f87-baac-0c690b7d99b7`::moving from state init -> state preparing
>Thread-587::INFO::2014-04-10 16:43:53,113::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-587::DEBUG::2014-04-10 16:43:53,113::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-587::DEBUG::2014-04-10 16:43:53,113::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-587::INFO::2014-04-10 16:43:53,113::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-587::DEBUG::2014-04-10 16:43:53,113::task::1168::TaskManager.Task::(prepare) Task=`c702294e-b3aa-4f87-baac-0c690b7d99b7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-587::DEBUG::2014-04-10 16:43:53,113::task::579::TaskManager.Task::(_updateState) Task=`c702294e-b3aa-4f87-baac-0c690b7d99b7`::moving from state preparing -> state finished
>Thread-587::DEBUG::2014-04-10 16:43:53,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-587::DEBUG::2014-04-10 16:43:53,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-587::DEBUG::2014-04-10 16:43:53,114::task::974::TaskManager.Task::(_decref) Task=`c702294e-b3aa-4f87-baac-0c690b7d99b7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:43:53,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:43:53,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340691 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:43:53,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:43:53,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000220015 s, 3.0 MB/s\n'; <rc> = 0
>Thread-588::DEBUG::2014-04-10 16:43:54,122::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-588::DEBUG::2014-04-10 16:43:54,123::task::579::TaskManager.Task::(_updateState) Task=`aa931693-9e9e-4304-a7a3-ada2caf298c2`::moving from state init -> state preparing
>Thread-588::INFO::2014-04-10 16:43:54,123::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-588::DEBUG::2014-04-10 16:43:54,123::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-588::DEBUG::2014-04-10 16:43:54,123::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-588::INFO::2014-04-10 16:43:54,124::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-588::DEBUG::2014-04-10 16:43:54,124::task::1168::TaskManager.Task::(prepare) Task=`aa931693-9e9e-4304-a7a3-ada2caf298c2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-588::DEBUG::2014-04-10 16:43:54,124::task::579::TaskManager.Task::(_updateState) Task=`aa931693-9e9e-4304-a7a3-ada2caf298c2`::moving from state preparing -> state finished
>Thread-588::DEBUG::2014-04-10 16:43:54,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-588::DEBUG::2014-04-10 16:43:54,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-588::DEBUG::2014-04-10 16:43:54,125::task::974::TaskManager.Task::(_decref) Task=`aa931693-9e9e-4304-a7a3-ada2caf298c2`::ref 0 aborting False
>Thread-590::DEBUG::2014-04-10 16:43:55,132::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-590::DEBUG::2014-04-10 16:43:55,133::task::579::TaskManager.Task::(_updateState) Task=`75320a0d-5951-4e18-97a8-8156a47a203a`::moving from state init -> state preparing
>Thread-590::INFO::2014-04-10 16:43:55,133::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-590::DEBUG::2014-04-10 16:43:55,133::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-590::DEBUG::2014-04-10 16:43:55,133::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-590::INFO::2014-04-10 16:43:55,133::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-590::DEBUG::2014-04-10 16:43:55,134::task::1168::TaskManager.Task::(prepare) Task=`75320a0d-5951-4e18-97a8-8156a47a203a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-590::DEBUG::2014-04-10 16:43:55,134::task::579::TaskManager.Task::(_updateState) Task=`75320a0d-5951-4e18-97a8-8156a47a203a`::moving from state preparing -> state finished
>Thread-590::DEBUG::2014-04-10 16:43:55,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-590::DEBUG::2014-04-10 16:43:55,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-590::DEBUG::2014-04-10 16:43:55,134::task::974::TaskManager.Task::(_decref) Task=`75320a0d-5951-4e18-97a8-8156a47a203a`::ref 0 aborting False
>Thread-591::DEBUG::2014-04-10 16:43:56,142::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-591::DEBUG::2014-04-10 16:43:56,143::task::579::TaskManager.Task::(_updateState) Task=`92a99d1a-affd-4ed8-97e5-5e9e983c1983`::moving from state init -> state preparing
>Thread-591::INFO::2014-04-10 16:43:56,143::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-591::DEBUG::2014-04-10 16:43:56,143::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-591::DEBUG::2014-04-10 16:43:56,143::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-591::INFO::2014-04-10 16:43:56,144::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-591::DEBUG::2014-04-10 16:43:56,144::task::1168::TaskManager.Task::(prepare) Task=`92a99d1a-affd-4ed8-97e5-5e9e983c1983`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-591::DEBUG::2014-04-10 16:43:56,144::task::579::TaskManager.Task::(_updateState) Task=`92a99d1a-affd-4ed8-97e5-5e9e983c1983`::moving from state preparing -> state finished
>Thread-591::DEBUG::2014-04-10 16:43:56,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-591::DEBUG::2014-04-10 16:43:56,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-591::DEBUG::2014-04-10 16:43:56,144::task::974::TaskManager.Task::(_decref) Task=`92a99d1a-affd-4ed8-97e5-5e9e983c1983`::ref 0 aborting False
>Thread-592::DEBUG::2014-04-10 16:43:57,153::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-592::DEBUG::2014-04-10 16:43:57,154::task::579::TaskManager.Task::(_updateState) Task=`3750369d-9686-4bb7-acc3-38f085ecf09e`::moving from state init -> state preparing
>Thread-592::INFO::2014-04-10 16:43:57,155::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-592::DEBUG::2014-04-10 16:43:57,155::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-592::DEBUG::2014-04-10 16:43:57,155::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-592::INFO::2014-04-10 16:43:57,156::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-592::DEBUG::2014-04-10 16:43:57,156::task::1168::TaskManager.Task::(prepare) Task=`3750369d-9686-4bb7-acc3-38f085ecf09e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-592::DEBUG::2014-04-10 16:43:57,157::task::579::TaskManager.Task::(_updateState) Task=`3750369d-9686-4bb7-acc3-38f085ecf09e`::moving from state preparing -> state finished
>Thread-592::DEBUG::2014-04-10 16:43:57,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-592::DEBUG::2014-04-10 16:43:57,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-592::DEBUG::2014-04-10 16:43:57,158::task::974::TaskManager.Task::(_decref) Task=`3750369d-9686-4bb7-acc3-38f085ecf09e`::ref 0 aborting False
>Thread-540::WARNING::2014-04-10 16:43:58,167::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-540::DEBUG::2014-04-10 16:43:58,170::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-594::DEBUG::2014-04-10 16:43:58,173::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-542::WARNING::2014-04-10 16:43:58,173::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-594::DEBUG::2014-04-10 16:43:58,178::task::579::TaskManager.Task::(_updateState) Task=`4b0ccd39-df28-464d-859e-cdd7ba8c54d1`::moving from state init -> state preparing
>Thread-542::DEBUG::2014-04-10 16:43:58,178::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-594::INFO::2014-04-10 16:43:58,181::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-467::ERROR::2014-04-10 16:43:58,181::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-594::DEBUG::2014-04-10 16:43:58,182::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-467::ERROR::2014-04-10 16:43:58,183::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-594::DEBUG::2014-04-10 16:43:58,185::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-594::INFO::2014-04-10 16:43:58,199::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-594::DEBUG::2014-04-10 16:43:58,210::task::1168::TaskManager.Task::(prepare) Task=`4b0ccd39-df28-464d-859e-cdd7ba8c54d1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-594::DEBUG::2014-04-10 16:43:58,214::task::579::TaskManager.Task::(_updateState) Task=`4b0ccd39-df28-464d-859e-cdd7ba8c54d1`::moving from state preparing -> state finished
>Thread-594::DEBUG::2014-04-10 16:43:58,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-594::DEBUG::2014-04-10 16:43:58,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-594::DEBUG::2014-04-10 16:43:58,216::task::974::TaskManager.Task::(_decref) Task=`4b0ccd39-df28-464d-859e-cdd7ba8c54d1`::ref 0 aborting False
>Thread-107::DEBUG::2014-04-10 16:43:58,244::task::579::TaskManager.Task::(_updateState) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::moving from state init -> state preparing
>Thread-107::INFO::2014-04-10 16:43:58,244::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-599::DEBUG::2014-04-10 16:43:59,265::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-599::DEBUG::2014-04-10 16:43:59,265::task::579::TaskManager.Task::(_updateState) Task=`3d511c13-c9a2-4a7f-a99f-bcab01833e58`::moving from state init -> state preparing
>Thread-599::INFO::2014-04-10 16:43:59,265::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-599::DEBUG::2014-04-10 16:43:59,266::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-599::DEBUG::2014-04-10 16:43:59,266::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-599::INFO::2014-04-10 16:43:59,266::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-599::DEBUG::2014-04-10 16:43:59,266::task::1168::TaskManager.Task::(prepare) Task=`3d511c13-c9a2-4a7f-a99f-bcab01833e58`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-599::DEBUG::2014-04-10 16:43:59,266::task::579::TaskManager.Task::(_updateState) Task=`3d511c13-c9a2-4a7f-a99f-bcab01833e58`::moving from state preparing -> state finished
>Thread-599::DEBUG::2014-04-10 16:43:59,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-599::DEBUG::2014-04-10 16:43:59,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-599::DEBUG::2014-04-10 16:43:59,267::task::974::TaskManager.Task::(_decref) Task=`3d511c13-c9a2-4a7f-a99f-bcab01833e58`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:43:59,440::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-601::DEBUG::2014-04-10 16:44:00,274::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-601::DEBUG::2014-04-10 16:44:00,275::task::579::TaskManager.Task::(_updateState) Task=`5b1ee29f-4c36-4792-838e-199ae78eee3a`::moving from state init -> state preparing
>Thread-601::INFO::2014-04-10 16:44:00,275::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-601::DEBUG::2014-04-10 16:44:00,275::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-601::DEBUG::2014-04-10 16:44:00,275::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-601::INFO::2014-04-10 16:44:00,275::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-601::DEBUG::2014-04-10 16:44:00,276::task::1168::TaskManager.Task::(prepare) Task=`5b1ee29f-4c36-4792-838e-199ae78eee3a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-601::DEBUG::2014-04-10 16:44:00,276::task::579::TaskManager.Task::(_updateState) Task=`5b1ee29f-4c36-4792-838e-199ae78eee3a`::moving from state preparing -> state finished
>Thread-601::DEBUG::2014-04-10 16:44:00,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-601::DEBUG::2014-04-10 16:44:00,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-601::DEBUG::2014-04-10 16:44:00,276::task::974::TaskManager.Task::(_decref) Task=`5b1ee29f-4c36-4792-838e-199ae78eee3a`::ref 0 aborting False
>Thread-602::DEBUG::2014-04-10 16:44:01,284::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-602::DEBUG::2014-04-10 16:44:01,284::task::579::TaskManager.Task::(_updateState) Task=`99db7177-083d-45bd-b8e1-5008b80a068f`::moving from state init -> state preparing
>Thread-602::INFO::2014-04-10 16:44:01,284::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-602::DEBUG::2014-04-10 16:44:01,285::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-602::DEBUG::2014-04-10 16:44:01,285::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-602::INFO::2014-04-10 16:44:01,285::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-602::DEBUG::2014-04-10 16:44:01,285::task::1168::TaskManager.Task::(prepare) Task=`99db7177-083d-45bd-b8e1-5008b80a068f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-602::DEBUG::2014-04-10 16:44:01,285::task::579::TaskManager.Task::(_updateState) Task=`99db7177-083d-45bd-b8e1-5008b80a068f`::moving from state preparing -> state finished
>Thread-602::DEBUG::2014-04-10 16:44:01,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-602::DEBUG::2014-04-10 16:44:01,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-602::DEBUG::2014-04-10 16:44:01,286::task::974::TaskManager.Task::(_decref) Task=`99db7177-083d-45bd-b8e1-5008b80a068f`::ref 0 aborting False
>Thread-603::DEBUG::2014-04-10 16:44:02,294::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-603::DEBUG::2014-04-10 16:44:02,294::task::579::TaskManager.Task::(_updateState) Task=`5ee25322-f377-42ff-8248-c314e8272da4`::moving from state init -> state preparing
>Thread-603::INFO::2014-04-10 16:44:02,295::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-603::DEBUG::2014-04-10 16:44:02,295::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-603::DEBUG::2014-04-10 16:44:02,295::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-603::INFO::2014-04-10 16:44:02,295::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-603::DEBUG::2014-04-10 16:44:02,295::task::1168::TaskManager.Task::(prepare) Task=`5ee25322-f377-42ff-8248-c314e8272da4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-603::DEBUG::2014-04-10 16:44:02,295::task::579::TaskManager.Task::(_updateState) Task=`5ee25322-f377-42ff-8248-c314e8272da4`::moving from state preparing -> state finished
>Thread-603::DEBUG::2014-04-10 16:44:02,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-603::DEBUG::2014-04-10 16:44:02,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-603::DEBUG::2014-04-10 16:44:02,296::task::974::TaskManager.Task::(_decref) Task=`5ee25322-f377-42ff-8248-c314e8272da4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:03,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:44:03,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000322995 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:44:03,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:03,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024066 s, 2.8 MB/s\n'; <rc> = 0
>Thread-605::DEBUG::2014-04-10 16:44:03,304::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-605::DEBUG::2014-04-10 16:44:03,304::task::579::TaskManager.Task::(_updateState) Task=`244b0f3f-d0c3-457f-8110-55639f6f20b2`::moving from state init -> state preparing
>Thread-605::INFO::2014-04-10 16:44:03,305::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-605::DEBUG::2014-04-10 16:44:03,305::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-605::DEBUG::2014-04-10 16:44:03,305::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-605::INFO::2014-04-10 16:44:03,305::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-605::DEBUG::2014-04-10 16:44:03,305::task::1168::TaskManager.Task::(prepare) Task=`244b0f3f-d0c3-457f-8110-55639f6f20b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-605::DEBUG::2014-04-10 16:44:03,305::task::579::TaskManager.Task::(_updateState) Task=`244b0f3f-d0c3-457f-8110-55639f6f20b2`::moving from state preparing -> state finished
>Thread-605::DEBUG::2014-04-10 16:44:03,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-605::DEBUG::2014-04-10 16:44:03,306::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-605::DEBUG::2014-04-10 16:44:03,306::task::974::TaskManager.Task::(_decref) Task=`244b0f3f-d0c3-457f-8110-55639f6f20b2`::ref 0 aborting False
>Thread-606::DEBUG::2014-04-10 16:44:04,313::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-606::DEBUG::2014-04-10 16:44:04,314::task::579::TaskManager.Task::(_updateState) Task=`9c4abf7d-014a-4e07-b602-46aea01e30de`::moving from state init -> state preparing
>Thread-606::INFO::2014-04-10 16:44:04,314::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-606::DEBUG::2014-04-10 16:44:04,314::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-606::DEBUG::2014-04-10 16:44:04,314::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-606::INFO::2014-04-10 16:44:04,314::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-606::DEBUG::2014-04-10 16:44:04,315::task::1168::TaskManager.Task::(prepare) Task=`9c4abf7d-014a-4e07-b602-46aea01e30de`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-606::DEBUG::2014-04-10 16:44:04,315::task::579::TaskManager.Task::(_updateState) Task=`9c4abf7d-014a-4e07-b602-46aea01e30de`::moving from state preparing -> state finished
>Thread-606::DEBUG::2014-04-10 16:44:04,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-606::DEBUG::2014-04-10 16:44:04,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-606::DEBUG::2014-04-10 16:44:04,315::task::974::TaskManager.Task::(_decref) Task=`9c4abf7d-014a-4e07-b602-46aea01e30de`::ref 0 aborting False
>Thread-607::DEBUG::2014-04-10 16:44:05,323::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-607::DEBUG::2014-04-10 16:44:05,323::task::579::TaskManager.Task::(_updateState) Task=`5f875288-6632-4602-af0d-ad0ce02591be`::moving from state init -> state preparing
>Thread-607::INFO::2014-04-10 16:44:05,323::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-607::DEBUG::2014-04-10 16:44:05,323::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-607::DEBUG::2014-04-10 16:44:05,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-607::INFO::2014-04-10 16:44:05,324::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-607::DEBUG::2014-04-10 16:44:05,324::task::1168::TaskManager.Task::(prepare) Task=`5f875288-6632-4602-af0d-ad0ce02591be`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-607::DEBUG::2014-04-10 16:44:05,324::task::579::TaskManager.Task::(_updateState) Task=`5f875288-6632-4602-af0d-ad0ce02591be`::moving from state preparing -> state finished
>Thread-607::DEBUG::2014-04-10 16:44:05,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-607::DEBUG::2014-04-10 16:44:05,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-607::DEBUG::2014-04-10 16:44:05,325::task::974::TaskManager.Task::(_decref) Task=`5f875288-6632-4602-af0d-ad0ce02591be`::ref 0 aborting False
>Thread-608::DEBUG::2014-04-10 16:44:06,234::task::579::TaskManager.Task::(_updateState) Task=`d38f5459-3ac9-4d4f-92c6-161f025dc9f5`::moving from state init -> state preparing
>Thread-608::INFO::2014-04-10 16:44:06,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-608::INFO::2014-04-10 16:44:06,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '8.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322995', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024066', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.6', 'valid': False}}
>Thread-608::DEBUG::2014-04-10 16:44:06,235::task::1168::TaskManager.Task::(prepare) Task=`d38f5459-3ac9-4d4f-92c6-161f025dc9f5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '8.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322995', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024066', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.6', 'valid': False}}
>Thread-608::DEBUG::2014-04-10 16:44:06,235::task::579::TaskManager.Task::(_updateState) Task=`d38f5459-3ac9-4d4f-92c6-161f025dc9f5`::moving from state preparing -> state finished
>Thread-608::DEBUG::2014-04-10 16:44:06,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-608::DEBUG::2014-04-10 16:44:06,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-608::DEBUG::2014-04-10 16:44:06,236::task::974::TaskManager.Task::(_decref) Task=`d38f5459-3ac9-4d4f-92c6-161f025dc9f5`::ref 0 aborting False
>Thread-610::DEBUG::2014-04-10 16:44:06,332::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-610::DEBUG::2014-04-10 16:44:06,332::task::579::TaskManager.Task::(_updateState) Task=`c4cfb4c2-182e-4d7d-8601-65e7076cca8d`::moving from state init -> state preparing
>Thread-610::INFO::2014-04-10 16:44:06,333::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-610::DEBUG::2014-04-10 16:44:06,333::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-610::DEBUG::2014-04-10 16:44:06,333::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-610::INFO::2014-04-10 16:44:06,333::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-610::DEBUG::2014-04-10 16:44:06,333::task::1168::TaskManager.Task::(prepare) Task=`c4cfb4c2-182e-4d7d-8601-65e7076cca8d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-610::DEBUG::2014-04-10 16:44:06,333::task::579::TaskManager.Task::(_updateState) Task=`c4cfb4c2-182e-4d7d-8601-65e7076cca8d`::moving from state preparing -> state finished
>Thread-610::DEBUG::2014-04-10 16:44:06,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-610::DEBUG::2014-04-10 16:44:06,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-610::DEBUG::2014-04-10 16:44:06,334::task::974::TaskManager.Task::(_decref) Task=`c4cfb4c2-182e-4d7d-8601-65e7076cca8d`::ref 0 aborting False
>Thread-611::DEBUG::2014-04-10 16:44:07,342::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-611::DEBUG::2014-04-10 16:44:07,343::task::579::TaskManager.Task::(_updateState) Task=`9b55e7ba-56fa-4a56-9aab-ae12ffb7f286`::moving from state init -> state preparing
>Thread-611::INFO::2014-04-10 16:44:07,343::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-611::DEBUG::2014-04-10 16:44:07,343::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-611::DEBUG::2014-04-10 16:44:07,344::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-611::INFO::2014-04-10 16:44:07,344::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-611::DEBUG::2014-04-10 16:44:07,344::task::1168::TaskManager.Task::(prepare) Task=`9b55e7ba-56fa-4a56-9aab-ae12ffb7f286`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-611::DEBUG::2014-04-10 16:44:07,344::task::579::TaskManager.Task::(_updateState) Task=`9b55e7ba-56fa-4a56-9aab-ae12ffb7f286`::moving from state preparing -> state finished
>Thread-611::DEBUG::2014-04-10 16:44:07,344::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-611::DEBUG::2014-04-10 16:44:07,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-611::DEBUG::2014-04-10 16:44:07,345::task::974::TaskManager.Task::(_decref) Task=`9b55e7ba-56fa-4a56-9aab-ae12ffb7f286`::ref 0 aborting False
>Thread-612::DEBUG::2014-04-10 16:44:08,352::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-612::DEBUG::2014-04-10 16:44:08,352::task::579::TaskManager.Task::(_updateState) Task=`ece89246-569a-43e9-8d39-81785ceada41`::moving from state init -> state preparing
>Thread-612::INFO::2014-04-10 16:44:08,352::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-612::DEBUG::2014-04-10 16:44:08,353::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-612::DEBUG::2014-04-10 16:44:08,353::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-612::INFO::2014-04-10 16:44:08,353::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-612::DEBUG::2014-04-10 16:44:08,353::task::1168::TaskManager.Task::(prepare) Task=`ece89246-569a-43e9-8d39-81785ceada41`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-612::DEBUG::2014-04-10 16:44:08,353::task::579::TaskManager.Task::(_updateState) Task=`ece89246-569a-43e9-8d39-81785ceada41`::moving from state preparing -> state finished
>Thread-612::DEBUG::2014-04-10 16:44:08,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-612::DEBUG::2014-04-10 16:44:08,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-612::DEBUG::2014-04-10 16:44:08,354::task::974::TaskManager.Task::(_decref) Task=`ece89246-569a-43e9-8d39-81785ceada41`::ref 0 aborting False
>Thread-614::DEBUG::2014-04-10 16:44:09,361::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-614::DEBUG::2014-04-10 16:44:09,361::task::579::TaskManager.Task::(_updateState) Task=`30762dbb-506a-4cee-8e65-496db257d83c`::moving from state init -> state preparing
>Thread-614::INFO::2014-04-10 16:44:09,361::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-614::DEBUG::2014-04-10 16:44:09,361::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-614::DEBUG::2014-04-10 16:44:09,361::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-614::INFO::2014-04-10 16:44:09,362::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-614::DEBUG::2014-04-10 16:44:09,362::task::1168::TaskManager.Task::(prepare) Task=`30762dbb-506a-4cee-8e65-496db257d83c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-614::DEBUG::2014-04-10 16:44:09,362::task::579::TaskManager.Task::(_updateState) Task=`30762dbb-506a-4cee-8e65-496db257d83c`::moving from state preparing -> state finished
>Thread-614::DEBUG::2014-04-10 16:44:09,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-614::DEBUG::2014-04-10 16:44:09,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-614::DEBUG::2014-04-10 16:44:09,362::task::974::TaskManager.Task::(_decref) Task=`30762dbb-506a-4cee-8e65-496db257d83c`::ref 0 aborting False
>Thread-615::DEBUG::2014-04-10 16:44:10,370::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-615::DEBUG::2014-04-10 16:44:10,370::task::579::TaskManager.Task::(_updateState) Task=`dfdd154c-5d9d-4c56-a25a-bf1be615eb00`::moving from state init -> state preparing
>Thread-615::INFO::2014-04-10 16:44:10,371::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-615::DEBUG::2014-04-10 16:44:10,371::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-615::DEBUG::2014-04-10 16:44:10,371::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-615::INFO::2014-04-10 16:44:10,371::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-615::DEBUG::2014-04-10 16:44:10,371::task::1168::TaskManager.Task::(prepare) Task=`dfdd154c-5d9d-4c56-a25a-bf1be615eb00`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-615::DEBUG::2014-04-10 16:44:10,372::task::579::TaskManager.Task::(_updateState) Task=`dfdd154c-5d9d-4c56-a25a-bf1be615eb00`::moving from state preparing -> state finished
>Thread-615::DEBUG::2014-04-10 16:44:10,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-615::DEBUG::2014-04-10 16:44:10,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-615::DEBUG::2014-04-10 16:44:10,372::task::974::TaskManager.Task::(_decref) Task=`dfdd154c-5d9d-4c56-a25a-bf1be615eb00`::ref 0 aborting False
>Thread-616::DEBUG::2014-04-10 16:44:11,380::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-616::DEBUG::2014-04-10 16:44:11,380::task::579::TaskManager.Task::(_updateState) Task=`3527d65c-b1ba-489b-b561-aa40c0298ce8`::moving from state init -> state preparing
>Thread-616::INFO::2014-04-10 16:44:11,380::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-616::DEBUG::2014-04-10 16:44:11,381::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-616::DEBUG::2014-04-10 16:44:11,381::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-616::INFO::2014-04-10 16:44:11,381::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-616::DEBUG::2014-04-10 16:44:11,381::task::1168::TaskManager.Task::(prepare) Task=`3527d65c-b1ba-489b-b561-aa40c0298ce8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-616::DEBUG::2014-04-10 16:44:11,381::task::579::TaskManager.Task::(_updateState) Task=`3527d65c-b1ba-489b-b561-aa40c0298ce8`::moving from state preparing -> state finished
>Thread-616::DEBUG::2014-04-10 16:44:11,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-616::DEBUG::2014-04-10 16:44:11,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-616::DEBUG::2014-04-10 16:44:11,382::task::974::TaskManager.Task::(_decref) Task=`3527d65c-b1ba-489b-b561-aa40c0298ce8`::ref 0 aborting False
>Thread-618::DEBUG::2014-04-10 16:44:12,389::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-618::DEBUG::2014-04-10 16:44:12,389::task::579::TaskManager.Task::(_updateState) Task=`1f9ed292-fb0b-4b20-b4e4-22f3d284940c`::moving from state init -> state preparing
>Thread-618::INFO::2014-04-10 16:44:12,390::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-618::DEBUG::2014-04-10 16:44:12,390::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-618::DEBUG::2014-04-10 16:44:12,390::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-618::INFO::2014-04-10 16:44:12,390::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-618::DEBUG::2014-04-10 16:44:12,390::task::1168::TaskManager.Task::(prepare) Task=`1f9ed292-fb0b-4b20-b4e4-22f3d284940c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-618::DEBUG::2014-04-10 16:44:12,391::task::579::TaskManager.Task::(_updateState) Task=`1f9ed292-fb0b-4b20-b4e4-22f3d284940c`::moving from state preparing -> state finished
>Thread-618::DEBUG::2014-04-10 16:44:12,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-618::DEBUG::2014-04-10 16:44:12,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-618::DEBUG::2014-04-10 16:44:12,391::task::974::TaskManager.Task::(_decref) Task=`1f9ed292-fb0b-4b20-b4e4-22f3d284940c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:13,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:44:13,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256192 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:44:13,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:13,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025026 s, 2.7 MB/s\n'; <rc> = 0
>Thread-619::DEBUG::2014-04-10 16:44:13,400::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-619::DEBUG::2014-04-10 16:44:13,401::task::579::TaskManager.Task::(_updateState) Task=`f566ec8c-6d52-4b67-a599-3a106c90e9b4`::moving from state init -> state preparing
>Thread-619::INFO::2014-04-10 16:44:13,401::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-619::DEBUG::2014-04-10 16:44:13,401::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-619::DEBUG::2014-04-10 16:44:13,401::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-619::INFO::2014-04-10 16:44:13,401::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-619::DEBUG::2014-04-10 16:44:13,402::task::1168::TaskManager.Task::(prepare) Task=`f566ec8c-6d52-4b67-a599-3a106c90e9b4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-619::DEBUG::2014-04-10 16:44:13,402::task::579::TaskManager.Task::(_updateState) Task=`f566ec8c-6d52-4b67-a599-3a106c90e9b4`::moving from state preparing -> state finished
>Thread-619::DEBUG::2014-04-10 16:44:13,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-619::DEBUG::2014-04-10 16:44:13,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-619::DEBUG::2014-04-10 16:44:13,402::task::974::TaskManager.Task::(_decref) Task=`f566ec8c-6d52-4b67-a599-3a106c90e9b4`::ref 0 aborting False
>Thread-620::DEBUG::2014-04-10 16:44:14,410::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-620::DEBUG::2014-04-10 16:44:14,410::task::579::TaskManager.Task::(_updateState) Task=`e6a65d6c-30ea-4cd2-9f67-23d1a2a2815d`::moving from state init -> state preparing
>Thread-620::INFO::2014-04-10 16:44:14,410::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-620::DEBUG::2014-04-10 16:44:14,411::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-620::DEBUG::2014-04-10 16:44:14,411::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-620::INFO::2014-04-10 16:44:14,411::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-620::DEBUG::2014-04-10 16:44:14,411::task::1168::TaskManager.Task::(prepare) Task=`e6a65d6c-30ea-4cd2-9f67-23d1a2a2815d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-620::DEBUG::2014-04-10 16:44:14,411::task::579::TaskManager.Task::(_updateState) Task=`e6a65d6c-30ea-4cd2-9f67-23d1a2a2815d`::moving from state preparing -> state finished
>Thread-620::DEBUG::2014-04-10 16:44:14,411::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-620::DEBUG::2014-04-10 16:44:14,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-620::DEBUG::2014-04-10 16:44:14,412::task::974::TaskManager.Task::(_decref) Task=`e6a65d6c-30ea-4cd2-9f67-23d1a2a2815d`::ref 0 aborting False
>Thread-622::DEBUG::2014-04-10 16:44:15,419::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-622::DEBUG::2014-04-10 16:44:15,419::task::579::TaskManager.Task::(_updateState) Task=`41bd0d4f-162a-4124-b7f6-22930a4638ff`::moving from state init -> state preparing
>Thread-622::INFO::2014-04-10 16:44:15,420::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-622::DEBUG::2014-04-10 16:44:15,420::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-622::DEBUG::2014-04-10 16:44:15,420::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-622::INFO::2014-04-10 16:44:15,421::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-622::DEBUG::2014-04-10 16:44:15,421::task::1168::TaskManager.Task::(prepare) Task=`41bd0d4f-162a-4124-b7f6-22930a4638ff`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-622::DEBUG::2014-04-10 16:44:15,421::task::579::TaskManager.Task::(_updateState) Task=`41bd0d4f-162a-4124-b7f6-22930a4638ff`::moving from state preparing -> state finished
>Thread-622::DEBUG::2014-04-10 16:44:15,421::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-622::DEBUG::2014-04-10 16:44:15,421::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-622::DEBUG::2014-04-10 16:44:15,421::task::974::TaskManager.Task::(_decref) Task=`41bd0d4f-162a-4124-b7f6-22930a4638ff`::ref 0 aborting False
>Thread-623::DEBUG::2014-04-10 16:44:16,429::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-623::DEBUG::2014-04-10 16:44:16,429::task::579::TaskManager.Task::(_updateState) Task=`b3a92a9e-3b34-4b51-ae0d-6fce1d093d21`::moving from state init -> state preparing
>Thread-623::INFO::2014-04-10 16:44:16,429::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-623::DEBUG::2014-04-10 16:44:16,430::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-623::DEBUG::2014-04-10 16:44:16,430::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-623::INFO::2014-04-10 16:44:16,430::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-623::DEBUG::2014-04-10 16:44:16,430::task::1168::TaskManager.Task::(prepare) Task=`b3a92a9e-3b34-4b51-ae0d-6fce1d093d21`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-623::DEBUG::2014-04-10 16:44:16,430::task::579::TaskManager.Task::(_updateState) Task=`b3a92a9e-3b34-4b51-ae0d-6fce1d093d21`::moving from state preparing -> state finished
>Thread-623::DEBUG::2014-04-10 16:44:16,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-623::DEBUG::2014-04-10 16:44:16,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-623::DEBUG::2014-04-10 16:44:16,431::task::974::TaskManager.Task::(_decref) Task=`b3a92a9e-3b34-4b51-ae0d-6fce1d093d21`::ref 0 aborting False
>Thread-624::DEBUG::2014-04-10 16:44:17,438::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-624::DEBUG::2014-04-10 16:44:17,438::task::579::TaskManager.Task::(_updateState) Task=`cfa48913-14a5-4673-8e50-8a0e4a68c400`::moving from state init -> state preparing
>Thread-624::INFO::2014-04-10 16:44:17,439::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-624::DEBUG::2014-04-10 16:44:17,439::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-624::DEBUG::2014-04-10 16:44:17,439::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-624::INFO::2014-04-10 16:44:17,439::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-624::DEBUG::2014-04-10 16:44:17,439::task::1168::TaskManager.Task::(prepare) Task=`cfa48913-14a5-4673-8e50-8a0e4a68c400`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-624::DEBUG::2014-04-10 16:44:17,440::task::579::TaskManager.Task::(_updateState) Task=`cfa48913-14a5-4673-8e50-8a0e4a68c400`::moving from state preparing -> state finished
>Thread-624::DEBUG::2014-04-10 16:44:17,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-624::DEBUG::2014-04-10 16:44:17,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-624::DEBUG::2014-04-10 16:44:17,440::task::974::TaskManager.Task::(_decref) Task=`cfa48913-14a5-4673-8e50-8a0e4a68c400`::ref 0 aborting False
>Thread-626::DEBUG::2014-04-10 16:44:18,447::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-626::DEBUG::2014-04-10 16:44:18,447::task::579::TaskManager.Task::(_updateState) Task=`c112ff48-2b5f-4e13-b5bb-8382c646109c`::moving from state init -> state preparing
>Thread-626::INFO::2014-04-10 16:44:18,448::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-626::DEBUG::2014-04-10 16:44:18,448::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-626::DEBUG::2014-04-10 16:44:18,448::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-626::INFO::2014-04-10 16:44:18,448::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-626::DEBUG::2014-04-10 16:44:18,448::task::1168::TaskManager.Task::(prepare) Task=`c112ff48-2b5f-4e13-b5bb-8382c646109c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-626::DEBUG::2014-04-10 16:44:18,448::task::579::TaskManager.Task::(_updateState) Task=`c112ff48-2b5f-4e13-b5bb-8382c646109c`::moving from state preparing -> state finished
>Thread-626::DEBUG::2014-04-10 16:44:18,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-626::DEBUG::2014-04-10 16:44:18,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-626::DEBUG::2014-04-10 16:44:18,449::task::974::TaskManager.Task::(_decref) Task=`c112ff48-2b5f-4e13-b5bb-8382c646109c`::ref 0 aborting False
>Thread-627::DEBUG::2014-04-10 16:44:19,456::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-627::DEBUG::2014-04-10 16:44:19,456::task::579::TaskManager.Task::(_updateState) Task=`fb68b348-8992-4efc-bb38-8d64a40cf8aa`::moving from state init -> state preparing
>Thread-627::INFO::2014-04-10 16:44:19,457::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-627::DEBUG::2014-04-10 16:44:19,457::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-627::DEBUG::2014-04-10 16:44:19,457::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-627::INFO::2014-04-10 16:44:19,457::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-627::DEBUG::2014-04-10 16:44:19,457::task::1168::TaskManager.Task::(prepare) Task=`fb68b348-8992-4efc-bb38-8d64a40cf8aa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-627::DEBUG::2014-04-10 16:44:19,457::task::579::TaskManager.Task::(_updateState) Task=`fb68b348-8992-4efc-bb38-8d64a40cf8aa`::moving from state preparing -> state finished
>Thread-627::DEBUG::2014-04-10 16:44:19,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-627::DEBUG::2014-04-10 16:44:19,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-627::DEBUG::2014-04-10 16:44:19,458::task::974::TaskManager.Task::(_decref) Task=`fb68b348-8992-4efc-bb38-8d64a40cf8aa`::ref 0 aborting False
>Thread-628::DEBUG::2014-04-10 16:44:20,466::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-628::DEBUG::2014-04-10 16:44:20,466::task::579::TaskManager.Task::(_updateState) Task=`168398e0-0180-4363-ab53-490b40071605`::moving from state init -> state preparing
>Thread-628::INFO::2014-04-10 16:44:20,467::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-628::DEBUG::2014-04-10 16:44:20,467::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-628::DEBUG::2014-04-10 16:44:20,467::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-628::INFO::2014-04-10 16:44:20,467::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-628::DEBUG::2014-04-10 16:44:20,467::task::1168::TaskManager.Task::(prepare) Task=`168398e0-0180-4363-ab53-490b40071605`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-628::DEBUG::2014-04-10 16:44:20,467::task::579::TaskManager.Task::(_updateState) Task=`168398e0-0180-4363-ab53-490b40071605`::moving from state preparing -> state finished
>Thread-628::DEBUG::2014-04-10 16:44:20,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-628::DEBUG::2014-04-10 16:44:20,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-628::DEBUG::2014-04-10 16:44:20,468::task::974::TaskManager.Task::(_decref) Task=`168398e0-0180-4363-ab53-490b40071605`::ref 0 aborting False
>Thread-629::DEBUG::2014-04-10 16:44:21,419::task::579::TaskManager.Task::(_updateState) Task=`06526f16-9de0-4b4f-9290-d9d6c1ffcfeb`::moving from state init -> state preparing
>Thread-629::INFO::2014-04-10 16:44:21,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-629::INFO::2014-04-10 16:44:21,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256192', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025026', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.8', 'valid': False}}
>Thread-629::DEBUG::2014-04-10 16:44:21,420::task::1168::TaskManager.Task::(prepare) Task=`06526f16-9de0-4b4f-9290-d9d6c1ffcfeb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256192', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025026', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.8', 'valid': False}}
>Thread-629::DEBUG::2014-04-10 16:44:21,420::task::579::TaskManager.Task::(_updateState) Task=`06526f16-9de0-4b4f-9290-d9d6c1ffcfeb`::moving from state preparing -> state finished
>Thread-629::DEBUG::2014-04-10 16:44:21,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-629::DEBUG::2014-04-10 16:44:21,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-629::DEBUG::2014-04-10 16:44:21,420::task::974::TaskManager.Task::(_decref) Task=`06526f16-9de0-4b4f-9290-d9d6c1ffcfeb`::ref 0 aborting False
>Thread-631::DEBUG::2014-04-10 16:44:21,475::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-631::DEBUG::2014-04-10 16:44:21,475::task::579::TaskManager.Task::(_updateState) Task=`6f5bccea-6bd3-4758-a684-ae7ac7eebc57`::moving from state init -> state preparing
>Thread-631::INFO::2014-04-10 16:44:21,475::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-631::DEBUG::2014-04-10 16:44:21,476::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-631::DEBUG::2014-04-10 16:44:21,476::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-631::INFO::2014-04-10 16:44:21,476::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-631::DEBUG::2014-04-10 16:44:21,476::task::1168::TaskManager.Task::(prepare) Task=`6f5bccea-6bd3-4758-a684-ae7ac7eebc57`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-631::DEBUG::2014-04-10 16:44:21,476::task::579::TaskManager.Task::(_updateState) Task=`6f5bccea-6bd3-4758-a684-ae7ac7eebc57`::moving from state preparing -> state finished
>Thread-631::DEBUG::2014-04-10 16:44:21,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-631::DEBUG::2014-04-10 16:44:21,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-631::DEBUG::2014-04-10 16:44:21,477::task::974::TaskManager.Task::(_decref) Task=`6f5bccea-6bd3-4758-a684-ae7ac7eebc57`::ref 0 aborting False
>Thread-632::DEBUG::2014-04-10 16:44:22,485::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-632::DEBUG::2014-04-10 16:44:22,485::task::579::TaskManager.Task::(_updateState) Task=`ce699895-1244-4c02-9066-e54cbd83a02f`::moving from state init -> state preparing
>Thread-632::INFO::2014-04-10 16:44:22,486::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-632::DEBUG::2014-04-10 16:44:22,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-632::DEBUG::2014-04-10 16:44:22,486::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-632::INFO::2014-04-10 16:44:22,486::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-632::DEBUG::2014-04-10 16:44:22,486::task::1168::TaskManager.Task::(prepare) Task=`ce699895-1244-4c02-9066-e54cbd83a02f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-632::DEBUG::2014-04-10 16:44:22,486::task::579::TaskManager.Task::(_updateState) Task=`ce699895-1244-4c02-9066-e54cbd83a02f`::moving from state preparing -> state finished
>Thread-632::DEBUG::2014-04-10 16:44:22,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-632::DEBUG::2014-04-10 16:44:22,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-632::DEBUG::2014-04-10 16:44:22,487::task::974::TaskManager.Task::(_decref) Task=`ce699895-1244-4c02-9066-e54cbd83a02f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:23,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:44:23,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000225189 s, 3.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:44:23,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:23,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242939 s, 2.8 MB/s\n'; <rc> = 0
>Thread-633::DEBUG::2014-04-10 16:44:23,495::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-633::DEBUG::2014-04-10 16:44:23,495::task::579::TaskManager.Task::(_updateState) Task=`9f2322a2-3d75-42eb-98a9-959a08c61560`::moving from state init -> state preparing
>Thread-633::INFO::2014-04-10 16:44:23,495::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-633::DEBUG::2014-04-10 16:44:23,496::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-633::DEBUG::2014-04-10 16:44:23,496::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-633::INFO::2014-04-10 16:44:23,496::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-633::DEBUG::2014-04-10 16:44:23,496::task::1168::TaskManager.Task::(prepare) Task=`9f2322a2-3d75-42eb-98a9-959a08c61560`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-633::DEBUG::2014-04-10 16:44:23,496::task::579::TaskManager.Task::(_updateState) Task=`9f2322a2-3d75-42eb-98a9-959a08c61560`::moving from state preparing -> state finished
>Thread-633::DEBUG::2014-04-10 16:44:23,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-633::DEBUG::2014-04-10 16:44:23,497::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-633::DEBUG::2014-04-10 16:44:23,497::task::974::TaskManager.Task::(_decref) Task=`9f2322a2-3d75-42eb-98a9-959a08c61560`::ref 0 aborting False
>Thread-634::DEBUG::2014-04-10 16:44:24,505::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-634::DEBUG::2014-04-10 16:44:24,506::task::579::TaskManager.Task::(_updateState) Task=`4f96d6cb-570d-4223-93cc-d1be6c3f391d`::moving from state init -> state preparing
>Thread-634::INFO::2014-04-10 16:44:24,506::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-634::DEBUG::2014-04-10 16:44:24,506::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-634::DEBUG::2014-04-10 16:44:24,507::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-634::INFO::2014-04-10 16:44:24,507::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-634::DEBUG::2014-04-10 16:44:24,507::task::1168::TaskManager.Task::(prepare) Task=`4f96d6cb-570d-4223-93cc-d1be6c3f391d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-634::DEBUG::2014-04-10 16:44:24,507::task::579::TaskManager.Task::(_updateState) Task=`4f96d6cb-570d-4223-93cc-d1be6c3f391d`::moving from state preparing -> state finished
>Thread-634::DEBUG::2014-04-10 16:44:24,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-634::DEBUG::2014-04-10 16:44:24,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-634::DEBUG::2014-04-10 16:44:24,508::task::974::TaskManager.Task::(_decref) Task=`4f96d6cb-570d-4223-93cc-d1be6c3f391d`::ref 0 aborting False
>Thread-636::DEBUG::2014-04-10 16:44:25,514::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-636::DEBUG::2014-04-10 16:44:25,515::task::579::TaskManager.Task::(_updateState) Task=`4db5bd8e-99d6-4cf2-9e7c-de81bf81a919`::moving from state init -> state preparing
>Thread-636::INFO::2014-04-10 16:44:25,515::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-636::DEBUG::2014-04-10 16:44:25,515::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-636::DEBUG::2014-04-10 16:44:25,515::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-636::INFO::2014-04-10 16:44:25,516::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-636::DEBUG::2014-04-10 16:44:25,516::task::1168::TaskManager.Task::(prepare) Task=`4db5bd8e-99d6-4cf2-9e7c-de81bf81a919`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-636::DEBUG::2014-04-10 16:44:25,516::task::579::TaskManager.Task::(_updateState) Task=`4db5bd8e-99d6-4cf2-9e7c-de81bf81a919`::moving from state preparing -> state finished
>Thread-636::DEBUG::2014-04-10 16:44:25,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-636::DEBUG::2014-04-10 16:44:25,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-636::DEBUG::2014-04-10 16:44:25,516::task::974::TaskManager.Task::(_decref) Task=`4db5bd8e-99d6-4cf2-9e7c-de81bf81a919`::ref 0 aborting False
>Thread-637::DEBUG::2014-04-10 16:44:26,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-637::DEBUG::2014-04-10 16:44:26,524::task::579::TaskManager.Task::(_updateState) Task=`e7c8439d-02c3-4d42-8d9b-d2d5bb307bd3`::moving from state init -> state preparing
>Thread-637::INFO::2014-04-10 16:44:26,524::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-637::DEBUG::2014-04-10 16:44:26,524::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-637::DEBUG::2014-04-10 16:44:26,524::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-637::INFO::2014-04-10 16:44:26,525::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-637::DEBUG::2014-04-10 16:44:26,525::task::1168::TaskManager.Task::(prepare) Task=`e7c8439d-02c3-4d42-8d9b-d2d5bb307bd3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-637::DEBUG::2014-04-10 16:44:26,525::task::579::TaskManager.Task::(_updateState) Task=`e7c8439d-02c3-4d42-8d9b-d2d5bb307bd3`::moving from state preparing -> state finished
>Thread-637::DEBUG::2014-04-10 16:44:26,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-637::DEBUG::2014-04-10 16:44:26,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-637::DEBUG::2014-04-10 16:44:26,525::task::974::TaskManager.Task::(_decref) Task=`e7c8439d-02c3-4d42-8d9b-d2d5bb307bd3`::ref 0 aborting False
>Thread-638::DEBUG::2014-04-10 16:44:27,533::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-638::DEBUG::2014-04-10 16:44:27,534::task::579::TaskManager.Task::(_updateState) Task=`59d069fc-9dad-4234-bf53-3c77a4bc7b94`::moving from state init -> state preparing
>Thread-638::INFO::2014-04-10 16:44:27,534::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-638::DEBUG::2014-04-10 16:44:27,535::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-638::DEBUG::2014-04-10 16:44:27,535::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-638::INFO::2014-04-10 16:44:27,535::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-638::DEBUG::2014-04-10 16:44:27,535::task::1168::TaskManager.Task::(prepare) Task=`59d069fc-9dad-4234-bf53-3c77a4bc7b94`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-638::DEBUG::2014-04-10 16:44:27,535::task::579::TaskManager.Task::(_updateState) Task=`59d069fc-9dad-4234-bf53-3c77a4bc7b94`::moving from state preparing -> state finished
>Thread-638::DEBUG::2014-04-10 16:44:27,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-638::DEBUG::2014-04-10 16:44:27,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-638::DEBUG::2014-04-10 16:44:27,536::task::974::TaskManager.Task::(_decref) Task=`59d069fc-9dad-4234-bf53-3c77a4bc7b94`::ref 0 aborting False
>Thread-640::DEBUG::2014-04-10 16:44:28,543::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-640::DEBUG::2014-04-10 16:44:28,544::task::579::TaskManager.Task::(_updateState) Task=`0dcda828-d172-442e-8e90-23c670fccea3`::moving from state init -> state preparing
>Thread-640::INFO::2014-04-10 16:44:28,544::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-640::DEBUG::2014-04-10 16:44:28,544::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-640::DEBUG::2014-04-10 16:44:28,544::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-640::INFO::2014-04-10 16:44:28,544::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-640::DEBUG::2014-04-10 16:44:28,545::task::1168::TaskManager.Task::(prepare) Task=`0dcda828-d172-442e-8e90-23c670fccea3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-640::DEBUG::2014-04-10 16:44:28,545::task::579::TaskManager.Task::(_updateState) Task=`0dcda828-d172-442e-8e90-23c670fccea3`::moving from state preparing -> state finished
>Thread-640::DEBUG::2014-04-10 16:44:28,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-640::DEBUG::2014-04-10 16:44:28,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-640::DEBUG::2014-04-10 16:44:28,545::task::974::TaskManager.Task::(_decref) Task=`0dcda828-d172-442e-8e90-23c670fccea3`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:44:29,474::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-641::DEBUG::2014-04-10 16:44:29,554::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-641::DEBUG::2014-04-10 16:44:29,555::task::579::TaskManager.Task::(_updateState) Task=`0375ed22-f257-437a-8849-42d78bf00fb6`::moving from state init -> state preparing
>Thread-641::INFO::2014-04-10 16:44:29,557::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-641::DEBUG::2014-04-10 16:44:29,558::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-641::DEBUG::2014-04-10 16:44:29,560::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-641::INFO::2014-04-10 16:44:29,560::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-641::DEBUG::2014-04-10 16:44:29,561::task::1168::TaskManager.Task::(prepare) Task=`0375ed22-f257-437a-8849-42d78bf00fb6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-641::DEBUG::2014-04-10 16:44:29,562::task::579::TaskManager.Task::(_updateState) Task=`0375ed22-f257-437a-8849-42d78bf00fb6`::moving from state preparing -> state finished
>Thread-641::DEBUG::2014-04-10 16:44:29,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-641::DEBUG::2014-04-10 16:44:29,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-641::DEBUG::2014-04-10 16:44:29,565::task::974::TaskManager.Task::(_decref) Task=`0375ed22-f257-437a-8849-42d78bf00fb6`::ref 0 aborting False
>Thread-545::WARNING::2014-04-10 16:44:29,819::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-545::DEBUG::2014-04-10 16:44:29,821::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-547::WARNING::2014-04-10 16:44:29,824::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-642::DEBUG::2014-04-10 16:44:30,576::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-642::DEBUG::2014-04-10 16:44:30,576::task::579::TaskManager.Task::(_updateState) Task=`4f72048c-af96-4b58-850e-c8ae5de20445`::moving from state init -> state preparing
>Thread-642::INFO::2014-04-10 16:44:30,577::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-642::DEBUG::2014-04-10 16:44:30,577::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-642::DEBUG::2014-04-10 16:44:30,577::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-642::INFO::2014-04-10 16:44:30,577::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-642::DEBUG::2014-04-10 16:44:30,577::task::1168::TaskManager.Task::(prepare) Task=`4f72048c-af96-4b58-850e-c8ae5de20445`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-642::DEBUG::2014-04-10 16:44:30,577::task::579::TaskManager.Task::(_updateState) Task=`4f72048c-af96-4b58-850e-c8ae5de20445`::moving from state preparing -> state finished
>Thread-642::DEBUG::2014-04-10 16:44:30,578::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-642::DEBUG::2014-04-10 16:44:30,578::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-642::DEBUG::2014-04-10 16:44:30,578::task::974::TaskManager.Task::(_decref) Task=`4f72048c-af96-4b58-850e-c8ae5de20445`::ref 0 aborting False
>Thread-644::DEBUG::2014-04-10 16:44:31,585::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-644::DEBUG::2014-04-10 16:44:31,585::task::579::TaskManager.Task::(_updateState) Task=`ba42d255-e33e-4ce4-bbc8-7e577107bb7f`::moving from state init -> state preparing
>Thread-644::INFO::2014-04-10 16:44:31,586::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-644::DEBUG::2014-04-10 16:44:31,586::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-644::DEBUG::2014-04-10 16:44:31,586::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-644::INFO::2014-04-10 16:44:31,586::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-644::DEBUG::2014-04-10 16:44:31,586::task::1168::TaskManager.Task::(prepare) Task=`ba42d255-e33e-4ce4-bbc8-7e577107bb7f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-644::DEBUG::2014-04-10 16:44:31,586::task::579::TaskManager.Task::(_updateState) Task=`ba42d255-e33e-4ce4-bbc8-7e577107bb7f`::moving from state preparing -> state finished
>Thread-644::DEBUG::2014-04-10 16:44:31,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-644::DEBUG::2014-04-10 16:44:31,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-644::DEBUG::2014-04-10 16:44:31,587::task::974::TaskManager.Task::(_decref) Task=`ba42d255-e33e-4ce4-bbc8-7e577107bb7f`::ref 0 aborting False
>Thread-645::DEBUG::2014-04-10 16:44:33,039::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-645::DEBUG::2014-04-10 16:44:33,040::task::579::TaskManager.Task::(_updateState) Task=`08aa88ca-6a43-4c1d-8bf6-2d1d21ec0774`::moving from state init -> state preparing
>Thread-645::INFO::2014-04-10 16:44:33,040::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-645::DEBUG::2014-04-10 16:44:33,040::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-645::DEBUG::2014-04-10 16:44:33,040::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-645::INFO::2014-04-10 16:44:33,041::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-645::DEBUG::2014-04-10 16:44:33,041::task::1168::TaskManager.Task::(prepare) Task=`08aa88ca-6a43-4c1d-8bf6-2d1d21ec0774`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-645::DEBUG::2014-04-10 16:44:33,041::task::579::TaskManager.Task::(_updateState) Task=`08aa88ca-6a43-4c1d-8bf6-2d1d21ec0774`::moving from state preparing -> state finished
>Thread-645::DEBUG::2014-04-10 16:44:33,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-645::DEBUG::2014-04-10 16:44:33,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-645::DEBUG::2014-04-10 16:44:33,042::task::974::TaskManager.Task::(_decref) Task=`08aa88ca-6a43-4c1d-8bf6-2d1d21ec0774`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:33,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:44:33,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311698 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:44:33,316::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:33,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271076 s, 2.5 MB/s\n'; <rc> = 0
>Thread-647::DEBUG::2014-04-10 16:44:34,049::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-647::DEBUG::2014-04-10 16:44:34,049::task::579::TaskManager.Task::(_updateState) Task=`8ded4447-dc79-4e9a-bc18-1df4cc949828`::moving from state init -> state preparing
>Thread-647::INFO::2014-04-10 16:44:34,050::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-647::DEBUG::2014-04-10 16:44:34,050::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-647::DEBUG::2014-04-10 16:44:34,050::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-647::INFO::2014-04-10 16:44:34,050::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-647::DEBUG::2014-04-10 16:44:34,051::task::1168::TaskManager.Task::(prepare) Task=`8ded4447-dc79-4e9a-bc18-1df4cc949828`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-647::DEBUG::2014-04-10 16:44:34,051::task::579::TaskManager.Task::(_updateState) Task=`8ded4447-dc79-4e9a-bc18-1df4cc949828`::moving from state preparing -> state finished
>Thread-647::DEBUG::2014-04-10 16:44:34,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-647::DEBUG::2014-04-10 16:44:34,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-647::DEBUG::2014-04-10 16:44:34,051::task::974::TaskManager.Task::(_decref) Task=`8ded4447-dc79-4e9a-bc18-1df4cc949828`::ref 0 aborting False
>Thread-648::DEBUG::2014-04-10 16:44:35,058::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-648::DEBUG::2014-04-10 16:44:35,058::task::579::TaskManager.Task::(_updateState) Task=`afcddc3f-b6cb-42f6-ac82-648d1128f9db`::moving from state init -> state preparing
>Thread-648::INFO::2014-04-10 16:44:35,059::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-648::DEBUG::2014-04-10 16:44:35,059::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-648::DEBUG::2014-04-10 16:44:35,059::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-648::INFO::2014-04-10 16:44:35,059::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-648::DEBUG::2014-04-10 16:44:35,059::task::1168::TaskManager.Task::(prepare) Task=`afcddc3f-b6cb-42f6-ac82-648d1128f9db`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-648::DEBUG::2014-04-10 16:44:35,059::task::579::TaskManager.Task::(_updateState) Task=`afcddc3f-b6cb-42f6-ac82-648d1128f9db`::moving from state preparing -> state finished
>Thread-648::DEBUG::2014-04-10 16:44:35,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-648::DEBUG::2014-04-10 16:44:35,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-648::DEBUG::2014-04-10 16:44:35,060::task::974::TaskManager.Task::(_decref) Task=`afcddc3f-b6cb-42f6-ac82-648d1128f9db`::ref 0 aborting False
>Thread-649::DEBUG::2014-04-10 16:44:36,067::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-649::DEBUG::2014-04-10 16:44:36,067::task::579::TaskManager.Task::(_updateState) Task=`4e095862-bd01-4608-aa20-191be4b25194`::moving from state init -> state preparing
>Thread-649::INFO::2014-04-10 16:44:36,067::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-649::DEBUG::2014-04-10 16:44:36,068::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-649::DEBUG::2014-04-10 16:44:36,068::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-649::INFO::2014-04-10 16:44:36,068::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-649::DEBUG::2014-04-10 16:44:36,068::task::1168::TaskManager.Task::(prepare) Task=`4e095862-bd01-4608-aa20-191be4b25194`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-649::DEBUG::2014-04-10 16:44:36,068::task::579::TaskManager.Task::(_updateState) Task=`4e095862-bd01-4608-aa20-191be4b25194`::moving from state preparing -> state finished
>Thread-649::DEBUG::2014-04-10 16:44:36,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-649::DEBUG::2014-04-10 16:44:36,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-649::DEBUG::2014-04-10 16:44:36,069::task::974::TaskManager.Task::(_decref) Task=`4e095862-bd01-4608-aa20-191be4b25194`::ref 0 aborting False
>Thread-650::DEBUG::2014-04-10 16:44:36,625::task::579::TaskManager.Task::(_updateState) Task=`4fd9eca5-f595-485d-b54c-25ba2f2c4577`::moving from state init -> state preparing
>Thread-650::INFO::2014-04-10 16:44:36,625::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-650::INFO::2014-04-10 16:44:36,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311698', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271076', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '54.0', 'valid': False}}
>Thread-650::DEBUG::2014-04-10 16:44:36,626::task::1168::TaskManager.Task::(prepare) Task=`4fd9eca5-f595-485d-b54c-25ba2f2c4577`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311698', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271076', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '54.0', 'valid': False}}
>Thread-650::DEBUG::2014-04-10 16:44:36,626::task::579::TaskManager.Task::(_updateState) Task=`4fd9eca5-f595-485d-b54c-25ba2f2c4577`::moving from state preparing -> state finished
>Thread-650::DEBUG::2014-04-10 16:44:36,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-650::DEBUG::2014-04-10 16:44:36,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-650::DEBUG::2014-04-10 16:44:36,626::task::974::TaskManager.Task::(_decref) Task=`4fd9eca5-f595-485d-b54c-25ba2f2c4577`::ref 0 aborting False
>Thread-652::DEBUG::2014-04-10 16:44:37,077::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-652::DEBUG::2014-04-10 16:44:37,078::task::579::TaskManager.Task::(_updateState) Task=`5b81042f-a16e-4abe-b685-d3ad1725328e`::moving from state init -> state preparing
>Thread-652::INFO::2014-04-10 16:44:37,078::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-652::DEBUG::2014-04-10 16:44:37,078::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-652::DEBUG::2014-04-10 16:44:37,079::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-652::INFO::2014-04-10 16:44:37,079::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-652::DEBUG::2014-04-10 16:44:37,079::task::1168::TaskManager.Task::(prepare) Task=`5b81042f-a16e-4abe-b685-d3ad1725328e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-652::DEBUG::2014-04-10 16:44:37,079::task::579::TaskManager.Task::(_updateState) Task=`5b81042f-a16e-4abe-b685-d3ad1725328e`::moving from state preparing -> state finished
>Thread-652::DEBUG::2014-04-10 16:44:37,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-652::DEBUG::2014-04-10 16:44:37,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-652::DEBUG::2014-04-10 16:44:37,080::task::974::TaskManager.Task::(_decref) Task=`5b81042f-a16e-4abe-b685-d3ad1725328e`::ref 0 aborting False
>Thread-653::DEBUG::2014-04-10 16:44:38,087::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-653::DEBUG::2014-04-10 16:44:38,087::task::579::TaskManager.Task::(_updateState) Task=`727fc0e2-24b7-4852-bbf2-09309f1d8691`::moving from state init -> state preparing
>Thread-653::INFO::2014-04-10 16:44:38,087::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-653::DEBUG::2014-04-10 16:44:38,088::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-653::DEBUG::2014-04-10 16:44:38,088::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-653::INFO::2014-04-10 16:44:38,088::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-653::DEBUG::2014-04-10 16:44:38,088::task::1168::TaskManager.Task::(prepare) Task=`727fc0e2-24b7-4852-bbf2-09309f1d8691`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-653::DEBUG::2014-04-10 16:44:38,088::task::579::TaskManager.Task::(_updateState) Task=`727fc0e2-24b7-4852-bbf2-09309f1d8691`::moving from state preparing -> state finished
>Thread-653::DEBUG::2014-04-10 16:44:38,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-653::DEBUG::2014-04-10 16:44:38,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-653::DEBUG::2014-04-10 16:44:38,089::task::974::TaskManager.Task::(_decref) Task=`727fc0e2-24b7-4852-bbf2-09309f1d8691`::ref 0 aborting False
>Thread-654::DEBUG::2014-04-10 16:44:39,096::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-654::DEBUG::2014-04-10 16:44:39,097::task::579::TaskManager.Task::(_updateState) Task=`0822cfe1-90d4-48bc-b6b9-f3e7611556b4`::moving from state init -> state preparing
>Thread-654::INFO::2014-04-10 16:44:39,097::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-654::DEBUG::2014-04-10 16:44:39,097::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-654::DEBUG::2014-04-10 16:44:39,097::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-654::INFO::2014-04-10 16:44:39,097::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-654::DEBUG::2014-04-10 16:44:39,098::task::1168::TaskManager.Task::(prepare) Task=`0822cfe1-90d4-48bc-b6b9-f3e7611556b4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-654::DEBUG::2014-04-10 16:44:39,098::task::579::TaskManager.Task::(_updateState) Task=`0822cfe1-90d4-48bc-b6b9-f3e7611556b4`::moving from state preparing -> state finished
>Thread-654::DEBUG::2014-04-10 16:44:39,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-654::DEBUG::2014-04-10 16:44:39,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-654::DEBUG::2014-04-10 16:44:39,098::task::974::TaskManager.Task::(_decref) Task=`0822cfe1-90d4-48bc-b6b9-f3e7611556b4`::ref 0 aborting False
>Thread-656::DEBUG::2014-04-10 16:44:40,105::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-656::DEBUG::2014-04-10 16:44:40,105::task::579::TaskManager.Task::(_updateState) Task=`9c0fd35c-1547-457a-90ed-38b51ac588f7`::moving from state init -> state preparing
>Thread-656::INFO::2014-04-10 16:44:40,106::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-656::DEBUG::2014-04-10 16:44:40,106::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-656::DEBUG::2014-04-10 16:44:40,106::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-656::INFO::2014-04-10 16:44:40,106::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-656::DEBUG::2014-04-10 16:44:40,106::task::1168::TaskManager.Task::(prepare) Task=`9c0fd35c-1547-457a-90ed-38b51ac588f7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-656::DEBUG::2014-04-10 16:44:40,107::task::579::TaskManager.Task::(_updateState) Task=`9c0fd35c-1547-457a-90ed-38b51ac588f7`::moving from state preparing -> state finished
>Thread-656::DEBUG::2014-04-10 16:44:40,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-656::DEBUG::2014-04-10 16:44:40,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-656::DEBUG::2014-04-10 16:44:40,107::task::974::TaskManager.Task::(_decref) Task=`9c0fd35c-1547-457a-90ed-38b51ac588f7`::ref 0 aborting False
>Thread-657::DEBUG::2014-04-10 16:44:41,114::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-657::DEBUG::2014-04-10 16:44:41,115::task::579::TaskManager.Task::(_updateState) Task=`46f920f3-67de-48bf-b6ea-98c6a3ff6522`::moving from state init -> state preparing
>Thread-657::INFO::2014-04-10 16:44:41,115::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-657::DEBUG::2014-04-10 16:44:41,115::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-657::DEBUG::2014-04-10 16:44:41,115::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-657::INFO::2014-04-10 16:44:41,115::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-657::DEBUG::2014-04-10 16:44:41,115::task::1168::TaskManager.Task::(prepare) Task=`46f920f3-67de-48bf-b6ea-98c6a3ff6522`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-657::DEBUG::2014-04-10 16:44:41,116::task::579::TaskManager.Task::(_updateState) Task=`46f920f3-67de-48bf-b6ea-98c6a3ff6522`::moving from state preparing -> state finished
>Thread-657::DEBUG::2014-04-10 16:44:41,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-657::DEBUG::2014-04-10 16:44:41,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-657::DEBUG::2014-04-10 16:44:41,116::task::974::TaskManager.Task::(_decref) Task=`46f920f3-67de-48bf-b6ea-98c6a3ff6522`::ref 0 aborting False
>Thread-658::DEBUG::2014-04-10 16:44:42,132::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-658::DEBUG::2014-04-10 16:44:42,137::task::579::TaskManager.Task::(_updateState) Task=`9b5612c5-85eb-4bb0-ac2c-9908f0ae14a2`::moving from state init -> state preparing
>Thread-658::INFO::2014-04-10 16:44:42,140::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-658::DEBUG::2014-04-10 16:44:42,142::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-658::DEBUG::2014-04-10 16:44:42,144::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-658::INFO::2014-04-10 16:44:42,147::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-658::DEBUG::2014-04-10 16:44:42,149::task::1168::TaskManager.Task::(prepare) Task=`9b5612c5-85eb-4bb0-ac2c-9908f0ae14a2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-658::DEBUG::2014-04-10 16:44:42,152::task::579::TaskManager.Task::(_updateState) Task=`9b5612c5-85eb-4bb0-ac2c-9908f0ae14a2`::moving from state preparing -> state finished
>Thread-658::DEBUG::2014-04-10 16:44:42,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-658::DEBUG::2014-04-10 16:44:42,156::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-658::DEBUG::2014-04-10 16:44:42,159::task::974::TaskManager.Task::(_decref) Task=`9b5612c5-85eb-4bb0-ac2c-9908f0ae14a2`::ref 0 aborting False
>Thread-569::WARNING::2014-04-10 16:44:42,634::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-571::WARNING::2014-04-10 16:44:42,638::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-569::DEBUG::2014-04-10 16:44:42,643::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-571::DEBUG::2014-04-10 16:44:42,644::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-551::ERROR::2014-04-10 16:44:42,646::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-664::DEBUG::2014-04-10 16:44:43,173::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-664::DEBUG::2014-04-10 16:44:43,173::task::579::TaskManager.Task::(_updateState) Task=`4c319a34-bc7b-4342-b9af-d7f20658e76f`::moving from state init -> state preparing
>Thread-664::INFO::2014-04-10 16:44:43,174::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-664::DEBUG::2014-04-10 16:44:43,174::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-664::DEBUG::2014-04-10 16:44:43,174::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-664::INFO::2014-04-10 16:44:43,174::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-664::DEBUG::2014-04-10 16:44:43,175::task::1168::TaskManager.Task::(prepare) Task=`4c319a34-bc7b-4342-b9af-d7f20658e76f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-664::DEBUG::2014-04-10 16:44:43,175::task::579::TaskManager.Task::(_updateState) Task=`4c319a34-bc7b-4342-b9af-d7f20658e76f`::moving from state preparing -> state finished
>Thread-664::DEBUG::2014-04-10 16:44:43,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-664::DEBUG::2014-04-10 16:44:43,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-664::DEBUG::2014-04-10 16:44:43,175::task::974::TaskManager.Task::(_decref) Task=`4c319a34-bc7b-4342-b9af-d7f20658e76f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:43,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:44:43,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033037 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:44:43,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:43,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286174 s, 2.3 MB/s\n'; <rc> = 0
>Thread-665::DEBUG::2014-04-10 16:44:44,183::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-665::DEBUG::2014-04-10 16:44:44,183::task::579::TaskManager.Task::(_updateState) Task=`cb914b9e-1416-43ff-a2a9-a62dbe5758a5`::moving from state init -> state preparing
>Thread-665::INFO::2014-04-10 16:44:44,184::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-665::DEBUG::2014-04-10 16:44:44,184::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-665::DEBUG::2014-04-10 16:44:44,184::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-665::INFO::2014-04-10 16:44:44,184::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-665::DEBUG::2014-04-10 16:44:44,184::task::1168::TaskManager.Task::(prepare) Task=`cb914b9e-1416-43ff-a2a9-a62dbe5758a5`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-665::DEBUG::2014-04-10 16:44:44,185::task::579::TaskManager.Task::(_updateState) Task=`cb914b9e-1416-43ff-a2a9-a62dbe5758a5`::moving from state preparing -> state finished
>Thread-665::DEBUG::2014-04-10 16:44:44,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-665::DEBUG::2014-04-10 16:44:44,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-665::DEBUG::2014-04-10 16:44:44,185::task::974::TaskManager.Task::(_decref) Task=`cb914b9e-1416-43ff-a2a9-a62dbe5758a5`::ref 0 aborting False
>Thread-666::DEBUG::2014-04-10 16:44:45,193::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-666::DEBUG::2014-04-10 16:44:45,215::task::579::TaskManager.Task::(_updateState) Task=`17a2ba6b-5c79-4361-8e53-6acb7a10e28b`::moving from state init -> state preparing
>Thread-666::INFO::2014-04-10 16:44:45,217::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-666::DEBUG::2014-04-10 16:44:45,218::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-666::DEBUG::2014-04-10 16:44:45,218::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-666::INFO::2014-04-10 16:44:45,218::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-666::DEBUG::2014-04-10 16:44:45,219::task::1168::TaskManager.Task::(prepare) Task=`17a2ba6b-5c79-4361-8e53-6acb7a10e28b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-666::DEBUG::2014-04-10 16:44:45,219::task::579::TaskManager.Task::(_updateState) Task=`17a2ba6b-5c79-4361-8e53-6acb7a10e28b`::moving from state preparing -> state finished
>Thread-666::DEBUG::2014-04-10 16:44:45,219::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-666::DEBUG::2014-04-10 16:44:45,219::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-666::DEBUG::2014-04-10 16:44:45,219::task::974::TaskManager.Task::(_decref) Task=`17a2ba6b-5c79-4361-8e53-6acb7a10e28b`::ref 0 aborting False
>Thread-668::DEBUG::2014-04-10 16:44:46,227::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-668::DEBUG::2014-04-10 16:44:46,227::task::579::TaskManager.Task::(_updateState) Task=`93ceea10-be5f-47ed-b07e-58d2dc2f6fe8`::moving from state init -> state preparing
>Thread-668::INFO::2014-04-10 16:44:46,227::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-668::DEBUG::2014-04-10 16:44:46,227::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-668::DEBUG::2014-04-10 16:44:46,228::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-668::INFO::2014-04-10 16:44:46,228::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-668::DEBUG::2014-04-10 16:44:46,228::task::1168::TaskManager.Task::(prepare) Task=`93ceea10-be5f-47ed-b07e-58d2dc2f6fe8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-668::DEBUG::2014-04-10 16:44:46,228::task::579::TaskManager.Task::(_updateState) Task=`93ceea10-be5f-47ed-b07e-58d2dc2f6fe8`::moving from state preparing -> state finished
>Thread-668::DEBUG::2014-04-10 16:44:46,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-668::DEBUG::2014-04-10 16:44:46,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-668::DEBUG::2014-04-10 16:44:46,228::task::974::TaskManager.Task::(_decref) Task=`93ceea10-be5f-47ed-b07e-58d2dc2f6fe8`::ref 0 aborting False
>Thread-669::DEBUG::2014-04-10 16:44:47,236::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-669::DEBUG::2014-04-10 16:44:47,237::task::579::TaskManager.Task::(_updateState) Task=`822a41fe-4d71-4204-aae0-bc18a42eec48`::moving from state init -> state preparing
>Thread-669::INFO::2014-04-10 16:44:47,237::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-669::DEBUG::2014-04-10 16:44:47,238::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-669::DEBUG::2014-04-10 16:44:47,238::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-669::INFO::2014-04-10 16:44:47,238::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-669::DEBUG::2014-04-10 16:44:47,238::task::1168::TaskManager.Task::(prepare) Task=`822a41fe-4d71-4204-aae0-bc18a42eec48`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-669::DEBUG::2014-04-10 16:44:47,238::task::579::TaskManager.Task::(_updateState) Task=`822a41fe-4d71-4204-aae0-bc18a42eec48`::moving from state preparing -> state finished
>Thread-669::DEBUG::2014-04-10 16:44:47,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-669::DEBUG::2014-04-10 16:44:47,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-669::DEBUG::2014-04-10 16:44:47,239::task::974::TaskManager.Task::(_decref) Task=`822a41fe-4d71-4204-aae0-bc18a42eec48`::ref 0 aborting False
>Thread-670::DEBUG::2014-04-10 16:44:48,246::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-670::DEBUG::2014-04-10 16:44:48,247::task::579::TaskManager.Task::(_updateState) Task=`bc14e0ab-1c57-452f-ace9-d2877a894c11`::moving from state init -> state preparing
>Thread-670::INFO::2014-04-10 16:44:48,247::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-670::DEBUG::2014-04-10 16:44:48,247::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-670::DEBUG::2014-04-10 16:44:48,247::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-670::INFO::2014-04-10 16:44:48,248::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-670::DEBUG::2014-04-10 16:44:48,248::task::1168::TaskManager.Task::(prepare) Task=`bc14e0ab-1c57-452f-ace9-d2877a894c11`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-670::DEBUG::2014-04-10 16:44:48,248::task::579::TaskManager.Task::(_updateState) Task=`bc14e0ab-1c57-452f-ace9-d2877a894c11`::moving from state preparing -> state finished
>Thread-670::DEBUG::2014-04-10 16:44:48,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-670::DEBUG::2014-04-10 16:44:48,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-670::DEBUG::2014-04-10 16:44:48,248::task::974::TaskManager.Task::(_decref) Task=`bc14e0ab-1c57-452f-ace9-d2877a894c11`::ref 0 aborting False
>Thread-672::DEBUG::2014-04-10 16:44:49,256::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-672::DEBUG::2014-04-10 16:44:49,256::task::579::TaskManager.Task::(_updateState) Task=`2c5308d6-4efe-4c61-ac40-b041f7daf7f0`::moving from state init -> state preparing
>Thread-672::INFO::2014-04-10 16:44:49,257::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-672::DEBUG::2014-04-10 16:44:49,257::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-672::DEBUG::2014-04-10 16:44:49,257::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-672::INFO::2014-04-10 16:44:49,257::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-672::DEBUG::2014-04-10 16:44:49,257::task::1168::TaskManager.Task::(prepare) Task=`2c5308d6-4efe-4c61-ac40-b041f7daf7f0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-672::DEBUG::2014-04-10 16:44:49,257::task::579::TaskManager.Task::(_updateState) Task=`2c5308d6-4efe-4c61-ac40-b041f7daf7f0`::moving from state preparing -> state finished
>Thread-672::DEBUG::2014-04-10 16:44:49,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-672::DEBUG::2014-04-10 16:44:49,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-672::DEBUG::2014-04-10 16:44:49,258::task::974::TaskManager.Task::(_decref) Task=`2c5308d6-4efe-4c61-ac40-b041f7daf7f0`::ref 0 aborting False
>Thread-673::DEBUG::2014-04-10 16:44:50,265::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-673::DEBUG::2014-04-10 16:44:50,265::task::579::TaskManager.Task::(_updateState) Task=`2becf862-0b2c-4ef9-af8f-8b64c923a825`::moving from state init -> state preparing
>Thread-673::INFO::2014-04-10 16:44:50,266::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-673::DEBUG::2014-04-10 16:44:50,266::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-673::DEBUG::2014-04-10 16:44:50,266::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-673::INFO::2014-04-10 16:44:50,266::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-673::DEBUG::2014-04-10 16:44:50,266::task::1168::TaskManager.Task::(prepare) Task=`2becf862-0b2c-4ef9-af8f-8b64c923a825`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-673::DEBUG::2014-04-10 16:44:50,266::task::579::TaskManager.Task::(_updateState) Task=`2becf862-0b2c-4ef9-af8f-8b64c923a825`::moving from state preparing -> state finished
>Thread-673::DEBUG::2014-04-10 16:44:50,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-673::DEBUG::2014-04-10 16:44:50,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-673::DEBUG::2014-04-10 16:44:50,267::task::974::TaskManager.Task::(_decref) Task=`2becf862-0b2c-4ef9-af8f-8b64c923a825`::ref 0 aborting False
>Thread-674::DEBUG::2014-04-10 16:44:51,274::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-674::DEBUG::2014-04-10 16:44:51,274::task::579::TaskManager.Task::(_updateState) Task=`c2b6b332-7a06-4757-b646-b09064c4364c`::moving from state init -> state preparing
>Thread-674::INFO::2014-04-10 16:44:51,274::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-674::DEBUG::2014-04-10 16:44:51,275::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-674::DEBUG::2014-04-10 16:44:51,275::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-674::INFO::2014-04-10 16:44:51,275::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-674::DEBUG::2014-04-10 16:44:51,275::task::1168::TaskManager.Task::(prepare) Task=`c2b6b332-7a06-4757-b646-b09064c4364c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-674::DEBUG::2014-04-10 16:44:51,275::task::579::TaskManager.Task::(_updateState) Task=`c2b6b332-7a06-4757-b646-b09064c4364c`::moving from state preparing -> state finished
>Thread-674::DEBUG::2014-04-10 16:44:51,275::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-674::DEBUG::2014-04-10 16:44:51,275::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-674::DEBUG::2014-04-10 16:44:51,276::task::974::TaskManager.Task::(_decref) Task=`c2b6b332-7a06-4757-b646-b09064c4364c`::ref 0 aborting False
>Thread-675::DEBUG::2014-04-10 16:44:52,086::task::579::TaskManager.Task::(_updateState) Task=`03493524-4969-42b3-ab84-4655ecf6000b`::moving from state init -> state preparing
>Thread-675::INFO::2014-04-10 16:44:52,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-675::INFO::2014-04-10 16:44:52,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033037', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286174', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.5', 'valid': False}}
>Thread-675::DEBUG::2014-04-10 16:44:52,087::task::1168::TaskManager.Task::(prepare) Task=`03493524-4969-42b3-ab84-4655ecf6000b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033037', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286174', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.5', 'valid': False}}
>Thread-675::DEBUG::2014-04-10 16:44:52,087::task::579::TaskManager.Task::(_updateState) Task=`03493524-4969-42b3-ab84-4655ecf6000b`::moving from state preparing -> state finished
>Thread-675::DEBUG::2014-04-10 16:44:52,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-675::DEBUG::2014-04-10 16:44:52,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-675::DEBUG::2014-04-10 16:44:52,087::task::974::TaskManager.Task::(_decref) Task=`03493524-4969-42b3-ab84-4655ecf6000b`::ref 0 aborting False
>Thread-677::DEBUG::2014-04-10 16:44:52,283::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-677::DEBUG::2014-04-10 16:44:52,284::task::579::TaskManager.Task::(_updateState) Task=`3fd8cd3a-9614-463f-8e38-09c1da2131c6`::moving from state init -> state preparing
>Thread-677::INFO::2014-04-10 16:44:52,285::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-677::DEBUG::2014-04-10 16:44:52,285::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-677::DEBUG::2014-04-10 16:44:52,285::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-677::INFO::2014-04-10 16:44:52,285::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-677::DEBUG::2014-04-10 16:44:52,285::task::1168::TaskManager.Task::(prepare) Task=`3fd8cd3a-9614-463f-8e38-09c1da2131c6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-677::DEBUG::2014-04-10 16:44:52,286::task::579::TaskManager.Task::(_updateState) Task=`3fd8cd3a-9614-463f-8e38-09c1da2131c6`::moving from state preparing -> state finished
>Thread-677::DEBUG::2014-04-10 16:44:52,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-677::DEBUG::2014-04-10 16:44:52,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-677::DEBUG::2014-04-10 16:44:52,286::task::974::TaskManager.Task::(_decref) Task=`3fd8cd3a-9614-463f-8e38-09c1da2131c6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:44:53,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-678::DEBUG::2014-04-10 16:44:53,301::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-678::DEBUG::2014-04-10 16:44:53,303::task::579::TaskManager.Task::(_updateState) Task=`f2011bf1-391e-4b35-bf9e-8964ac2bae9c`::moving from state init -> state preparing
>Thread-678::INFO::2014-04-10 16:44:53,305::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-678::DEBUG::2014-04-10 16:44:53,306::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-678::DEBUG::2014-04-10 16:44:53,308::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-466::DEBUG::2014-04-10 16:44:53,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357496 s, 1.9 MB/s\n'; <rc> = 0
>Thread-678::INFO::2014-04-10 16:44:53,309::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-678::DEBUG::2014-04-10 16:44:53,311::task::1168::TaskManager.Task::(prepare) Task=`f2011bf1-391e-4b35-bf9e-8964ac2bae9c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-678::DEBUG::2014-04-10 16:44:53,312::task::579::TaskManager.Task::(_updateState) Task=`f2011bf1-391e-4b35-bf9e-8964ac2bae9c`::moving from state preparing -> state finished
>Thread-678::DEBUG::2014-04-10 16:44:53,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-678::DEBUG::2014-04-10 16:44:53,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-678::DEBUG::2014-04-10 16:44:53,317::task::974::TaskManager.Task::(_decref) Task=`f2011bf1-391e-4b35-bf9e-8964ac2bae9c`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:44:53,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:44:53,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286206 s, 2.3 MB/s\n'; <rc> = 0
>Thread-679::DEBUG::2014-04-10 16:44:54,329::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-679::DEBUG::2014-04-10 16:44:54,329::task::579::TaskManager.Task::(_updateState) Task=`bc5774b9-8a97-414b-8f5b-2b2639c3aa7a`::moving from state init -> state preparing
>Thread-679::INFO::2014-04-10 16:44:54,330::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-679::DEBUG::2014-04-10 16:44:54,330::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-679::DEBUG::2014-04-10 16:44:54,330::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-679::INFO::2014-04-10 16:44:54,330::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-679::DEBUG::2014-04-10 16:44:54,330::task::1168::TaskManager.Task::(prepare) Task=`bc5774b9-8a97-414b-8f5b-2b2639c3aa7a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-679::DEBUG::2014-04-10 16:44:54,331::task::579::TaskManager.Task::(_updateState) Task=`bc5774b9-8a97-414b-8f5b-2b2639c3aa7a`::moving from state preparing -> state finished
>Thread-679::DEBUG::2014-04-10 16:44:54,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-679::DEBUG::2014-04-10 16:44:54,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-679::DEBUG::2014-04-10 16:44:54,331::task::974::TaskManager.Task::(_decref) Task=`bc5774b9-8a97-414b-8f5b-2b2639c3aa7a`::ref 0 aborting False
>Thread-681::DEBUG::2014-04-10 16:44:55,338::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-681::DEBUG::2014-04-10 16:44:55,339::task::579::TaskManager.Task::(_updateState) Task=`9f218569-9d43-4f05-a964-dba940b86b5f`::moving from state init -> state preparing
>Thread-681::INFO::2014-04-10 16:44:55,339::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-681::DEBUG::2014-04-10 16:44:55,339::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-681::DEBUG::2014-04-10 16:44:55,339::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-681::INFO::2014-04-10 16:44:55,339::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-681::DEBUG::2014-04-10 16:44:55,339::task::1168::TaskManager.Task::(prepare) Task=`9f218569-9d43-4f05-a964-dba940b86b5f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-681::DEBUG::2014-04-10 16:44:55,339::task::579::TaskManager.Task::(_updateState) Task=`9f218569-9d43-4f05-a964-dba940b86b5f`::moving from state preparing -> state finished
>Thread-681::DEBUG::2014-04-10 16:44:55,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-681::DEBUG::2014-04-10 16:44:55,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-681::DEBUG::2014-04-10 16:44:55,340::task::974::TaskManager.Task::(_decref) Task=`9f218569-9d43-4f05-a964-dba940b86b5f`::ref 0 aborting False
>Thread-682::DEBUG::2014-04-10 16:44:56,348::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-682::DEBUG::2014-04-10 16:44:56,348::task::579::TaskManager.Task::(_updateState) Task=`8b99d4b3-4bdc-4a4c-b241-bda93e04847a`::moving from state init -> state preparing
>Thread-682::INFO::2014-04-10 16:44:56,348::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-682::DEBUG::2014-04-10 16:44:56,348::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-682::DEBUG::2014-04-10 16:44:56,349::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-682::INFO::2014-04-10 16:44:56,349::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-682::DEBUG::2014-04-10 16:44:56,349::task::1168::TaskManager.Task::(prepare) Task=`8b99d4b3-4bdc-4a4c-b241-bda93e04847a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-682::DEBUG::2014-04-10 16:44:56,349::task::579::TaskManager.Task::(_updateState) Task=`8b99d4b3-4bdc-4a4c-b241-bda93e04847a`::moving from state preparing -> state finished
>Thread-682::DEBUG::2014-04-10 16:44:56,349::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-682::DEBUG::2014-04-10 16:44:56,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-682::DEBUG::2014-04-10 16:44:56,350::task::974::TaskManager.Task::(_decref) Task=`8b99d4b3-4bdc-4a4c-b241-bda93e04847a`::ref 0 aborting False
>Thread-683::DEBUG::2014-04-10 16:44:57,365::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-683::DEBUG::2014-04-10 16:44:57,371::task::579::TaskManager.Task::(_updateState) Task=`9d70e22a-36b4-401e-8701-947940a3d94e`::moving from state init -> state preparing
>Thread-683::INFO::2014-04-10 16:44:57,376::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-683::DEBUG::2014-04-10 16:44:57,378::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-683::DEBUG::2014-04-10 16:44:57,382::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-683::INFO::2014-04-10 16:44:57,385::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-683::DEBUG::2014-04-10 16:44:57,390::task::1168::TaskManager.Task::(prepare) Task=`9d70e22a-36b4-401e-8701-947940a3d94e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-683::DEBUG::2014-04-10 16:44:57,393::task::579::TaskManager.Task::(_updateState) Task=`9d70e22a-36b4-401e-8701-947940a3d94e`::moving from state preparing -> state finished
>Thread-683::DEBUG::2014-04-10 16:44:57,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-683::DEBUG::2014-04-10 16:44:57,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-683::DEBUG::2014-04-10 16:44:57,403::task::974::TaskManager.Task::(_decref) Task=`9d70e22a-36b4-401e-8701-947940a3d94e`::ref 0 aborting False
>Thread-595::WARNING::2014-04-10 16:44:58,210::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-595::DEBUG::2014-04-10 16:44:58,213::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-597::WARNING::2014-04-10 16:44:58,215::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>14cef35a-8e4f-401f-8b32-f346397180b1::ERROR::2014-04-10 16:44:58,216::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>14cef35a-8e4f-401f-8b32-f346397180b1::ERROR::2014-04-10 16:44:58,217::sp::296::Storage.StoragePool::(startSpm) Backup domain validation failed
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sp.py", line 293, in startSpm
>    self.checkBackupDomain(__securityOverride=True)
>  File "/usr/share/vdsm/storage/securable.py", line 68, in wrapper
>    return f(self, *args, **kwargs)
>  File "/usr/share/vdsm/storage/sp.py", line 1577, in checkBackupDomain
>    dom = sdCache.produce(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,231::sp::333::Storage.StoragePool::(startSpm) ended.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,238::task::579::TaskManager.Task::(_updateState) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::moving from state running -> state finished
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,250::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,257::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,257::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,257::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,258::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,258::task::897::TaskManager.Task::(_runJobs) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::Task.run: exit - success: result 
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,258::task::974::TaskManager.Task::(_decref) Task=`14cef35a-8e4f-401f-8b32-f346397180b1`::ref 0 aborting False
>14cef35a-8e4f-401f-8b32-f346397180b1::DEBUG::2014-04-10 16:44:58,258::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-689::DEBUG::2014-04-10 16:44:58,423::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-689::DEBUG::2014-04-10 16:44:58,423::task::579::TaskManager.Task::(_updateState) Task=`0ab934bb-c939-4556-8efe-748308df18e5`::moving from state init -> state preparing
>Thread-689::INFO::2014-04-10 16:44:58,423::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-689::DEBUG::2014-04-10 16:44:58,424::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-689::DEBUG::2014-04-10 16:44:58,424::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}
>Thread-689::INFO::2014-04-10 16:44:58,424::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-689::DEBUG::2014-04-10 16:44:58,424::task::1168::TaskManager.Task::(prepare) Task=`0ab934bb-c939-4556-8efe-748308df18e5`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '14cef35a-8e4f-401f-8b32-f346397180b1'}}
>Thread-689::DEBUG::2014-04-10 16:44:58,424::task::579::TaskManager.Task::(_updateState) Task=`0ab934bb-c939-4556-8efe-748308df18e5`::moving from state preparing -> state finished
>Thread-689::DEBUG::2014-04-10 16:44:58,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-689::DEBUG::2014-04-10 16:44:58,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-689::DEBUG::2014-04-10 16:44:58,425::task::974::TaskManager.Task::(_decref) Task=`0ab934bb-c939-4556-8efe-748308df18e5`::ref 0 aborting False
>Thread-690::DEBUG::2014-04-10 16:44:58,432::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-690::DEBUG::2014-04-10 16:44:58,433::task::579::TaskManager.Task::(_updateState) Task=`c21f465e-4442-4718-b630-60336a47c719`::moving from state init -> state preparing
>Thread-690::INFO::2014-04-10 16:44:58,433::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-690::INFO::2014-04-10 16:44:58,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-690::DEBUG::2014-04-10 16:44:58,433::task::1168::TaskManager.Task::(prepare) Task=`c21f465e-4442-4718-b630-60336a47c719`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-690::DEBUG::2014-04-10 16:44:58,434::task::579::TaskManager.Task::(_updateState) Task=`c21f465e-4442-4718-b630-60336a47c719`::moving from state preparing -> state finished
>Thread-690::DEBUG::2014-04-10 16:44:58,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-690::DEBUG::2014-04-10 16:44:58,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-690::DEBUG::2014-04-10 16:44:58,434::task::974::TaskManager.Task::(_decref) Task=`c21f465e-4442-4718-b630-60336a47c719`::ref 0 aborting False
>Thread-691::DEBUG::2014-04-10 16:44:58,442::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-691::DEBUG::2014-04-10 16:44:58,442::task::579::TaskManager.Task::(_updateState) Task=`dc9aabe4-088e-4d75-82f2-7333d69783fa`::moving from state init -> state preparing
>Thread-691::INFO::2014-04-10 16:44:58,443::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='14cef35a-8e4f-401f-8b32-f346397180b1', spUUID=None, options=None)
>Thread-691::DEBUG::2014-04-10 16:44:58,443::taskManager::161::TaskManager::(clearTask) Entry. taskID: 14cef35a-8e4f-401f-8b32-f346397180b1
>Thread-691::DEBUG::2014-04-10 16:44:58,443::taskManager::166::TaskManager::(clearTask) Return.
>Thread-691::INFO::2014-04-10 16:44:58,443::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-691::DEBUG::2014-04-10 16:44:58,443::task::1168::TaskManager.Task::(prepare) Task=`dc9aabe4-088e-4d75-82f2-7333d69783fa`::finished: None
>Thread-691::DEBUG::2014-04-10 16:44:58,444::task::579::TaskManager.Task::(_updateState) Task=`dc9aabe4-088e-4d75-82f2-7333d69783fa`::moving from state preparing -> state finished
>Thread-691::DEBUG::2014-04-10 16:44:58,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-691::DEBUG::2014-04-10 16:44:58,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-691::DEBUG::2014-04-10 16:44:58,444::task::974::TaskManager.Task::(_decref) Task=`dc9aabe4-088e-4d75-82f2-7333d69783fa`::ref 0 aborting False
>Thread-692::DEBUG::2014-04-10 16:44:58,499::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-692::DEBUG::2014-04-10 16:44:58,500::task::579::TaskManager.Task::(_updateState) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::moving from state init -> state preparing
>Thread-692::INFO::2014-04-10 16:44:58,500::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-692::DEBUG::2014-04-10 16:44:58,500::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`748187f9-f7fd-4496-bab9-8cd4f8f88711`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-692::DEBUG::2014-04-10 16:44:58,501::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-692::DEBUG::2014-04-10 16:44:58,501::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-692::DEBUG::2014-04-10 16:44:58,501::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`748187f9-f7fd-4496-bab9-8cd4f8f88711`::Granted request
>Thread-692::DEBUG::2014-04-10 16:44:58,501::task::811::TaskManager.Task::(resourceAcquired) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-692::DEBUG::2014-04-10 16:44:58,502::task::974::TaskManager.Task::(_decref) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::ref 1 aborting False
>Thread-692::INFO::2014-04-10 16:44:58,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-692::DEBUG::2014-04-10 16:44:58,504::task::1168::TaskManager.Task::(prepare) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-692::DEBUG::2014-04-10 16:44:58,504::task::579::TaskManager.Task::(_updateState) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::moving from state preparing -> state finished
>Thread-692::DEBUG::2014-04-10 16:44:58,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-692::DEBUG::2014-04-10 16:44:58,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-692::DEBUG::2014-04-10 16:44:58,505::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-692::DEBUG::2014-04-10 16:44:58,505::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-692::DEBUG::2014-04-10 16:44:58,505::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-692::DEBUG::2014-04-10 16:44:58,506::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-692::DEBUG::2014-04-10 16:44:58,506::task::974::TaskManager.Task::(_decref) Task=`2064df70-a91b-437e-b0fe-25ba2ada8de2`::ref 0 aborting False
>Thread-693::DEBUG::2014-04-10 16:44:58,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-693::DEBUG::2014-04-10 16:44:58,590::task::579::TaskManager.Task::(_updateState) Task=`ece46208-cc8c-414a-ae2f-ea83fc11fe94`::moving from state init -> state preparing
>Thread-693::INFO::2014-04-10 16:44:58,590::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None)
>Thread-693::DEBUG::2014-04-10 16:44:58,591::taskManager::181::TaskManager::(getAllTasksInfo) Entry.
>Thread-693::DEBUG::2014-04-10 16:44:58,591::taskManager::192::TaskManager::(getAllTasksInfo) Return. Response: {}
>Thread-693::INFO::2014-04-10 16:44:58,591::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}}
>Thread-693::DEBUG::2014-04-10 16:44:58,591::task::1168::TaskManager.Task::(prepare) Task=`ece46208-cc8c-414a-ae2f-ea83fc11fe94`::finished: {'allTasksInfo': {}}
>Thread-693::DEBUG::2014-04-10 16:44:58,591::task::579::TaskManager.Task::(_updateState) Task=`ece46208-cc8c-414a-ae2f-ea83fc11fe94`::moving from state preparing -> state finished
>Thread-693::DEBUG::2014-04-10 16:44:58,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-693::DEBUG::2014-04-10 16:44:58,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-693::DEBUG::2014-04-10 16:44:58,592::task::974::TaskManager.Task::(_decref) Task=`ece46208-cc8c-414a-ae2f-ea83fc11fe94`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 16:44:59,511::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-694::DEBUG::2014-04-10 16:44:59,681::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2162fb9f]
>Thread-694::DEBUG::2014-04-10 16:44:59,682::task::579::TaskManager.Task::(_updateState) Task=`b1f39223-1b54-40b9-9300-1157623bceba`::moving from state init -> state preparing
>Thread-694::INFO::2014-04-10 16:44:59,682::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}], options=None)
>Thread-694::DEBUG::2014-04-10 16:44:59,684::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2
>Thread-466::DEBUG::2014-04-10 16:45:03,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:03,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000285644 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:03,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:03,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288845 s, 2.3 MB/s\n'; <rc> = 0
>Thread-697::DEBUG::2014-04-10 16:45:07,353::task::579::TaskManager.Task::(_updateState) Task=`1f15ac09-c1c8-4577-ba9e-6f280fabfb69`::moving from state init -> state preparing
>Thread-697::INFO::2014-04-10 16:45:07,353::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-697::INFO::2014-04-10 16:45:07,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285644', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288845', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '84.7', 'valid': False}}
>Thread-697::DEBUG::2014-04-10 16:45:07,354::task::1168::TaskManager.Task::(prepare) Task=`1f15ac09-c1c8-4577-ba9e-6f280fabfb69`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '69.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285644', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288845', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '84.7', 'valid': False}}
>Thread-697::DEBUG::2014-04-10 16:45:07,354::task::579::TaskManager.Task::(_updateState) Task=`1f15ac09-c1c8-4577-ba9e-6f280fabfb69`::moving from state preparing -> state finished
>Thread-697::DEBUG::2014-04-10 16:45:07,354::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-697::DEBUG::2014-04-10 16:45:07,354::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-697::DEBUG::2014-04-10 16:45:07,354::task::974::TaskManager.Task::(_decref) Task=`1f15ac09-c1c8-4577-ba9e-6f280fabfb69`::ref 0 aborting False
>Thread-699::DEBUG::2014-04-10 16:45:08,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-699::DEBUG::2014-04-10 16:45:08,591::task::579::TaskManager.Task::(_updateState) Task=`d78224f2-7910-4f3b-b4e3-42462a90b239`::moving from state init -> state preparing
>Thread-699::INFO::2014-04-10 16:45:08,591::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-699::INFO::2014-04-10 16:45:08,592::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-699::DEBUG::2014-04-10 16:45:08,592::task::1168::TaskManager.Task::(prepare) Task=`d78224f2-7910-4f3b-b4e3-42462a90b239`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-699::DEBUG::2014-04-10 16:45:08,592::task::579::TaskManager.Task::(_updateState) Task=`d78224f2-7910-4f3b-b4e3-42462a90b239`::moving from state preparing -> state finished
>Thread-699::DEBUG::2014-04-10 16:45:08,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-699::DEBUG::2014-04-10 16:45:08,593::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-699::DEBUG::2014-04-10 16:45:08,593::task::974::TaskManager.Task::(_decref) Task=`d78224f2-7910-4f3b-b4e3-42462a90b239`::ref 0 aborting False
>Thread-700::DEBUG::2014-04-10 16:45:08,603::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-700::DEBUG::2014-04-10 16:45:08,604::task::579::TaskManager.Task::(_updateState) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::moving from state init -> state preparing
>Thread-700::INFO::2014-04-10 16:45:08,604::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-700::DEBUG::2014-04-10 16:45:08,605::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dbf55845-66d2-40e6-851e-437b70672b2d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-700::DEBUG::2014-04-10 16:45:08,605::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-700::DEBUG::2014-04-10 16:45:08,605::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-700::DEBUG::2014-04-10 16:45:08,605::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dbf55845-66d2-40e6-851e-437b70672b2d`::Granted request
>Thread-700::DEBUG::2014-04-10 16:45:08,606::task::811::TaskManager.Task::(resourceAcquired) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-700::DEBUG::2014-04-10 16:45:08,607::task::974::TaskManager.Task::(_decref) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::ref 1 aborting False
>Thread-700::INFO::2014-04-10 16:45:08,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-700::DEBUG::2014-04-10 16:45:08,609::task::1168::TaskManager.Task::(prepare) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-700::DEBUG::2014-04-10 16:45:08,610::task::579::TaskManager.Task::(_updateState) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::moving from state preparing -> state finished
>Thread-700::DEBUG::2014-04-10 16:45:08,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-700::DEBUG::2014-04-10 16:45:08,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-700::DEBUG::2014-04-10 16:45:08,610::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-700::DEBUG::2014-04-10 16:45:08,610::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-700::DEBUG::2014-04-10 16:45:08,611::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-700::DEBUG::2014-04-10 16:45:08,611::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-700::DEBUG::2014-04-10 16:45:08,611::task::974::TaskManager.Task::(_decref) Task=`f45f8cfa-9f9f-4ae4-bbcf-179374a044e7`::ref 0 aborting False
>Thread-702::DEBUG::2014-04-10 16:45:10,572::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [3c8c2c14]
>Thread-702::DEBUG::2014-04-10 16:45:10,573::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '72.33', 'elapsedTime': '1093', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-466::DEBUG::2014-04-10 16:45:13,345::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:13,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348373 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:13,371::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:13,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320793 s, 2.1 MB/s\n'; <rc> = 0
>Thread-704::DEBUG::2014-04-10 16:45:13,604::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-704::DEBUG::2014-04-10 16:45:13,606::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '75.36', 'elapsedTime': '1096', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-706::DEBUG::2014-04-10 16:45:16,632::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-706::DEBUG::2014-04-10 16:45:16,633::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '78.39', 'elapsedTime': '1099', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-707::DEBUG::2014-04-10 16:45:18,681::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-707::DEBUG::2014-04-10 16:45:18,682::task::579::TaskManager.Task::(_updateState) Task=`c75f7d18-fd1c-460b-b016-ab1846af66a6`::moving from state init -> state preparing
>Thread-707::INFO::2014-04-10 16:45:18,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-707::INFO::2014-04-10 16:45:18,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-707::DEBUG::2014-04-10 16:45:18,683::task::1168::TaskManager.Task::(prepare) Task=`c75f7d18-fd1c-460b-b016-ab1846af66a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-707::DEBUG::2014-04-10 16:45:18,683::task::579::TaskManager.Task::(_updateState) Task=`c75f7d18-fd1c-460b-b016-ab1846af66a6`::moving from state preparing -> state finished
>Thread-707::DEBUG::2014-04-10 16:45:18,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-707::DEBUG::2014-04-10 16:45:18,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-707::DEBUG::2014-04-10 16:45:18,684::task::974::TaskManager.Task::(_decref) Task=`c75f7d18-fd1c-460b-b016-ab1846af66a6`::ref 0 aborting False
>Thread-708::DEBUG::2014-04-10 16:45:18,691::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-708::DEBUG::2014-04-10 16:45:18,691::task::579::TaskManager.Task::(_updateState) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::moving from state init -> state preparing
>Thread-708::INFO::2014-04-10 16:45:18,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-708::DEBUG::2014-04-10 16:45:18,692::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28069772-5e3e-4098-bd78-ccdf46d6130b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-708::DEBUG::2014-04-10 16:45:18,692::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-708::DEBUG::2014-04-10 16:45:18,692::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-708::DEBUG::2014-04-10 16:45:18,693::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28069772-5e3e-4098-bd78-ccdf46d6130b`::Granted request
>Thread-708::DEBUG::2014-04-10 16:45:18,693::task::811::TaskManager.Task::(resourceAcquired) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-708::DEBUG::2014-04-10 16:45:18,693::task::974::TaskManager.Task::(_decref) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::ref 1 aborting False
>Thread-708::INFO::2014-04-10 16:45:18,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-708::DEBUG::2014-04-10 16:45:18,696::task::1168::TaskManager.Task::(prepare) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-708::DEBUG::2014-04-10 16:45:18,696::task::579::TaskManager.Task::(_updateState) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::moving from state preparing -> state finished
>Thread-708::DEBUG::2014-04-10 16:45:18,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-708::DEBUG::2014-04-10 16:45:18,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-708::DEBUG::2014-04-10 16:45:18,696::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-708::DEBUG::2014-04-10 16:45:18,697::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-708::DEBUG::2014-04-10 16:45:18,697::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-708::DEBUG::2014-04-10 16:45:18,697::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-708::DEBUG::2014-04-10 16:45:18,697::task::974::TaskManager.Task::(_decref) Task=`b0f41db2-06cd-4bec-b261-8c6703183d78`::ref 0 aborting False
>Thread-710::DEBUG::2014-04-10 16:45:19,661::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [1a9b4afc]
>Thread-710::DEBUG::2014-04-10 16:45:19,662::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '81.42', 'elapsedTime': '1102', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-711::DEBUG::2014-04-10 16:45:22,687::task::579::TaskManager.Task::(_updateState) Task=`06673dfc-8f58-4f19-a745-805e8c57210f`::moving from state init -> state preparing
>Thread-711::INFO::2014-04-10 16:45:22,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-711::INFO::2014-04-10 16:45:22,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '84.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348373', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320793', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '100.1', 'valid': False}}
>Thread-711::DEBUG::2014-04-10 16:45:22,688::task::1168::TaskManager.Task::(prepare) Task=`06673dfc-8f58-4f19-a745-805e8c57210f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '84.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348373', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320793', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '100.1', 'valid': False}}
>Thread-711::DEBUG::2014-04-10 16:45:22,688::task::579::TaskManager.Task::(_updateState) Task=`06673dfc-8f58-4f19-a745-805e8c57210f`::moving from state preparing -> state finished
>Thread-711::DEBUG::2014-04-10 16:45:22,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-711::DEBUG::2014-04-10 16:45:22,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-711::DEBUG::2014-04-10 16:45:22,688::task::974::TaskManager.Task::(_decref) Task=`06673dfc-8f58-4f19-a745-805e8c57210f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:45:23,355::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 16:45:23,379::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 16:45:23,382::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 16:45:23,400::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 16:45:23,420::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 16:45:23,421::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 16:45:23,424::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 16:45:23,425::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 16:45:23,425::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 16:45:23,425::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:45:23,433::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 16:45:23,439::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:45:23,441::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:45:23,442::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 16:45:23,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:23,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387026 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:23,478::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:23,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000449468 s, 1.5 MB/s\n'; <rc> = 0
>Thread-722::DEBUG::2014-04-10 16:45:25,818::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [1ad889f5]
>Thread-722::DEBUG::2014-04-10 16:45:25,820::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '87.58', 'elapsedTime': '1108', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-723::DEBUG::2014-04-10 16:45:28,770::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-723::DEBUG::2014-04-10 16:45:28,771::task::579::TaskManager.Task::(_updateState) Task=`bd4b0b7f-157a-4997-9af0-be18de841cb9`::moving from state init -> state preparing
>Thread-723::INFO::2014-04-10 16:45:28,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-723::INFO::2014-04-10 16:45:28,772::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-723::DEBUG::2014-04-10 16:45:28,772::task::1168::TaskManager.Task::(prepare) Task=`bd4b0b7f-157a-4997-9af0-be18de841cb9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-723::DEBUG::2014-04-10 16:45:28,772::task::579::TaskManager.Task::(_updateState) Task=`bd4b0b7f-157a-4997-9af0-be18de841cb9`::moving from state preparing -> state finished
>Thread-723::DEBUG::2014-04-10 16:45:28,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-723::DEBUG::2014-04-10 16:45:28,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-723::DEBUG::2014-04-10 16:45:28,773::task::974::TaskManager.Task::(_decref) Task=`bd4b0b7f-157a-4997-9af0-be18de841cb9`::ref 0 aborting False
>Thread-724::DEBUG::2014-04-10 16:45:28,780::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-724::DEBUG::2014-04-10 16:45:28,780::task::579::TaskManager.Task::(_updateState) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::moving from state init -> state preparing
>Thread-724::INFO::2014-04-10 16:45:28,780::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-724::DEBUG::2014-04-10 16:45:28,781::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0a32021f-ae90-4170-bd99-bebcf69015c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-724::DEBUG::2014-04-10 16:45:28,781::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-724::DEBUG::2014-04-10 16:45:28,782::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-724::DEBUG::2014-04-10 16:45:28,782::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0a32021f-ae90-4170-bd99-bebcf69015c5`::Granted request
>Thread-724::DEBUG::2014-04-10 16:45:28,782::task::811::TaskManager.Task::(resourceAcquired) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-724::DEBUG::2014-04-10 16:45:28,782::task::974::TaskManager.Task::(_decref) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::ref 1 aborting False
>Thread-724::INFO::2014-04-10 16:45:28,784::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-724::DEBUG::2014-04-10 16:45:28,785::task::1168::TaskManager.Task::(prepare) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-724::DEBUG::2014-04-10 16:45:28,785::task::579::TaskManager.Task::(_updateState) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::moving from state preparing -> state finished
>Thread-724::DEBUG::2014-04-10 16:45:28,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-724::DEBUG::2014-04-10 16:45:28,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-724::DEBUG::2014-04-10 16:45:28,785::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-724::DEBUG::2014-04-10 16:45:28,785::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-724::DEBUG::2014-04-10 16:45:28,786::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-724::DEBUG::2014-04-10 16:45:28,786::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-724::DEBUG::2014-04-10 16:45:28,786::task::974::TaskManager.Task::(_decref) Task=`cd3d1fdd-d7b7-46b0-abcb-e4462961b2a9`::ref 0 aborting False
>Thread-726::DEBUG::2014-04-10 16:45:28,847::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-726::DEBUG::2014-04-10 16:45:28,849::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '90.60', 'elapsedTime': '1112', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>VM Channels Listener::DEBUG::2014-04-10 16:45:29,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-728::DEBUG::2014-04-10 16:45:31,879::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-728::DEBUG::2014-04-10 16:45:31,880::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '93.64', 'elapsedTime': '1115', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-466::DEBUG::2014-04-10 16:45:33,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:33,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276271 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:33,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:33,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000258759 s, 2.6 MB/s\n'; <rc> = 0
>Thread-730::DEBUG::2014-04-10 16:45:34,911::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-730::DEBUG::2014-04-10 16:45:34,913::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '96.67', 'elapsedTime': '1118', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-731::DEBUG::2014-04-10 16:45:37,936::task::579::TaskManager.Task::(_updateState) Task=`47ad7c1c-a3c3-412b-81cc-211ccf3542cf`::moving from state init -> state preparing
>Thread-731::INFO::2014-04-10 16:45:37,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-731::INFO::2014-04-10 16:45:37,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '99.7', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276271', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258759', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '115.3', 'valid': False}}
>Thread-731::DEBUG::2014-04-10 16:45:37,937::task::1168::TaskManager.Task::(prepare) Task=`47ad7c1c-a3c3-412b-81cc-211ccf3542cf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '99.7', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276271', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258759', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '115.3', 'valid': False}}
>Thread-731::DEBUG::2014-04-10 16:45:37,937::task::579::TaskManager.Task::(_updateState) Task=`47ad7c1c-a3c3-412b-81cc-211ccf3542cf`::moving from state preparing -> state finished
>Thread-731::DEBUG::2014-04-10 16:45:37,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-731::DEBUG::2014-04-10 16:45:37,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-731::DEBUG::2014-04-10 16:45:37,938::task::974::TaskManager.Task::(_decref) Task=`47ad7c1c-a3c3-412b-81cc-211ccf3542cf`::ref 0 aborting False
>Thread-733::DEBUG::2014-04-10 16:45:38,904::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-733::DEBUG::2014-04-10 16:45:38,904::task::579::TaskManager.Task::(_updateState) Task=`62ee0b19-d6f8-48a6-af3b-23edea8e92a8`::moving from state init -> state preparing
>Thread-733::INFO::2014-04-10 16:45:38,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-733::INFO::2014-04-10 16:45:38,905::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-733::DEBUG::2014-04-10 16:45:38,905::task::1168::TaskManager.Task::(prepare) Task=`62ee0b19-d6f8-48a6-af3b-23edea8e92a8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-733::DEBUG::2014-04-10 16:45:38,906::task::579::TaskManager.Task::(_updateState) Task=`62ee0b19-d6f8-48a6-af3b-23edea8e92a8`::moving from state preparing -> state finished
>Thread-733::DEBUG::2014-04-10 16:45:38,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-733::DEBUG::2014-04-10 16:45:38,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-733::DEBUG::2014-04-10 16:45:38,906::task::974::TaskManager.Task::(_decref) Task=`62ee0b19-d6f8-48a6-af3b-23edea8e92a8`::ref 0 aborting False
>Thread-734::DEBUG::2014-04-10 16:45:38,913::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-734::DEBUG::2014-04-10 16:45:38,914::task::579::TaskManager.Task::(_updateState) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::moving from state init -> state preparing
>Thread-734::INFO::2014-04-10 16:45:38,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-734::DEBUG::2014-04-10 16:45:38,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b64297d-535a-4671-9c36-2f5c2fc402ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-734::DEBUG::2014-04-10 16:45:38,915::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-734::DEBUG::2014-04-10 16:45:38,915::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-734::DEBUG::2014-04-10 16:45:38,915::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b64297d-535a-4671-9c36-2f5c2fc402ba`::Granted request
>Thread-734::DEBUG::2014-04-10 16:45:38,916::task::811::TaskManager.Task::(resourceAcquired) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-734::DEBUG::2014-04-10 16:45:38,916::task::974::TaskManager.Task::(_decref) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::ref 1 aborting False
>Thread-734::INFO::2014-04-10 16:45:38,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-734::DEBUG::2014-04-10 16:45:38,919::task::1168::TaskManager.Task::(prepare) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-734::DEBUG::2014-04-10 16:45:38,919::task::579::TaskManager.Task::(_updateState) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::moving from state preparing -> state finished
>Thread-734::DEBUG::2014-04-10 16:45:38,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-734::DEBUG::2014-04-10 16:45:38,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-734::DEBUG::2014-04-10 16:45:38,920::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-734::DEBUG::2014-04-10 16:45:38,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-734::DEBUG::2014-04-10 16:45:38,921::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-734::DEBUG::2014-04-10 16:45:38,921::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-734::DEBUG::2014-04-10 16:45:38,921::task::974::TaskManager.Task::(_decref) Task=`c4a0e487-66a7-472d-8c3b-fd7e3ec6b938`::ref 0 aborting False
>Thread-736::DEBUG::2014-04-10 16:45:41,092::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-736::DEBUG::2014-04-10 16:45:41,093::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '102.85', 'elapsedTime': '1124', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-659::WARNING::2014-04-10 16:45:42,668::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-659::DEBUG::2014-04-10 16:45:42,671::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-661::WARNING::2014-04-10 16:45:42,672::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-661::DEBUG::2014-04-10 16:45:42,675::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:45:42,675::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:45:42,676::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:45:43,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:43,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299461 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:43,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:43,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270672 s, 2.5 MB/s\n'; <rc> = 0
>Thread-738::DEBUG::2014-04-10 16:45:44,125::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-738::DEBUG::2014-04-10 16:45:44,127::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '105.88', 'elapsedTime': '1127', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-740::DEBUG::2014-04-10 16:45:47,155::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-740::DEBUG::2014-04-10 16:45:47,156::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '108.91', 'elapsedTime': '1130', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-741::DEBUG::2014-04-10 16:45:48,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-741::DEBUG::2014-04-10 16:45:48,985::task::579::TaskManager.Task::(_updateState) Task=`f914be3c-3911-4dfc-954c-ffb96c0c11f0`::moving from state init -> state preparing
>Thread-741::INFO::2014-04-10 16:45:48,986::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-741::INFO::2014-04-10 16:45:48,986::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-741::DEBUG::2014-04-10 16:45:48,986::task::1168::TaskManager.Task::(prepare) Task=`f914be3c-3911-4dfc-954c-ffb96c0c11f0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-741::DEBUG::2014-04-10 16:45:48,986::task::579::TaskManager.Task::(_updateState) Task=`f914be3c-3911-4dfc-954c-ffb96c0c11f0`::moving from state preparing -> state finished
>Thread-741::DEBUG::2014-04-10 16:45:48,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-741::DEBUG::2014-04-10 16:45:48,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-741::DEBUG::2014-04-10 16:45:48,987::task::974::TaskManager.Task::(_decref) Task=`f914be3c-3911-4dfc-954c-ffb96c0c11f0`::ref 0 aborting False
>Thread-742::DEBUG::2014-04-10 16:45:48,994::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-742::DEBUG::2014-04-10 16:45:48,995::task::579::TaskManager.Task::(_updateState) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::moving from state init -> state preparing
>Thread-742::INFO::2014-04-10 16:45:48,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-742::DEBUG::2014-04-10 16:45:48,996::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4f7e36b4-84ee-4a2e-b179-69e7d7692e3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-742::DEBUG::2014-04-10 16:45:48,996::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-742::DEBUG::2014-04-10 16:45:48,996::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-742::DEBUG::2014-04-10 16:45:48,996::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4f7e36b4-84ee-4a2e-b179-69e7d7692e3b`::Granted request
>Thread-742::DEBUG::2014-04-10 16:45:48,997::task::811::TaskManager.Task::(resourceAcquired) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-742::DEBUG::2014-04-10 16:45:48,997::task::974::TaskManager.Task::(_decref) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::ref 1 aborting False
>Thread-742::INFO::2014-04-10 16:45:48,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-742::DEBUG::2014-04-10 16:45:48,999::task::1168::TaskManager.Task::(prepare) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-742::DEBUG::2014-04-10 16:45:49,000::task::579::TaskManager.Task::(_updateState) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::moving from state preparing -> state finished
>Thread-742::DEBUG::2014-04-10 16:45:49,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-742::DEBUG::2014-04-10 16:45:49,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-742::DEBUG::2014-04-10 16:45:49,001::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-742::DEBUG::2014-04-10 16:45:49,001::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-742::DEBUG::2014-04-10 16:45:49,001::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-742::DEBUG::2014-04-10 16:45:49,001::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-742::DEBUG::2014-04-10 16:45:49,002::task::974::TaskManager.Task::(_decref) Task=`6bf48e53-ec66-45be-ad70-08308d87e8a2`::ref 0 aborting False
>Thread-744::DEBUG::2014-04-10 16:45:50,184::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [29d39d31]
>Thread-744::DEBUG::2014-04-10 16:45:50,185::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '111.94', 'elapsedTime': '1133', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-469::DEBUG::2014-04-10 16:45:52,676::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-749::DEBUG::2014-04-10 16:45:53,211::task::579::TaskManager.Task::(_updateState) Task=`8ae7018e-9d3e-405e-9d77-1d4a996ffc21`::moving from state init -> state preparing
>Thread-749::INFO::2014-04-10 16:45:53,211::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-749::INFO::2014-04-10 16:45:53,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '115.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299461', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270672', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '10.5', 'valid': False}}
>Thread-749::DEBUG::2014-04-10 16:45:53,212::task::1168::TaskManager.Task::(prepare) Task=`8ae7018e-9d3e-405e-9d77-1d4a996ffc21`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '115.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299461', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270672', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '10.5', 'valid': False}}
>Thread-749::DEBUG::2014-04-10 16:45:53,212::task::579::TaskManager.Task::(_updateState) Task=`8ae7018e-9d3e-405e-9d77-1d4a996ffc21`::moving from state preparing -> state finished
>Thread-749::DEBUG::2014-04-10 16:45:53,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-749::DEBUG::2014-04-10 16:45:53,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-749::DEBUG::2014-04-10 16:45:53,213::task::974::TaskManager.Task::(_decref) Task=`8ae7018e-9d3e-405e-9d77-1d4a996ffc21`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:45:53,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:45:53,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359584 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:45:53,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:45:53,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000322188 s, 2.1 MB/s\n'; <rc> = 0
>Thread-752::DEBUG::2014-04-10 16:45:56,332::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-752::DEBUG::2014-04-10 16:45:56,333::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.25', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '118.09', 'elapsedTime': '1139', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-684::WARNING::2014-04-10 16:45:58,244::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-684::DEBUG::2014-04-10 16:45:58,247::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-686::WARNING::2014-04-10 16:45:58,252::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-107::ERROR::2014-04-10 16:45:58,253::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::ERROR::2014-04-10 16:45:58,254::task::850::TaskManager.Task::(_setError) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3068, in getVolumeSize
>    dom = sdCache.produce(sdUUID=sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-107::DEBUG::2014-04-10 16:45:58,270::task::869::TaskManager.Task::(_run) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::Task._run: 9799b7b9-f160-4baf-b7db-4fbdae11ed39 ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731', '7879e1b7-c238-4222-95eb-e922c5cf80dc') {} failed - stopping task
>Thread-107::DEBUG::2014-04-10 16:45:58,271::task::1194::TaskManager.Task::(stop) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::stopping in state preparing (force False)
>Thread-107::DEBUG::2014-04-10 16:45:58,276::task::974::TaskManager.Task::(_decref) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::ref 1 aborting True
>Thread-107::INFO::2014-04-10 16:45:58,277::task::1151::TaskManager.Task::(prepare) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-107::DEBUG::2014-04-10 16:45:58,278::task::1156::TaskManager.Task::(prepare) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::Prepare: aborted: Storage domain does not exist
>Thread-107::DEBUG::2014-04-10 16:45:58,278::task::974::TaskManager.Task::(_decref) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::ref 0 aborting True
>Thread-107::DEBUG::2014-04-10 16:45:58,279::task::909::TaskManager.Task::(_doAbort) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::Task._doAbort: force False
>Thread-107::DEBUG::2014-04-10 16:45:58,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::DEBUG::2014-04-10 16:45:58,279::task::579::TaskManager.Task::(_updateState) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::moving from state preparing -> state aborting
>Thread-107::DEBUG::2014-04-10 16:45:58,279::task::534::TaskManager.Task::(__state_aborting) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::_aborting: recover policy none
>Thread-107::DEBUG::2014-04-10 16:45:58,279::task::579::TaskManager.Task::(_updateState) Task=`9799b7b9-f160-4baf-b7db-4fbdae11ed39`::moving from state aborting -> state failed
>Thread-107::DEBUG::2014-04-10 16:45:58,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-107::DEBUG::2014-04-10 16:45:58,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-107::ERROR::2014-04-10 16:45:58,280::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-107::ERROR::2014-04-10 16:45:58,280::vm::3704::vm.Vm::(updateDriveVolume) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to update the volume 7879e1b7-c238-4222-95eb-e922c5cf80dc (domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 image: fe90abc5-8638-40e8-b394-9082b3217731) for the drive vda
>Thread-757::DEBUG::2014-04-10 16:45:59,076::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-757::DEBUG::2014-04-10 16:45:59,078::task::579::TaskManager.Task::(_updateState) Task=`4486001e-7dcd-4193-a8f2-20913a3ed0ad`::moving from state init -> state preparing
>Thread-757::INFO::2014-04-10 16:45:59,078::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-757::INFO::2014-04-10 16:45:59,079::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-757::DEBUG::2014-04-10 16:45:59,080::task::1168::TaskManager.Task::(prepare) Task=`4486001e-7dcd-4193-a8f2-20913a3ed0ad`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-757::DEBUG::2014-04-10 16:45:59,080::task::579::TaskManager.Task::(_updateState) Task=`4486001e-7dcd-4193-a8f2-20913a3ed0ad`::moving from state preparing -> state finished
>Thread-757::DEBUG::2014-04-10 16:45:59,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-757::DEBUG::2014-04-10 16:45:59,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-757::DEBUG::2014-04-10 16:45:59,081::task::974::TaskManager.Task::(_decref) Task=`4486001e-7dcd-4193-a8f2-20913a3ed0ad`::ref 0 aborting False
>Thread-758::DEBUG::2014-04-10 16:45:59,090::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-758::DEBUG::2014-04-10 16:45:59,090::task::579::TaskManager.Task::(_updateState) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::moving from state init -> state preparing
>Thread-758::INFO::2014-04-10 16:45:59,091::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-758::DEBUG::2014-04-10 16:45:59,092::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e4f43849-1bbb-4b87-a22e-8cc4fe41f698`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-758::DEBUG::2014-04-10 16:45:59,092::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-758::DEBUG::2014-04-10 16:45:59,093::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-758::DEBUG::2014-04-10 16:45:59,093::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e4f43849-1bbb-4b87-a22e-8cc4fe41f698`::Granted request
>Thread-758::DEBUG::2014-04-10 16:45:59,094::task::811::TaskManager.Task::(resourceAcquired) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-758::DEBUG::2014-04-10 16:45:59,094::task::974::TaskManager.Task::(_decref) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::ref 1 aborting False
>Thread-758::INFO::2014-04-10 16:45:59,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-758::DEBUG::2014-04-10 16:45:59,098::task::1168::TaskManager.Task::(prepare) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-758::DEBUG::2014-04-10 16:45:59,099::task::579::TaskManager.Task::(_updateState) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::moving from state preparing -> state finished
>Thread-758::DEBUG::2014-04-10 16:45:59,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-758::DEBUG::2014-04-10 16:45:59,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-758::DEBUG::2014-04-10 16:45:59,100::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-758::DEBUG::2014-04-10 16:45:59,101::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-758::DEBUG::2014-04-10 16:45:59,102::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-758::DEBUG::2014-04-10 16:45:59,102::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-758::DEBUG::2014-04-10 16:45:59,103::task::974::TaskManager.Task::(_decref) Task=`43ab3317-b9fe-4967-b359-89a4d45f0d1b`::ref 0 aborting False
>Thread-760::DEBUG::2014-04-10 16:45:59,364::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-760::DEBUG::2014-04-10 16:45:59,366::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.23', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '-1', 'statsAge': '121.12', 'elapsedTime': '1142', 'vmType': 'kvm', 'cpuSys': '0.61', 'appsList': [], 'guestIPs': ''}]}
>VM Channels Listener::DEBUG::2014-04-10 16:45:59,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-694::DEBUG::2014-04-10 16:45:59,688::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-694::DEBUG::2014-04-10 16:45:59,689::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-694::INFO::2014-04-10 16:45:59,689::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-694::DEBUG::2014-04-10 16:45:59,689::task::1168::TaskManager.Task::(prepare) Task=`b1f39223-1b54-40b9-9300-1157623bceba`::finished: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-694::DEBUG::2014-04-10 16:45:59,689::task::579::TaskManager.Task::(_updateState) Task=`b1f39223-1b54-40b9-9300-1157623bceba`::moving from state preparing -> state finished
>Thread-694::DEBUG::2014-04-10 16:45:59,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-694::DEBUG::2014-04-10 16:45:59,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-694::DEBUG::2014-04-10 16:45:59,690::task::974::TaskManager.Task::(_decref) Task=`b1f39223-1b54-40b9-9300-1157623bceba`::ref 0 aborting False
>Thread-761::DEBUG::2014-04-10 16:45:59,724::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2734db78]
>Thread-761::DEBUG::2014-04-10 16:45:59,724::task::579::TaskManager.Task::(_updateState) Task=`f66c74b6-d02b-47d0-b873-3457c11d8a04`::moving from state init -> state preparing
>Thread-761::INFO::2014-04-10 16:45:59,724::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-761::DEBUG::2014-04-10 16:45:59,726::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-763::DEBUG::2014-04-10 16:46:02,917::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-763::DEBUG::2014-04-10 16:46:02,919::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '11035', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-3150048243914003143', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:06', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'displayType': 'qxl', 'cpuUser': '0.23', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '2147483648', 'writeLatency': '0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.61', 'elapsedTime': '1146', 'vmType': 'kvm', 'cpuSys': '0.61', 'appsList': [], 'guestIPs': ''}]}
>Thread-466::DEBUG::2014-04-10 16:46:03,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:03,638::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369824 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:03,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:03,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031853 s, 2.1 MB/s\n'; <rc> = 0
>Thread-765::DEBUG::2014-04-10 16:46:08,976::task::579::TaskManager.Task::(_updateState) Task=`a2874165-749c-47b3-82d9-f59d30425c3c`::moving from state init -> state preparing
>Thread-765::INFO::2014-04-10 16:46:08,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-765::INFO::2014-04-10 16:46:08,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '130.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369824', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031853', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '26.3', 'valid': False}}
>Thread-765::DEBUG::2014-04-10 16:46:08,978::task::1168::TaskManager.Task::(prepare) Task=`a2874165-749c-47b3-82d9-f59d30425c3c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '130.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369824', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031853', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '26.3', 'valid': False}}
>Thread-765::DEBUG::2014-04-10 16:46:08,979::task::579::TaskManager.Task::(_updateState) Task=`a2874165-749c-47b3-82d9-f59d30425c3c`::moving from state preparing -> state finished
>Thread-765::DEBUG::2014-04-10 16:46:08,979::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-765::DEBUG::2014-04-10 16:46:08,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-765::DEBUG::2014-04-10 16:46:08,979::task::974::TaskManager.Task::(_decref) Task=`a2874165-749c-47b3-82d9-f59d30425c3c`::ref 0 aborting False
>Thread-767::DEBUG::2014-04-10 16:46:09,172::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-767::DEBUG::2014-04-10 16:46:09,172::task::579::TaskManager.Task::(_updateState) Task=`c62b7642-203c-494e-b7f0-c1ccbc8255b4`::moving from state init -> state preparing
>Thread-767::INFO::2014-04-10 16:46:09,173::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-767::INFO::2014-04-10 16:46:09,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-767::DEBUG::2014-04-10 16:46:09,173::task::1168::TaskManager.Task::(prepare) Task=`c62b7642-203c-494e-b7f0-c1ccbc8255b4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-767::DEBUG::2014-04-10 16:46:09,174::task::579::TaskManager.Task::(_updateState) Task=`c62b7642-203c-494e-b7f0-c1ccbc8255b4`::moving from state preparing -> state finished
>Thread-767::DEBUG::2014-04-10 16:46:09,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-767::DEBUG::2014-04-10 16:46:09,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-767::DEBUG::2014-04-10 16:46:09,174::task::974::TaskManager.Task::(_decref) Task=`c62b7642-203c-494e-b7f0-c1ccbc8255b4`::ref 0 aborting False
>Thread-768::DEBUG::2014-04-10 16:46:09,181::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-768::DEBUG::2014-04-10 16:46:09,181::task::579::TaskManager.Task::(_updateState) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::moving from state init -> state preparing
>Thread-768::INFO::2014-04-10 16:46:09,182::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-768::DEBUG::2014-04-10 16:46:09,182::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9688af46-a5e8-44cf-b4ad-88c81045d0ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-768::DEBUG::2014-04-10 16:46:09,182::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-768::DEBUG::2014-04-10 16:46:09,183::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-768::DEBUG::2014-04-10 16:46:09,183::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9688af46-a5e8-44cf-b4ad-88c81045d0ef`::Granted request
>Thread-768::DEBUG::2014-04-10 16:46:09,183::task::811::TaskManager.Task::(resourceAcquired) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-768::DEBUG::2014-04-10 16:46:09,183::task::974::TaskManager.Task::(_decref) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::ref 1 aborting False
>Thread-768::INFO::2014-04-10 16:46:09,186::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-768::DEBUG::2014-04-10 16:46:09,186::task::1168::TaskManager.Task::(prepare) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-768::DEBUG::2014-04-10 16:46:09,186::task::579::TaskManager.Task::(_updateState) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::moving from state preparing -> state finished
>Thread-768::DEBUG::2014-04-10 16:46:09,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-768::DEBUG::2014-04-10 16:46:09,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-768::DEBUG::2014-04-10 16:46:09,187::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-768::DEBUG::2014-04-10 16:46:09,187::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-768::DEBUG::2014-04-10 16:46:09,188::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-768::DEBUG::2014-04-10 16:46:09,188::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-768::DEBUG::2014-04-10 16:46:09,188::task::974::TaskManager.Task::(_decref) Task=`1702cf4f-d253-4e02-a7e4-6c718efe8d99`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:46:13,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:13,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340362 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:13,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:13,703::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000268573 s, 2.5 MB/s\n'; <rc> = 0
>Thread-771::DEBUG::2014-04-10 16:46:15,231::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {} flowID [786556db]
>Thread-771::INFO::2014-04-10 16:46:15,232::API::324::vds::(destroy) vmContainerLock acquired by vm af1debb5-7b64-4d09-8455-850ddba3e546
>Thread-771::DEBUG::2014-04-10 16:46:15,232::vm::4533::vm.Vm::(destroy) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::destroy Called
>Thread-771::INFO::2014-04-10 16:46:15,232::vm::4479::vm.Vm::(releaseVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Release VM resources
>Thread-771::DEBUG::2014-04-10 16:46:15,245::sampling::292::vm.Vm::(stop) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Stop statistics collection
>Thread-771::DEBUG::2014-04-10 16:46:15,246::vmChannels::205::vds::(unregister) Delete fileno 9 from listener.
>Thread-107::DEBUG::2014-04-10 16:46:15,246::sampling::323::vm.Vm::(run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Stats thread finished
>VM Channels Listener::DEBUG::2014-04-10 16:46:15,603::vmChannels::112::vds::(_do_del_channels) fileno 9 was removed from listener.
>Thread-713::WARNING::2014-04-10 16:46:23,368::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-713::DEBUG::2014-04-10 16:46:23,377::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-715::WARNING::2014-04-10 16:46:23,378::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-715::DEBUG::2014-04-10 16:46:23,388::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-717::WARNING::2014-04-10 16:46:23,413::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-717::DEBUG::2014-04-10 16:46:23,416::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-719::WARNING::2014-04-10 16:46:23,417::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-719::DEBUG::2014-04-10 16:46:23,419::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-466::DEBUG::2014-04-10 16:46:23,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:23,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028479 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:23,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:23,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00038016 s, 1.8 MB/s\n'; <rc> = 0
>libvirtEventLoop::DEBUG::2014-04-10 16:46:30,283::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::event Shutdown detail 0 opaque None
>Thread-771::DEBUG::2014-04-10 16:46:30,284::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 9 edom: 10 level: 2 message: operation failed: failed to kill qemu process with SIGTERM
>Thread-771::WARNING::2014-04-10 16:46:30,284::vm::4496::vm.Vm::(releaseVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Failed to destroy VM 'af1debb5-7b64-4d09-8455-850ddba3e546' gracefully
>Thread-466::DEBUG::2014-04-10 16:46:33,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:33,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000422458 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:33,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:33,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305288 s, 2.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:46:43,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:43,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031363 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:43,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:43,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326547 s, 2.1 MB/s\n'; <rc> = 0
>Thread-745::WARNING::2014-04-10 16:46:52,685::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-745::DEBUG::2014-04-10 16:46:52,689::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-747::WARNING::2014-04-10 16:46:52,693::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-469::ERROR::2014-04-10 16:46:52,694::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:46:52,694::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:46:53,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:46:53,860::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362822 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:46:53,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:46:53,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363359 s, 1.8 MB/s\n'; <rc> = 0
>Thread-753::WARNING::2014-04-10 16:46:58,272::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-753::DEBUG::2014-04-10 16:46:58,274::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-755::WARNING::2014-04-10 16:46:58,277::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-549::ERROR::2014-04-10 16:46:58,279::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::DEBUG::2014-04-10 16:46:58,280::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-467::DEBUG::2014-04-10 16:46:58,281::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:46:58,281::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-467::DEBUG::2014-04-10 16:46:58,281::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:46:58,282::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:46:58,299::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-467::DEBUG::2014-04-10 16:46:58,300::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-761::DEBUG::2014-04-10 16:46:59,732::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-761::DEBUG::2014-04-10 16:46:59,733::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-761::INFO::2014-04-10 16:46:59,733::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-761::DEBUG::2014-04-10 16:46:59,733::task::1168::TaskManager.Task::(prepare) Task=`f66c74b6-d02b-47d0-b873-3457c11d8a04`::finished: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-761::DEBUG::2014-04-10 16:46:59,733::task::579::TaskManager.Task::(_updateState) Task=`f66c74b6-d02b-47d0-b873-3457c11d8a04`::moving from state preparing -> state finished
>Thread-761::DEBUG::2014-04-10 16:46:59,734::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-761::DEBUG::2014-04-10 16:46:59,734::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-761::DEBUG::2014-04-10 16:46:59,734::task::974::TaskManager.Task::(_decref) Task=`f66c74b6-d02b-47d0-b873-3457c11d8a04`::ref 0 aborting False
>Thread-772::DEBUG::2014-04-10 16:46:59,746::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-772::DEBUG::2014-04-10 16:46:59,747::task::579::TaskManager.Task::(_updateState) Task=`d46e4618-b48d-4436-a314-ff0a0f56c3ad`::moving from state init -> state preparing
>Thread-772::INFO::2014-04-10 16:46:59,747::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-772::INFO::2014-04-10 16:46:59,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-772::DEBUG::2014-04-10 16:46:59,747::task::1168::TaskManager.Task::(prepare) Task=`d46e4618-b48d-4436-a314-ff0a0f56c3ad`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-772::DEBUG::2014-04-10 16:46:59,747::task::579::TaskManager.Task::(_updateState) Task=`d46e4618-b48d-4436-a314-ff0a0f56c3ad`::moving from state preparing -> state finished
>Thread-772::DEBUG::2014-04-10 16:46:59,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-772::DEBUG::2014-04-10 16:46:59,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-772::DEBUG::2014-04-10 16:46:59,748::task::974::TaskManager.Task::(_decref) Task=`d46e4618-b48d-4436-a314-ff0a0f56c3ad`::ref 0 aborting False
>Thread-773::DEBUG::2014-04-10 16:46:59,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-773::DEBUG::2014-04-10 16:46:59,755::task::579::TaskManager.Task::(_updateState) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::moving from state init -> state preparing
>Thread-773::INFO::2014-04-10 16:46:59,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-773::DEBUG::2014-04-10 16:46:59,756::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`747ed384-2643-4806-b432-f2687b97f77c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-773::DEBUG::2014-04-10 16:46:59,756::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-773::DEBUG::2014-04-10 16:46:59,756::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-773::DEBUG::2014-04-10 16:46:59,756::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`747ed384-2643-4806-b432-f2687b97f77c`::Granted request
>Thread-773::DEBUG::2014-04-10 16:46:59,757::task::811::TaskManager.Task::(resourceAcquired) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-773::DEBUG::2014-04-10 16:46:59,757::task::974::TaskManager.Task::(_decref) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::ref 1 aborting False
>Thread-773::INFO::2014-04-10 16:46:59,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-773::DEBUG::2014-04-10 16:46:59,759::task::1168::TaskManager.Task::(prepare) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-773::DEBUG::2014-04-10 16:46:59,760::task::579::TaskManager.Task::(_updateState) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::moving from state preparing -> state finished
>Thread-773::DEBUG::2014-04-10 16:46:59,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-773::DEBUG::2014-04-10 16:46:59,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-773::DEBUG::2014-04-10 16:46:59,760::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-773::DEBUG::2014-04-10 16:46:59,760::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-773::DEBUG::2014-04-10 16:46:59,761::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-773::DEBUG::2014-04-10 16:46:59,761::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-773::DEBUG::2014-04-10 16:46:59,761::task::974::TaskManager.Task::(_decref) Task=`561c82ac-204f-4fc7-a713-8cf1a74b1c5f`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 16:47:00,324::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:47:00,386::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:47:00,387::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,387::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,387::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,388::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,388::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,388::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:47:00,388::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-469::DEBUG::2014-04-10 16:47:02,695::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-469::DEBUG::2014-04-10 16:47:02,695::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-469::DEBUG::2014-04-10 16:47:02,696::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-469::DEBUG::2014-04-10 16:47:02,696::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-469::DEBUG::2014-04-10 16:47:02,696::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:47:02,708::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-469::DEBUG::2014-04-10 16:47:02,708::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-466::DEBUG::2014-04-10 16:47:03,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:03,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350357 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:03,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:03,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376974 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:47:04,735::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:47:04,763::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:47:04,763::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,764::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,764::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,764::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,764::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,764::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-469::DEBUG::2014-04-10 16:47:04,765::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-782::DEBUG::2014-04-10 16:47:09,834::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-782::DEBUG::2014-04-10 16:47:09,835::task::579::TaskManager.Task::(_updateState) Task=`f07779b6-f919-432b-8cf6-0e3cf7aa16f2`::moving from state init -> state preparing
>Thread-782::INFO::2014-04-10 16:47:09,835::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-782::INFO::2014-04-10 16:47:09,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-782::DEBUG::2014-04-10 16:47:09,836::task::1168::TaskManager.Task::(prepare) Task=`f07779b6-f919-432b-8cf6-0e3cf7aa16f2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-782::DEBUG::2014-04-10 16:47:09,836::task::579::TaskManager.Task::(_updateState) Task=`f07779b6-f919-432b-8cf6-0e3cf7aa16f2`::moving from state preparing -> state finished
>Thread-782::DEBUG::2014-04-10 16:47:09,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-782::DEBUG::2014-04-10 16:47:09,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-782::DEBUG::2014-04-10 16:47:09,836::task::974::TaskManager.Task::(_decref) Task=`f07779b6-f919-432b-8cf6-0e3cf7aa16f2`::ref 0 aborting False
>Thread-783::DEBUG::2014-04-10 16:47:09,843::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-783::DEBUG::2014-04-10 16:47:09,844::task::579::TaskManager.Task::(_updateState) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::moving from state init -> state preparing
>Thread-783::INFO::2014-04-10 16:47:09,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-783::DEBUG::2014-04-10 16:47:09,844::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b291734-6511-41c4-9e97-9d0b53142686`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-783::DEBUG::2014-04-10 16:47:09,845::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-783::DEBUG::2014-04-10 16:47:09,845::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-783::DEBUG::2014-04-10 16:47:09,845::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b291734-6511-41c4-9e97-9d0b53142686`::Granted request
>Thread-783::DEBUG::2014-04-10 16:47:09,845::task::811::TaskManager.Task::(resourceAcquired) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-783::DEBUG::2014-04-10 16:47:09,846::task::974::TaskManager.Task::(_decref) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::ref 1 aborting False
>Thread-783::INFO::2014-04-10 16:47:09,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-783::DEBUG::2014-04-10 16:47:09,848::task::1168::TaskManager.Task::(prepare) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-783::DEBUG::2014-04-10 16:47:09,848::task::579::TaskManager.Task::(_updateState) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::moving from state preparing -> state finished
>Thread-783::DEBUG::2014-04-10 16:47:09,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-783::DEBUG::2014-04-10 16:47:09,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-783::DEBUG::2014-04-10 16:47:09,849::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-783::DEBUG::2014-04-10 16:47:09,849::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-783::DEBUG::2014-04-10 16:47:09,849::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-783::DEBUG::2014-04-10 16:47:09,849::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-783::DEBUG::2014-04-10 16:47:09,850::task::974::TaskManager.Task::(_decref) Task=`c2bb47e3-02c0-4e36-907e-8920d82a0413`::ref 0 aborting False
>libvirtEventLoop::DEBUG::2014-04-10 16:47:10,717::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::event Stopped detail 1 opaque None
>libvirtEventLoop::INFO::2014-04-10 16:47:10,718::vm::2238::vm.Vm::(_onQemuDeath) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::underlying process disconnected
>Thread-771::WARNING::2014-04-10 16:47:10,718::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7f37000705d0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7f37000705d0>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7f37000705d0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7f37000705d0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7f37000705d0>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'status': 'Powering down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'pid': '11035', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'displaySecurePort': u'5901', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'scsi0', 'specParams': {}, 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '2147483648', 'alias': u'virtio-disk0', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'readonly': 'False', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'reqsize': '0', 'format': 'raw', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'specParams': {}, 'volumeChain': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}, {'target': 1048576, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179', 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm2', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7f37000705d0>> device:cdrom deviceId:3c666899-b23a-4f65-b6a1-418bb4be0dab drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7f37000705d0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7f37000705d0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7f37000705d0>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7f37000705d0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7f37000705d0>> log:<logUtils.SimpleLogAdapter instance at 0x1458e18> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>Thread-771::DEBUG::2014-04-10 16:47:10,721::task::579::TaskManager.Task::(_updateState) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::moving from state init -> state preparing
>Thread-771::INFO::2014-04-10 16:47:10,721::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID=None)
>Thread-771::DEBUG::2014-04-10 16:47:10,722::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`2e8c5d2a-21fb-4164-9f15-833236293a58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage'
>Thread-771::DEBUG::2014-04-10 16:47:10,722::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-771::DEBUG::2014-04-10 16:47:10,722::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-771::DEBUG::2014-04-10 16:47:10,722::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`2e8c5d2a-21fb-4164-9f15-833236293a58`::Granted request
>Thread-771::DEBUG::2014-04-10 16:47:10,722::task::811::TaskManager.Task::(resourceAcquired) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-771::DEBUG::2014-04-10 16:47:10,723::task::974::TaskManager.Task::(_decref) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::ref 1 aborting False
>Thread-466::DEBUG::2014-04-10 16:47:13,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:13,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316043 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:13,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:13,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000563525 s, 1.2 MB/s\n'; <rc> = 0
>Thread-784::DEBUG::2014-04-10 16:47:19,913::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-784::DEBUG::2014-04-10 16:47:19,919::task::579::TaskManager.Task::(_updateState) Task=`c6064d48-4bc7-49d6-a727-69b4c708a71d`::moving from state init -> state preparing
>Thread-784::INFO::2014-04-10 16:47:19,920::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-784::INFO::2014-04-10 16:47:19,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-784::DEBUG::2014-04-10 16:47:19,920::task::1168::TaskManager.Task::(prepare) Task=`c6064d48-4bc7-49d6-a727-69b4c708a71d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-784::DEBUG::2014-04-10 16:47:19,920::task::579::TaskManager.Task::(_updateState) Task=`c6064d48-4bc7-49d6-a727-69b4c708a71d`::moving from state preparing -> state finished
>Thread-784::DEBUG::2014-04-10 16:47:19,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-784::DEBUG::2014-04-10 16:47:19,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-784::DEBUG::2014-04-10 16:47:19,921::task::974::TaskManager.Task::(_decref) Task=`c6064d48-4bc7-49d6-a727-69b4c708a71d`::ref 0 aborting False
>Thread-785::DEBUG::2014-04-10 16:47:19,927::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-785::DEBUG::2014-04-10 16:47:19,927::task::579::TaskManager.Task::(_updateState) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::moving from state init -> state preparing
>Thread-785::INFO::2014-04-10 16:47:19,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-785::DEBUG::2014-04-10 16:47:19,928::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`efbff1f0-bcaa-47e0-858f-a42498155666`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-785::DEBUG::2014-04-10 16:47:19,928::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-785::DEBUG::2014-04-10 16:47:19,928::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-785::DEBUG::2014-04-10 16:47:19,929::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`efbff1f0-bcaa-47e0-858f-a42498155666`::Granted request
>Thread-785::DEBUG::2014-04-10 16:47:19,929::task::811::TaskManager.Task::(resourceAcquired) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-785::DEBUG::2014-04-10 16:47:19,929::task::974::TaskManager.Task::(_decref) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::ref 1 aborting False
>Thread-785::INFO::2014-04-10 16:47:19,931::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-785::DEBUG::2014-04-10 16:47:19,931::task::1168::TaskManager.Task::(prepare) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-785::DEBUG::2014-04-10 16:47:19,931::task::579::TaskManager.Task::(_updateState) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::moving from state preparing -> state finished
>Thread-785::DEBUG::2014-04-10 16:47:19,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-785::DEBUG::2014-04-10 16:47:19,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-785::DEBUG::2014-04-10 16:47:19,932::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-785::DEBUG::2014-04-10 16:47:19,932::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-785::DEBUG::2014-04-10 16:47:19,932::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-785::DEBUG::2014-04-10 16:47:19,932::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-785::DEBUG::2014-04-10 16:47:19,933::task::974::TaskManager.Task::(_decref) Task=`aa14d4d0-3e7c-4413-80ef-0eae34c8987c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:47:23,966::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:23,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379873 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:24,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:24,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000301373 s, 2.2 MB/s\n'; <rc> = 0
>Thread-786::DEBUG::2014-04-10 16:47:30,008::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-786::DEBUG::2014-04-10 16:47:30,008::task::579::TaskManager.Task::(_updateState) Task=`d4b4412f-afaf-445b-8243-0e88cb04b7b0`::moving from state init -> state preparing
>Thread-786::INFO::2014-04-10 16:47:30,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-786::INFO::2014-04-10 16:47:30,009::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-786::DEBUG::2014-04-10 16:47:30,009::task::1168::TaskManager.Task::(prepare) Task=`d4b4412f-afaf-445b-8243-0e88cb04b7b0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-786::DEBUG::2014-04-10 16:47:30,010::task::579::TaskManager.Task::(_updateState) Task=`d4b4412f-afaf-445b-8243-0e88cb04b7b0`::moving from state preparing -> state finished
>Thread-786::DEBUG::2014-04-10 16:47:30,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-786::DEBUG::2014-04-10 16:47:30,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-786::DEBUG::2014-04-10 16:47:30,010::task::974::TaskManager.Task::(_decref) Task=`d4b4412f-afaf-445b-8243-0e88cb04b7b0`::ref 0 aborting False
>Thread-787::DEBUG::2014-04-10 16:47:30,017::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-787::DEBUG::2014-04-10 16:47:30,017::task::579::TaskManager.Task::(_updateState) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::moving from state init -> state preparing
>Thread-787::INFO::2014-04-10 16:47:30,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-787::DEBUG::2014-04-10 16:47:30,018::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`467e6bd9-7eda-45b5-9cc8-1fcfd7beb18b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-787::DEBUG::2014-04-10 16:47:30,018::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-787::DEBUG::2014-04-10 16:47:30,018::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-787::DEBUG::2014-04-10 16:47:30,019::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`467e6bd9-7eda-45b5-9cc8-1fcfd7beb18b`::Granted request
>Thread-787::DEBUG::2014-04-10 16:47:30,019::task::811::TaskManager.Task::(resourceAcquired) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-787::DEBUG::2014-04-10 16:47:30,019::task::974::TaskManager.Task::(_decref) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::ref 1 aborting False
>Thread-787::INFO::2014-04-10 16:47:30,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-787::DEBUG::2014-04-10 16:47:30,022::task::1168::TaskManager.Task::(prepare) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-787::DEBUG::2014-04-10 16:47:30,022::task::579::TaskManager.Task::(_updateState) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::moving from state preparing -> state finished
>Thread-787::DEBUG::2014-04-10 16:47:30,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-787::DEBUG::2014-04-10 16:47:30,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-787::DEBUG::2014-04-10 16:47:30,023::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-787::DEBUG::2014-04-10 16:47:30,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-787::DEBUG::2014-04-10 16:47:30,023::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-787::DEBUG::2014-04-10 16:47:30,023::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-787::DEBUG::2014-04-10 16:47:30,024::task::974::TaskManager.Task::(_decref) Task=`367f1abc-8046-41d8-8369-03381b7e18df`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:47:34,010::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:34,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342987 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:34,050::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:34,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397538 s, 1.7 MB/s\n'; <rc> = 0
>Thread-788::DEBUG::2014-04-10 16:47:40,096::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-788::DEBUG::2014-04-10 16:47:40,097::task::579::TaskManager.Task::(_updateState) Task=`6a8fefb3-277f-4591-9156-c02b191657c8`::moving from state init -> state preparing
>Thread-788::INFO::2014-04-10 16:47:40,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-788::INFO::2014-04-10 16:47:40,098::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-788::DEBUG::2014-04-10 16:47:40,098::task::1168::TaskManager.Task::(prepare) Task=`6a8fefb3-277f-4591-9156-c02b191657c8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-788::DEBUG::2014-04-10 16:47:40,098::task::579::TaskManager.Task::(_updateState) Task=`6a8fefb3-277f-4591-9156-c02b191657c8`::moving from state preparing -> state finished
>Thread-788::DEBUG::2014-04-10 16:47:40,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-788::DEBUG::2014-04-10 16:47:40,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-788::DEBUG::2014-04-10 16:47:40,099::task::974::TaskManager.Task::(_decref) Task=`6a8fefb3-277f-4591-9156-c02b191657c8`::ref 0 aborting False
>Thread-789::DEBUG::2014-04-10 16:47:40,106::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-789::DEBUG::2014-04-10 16:47:40,106::task::579::TaskManager.Task::(_updateState) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::moving from state init -> state preparing
>Thread-789::INFO::2014-04-10 16:47:40,107::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-789::DEBUG::2014-04-10 16:47:40,107::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`58191dbf-4cd0-46a2-aff0-ba0f83526a0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-789::DEBUG::2014-04-10 16:47:40,107::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-789::DEBUG::2014-04-10 16:47:40,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-789::DEBUG::2014-04-10 16:47:40,108::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`58191dbf-4cd0-46a2-aff0-ba0f83526a0c`::Granted request
>Thread-789::DEBUG::2014-04-10 16:47:40,108::task::811::TaskManager.Task::(resourceAcquired) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-789::DEBUG::2014-04-10 16:47:40,108::task::974::TaskManager.Task::(_decref) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::ref 1 aborting False
>Thread-789::INFO::2014-04-10 16:47:40,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-789::DEBUG::2014-04-10 16:47:40,111::task::1168::TaskManager.Task::(prepare) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-789::DEBUG::2014-04-10 16:47:40,111::task::579::TaskManager.Task::(_updateState) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::moving from state preparing -> state finished
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-789::DEBUG::2014-04-10 16:47:40,112::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-789::DEBUG::2014-04-10 16:47:40,113::task::974::TaskManager.Task::(_decref) Task=`21606385-55f5-4a49-93bb-993ed6957bd1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:47:44,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:44,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000406131 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:44,088::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:44,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000298512 s, 2.2 MB/s\n'; <rc> = 0
>Thread-790::DEBUG::2014-04-10 16:47:50,204::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-790::DEBUG::2014-04-10 16:47:50,205::task::579::TaskManager.Task::(_updateState) Task=`7c59df38-d79d-4f22-a4a2-8671450e24c6`::moving from state init -> state preparing
>Thread-790::INFO::2014-04-10 16:47:50,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-790::INFO::2014-04-10 16:47:50,205::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-790::DEBUG::2014-04-10 16:47:50,205::task::1168::TaskManager.Task::(prepare) Task=`7c59df38-d79d-4f22-a4a2-8671450e24c6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-790::DEBUG::2014-04-10 16:47:50,206::task::579::TaskManager.Task::(_updateState) Task=`7c59df38-d79d-4f22-a4a2-8671450e24c6`::moving from state preparing -> state finished
>Thread-790::DEBUG::2014-04-10 16:47:50,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-790::DEBUG::2014-04-10 16:47:50,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-790::DEBUG::2014-04-10 16:47:50,206::task::974::TaskManager.Task::(_decref) Task=`7c59df38-d79d-4f22-a4a2-8671450e24c6`::ref 0 aborting False
>Thread-791::DEBUG::2014-04-10 16:47:50,213::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-791::DEBUG::2014-04-10 16:47:50,213::task::579::TaskManager.Task::(_updateState) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::moving from state init -> state preparing
>Thread-791::INFO::2014-04-10 16:47:50,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-791::DEBUG::2014-04-10 16:47:50,214::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`480c43d8-20d4-40ad-90a7-5d3d14eaae95`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-791::DEBUG::2014-04-10 16:47:50,214::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-791::DEBUG::2014-04-10 16:47:50,214::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-791::DEBUG::2014-04-10 16:47:50,214::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`480c43d8-20d4-40ad-90a7-5d3d14eaae95`::Granted request
>Thread-791::DEBUG::2014-04-10 16:47:50,214::task::811::TaskManager.Task::(resourceAcquired) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-791::DEBUG::2014-04-10 16:47:50,215::task::974::TaskManager.Task::(_decref) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::ref 1 aborting False
>Thread-791::INFO::2014-04-10 16:47:50,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-791::DEBUG::2014-04-10 16:47:50,217::task::1168::TaskManager.Task::(prepare) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-791::DEBUG::2014-04-10 16:47:50,217::task::579::TaskManager.Task::(_updateState) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::moving from state preparing -> state finished
>Thread-791::DEBUG::2014-04-10 16:47:50,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-791::DEBUG::2014-04-10 16:47:50,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-791::DEBUG::2014-04-10 16:47:50,217::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-791::DEBUG::2014-04-10 16:47:50,218::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-791::DEBUG::2014-04-10 16:47:50,218::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-791::DEBUG::2014-04-10 16:47:50,218::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-791::DEBUG::2014-04-10 16:47:50,218::task::974::TaskManager.Task::(_decref) Task=`06d9e0d6-7491-4964-b3df-737fd2d0473b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:47:54,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:47:54,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377387 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:47:54,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:47:54,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303906 s, 2.2 MB/s\n'; <rc> = 0
>Thread-792::DEBUG::2014-04-10 16:48:00,317::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-792::DEBUG::2014-04-10 16:48:00,322::task::579::TaskManager.Task::(_updateState) Task=`9422c5c3-e981-4d7a-a472-601c7a1702e9`::moving from state init -> state preparing
>Thread-792::INFO::2014-04-10 16:48:00,326::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-792::INFO::2014-04-10 16:48:00,330::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-792::DEBUG::2014-04-10 16:48:00,333::task::1168::TaskManager.Task::(prepare) Task=`9422c5c3-e981-4d7a-a472-601c7a1702e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-792::DEBUG::2014-04-10 16:48:00,336::task::579::TaskManager.Task::(_updateState) Task=`9422c5c3-e981-4d7a-a472-601c7a1702e9`::moving from state preparing -> state finished
>Thread-792::DEBUG::2014-04-10 16:48:00,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-792::DEBUG::2014-04-10 16:48:00,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-792::DEBUG::2014-04-10 16:48:00,344::task::974::TaskManager.Task::(_decref) Task=`9422c5c3-e981-4d7a-a472-601c7a1702e9`::ref 0 aborting False
>Thread-793::DEBUG::2014-04-10 16:48:00,365::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-793::DEBUG::2014-04-10 16:48:00,369::task::579::TaskManager.Task::(_updateState) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::moving from state init -> state preparing
>Thread-793::INFO::2014-04-10 16:48:00,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-793::DEBUG::2014-04-10 16:48:00,379::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fcdb2086-9dcd-4636-8589-e41ec2b0582b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-793::DEBUG::2014-04-10 16:48:00,382::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-793::DEBUG::2014-04-10 16:48:00,386::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-793::DEBUG::2014-04-10 16:48:00,388::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fcdb2086-9dcd-4636-8589-e41ec2b0582b`::Granted request
>Thread-793::DEBUG::2014-04-10 16:48:00,395::task::811::TaskManager.Task::(resourceAcquired) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-793::DEBUG::2014-04-10 16:48:00,398::task::974::TaskManager.Task::(_decref) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::ref 1 aborting False
>Thread-774::WARNING::2014-04-10 16:48:00,409::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-774::DEBUG::2014-04-10 16:48:00,413::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-776::WARNING::2014-04-10 16:48:00,413::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-776::DEBUG::2014-04-10 16:48:00,417::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-467::ERROR::2014-04-10 16:48:00,420::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::ERROR::2014-04-10 16:48:00,424::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-793::INFO::2014-04-10 16:48:00,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-793::DEBUG::2014-04-10 16:48:00,454::task::1168::TaskManager.Task::(prepare) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-793::DEBUG::2014-04-10 16:48:00,458::task::579::TaskManager.Task::(_updateState) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::moving from state preparing -> state finished
>Thread-793::DEBUG::2014-04-10 16:48:00,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-793::DEBUG::2014-04-10 16:48:00,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-793::DEBUG::2014-04-10 16:48:00,459::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-793::DEBUG::2014-04-10 16:48:00,460::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-793::DEBUG::2014-04-10 16:48:00,460::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-793::DEBUG::2014-04-10 16:48:00,460::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-793::DEBUG::2014-04-10 16:48:00,460::task::974::TaskManager.Task::(_decref) Task=`1e799838-f482-44b2-a2fe-603ef55169e1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:48:04,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:04,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:04,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296792 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:48:04,374::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000208153 s, 3.2 MB/s\n'; <rc> = 0
>Thread-778::WARNING::2014-04-10 16:48:04,785::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-780::WARNING::2014-04-10 16:48:04,789::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-778::DEBUG::2014-04-10 16:48:04,796::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-780::DEBUG::2014-04-10 16:48:04,796::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:48:04,799::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:48:04,799::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-467::DEBUG::2014-04-10 16:48:10,433::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-798::DEBUG::2014-04-10 16:48:10,740::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-798::DEBUG::2014-04-10 16:48:10,740::task::579::TaskManager.Task::(_updateState) Task=`43adaeed-1438-420e-a814-0c8f45ab7d5b`::moving from state init -> state preparing
>Thread-798::INFO::2014-04-10 16:48:10,741::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-798::INFO::2014-04-10 16:48:10,741::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-798::DEBUG::2014-04-10 16:48:10,741::task::1168::TaskManager.Task::(prepare) Task=`43adaeed-1438-420e-a814-0c8f45ab7d5b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-798::DEBUG::2014-04-10 16:48:10,741::task::579::TaskManager.Task::(_updateState) Task=`43adaeed-1438-420e-a814-0c8f45ab7d5b`::moving from state preparing -> state finished
>Thread-798::DEBUG::2014-04-10 16:48:10,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-798::DEBUG::2014-04-10 16:48:10,742::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-798::DEBUG::2014-04-10 16:48:10,742::task::974::TaskManager.Task::(_decref) Task=`43adaeed-1438-420e-a814-0c8f45ab7d5b`::ref 0 aborting False
>Thread-799::DEBUG::2014-04-10 16:48:10,749::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-799::DEBUG::2014-04-10 16:48:10,749::task::579::TaskManager.Task::(_updateState) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::moving from state init -> state preparing
>Thread-799::INFO::2014-04-10 16:48:10,749::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-799::DEBUG::2014-04-10 16:48:10,750::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6d3825ba-bb20-4b6c-8bb3-7ae11324c0ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-799::DEBUG::2014-04-10 16:48:10,750::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-799::DEBUG::2014-04-10 16:48:10,750::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-799::DEBUG::2014-04-10 16:48:10,750::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6d3825ba-bb20-4b6c-8bb3-7ae11324c0ff`::Granted request
>Thread-799::DEBUG::2014-04-10 16:48:10,751::task::811::TaskManager.Task::(resourceAcquired) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-799::DEBUG::2014-04-10 16:48:10,751::task::974::TaskManager.Task::(_decref) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::ref 1 aborting False
>Thread-799::INFO::2014-04-10 16:48:10,753::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-799::DEBUG::2014-04-10 16:48:10,753::task::1168::TaskManager.Task::(prepare) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-799::DEBUG::2014-04-10 16:48:10,753::task::579::TaskManager.Task::(_updateState) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::moving from state preparing -> state finished
>Thread-799::DEBUG::2014-04-10 16:48:10,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-799::DEBUG::2014-04-10 16:48:10,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-799::DEBUG::2014-04-10 16:48:10,754::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-799::DEBUG::2014-04-10 16:48:10,754::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-799::DEBUG::2014-04-10 16:48:10,754::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-799::DEBUG::2014-04-10 16:48:10,754::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-799::DEBUG::2014-04-10 16:48:10,754::task::974::TaskManager.Task::(_decref) Task=`0ee17f3c-823c-450f-a520-c9e04466421c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:48:14,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:14,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397698 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:48:14,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:14,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321789 s, 2.1 MB/s\n'; <rc> = 0
>Thread-804::DEBUG::2014-04-10 16:48:20,865::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-804::DEBUG::2014-04-10 16:48:20,866::task::579::TaskManager.Task::(_updateState) Task=`48135a6f-94b9-4598-8c4b-d65dd109caa4`::moving from state init -> state preparing
>Thread-804::INFO::2014-04-10 16:48:20,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-804::INFO::2014-04-10 16:48:20,867::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-804::DEBUG::2014-04-10 16:48:20,867::task::1168::TaskManager.Task::(prepare) Task=`48135a6f-94b9-4598-8c4b-d65dd109caa4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-804::DEBUG::2014-04-10 16:48:20,867::task::579::TaskManager.Task::(_updateState) Task=`48135a6f-94b9-4598-8c4b-d65dd109caa4`::moving from state preparing -> state finished
>Thread-804::DEBUG::2014-04-10 16:48:20,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-804::DEBUG::2014-04-10 16:48:20,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-804::DEBUG::2014-04-10 16:48:20,867::task::974::TaskManager.Task::(_decref) Task=`48135a6f-94b9-4598-8c4b-d65dd109caa4`::ref 0 aborting False
>Thread-805::DEBUG::2014-04-10 16:48:20,874::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-805::DEBUG::2014-04-10 16:48:20,875::task::579::TaskManager.Task::(_updateState) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::moving from state init -> state preparing
>Thread-805::INFO::2014-04-10 16:48:20,875::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-805::DEBUG::2014-04-10 16:48:20,875::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8f013fcb-b80c-4ecc-8714-1bf1891eac84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-805::DEBUG::2014-04-10 16:48:20,875::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-805::DEBUG::2014-04-10 16:48:20,876::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-805::DEBUG::2014-04-10 16:48:20,876::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8f013fcb-b80c-4ecc-8714-1bf1891eac84`::Granted request
>Thread-805::DEBUG::2014-04-10 16:48:20,876::task::811::TaskManager.Task::(resourceAcquired) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-805::DEBUG::2014-04-10 16:48:20,876::task::974::TaskManager.Task::(_decref) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::ref 1 aborting False
>Thread-805::INFO::2014-04-10 16:48:20,878::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-805::DEBUG::2014-04-10 16:48:20,879::task::1168::TaskManager.Task::(prepare) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-805::DEBUG::2014-04-10 16:48:20,879::task::579::TaskManager.Task::(_updateState) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::moving from state preparing -> state finished
>Thread-805::DEBUG::2014-04-10 16:48:20,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-805::DEBUG::2014-04-10 16:48:20,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-805::DEBUG::2014-04-10 16:48:20,879::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-805::DEBUG::2014-04-10 16:48:20,880::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-805::DEBUG::2014-04-10 16:48:20,880::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-805::DEBUG::2014-04-10 16:48:20,880::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-805::DEBUG::2014-04-10 16:48:20,880::task::974::TaskManager.Task::(_decref) Task=`f39485af-d97d-4d11-81c3-bb3205b5d3da`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:48:24,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:24,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:24,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277387 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:48:24,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024552 s, 2.7 MB/s\n'; <rc> = 0
>Thread-806::DEBUG::2014-04-10 16:48:30,964::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-806::DEBUG::2014-04-10 16:48:30,965::task::579::TaskManager.Task::(_updateState) Task=`92f7d1ac-9378-42a1-8572-a654aaa745d8`::moving from state init -> state preparing
>Thread-806::INFO::2014-04-10 16:48:30,965::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-806::INFO::2014-04-10 16:48:30,965::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-806::DEBUG::2014-04-10 16:48:30,965::task::1168::TaskManager.Task::(prepare) Task=`92f7d1ac-9378-42a1-8572-a654aaa745d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-806::DEBUG::2014-04-10 16:48:30,966::task::579::TaskManager.Task::(_updateState) Task=`92f7d1ac-9378-42a1-8572-a654aaa745d8`::moving from state preparing -> state finished
>Thread-806::DEBUG::2014-04-10 16:48:30,966::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-806::DEBUG::2014-04-10 16:48:30,966::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-806::DEBUG::2014-04-10 16:48:30,966::task::974::TaskManager.Task::(_decref) Task=`92f7d1ac-9378-42a1-8572-a654aaa745d8`::ref 0 aborting False
>Thread-807::DEBUG::2014-04-10 16:48:30,973::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-807::DEBUG::2014-04-10 16:48:30,973::task::579::TaskManager.Task::(_updateState) Task=`05422215-d176-448a-b182-e94494b9afb6`::moving from state init -> state preparing
>Thread-807::INFO::2014-04-10 16:48:30,973::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-807::DEBUG::2014-04-10 16:48:30,974::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d0c0c81-1073-427b-a9b7-5c99d0b1510d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-807::DEBUG::2014-04-10 16:48:30,974::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-807::DEBUG::2014-04-10 16:48:30,974::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-807::DEBUG::2014-04-10 16:48:30,974::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d0c0c81-1073-427b-a9b7-5c99d0b1510d`::Granted request
>Thread-807::DEBUG::2014-04-10 16:48:30,975::task::811::TaskManager.Task::(resourceAcquired) Task=`05422215-d176-448a-b182-e94494b9afb6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-807::DEBUG::2014-04-10 16:48:30,975::task::974::TaskManager.Task::(_decref) Task=`05422215-d176-448a-b182-e94494b9afb6`::ref 1 aborting False
>Thread-807::INFO::2014-04-10 16:48:30,977::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-807::DEBUG::2014-04-10 16:48:30,978::task::1168::TaskManager.Task::(prepare) Task=`05422215-d176-448a-b182-e94494b9afb6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-807::DEBUG::2014-04-10 16:48:30,978::task::579::TaskManager.Task::(_updateState) Task=`05422215-d176-448a-b182-e94494b9afb6`::moving from state preparing -> state finished
>Thread-807::DEBUG::2014-04-10 16:48:30,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-807::DEBUG::2014-04-10 16:48:30,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-807::DEBUG::2014-04-10 16:48:30,978::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-807::DEBUG::2014-04-10 16:48:30,979::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-807::DEBUG::2014-04-10 16:48:30,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-807::DEBUG::2014-04-10 16:48:30,979::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-807::DEBUG::2014-04-10 16:48:30,979::task::974::TaskManager.Task::(_decref) Task=`05422215-d176-448a-b182-e94494b9afb6`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:48:34,535::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:34,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286249 s, 2.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:48:34,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:34,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264045 s, 2.5 MB/s\n'; <rc> = 0
>Thread-808::DEBUG::2014-04-10 16:48:41,045::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-808::DEBUG::2014-04-10 16:48:41,046::task::579::TaskManager.Task::(_updateState) Task=`c9c5da51-1cc7-4ea9-acaf-9cea0202645a`::moving from state init -> state preparing
>Thread-808::INFO::2014-04-10 16:48:41,046::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-808::INFO::2014-04-10 16:48:41,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-808::DEBUG::2014-04-10 16:48:41,047::task::1168::TaskManager.Task::(prepare) Task=`c9c5da51-1cc7-4ea9-acaf-9cea0202645a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-808::DEBUG::2014-04-10 16:48:41,047::task::579::TaskManager.Task::(_updateState) Task=`c9c5da51-1cc7-4ea9-acaf-9cea0202645a`::moving from state preparing -> state finished
>Thread-808::DEBUG::2014-04-10 16:48:41,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-808::DEBUG::2014-04-10 16:48:41,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-808::DEBUG::2014-04-10 16:48:41,047::task::974::TaskManager.Task::(_decref) Task=`c9c5da51-1cc7-4ea9-acaf-9cea0202645a`::ref 0 aborting False
>Thread-809::DEBUG::2014-04-10 16:48:41,054::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-809::DEBUG::2014-04-10 16:48:41,054::task::579::TaskManager.Task::(_updateState) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::moving from state init -> state preparing
>Thread-809::INFO::2014-04-10 16:48:41,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-809::DEBUG::2014-04-10 16:48:41,055::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`241cf6aa-aa9d-46cd-8ee6-6203b759146f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-809::DEBUG::2014-04-10 16:48:41,055::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-809::DEBUG::2014-04-10 16:48:41,056::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-809::DEBUG::2014-04-10 16:48:41,056::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`241cf6aa-aa9d-46cd-8ee6-6203b759146f`::Granted request
>Thread-809::DEBUG::2014-04-10 16:48:41,056::task::811::TaskManager.Task::(resourceAcquired) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-809::DEBUG::2014-04-10 16:48:41,056::task::974::TaskManager.Task::(_decref) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::ref 1 aborting False
>Thread-809::INFO::2014-04-10 16:48:41,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-809::DEBUG::2014-04-10 16:48:41,059::task::1168::TaskManager.Task::(prepare) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-809::DEBUG::2014-04-10 16:48:41,059::task::579::TaskManager.Task::(_updateState) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::moving from state preparing -> state finished
>Thread-809::DEBUG::2014-04-10 16:48:41,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-809::DEBUG::2014-04-10 16:48:41,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-809::DEBUG::2014-04-10 16:48:41,059::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-809::DEBUG::2014-04-10 16:48:41,060::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-809::DEBUG::2014-04-10 16:48:41,060::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-809::DEBUG::2014-04-10 16:48:41,060::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-809::DEBUG::2014-04-10 16:48:41,060::task::974::TaskManager.Task::(_decref) Task=`d247bb26-0d4d-44a0-a4a1-becbc208e83b`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:48:44,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:44,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000298738 s, 2.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:48:44,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:44,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309201 s, 2.2 MB/s\n'; <rc> = 0
>Thread-810::DEBUG::2014-04-10 16:48:51,135::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-810::DEBUG::2014-04-10 16:48:51,136::task::579::TaskManager.Task::(_updateState) Task=`2aca0b80-75ff-4376-85b6-6462d86b06fc`::moving from state init -> state preparing
>Thread-810::INFO::2014-04-10 16:48:51,136::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-810::INFO::2014-04-10 16:48:51,137::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-810::DEBUG::2014-04-10 16:48:51,137::task::1168::TaskManager.Task::(prepare) Task=`2aca0b80-75ff-4376-85b6-6462d86b06fc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-810::DEBUG::2014-04-10 16:48:51,137::task::579::TaskManager.Task::(_updateState) Task=`2aca0b80-75ff-4376-85b6-6462d86b06fc`::moving from state preparing -> state finished
>Thread-810::DEBUG::2014-04-10 16:48:51,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-810::DEBUG::2014-04-10 16:48:51,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-810::DEBUG::2014-04-10 16:48:51,138::task::974::TaskManager.Task::(_decref) Task=`2aca0b80-75ff-4376-85b6-6462d86b06fc`::ref 0 aborting False
>Thread-811::DEBUG::2014-04-10 16:48:51,144::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-811::DEBUG::2014-04-10 16:48:51,145::task::579::TaskManager.Task::(_updateState) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::moving from state init -> state preparing
>Thread-811::INFO::2014-04-10 16:48:51,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-811::DEBUG::2014-04-10 16:48:51,146::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76db2656-d24f-406a-a1c1-f1fb43e7bd7d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-811::DEBUG::2014-04-10 16:48:51,146::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-811::DEBUG::2014-04-10 16:48:51,146::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-811::DEBUG::2014-04-10 16:48:51,146::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76db2656-d24f-406a-a1c1-f1fb43e7bd7d`::Granted request
>Thread-811::DEBUG::2014-04-10 16:48:51,147::task::811::TaskManager.Task::(resourceAcquired) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-811::DEBUG::2014-04-10 16:48:51,148::task::974::TaskManager.Task::(_decref) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::ref 1 aborting False
>Thread-811::INFO::2014-04-10 16:48:51,150::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-811::DEBUG::2014-04-10 16:48:51,150::task::1168::TaskManager.Task::(prepare) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-811::DEBUG::2014-04-10 16:48:51,150::task::579::TaskManager.Task::(_updateState) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::moving from state preparing -> state finished
>Thread-811::DEBUG::2014-04-10 16:48:51,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-811::DEBUG::2014-04-10 16:48:51,150::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-811::DEBUG::2014-04-10 16:48:51,151::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-811::DEBUG::2014-04-10 16:48:51,151::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-811::DEBUG::2014-04-10 16:48:51,151::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-811::DEBUG::2014-04-10 16:48:51,151::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-811::DEBUG::2014-04-10 16:48:51,151::task::974::TaskManager.Task::(_decref) Task=`e4b32a1a-f160-4f0d-ab89-deec5f34893f`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:48:54,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:48:54,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:48:54,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256456 s, 2.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:48:54,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00023018 s, 2.9 MB/s\n'; <rc> = 0
>Thread-794::WARNING::2014-04-10 16:49:00,453::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-794::DEBUG::2014-04-10 16:49:00,455::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-796::WARNING::2014-04-10 16:49:00,457::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-771::ERROR::2014-04-10 16:49:00,459::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-771::ERROR::2014-04-10 16:49:00,460::task::850::TaskManager.Task::(_setError) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3306, in teardownImage
>    dom = sdCache.produce(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-771::DEBUG::2014-04-10 16:49:00,475::task::869::TaskManager.Task::(_run) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::Task._run: b4ec9a21-f977-445f-aa54-42fe900f31da ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'fe90abc5-8638-40e8-b394-9082b3217731') {} failed - stopping task
>Thread-771::DEBUG::2014-04-10 16:49:00,488::task::1194::TaskManager.Task::(stop) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::stopping in state preparing (force False)
>Thread-771::DEBUG::2014-04-10 16:49:00,492::task::974::TaskManager.Task::(_decref) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::ref 1 aborting True
>Thread-771::INFO::2014-04-10 16:49:00,492::task::1151::TaskManager.Task::(prepare) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-771::DEBUG::2014-04-10 16:49:00,492::task::1156::TaskManager.Task::(prepare) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::Prepare: aborted: Storage domain does not exist
>Thread-771::DEBUG::2014-04-10 16:49:00,494::task::974::TaskManager.Task::(_decref) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::ref 0 aborting True
>Thread-771::DEBUG::2014-04-10 16:49:00,495::task::909::TaskManager.Task::(_doAbort) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::Task._doAbort: force False
>Thread-771::DEBUG::2014-04-10 16:49:00,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-771::DEBUG::2014-04-10 16:49:00,496::task::579::TaskManager.Task::(_updateState) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::moving from state preparing -> state aborting
>Thread-771::DEBUG::2014-04-10 16:49:00,498::task::534::TaskManager.Task::(__state_aborting) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::_aborting: recover policy none
>Thread-771::DEBUG::2014-04-10 16:49:00,499::task::579::TaskManager.Task::(_updateState) Task=`b4ec9a21-f977-445f-aa54-42fe900f31da`::moving from state aborting -> state failed
>Thread-771::DEBUG::2014-04-10 16:49:00,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>Thread-771::DEBUG::2014-04-10 16:49:00,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-771::DEBUG::2014-04-10 16:49:00,499::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-771::DEBUG::2014-04-10 16:49:00,500::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-771::DEBUG::2014-04-10 16:49:00,500::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-771::DEBUG::2014-04-10 16:49:00,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-771::ERROR::2014-04-10 16:49:00,500::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)", 'code': 358}}
>Thread-771::DEBUG::2014-04-10 16:49:00,504::task::579::TaskManager.Task::(_updateState) Task=`b1ae6e15-9b30-40d2-b2a3-929fb392c43f`::moving from state init -> state preparing
>Thread-771::INFO::2014-04-10 16:49:00,504::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='af1debb5-7b64-4d09-8455-850ddba3e546')
>Thread-771::INFO::2014-04-10 16:49:00,524::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None
>Thread-771::DEBUG::2014-04-10 16:49:00,524::task::1168::TaskManager.Task::(prepare) Task=`b1ae6e15-9b30-40d2-b2a3-929fb392c43f`::finished: None
>Thread-771::DEBUG::2014-04-10 16:49:00,525::task::579::TaskManager.Task::(_updateState) Task=`b1ae6e15-9b30-40d2-b2a3-929fb392c43f`::moving from state preparing -> state finished
>Thread-771::DEBUG::2014-04-10 16:49:00,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-771::DEBUG::2014-04-10 16:49:00,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-771::DEBUG::2014-04-10 16:49:00,525::task::974::TaskManager.Task::(_decref) Task=`b1ae6e15-9b30-40d2-b2a3-929fb392c43f`::ref 0 aborting False
>Thread-771::DEBUG::2014-04-10 16:49:00,526::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-771::DEBUG::2014-04-10 16:49:00,793::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-771::INFO::2014-04-10 16:49:00,793::hooks::100::root::(_runHooksDir) 
>Thread-771::DEBUG::2014-04-10 16:49:00,795::vm::4527::vm.Vm::(deleteVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Total desktops after destroy of af1debb5-7b64-4d09-8455-850ddba3e546 is 0
>Thread-771::DEBUG::2014-04-10 16:49:00,795::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>libvirtEventLoop::DEBUG::2014-04-10 16:49:00,797::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'af1debb5-7b64-4d09-8455-850ddba3e546'
>libvirtEventLoop::DEBUG::2014-04-10 16:49:00,798::vm::2657::vm.Vm::(setDownStatus) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Changed state to Down: Admin shut down
>libvirtEventLoop::DEBUG::2014-04-10 16:49:00,798::sampling::292::vm.Vm::(stop) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Stop statistics collection
>libvirtEventLoop::DEBUG::2014-04-10 16:49:00,799::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid 'af1debb5-7b64-4d09-8455-850ddba3e546'
>Thread-818::DEBUG::2014-04-10 16:49:01,242::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-818::DEBUG::2014-04-10 16:49:01,243::task::579::TaskManager.Task::(_updateState) Task=`db74d096-65a1-4265-a4b4-dbbbe7bb3d14`::moving from state init -> state preparing
>Thread-818::INFO::2014-04-10 16:49:01,243::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-818::INFO::2014-04-10 16:49:01,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-818::DEBUG::2014-04-10 16:49:01,244::task::1168::TaskManager.Task::(prepare) Task=`db74d096-65a1-4265-a4b4-dbbbe7bb3d14`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-818::DEBUG::2014-04-10 16:49:01,244::task::579::TaskManager.Task::(_updateState) Task=`db74d096-65a1-4265-a4b4-dbbbe7bb3d14`::moving from state preparing -> state finished
>Thread-818::DEBUG::2014-04-10 16:49:01,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-818::DEBUG::2014-04-10 16:49:01,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-818::DEBUG::2014-04-10 16:49:01,245::task::974::TaskManager.Task::(_decref) Task=`db74d096-65a1-4265-a4b4-dbbbe7bb3d14`::ref 0 aborting False
>Thread-819::DEBUG::2014-04-10 16:49:01,251::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-819::DEBUG::2014-04-10 16:49:01,251::task::579::TaskManager.Task::(_updateState) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::moving from state init -> state preparing
>Thread-819::INFO::2014-04-10 16:49:01,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-819::DEBUG::2014-04-10 16:49:01,252::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5728368-2306-411f-b265-d2bd4dfefabb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-819::DEBUG::2014-04-10 16:49:01,252::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-819::DEBUG::2014-04-10 16:49:01,253::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-819::DEBUG::2014-04-10 16:49:01,253::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5728368-2306-411f-b265-d2bd4dfefabb`::Granted request
>Thread-819::DEBUG::2014-04-10 16:49:01,253::task::811::TaskManager.Task::(resourceAcquired) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-819::DEBUG::2014-04-10 16:49:01,253::task::974::TaskManager.Task::(_decref) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::ref 1 aborting False
>Thread-819::INFO::2014-04-10 16:49:01,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-819::DEBUG::2014-04-10 16:49:01,256::task::1168::TaskManager.Task::(prepare) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-819::DEBUG::2014-04-10 16:49:01,257::task::579::TaskManager.Task::(_updateState) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::moving from state preparing -> state finished
>Thread-819::DEBUG::2014-04-10 16:49:01,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-819::DEBUG::2014-04-10 16:49:01,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-819::DEBUG::2014-04-10 16:49:01,257::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-819::DEBUG::2014-04-10 16:49:01,257::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-819::DEBUG::2014-04-10 16:49:01,258::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-819::DEBUG::2014-04-10 16:49:01,258::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-819::DEBUG::2014-04-10 16:49:01,258::task::974::TaskManager.Task::(_decref) Task=`8420e090-acd3-4926-b4f9-125fdd976ce6`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:49:04,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:49:04,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:04,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000251766 s, 2.7 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:49:04,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000218995 s, 3.1 MB/s\n'; <rc> = 0
>Thread-821::DEBUG::2014-04-10 16:49:06,895::task::579::TaskManager.Task::(_updateState) Task=`3370c3d4-7b91-4539-bbbe-6f8382997d0c`::moving from state init -> state preparing
>Thread-821::INFO::2014-04-10 16:49:06,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-821::INFO::2014-04-10 16:49:06,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '66.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218995', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251766', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '62.1', 'valid': False}}
>Thread-821::DEBUG::2014-04-10 16:49:06,896::task::1168::TaskManager.Task::(prepare) Task=`3370c3d4-7b91-4539-bbbe-6f8382997d0c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '66.5', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000218995', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251766', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '62.1', 'valid': False}}
>Thread-821::DEBUG::2014-04-10 16:49:06,896::task::579::TaskManager.Task::(_updateState) Task=`3370c3d4-7b91-4539-bbbe-6f8382997d0c`::moving from state preparing -> state finished
>Thread-821::DEBUG::2014-04-10 16:49:06,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-821::DEBUG::2014-04-10 16:49:06,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-821::DEBUG::2014-04-10 16:49:06,897::task::974::TaskManager.Task::(_decref) Task=`3370c3d4-7b91-4539-bbbe-6f8382997d0c`::ref 0 aborting False
>Thread-824::DEBUG::2014-04-10 16:49:11,320::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-824::DEBUG::2014-04-10 16:49:11,328::task::579::TaskManager.Task::(_updateState) Task=`bd169eb3-109d-4c1a-83c0-025faa53ed0a`::moving from state init -> state preparing
>Thread-824::INFO::2014-04-10 16:49:11,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-824::INFO::2014-04-10 16:49:11,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-824::DEBUG::2014-04-10 16:49:11,329::task::1168::TaskManager.Task::(prepare) Task=`bd169eb3-109d-4c1a-83c0-025faa53ed0a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-824::DEBUG::2014-04-10 16:49:11,329::task::579::TaskManager.Task::(_updateState) Task=`bd169eb3-109d-4c1a-83c0-025faa53ed0a`::moving from state preparing -> state finished
>Thread-824::DEBUG::2014-04-10 16:49:11,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-824::DEBUG::2014-04-10 16:49:11,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-824::DEBUG::2014-04-10 16:49:11,330::task::974::TaskManager.Task::(_decref) Task=`bd169eb3-109d-4c1a-83c0-025faa53ed0a`::ref 0 aborting False
>Thread-825::DEBUG::2014-04-10 16:49:11,336::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-825::DEBUG::2014-04-10 16:49:11,337::task::579::TaskManager.Task::(_updateState) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::moving from state init -> state preparing
>Thread-825::INFO::2014-04-10 16:49:11,337::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-825::DEBUG::2014-04-10 16:49:11,337::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28dc4390-f4ef-4187-929e-f300af8dce43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-825::DEBUG::2014-04-10 16:49:11,338::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-825::DEBUG::2014-04-10 16:49:11,338::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-825::DEBUG::2014-04-10 16:49:11,338::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28dc4390-f4ef-4187-929e-f300af8dce43`::Granted request
>Thread-825::DEBUG::2014-04-10 16:49:11,338::task::811::TaskManager.Task::(resourceAcquired) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-825::DEBUG::2014-04-10 16:49:11,338::task::974::TaskManager.Task::(_decref) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::ref 1 aborting False
>Thread-825::INFO::2014-04-10 16:49:11,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-825::DEBUG::2014-04-10 16:49:11,341::task::1168::TaskManager.Task::(prepare) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-825::DEBUG::2014-04-10 16:49:11,341::task::579::TaskManager.Task::(_updateState) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::moving from state preparing -> state finished
>Thread-825::DEBUG::2014-04-10 16:49:11,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-825::DEBUG::2014-04-10 16:49:11,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-825::DEBUG::2014-04-10 16:49:11,342::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-825::DEBUG::2014-04-10 16:49:11,342::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-825::DEBUG::2014-04-10 16:49:11,342::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-825::DEBUG::2014-04-10 16:49:11,342::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-825::DEBUG::2014-04-10 16:49:11,342::task::974::TaskManager.Task::(_decref) Task=`825aaa06-8782-4f9f-88ae-72a5bbe0747b`::ref 0 aborting False
>Thread-800::WARNING::2014-04-10 16:49:14,816::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-800::DEBUG::2014-04-10 16:49:14,824::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-802::WARNING::2014-04-10 16:49:14,824::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-802::DEBUG::2014-04-10 16:49:14,831::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:49:14,835::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:49:14,842::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:49:14,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:14,862::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:14,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00020473 s, 3.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:49:14,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261882 s, 2.6 MB/s\n'; <rc> = 0
>Thread-829::DEBUG::2014-04-10 16:49:21,491::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-829::DEBUG::2014-04-10 16:49:21,492::task::579::TaskManager.Task::(_updateState) Task=`8edf0d79-0d03-4501-a495-2b8ebf55a007`::moving from state init -> state preparing
>Thread-829::INFO::2014-04-10 16:49:21,492::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-829::INFO::2014-04-10 16:49:21,492::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-829::DEBUG::2014-04-10 16:49:21,493::task::1168::TaskManager.Task::(prepare) Task=`8edf0d79-0d03-4501-a495-2b8ebf55a007`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-829::DEBUG::2014-04-10 16:49:21,493::task::579::TaskManager.Task::(_updateState) Task=`8edf0d79-0d03-4501-a495-2b8ebf55a007`::moving from state preparing -> state finished
>Thread-829::DEBUG::2014-04-10 16:49:21,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-829::DEBUG::2014-04-10 16:49:21,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-829::DEBUG::2014-04-10 16:49:21,493::task::974::TaskManager.Task::(_decref) Task=`8edf0d79-0d03-4501-a495-2b8ebf55a007`::ref 0 aborting False
>Thread-830::DEBUG::2014-04-10 16:49:21,500::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-830::DEBUG::2014-04-10 16:49:21,500::task::579::TaskManager.Task::(_updateState) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::moving from state init -> state preparing
>Thread-830::INFO::2014-04-10 16:49:21,500::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-830::DEBUG::2014-04-10 16:49:21,501::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebb74833-ca40-4918-a0eb-0a1b2aca2e53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-830::DEBUG::2014-04-10 16:49:21,501::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-830::DEBUG::2014-04-10 16:49:21,501::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-830::DEBUG::2014-04-10 16:49:21,501::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebb74833-ca40-4918-a0eb-0a1b2aca2e53`::Granted request
>Thread-830::DEBUG::2014-04-10 16:49:21,502::task::811::TaskManager.Task::(resourceAcquired) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-830::DEBUG::2014-04-10 16:49:21,502::task::974::TaskManager.Task::(_decref) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::ref 1 aborting False
>Thread-830::INFO::2014-04-10 16:49:21,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-830::DEBUG::2014-04-10 16:49:21,504::task::1168::TaskManager.Task::(prepare) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-830::DEBUG::2014-04-10 16:49:21,504::task::579::TaskManager.Task::(_updateState) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::moving from state preparing -> state finished
>Thread-830::DEBUG::2014-04-10 16:49:21,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-830::DEBUG::2014-04-10 16:49:21,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-830::DEBUG::2014-04-10 16:49:21,505::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-830::DEBUG::2014-04-10 16:49:21,505::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-830::DEBUG::2014-04-10 16:49:21,505::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-830::DEBUG::2014-04-10 16:49:21,505::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-830::DEBUG::2014-04-10 16:49:21,505::task::974::TaskManager.Task::(_decref) Task=`593e053b-d1fd-4446-b044-e652cda43f8d`::ref 0 aborting False
>Thread-831::DEBUG::2014-04-10 16:49:22,068::task::579::TaskManager.Task::(_updateState) Task=`4313ea28-bb30-4116-a458-6ba20e22b944`::moving from state init -> state preparing
>Thread-831::INFO::2014-04-10 16:49:22,069::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-831::INFO::2014-04-10 16:49:22,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '81.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261882', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020473', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.2', 'valid': False}}
>Thread-831::DEBUG::2014-04-10 16:49:22,069::task::1168::TaskManager.Task::(prepare) Task=`4313ea28-bb30-4116-a458-6ba20e22b944`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '81.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261882', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00020473', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.2', 'valid': False}}
>Thread-831::DEBUG::2014-04-10 16:49:22,069::task::579::TaskManager.Task::(_updateState) Task=`4313ea28-bb30-4116-a458-6ba20e22b944`::moving from state preparing -> state finished
>Thread-831::DEBUG::2014-04-10 16:49:22,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-831::DEBUG::2014-04-10 16:49:22,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-831::DEBUG::2014-04-10 16:49:22,070::task::974::TaskManager.Task::(_decref) Task=`4313ea28-bb30-4116-a458-6ba20e22b944`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:49:24,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:49:24,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000257483 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:49:24,954::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:24,971::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000226436 s, 3.0 MB/s\n'; <rc> = 0
>Thread-840::DEBUG::2014-04-10 16:49:31,598::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-840::DEBUG::2014-04-10 16:49:31,599::task::579::TaskManager.Task::(_updateState) Task=`6efe1376-8294-4c32-ba68-092512331485`::moving from state init -> state preparing
>Thread-840::INFO::2014-04-10 16:49:31,599::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-840::INFO::2014-04-10 16:49:31,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-840::DEBUG::2014-04-10 16:49:31,600::task::1168::TaskManager.Task::(prepare) Task=`6efe1376-8294-4c32-ba68-092512331485`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-840::DEBUG::2014-04-10 16:49:31,600::task::579::TaskManager.Task::(_updateState) Task=`6efe1376-8294-4c32-ba68-092512331485`::moving from state preparing -> state finished
>Thread-840::DEBUG::2014-04-10 16:49:31,600::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-840::DEBUG::2014-04-10 16:49:31,600::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-840::DEBUG::2014-04-10 16:49:31,600::task::974::TaskManager.Task::(_decref) Task=`6efe1376-8294-4c32-ba68-092512331485`::ref 0 aborting False
>Thread-841::DEBUG::2014-04-10 16:49:31,607::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-841::DEBUG::2014-04-10 16:49:31,607::task::579::TaskManager.Task::(_updateState) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::moving from state init -> state preparing
>Thread-841::INFO::2014-04-10 16:49:31,607::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-841::DEBUG::2014-04-10 16:49:31,608::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`96a30209-e7e2-4728-892d-2701976ad1e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-841::DEBUG::2014-04-10 16:49:31,608::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-841::DEBUG::2014-04-10 16:49:31,608::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-841::DEBUG::2014-04-10 16:49:31,608::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`96a30209-e7e2-4728-892d-2701976ad1e8`::Granted request
>Thread-841::DEBUG::2014-04-10 16:49:31,608::task::811::TaskManager.Task::(resourceAcquired) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-841::DEBUG::2014-04-10 16:49:31,609::task::974::TaskManager.Task::(_decref) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::ref 1 aborting False
>Thread-841::INFO::2014-04-10 16:49:31,611::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-841::DEBUG::2014-04-10 16:49:31,611::task::1168::TaskManager.Task::(prepare) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-841::DEBUG::2014-04-10 16:49:31,611::task::579::TaskManager.Task::(_updateState) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::moving from state preparing -> state finished
>Thread-841::DEBUG::2014-04-10 16:49:31,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-841::DEBUG::2014-04-10 16:49:31,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-841::DEBUG::2014-04-10 16:49:31,612::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-841::DEBUG::2014-04-10 16:49:31,612::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-841::DEBUG::2014-04-10 16:49:31,612::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-841::DEBUG::2014-04-10 16:49:31,612::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-841::DEBUG::2014-04-10 16:49:31,612::task::974::TaskManager.Task::(_decref) Task=`70fd8135-b95a-47eb-91fd-6d88d76b3cae`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:49:34,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:49:34,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026913 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:49:35,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:35,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000219607 s, 3.1 MB/s\n'; <rc> = 0
>Thread-843::DEBUG::2014-04-10 16:49:37,228::task::579::TaskManager.Task::(_updateState) Task=`88a17af6-545e-4035-94c1-3215e9d82993`::moving from state init -> state preparing
>Thread-843::INFO::2014-04-10 16:49:37,228::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-843::INFO::2014-04-10 16:49:37,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '96.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026913', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219607', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.4', 'valid': False}}
>Thread-843::DEBUG::2014-04-10 16:49:37,228::task::1168::TaskManager.Task::(prepare) Task=`88a17af6-545e-4035-94c1-3215e9d82993`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '96.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026913', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219607', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.4', 'valid': False}}
>Thread-843::DEBUG::2014-04-10 16:49:37,229::task::579::TaskManager.Task::(_updateState) Task=`88a17af6-545e-4035-94c1-3215e9d82993`::moving from state preparing -> state finished
>Thread-843::DEBUG::2014-04-10 16:49:37,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-843::DEBUG::2014-04-10 16:49:37,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-843::DEBUG::2014-04-10 16:49:37,229::task::974::TaskManager.Task::(_decref) Task=`88a17af6-545e-4035-94c1-3215e9d82993`::ref 0 aborting False
>Thread-846::DEBUG::2014-04-10 16:49:41,671::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-846::DEBUG::2014-04-10 16:49:41,672::task::579::TaskManager.Task::(_updateState) Task=`bdd550cc-5c6d-4b59-8cfa-b6aff93be708`::moving from state init -> state preparing
>Thread-846::INFO::2014-04-10 16:49:41,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-846::INFO::2014-04-10 16:49:41,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-846::DEBUG::2014-04-10 16:49:41,672::task::1168::TaskManager.Task::(prepare) Task=`bdd550cc-5c6d-4b59-8cfa-b6aff93be708`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-846::DEBUG::2014-04-10 16:49:41,673::task::579::TaskManager.Task::(_updateState) Task=`bdd550cc-5c6d-4b59-8cfa-b6aff93be708`::moving from state preparing -> state finished
>Thread-846::DEBUG::2014-04-10 16:49:41,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-846::DEBUG::2014-04-10 16:49:41,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-846::DEBUG::2014-04-10 16:49:41,673::task::974::TaskManager.Task::(_decref) Task=`bdd550cc-5c6d-4b59-8cfa-b6aff93be708`::ref 0 aborting False
>Thread-847::DEBUG::2014-04-10 16:49:41,680::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-847::DEBUG::2014-04-10 16:49:41,680::task::579::TaskManager.Task::(_updateState) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::moving from state init -> state preparing
>Thread-847::INFO::2014-04-10 16:49:41,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-847::DEBUG::2014-04-10 16:49:41,681::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`984ec983-b36e-4fe1-9ea7-68932bc06658`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-847::DEBUG::2014-04-10 16:49:41,681::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-847::DEBUG::2014-04-10 16:49:41,681::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-847::DEBUG::2014-04-10 16:49:41,681::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`984ec983-b36e-4fe1-9ea7-68932bc06658`::Granted request
>Thread-847::DEBUG::2014-04-10 16:49:41,682::task::811::TaskManager.Task::(resourceAcquired) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-847::DEBUG::2014-04-10 16:49:41,682::task::974::TaskManager.Task::(_decref) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::ref 1 aborting False
>Thread-847::INFO::2014-04-10 16:49:41,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-847::DEBUG::2014-04-10 16:49:41,684::task::1168::TaskManager.Task::(prepare) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-847::DEBUG::2014-04-10 16:49:41,684::task::579::TaskManager.Task::(_updateState) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::moving from state preparing -> state finished
>Thread-847::DEBUG::2014-04-10 16:49:41,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-847::DEBUG::2014-04-10 16:49:41,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-847::DEBUG::2014-04-10 16:49:41,685::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-847::DEBUG::2014-04-10 16:49:41,685::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-847::DEBUG::2014-04-10 16:49:41,685::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-847::DEBUG::2014-04-10 16:49:41,685::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-847::DEBUG::2014-04-10 16:49:41,686::task::974::TaskManager.Task::(_decref) Task=`f60cf04c-95e1-4272-bb15-9ca32b937ab8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:49:45,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:49:45,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000268096 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:49:45,066::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:45,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044992 s, 1.5 MB/s\n'; <rc> = 0
>Thread-851::DEBUG::2014-04-10 16:49:51,770::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-851::DEBUG::2014-04-10 16:49:51,771::task::579::TaskManager.Task::(_updateState) Task=`a9f23904-1947-4450-8883-0b8f70c56131`::moving from state init -> state preparing
>Thread-851::INFO::2014-04-10 16:49:51,771::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-851::INFO::2014-04-10 16:49:51,772::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-851::DEBUG::2014-04-10 16:49:51,772::task::1168::TaskManager.Task::(prepare) Task=`a9f23904-1947-4450-8883-0b8f70c56131`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-851::DEBUG::2014-04-10 16:49:51,772::task::579::TaskManager.Task::(_updateState) Task=`a9f23904-1947-4450-8883-0b8f70c56131`::moving from state preparing -> state finished
>Thread-851::DEBUG::2014-04-10 16:49:51,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-851::DEBUG::2014-04-10 16:49:51,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-851::DEBUG::2014-04-10 16:49:51,773::task::974::TaskManager.Task::(_decref) Task=`a9f23904-1947-4450-8883-0b8f70c56131`::ref 0 aborting False
>Thread-852::DEBUG::2014-04-10 16:49:51,780::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-852::DEBUG::2014-04-10 16:49:51,780::task::579::TaskManager.Task::(_updateState) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::moving from state init -> state preparing
>Thread-852::INFO::2014-04-10 16:49:51,780::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-852::DEBUG::2014-04-10 16:49:51,781::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b661f41-bbef-48ec-8837-c5a07d401cfd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-852::DEBUG::2014-04-10 16:49:51,781::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-852::DEBUG::2014-04-10 16:49:51,781::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-852::DEBUG::2014-04-10 16:49:51,782::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b661f41-bbef-48ec-8837-c5a07d401cfd`::Granted request
>Thread-852::DEBUG::2014-04-10 16:49:51,782::task::811::TaskManager.Task::(resourceAcquired) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-852::DEBUG::2014-04-10 16:49:51,782::task::974::TaskManager.Task::(_decref) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::ref 1 aborting False
>Thread-852::INFO::2014-04-10 16:49:51,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-852::DEBUG::2014-04-10 16:49:51,785::task::1168::TaskManager.Task::(prepare) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-852::DEBUG::2014-04-10 16:49:51,785::task::579::TaskManager.Task::(_updateState) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::moving from state preparing -> state finished
>Thread-852::DEBUG::2014-04-10 16:49:51,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-852::DEBUG::2014-04-10 16:49:51,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-852::DEBUG::2014-04-10 16:49:51,786::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-852::DEBUG::2014-04-10 16:49:51,786::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-852::DEBUG::2014-04-10 16:49:51,787::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-852::DEBUG::2014-04-10 16:49:51,787::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-852::DEBUG::2014-04-10 16:49:51,787::task::974::TaskManager.Task::(_decref) Task=`1a2e5ece-f1f3-4714-a252-dabb81a67fd3`::ref 0 aborting False
>Thread-853::DEBUG::2014-04-10 16:49:52,759::task::579::TaskManager.Task::(_updateState) Task=`53855b5f-f347-45a3-93fc-4ae3fc4efada`::moving from state init -> state preparing
>Thread-853::INFO::2014-04-10 16:49:52,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-853::INFO::2014-04-10 16:49:52,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '112.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268096', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044992', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}}
>Thread-853::DEBUG::2014-04-10 16:49:52,760::task::1168::TaskManager.Task::(prepare) Task=`53855b5f-f347-45a3-93fc-4ae3fc4efada`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '112.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268096', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044992', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '37.9', 'valid': False}}
>Thread-853::DEBUG::2014-04-10 16:49:52,760::task::579::TaskManager.Task::(_updateState) Task=`53855b5f-f347-45a3-93fc-4ae3fc4efada`::moving from state preparing -> state finished
>Thread-853::DEBUG::2014-04-10 16:49:52,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-853::DEBUG::2014-04-10 16:49:52,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-853::DEBUG::2014-04-10 16:49:52,760::task::974::TaskManager.Task::(_decref) Task=`53855b5f-f347-45a3-93fc-4ae3fc4efada`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:49:55,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:49:55,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267878 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:49:55,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:49:55,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244242 s, 2.7 MB/s\n'; <rc> = 0
>Thread-857::DEBUG::2014-04-10 16:49:59,466::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2194e9d0]
>Thread-857::DEBUG::2014-04-10 16:49:59,467::task::579::TaskManager.Task::(_updateState) Task=`d7442fe2-45a6-4777-8890-311b601eef14`::moving from state init -> state preparing
>Thread-857::INFO::2014-04-10 16:49:59,467::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}], options=None)
>Thread-857::DEBUG::2014-04-10 16:49:59,469::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2
>Thread-812::WARNING::2014-04-10 16:50:00,481::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-812::DEBUG::2014-04-10 16:50:00,484::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-814::WARNING::2014-04-10 16:50:00,492::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-467::ERROR::2014-04-10 16:50:00,493::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::ERROR::2014-04-10 16:50:00,493::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-858::DEBUG::2014-04-10 16:50:02,246::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-858::DEBUG::2014-04-10 16:50:02,251::task::579::TaskManager.Task::(_updateState) Task=`70aeb7f4-4032-4c66-a1b2-a46d81ebc898`::moving from state init -> state preparing
>Thread-858::INFO::2014-04-10 16:50:02,251::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-858::INFO::2014-04-10 16:50:02,251::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-858::DEBUG::2014-04-10 16:50:02,251::task::1168::TaskManager.Task::(prepare) Task=`70aeb7f4-4032-4c66-a1b2-a46d81ebc898`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-858::DEBUG::2014-04-10 16:50:02,252::task::579::TaskManager.Task::(_updateState) Task=`70aeb7f4-4032-4c66-a1b2-a46d81ebc898`::moving from state preparing -> state finished
>Thread-858::DEBUG::2014-04-10 16:50:02,252::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-858::DEBUG::2014-04-10 16:50:02,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-858::DEBUG::2014-04-10 16:50:02,252::task::974::TaskManager.Task::(_decref) Task=`70aeb7f4-4032-4c66-a1b2-a46d81ebc898`::ref 0 aborting False
>Thread-860::DEBUG::2014-04-10 16:50:02,260::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-860::DEBUG::2014-04-10 16:50:02,261::task::579::TaskManager.Task::(_updateState) Task=`0667f519-9c35-4050-871a-137a04844453`::moving from state init -> state preparing
>Thread-860::INFO::2014-04-10 16:50:02,261::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-860::DEBUG::2014-04-10 16:50:02,262::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c574b2dd-d2e6-44af-8b60-9df86e9bfa43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-860::DEBUG::2014-04-10 16:50:02,262::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-860::DEBUG::2014-04-10 16:50:02,262::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-860::DEBUG::2014-04-10 16:50:02,262::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c574b2dd-d2e6-44af-8b60-9df86e9bfa43`::Granted request
>Thread-860::DEBUG::2014-04-10 16:50:02,263::task::811::TaskManager.Task::(resourceAcquired) Task=`0667f519-9c35-4050-871a-137a04844453`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-860::DEBUG::2014-04-10 16:50:02,263::task::974::TaskManager.Task::(_decref) Task=`0667f519-9c35-4050-871a-137a04844453`::ref 1 aborting False
>Thread-860::INFO::2014-04-10 16:50:02,265::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-860::DEBUG::2014-04-10 16:50:02,265::task::1168::TaskManager.Task::(prepare) Task=`0667f519-9c35-4050-871a-137a04844453`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-860::DEBUG::2014-04-10 16:50:02,265::task::579::TaskManager.Task::(_updateState) Task=`0667f519-9c35-4050-871a-137a04844453`::moving from state preparing -> state finished
>Thread-860::DEBUG::2014-04-10 16:50:02,265::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-860::DEBUG::2014-04-10 16:50:02,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-860::DEBUG::2014-04-10 16:50:02,266::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-860::DEBUG::2014-04-10 16:50:02,266::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-860::DEBUG::2014-04-10 16:50:02,266::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-860::DEBUG::2014-04-10 16:50:02,266::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-860::DEBUG::2014-04-10 16:50:02,266::task::974::TaskManager.Task::(_decref) Task=`0667f519-9c35-4050-871a-137a04844453`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:50:05,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:05,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000249342 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:05,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:05,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000207799 s, 3.2 MB/s\n'; <rc> = 0
>Thread-862::DEBUG::2014-04-10 16:50:08,296::task::579::TaskManager.Task::(_updateState) Task=`7522b2fb-4e58-412d-8d66-25cc69a1f584`::moving from state init -> state preparing
>Thread-862::INFO::2014-04-10 16:50:08,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-862::INFO::2014-04-10 16:50:08,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249342', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000207799', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.4', 'valid': False}}
>Thread-862::DEBUG::2014-04-10 16:50:08,297::task::1168::TaskManager.Task::(prepare) Task=`7522b2fb-4e58-412d-8d66-25cc69a1f584`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '7.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249342', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000207799', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.4', 'valid': False}}
>Thread-862::DEBUG::2014-04-10 16:50:08,297::task::579::TaskManager.Task::(_updateState) Task=`7522b2fb-4e58-412d-8d66-25cc69a1f584`::moving from state preparing -> state finished
>Thread-862::DEBUG::2014-04-10 16:50:08,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-862::DEBUG::2014-04-10 16:50:08,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-862::DEBUG::2014-04-10 16:50:08,297::task::974::TaskManager.Task::(_decref) Task=`7522b2fb-4e58-412d-8d66-25cc69a1f584`::ref 0 aborting False
>Thread-869::DEBUG::2014-04-10 16:50:12,333::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-869::DEBUG::2014-04-10 16:50:12,334::task::579::TaskManager.Task::(_updateState) Task=`34998d94-7857-4fa3-8791-7d7d326597be`::moving from state init -> state preparing
>Thread-869::INFO::2014-04-10 16:50:12,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-869::INFO::2014-04-10 16:50:12,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-869::DEBUG::2014-04-10 16:50:12,335::task::1168::TaskManager.Task::(prepare) Task=`34998d94-7857-4fa3-8791-7d7d326597be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-869::DEBUG::2014-04-10 16:50:12,335::task::579::TaskManager.Task::(_updateState) Task=`34998d94-7857-4fa3-8791-7d7d326597be`::moving from state preparing -> state finished
>Thread-869::DEBUG::2014-04-10 16:50:12,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-869::DEBUG::2014-04-10 16:50:12,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-869::DEBUG::2014-04-10 16:50:12,335::task::974::TaskManager.Task::(_decref) Task=`34998d94-7857-4fa3-8791-7d7d326597be`::ref 0 aborting False
>Thread-870::DEBUG::2014-04-10 16:50:12,342::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-870::DEBUG::2014-04-10 16:50:12,342::task::579::TaskManager.Task::(_updateState) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::moving from state init -> state preparing
>Thread-870::INFO::2014-04-10 16:50:12,342::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-870::DEBUG::2014-04-10 16:50:12,343::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a0ca1fbf-7fcc-4157-88b7-0fcb850601a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-870::DEBUG::2014-04-10 16:50:12,343::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-870::DEBUG::2014-04-10 16:50:12,343::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-870::DEBUG::2014-04-10 16:50:12,343::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a0ca1fbf-7fcc-4157-88b7-0fcb850601a6`::Granted request
>Thread-870::DEBUG::2014-04-10 16:50:12,344::task::811::TaskManager.Task::(resourceAcquired) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-870::DEBUG::2014-04-10 16:50:12,344::task::974::TaskManager.Task::(_decref) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::ref 1 aborting False
>Thread-870::INFO::2014-04-10 16:50:12,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081613312', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081613312', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-870::DEBUG::2014-04-10 16:50:12,346::task::1168::TaskManager.Task::(prepare) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081613312', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081613312', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-870::DEBUG::2014-04-10 16:50:12,346::task::579::TaskManager.Task::(_updateState) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::moving from state preparing -> state finished
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-870::DEBUG::2014-04-10 16:50:12,347::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-870::DEBUG::2014-04-10 16:50:12,348::task::974::TaskManager.Task::(_decref) Task=`4986d380-e82a-48ab-b15f-9bee062f1efc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:50:15,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:15,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244445 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:15,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:15,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276298 s, 2.4 MB/s\n'; <rc> = 0
>Thread-874::DEBUG::2014-04-10 16:50:22,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-874::DEBUG::2014-04-10 16:50:22,416::task::579::TaskManager.Task::(_updateState) Task=`16363c19-c789-4d85-ba29-117d52fa48be`::moving from state init -> state preparing
>Thread-874::INFO::2014-04-10 16:50:22,416::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-874::INFO::2014-04-10 16:50:22,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-874::DEBUG::2014-04-10 16:50:22,417::task::1168::TaskManager.Task::(prepare) Task=`16363c19-c789-4d85-ba29-117d52fa48be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-874::DEBUG::2014-04-10 16:50:22,417::task::579::TaskManager.Task::(_updateState) Task=`16363c19-c789-4d85-ba29-117d52fa48be`::moving from state preparing -> state finished
>Thread-874::DEBUG::2014-04-10 16:50:22,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-874::DEBUG::2014-04-10 16:50:22,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-874::DEBUG::2014-04-10 16:50:22,418::task::974::TaskManager.Task::(_decref) Task=`16363c19-c789-4d85-ba29-117d52fa48be`::ref 0 aborting False
>Thread-875::DEBUG::2014-04-10 16:50:22,425::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-875::DEBUG::2014-04-10 16:50:22,425::task::579::TaskManager.Task::(_updateState) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::moving from state init -> state preparing
>Thread-875::INFO::2014-04-10 16:50:22,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-875::DEBUG::2014-04-10 16:50:22,426::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74d3a072-23bd-42e1-8971-3b636847ad8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-875::DEBUG::2014-04-10 16:50:22,426::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-875::DEBUG::2014-04-10 16:50:22,427::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-875::DEBUG::2014-04-10 16:50:22,427::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74d3a072-23bd-42e1-8971-3b636847ad8f`::Granted request
>Thread-875::DEBUG::2014-04-10 16:50:22,427::task::811::TaskManager.Task::(resourceAcquired) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-875::DEBUG::2014-04-10 16:50:22,427::task::974::TaskManager.Task::(_decref) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::ref 1 aborting False
>Thread-875::INFO::2014-04-10 16:50:22,430::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-875::DEBUG::2014-04-10 16:50:22,431::task::1168::TaskManager.Task::(prepare) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-875::DEBUG::2014-04-10 16:50:22,431::task::579::TaskManager.Task::(_updateState) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::moving from state preparing -> state finished
>Thread-875::DEBUG::2014-04-10 16:50:22,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-875::DEBUG::2014-04-10 16:50:22,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-875::DEBUG::2014-04-10 16:50:22,431::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-875::DEBUG::2014-04-10 16:50:22,432::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-875::DEBUG::2014-04-10 16:50:22,432::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-875::DEBUG::2014-04-10 16:50:22,432::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-875::DEBUG::2014-04-10 16:50:22,432::task::974::TaskManager.Task::(_decref) Task=`9b935b51-535d-4c35-a344-e32d98281db0`::ref 0 aborting False
>Thread-876::DEBUG::2014-04-10 16:50:23,467::task::579::TaskManager.Task::(_updateState) Task=`7182ba25-5bf4-42a0-b6b7-1bb88a0202bb`::moving from state init -> state preparing
>Thread-876::INFO::2014-04-10 16:50:23,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-876::INFO::2014-04-10 16:50:23,468::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244445', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276298', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.6', 'valid': False}}
>Thread-876::DEBUG::2014-04-10 16:50:23,468::task::1168::TaskManager.Task::(prepare) Task=`7182ba25-5bf4-42a0-b6b7-1bb88a0202bb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '23.0', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244445', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276298', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.6', 'valid': False}}
>Thread-876::DEBUG::2014-04-10 16:50:23,468::task::579::TaskManager.Task::(_updateState) Task=`7182ba25-5bf4-42a0-b6b7-1bb88a0202bb`::moving from state preparing -> state finished
>Thread-876::DEBUG::2014-04-10 16:50:23,468::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-876::DEBUG::2014-04-10 16:50:23,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-876::DEBUG::2014-04-10 16:50:23,469::task::974::TaskManager.Task::(_decref) Task=`7182ba25-5bf4-42a0-b6b7-1bb88a0202bb`::ref 0 aborting False
>Thread-833::WARNING::2014-04-10 16:50:24,866::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-833::DEBUG::2014-04-10 16:50:24,870::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-835::WARNING::2014-04-10 16:50:24,873::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-469::ERROR::2014-04-10 16:50:24,873::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:50:24,874::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:50:25,220::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 16:50:25,230::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 16:50:25,282::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 16:50:25,286::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 16:50:25,287::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 16:50:25,289::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 16:50:25,293::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 16:50:25,296::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 16:50:25,298::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 16:50:25,299::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 16:50:25,299::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:50:25,302::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:50:25,303::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:50:25,304::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 16:50:25,338::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:25,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:25,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276808 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:25,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000221781 s, 3.0 MB/s\n'; <rc> = 0
>Thread-888::DEBUG::2014-04-10 16:50:32,573::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-888::DEBUG::2014-04-10 16:50:32,573::task::579::TaskManager.Task::(_updateState) Task=`1fa1d315-5fa0-4d77-b72a-0088ff6bdc6b`::moving from state init -> state preparing
>Thread-888::INFO::2014-04-10 16:50:32,574::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-888::INFO::2014-04-10 16:50:32,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-888::DEBUG::2014-04-10 16:50:32,574::task::1168::TaskManager.Task::(prepare) Task=`1fa1d315-5fa0-4d77-b72a-0088ff6bdc6b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-888::DEBUG::2014-04-10 16:50:32,574::task::579::TaskManager.Task::(_updateState) Task=`1fa1d315-5fa0-4d77-b72a-0088ff6bdc6b`::moving from state preparing -> state finished
>Thread-888::DEBUG::2014-04-10 16:50:32,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-888::DEBUG::2014-04-10 16:50:32,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-888::DEBUG::2014-04-10 16:50:32,575::task::974::TaskManager.Task::(_decref) Task=`1fa1d315-5fa0-4d77-b72a-0088ff6bdc6b`::ref 0 aborting False
>Thread-889::DEBUG::2014-04-10 16:50:32,583::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-889::DEBUG::2014-04-10 16:50:32,584::task::579::TaskManager.Task::(_updateState) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::moving from state init -> state preparing
>Thread-889::INFO::2014-04-10 16:50:32,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-889::DEBUG::2014-04-10 16:50:32,586::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`094b6c34-b697-4651-8ebb-615295e0dd0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-889::DEBUG::2014-04-10 16:50:32,586::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-889::DEBUG::2014-04-10 16:50:32,586::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-889::DEBUG::2014-04-10 16:50:32,587::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`094b6c34-b697-4651-8ebb-615295e0dd0a`::Granted request
>Thread-889::DEBUG::2014-04-10 16:50:32,587::task::811::TaskManager.Task::(resourceAcquired) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-889::DEBUG::2014-04-10 16:50:32,587::task::974::TaskManager.Task::(_decref) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::ref 1 aborting False
>Thread-889::INFO::2014-04-10 16:50:32,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-889::DEBUG::2014-04-10 16:50:32,589::task::1168::TaskManager.Task::(prepare) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-889::DEBUG::2014-04-10 16:50:32,590::task::579::TaskManager.Task::(_updateState) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::moving from state preparing -> state finished
>Thread-889::DEBUG::2014-04-10 16:50:32,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-889::DEBUG::2014-04-10 16:50:32,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-889::DEBUG::2014-04-10 16:50:32,590::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-889::DEBUG::2014-04-10 16:50:32,590::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-889::DEBUG::2014-04-10 16:50:32,591::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-889::DEBUG::2014-04-10 16:50:32,591::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-889::DEBUG::2014-04-10 16:50:32,591::task::974::TaskManager.Task::(_decref) Task=`ab46bec1-e6f0-4291-b38e-29d2f87dec43`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:50:35,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:35,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:35,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259164 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:35,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000258228 s, 2.6 MB/s\n'; <rc> = 0
>Thread-896::DEBUG::2014-04-10 16:50:38,622::task::579::TaskManager.Task::(_updateState) Task=`65b99bca-5782-4194-8a49-cfa01b7b7ec4`::moving from state init -> state preparing
>Thread-896::INFO::2014-04-10 16:50:38,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-896::INFO::2014-04-10 16:50:38,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259164', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258228', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.7', 'valid': False}}
>Thread-896::DEBUG::2014-04-10 16:50:38,623::task::1168::TaskManager.Task::(prepare) Task=`65b99bca-5782-4194-8a49-cfa01b7b7ec4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '38.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259164', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258228', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '13.7', 'valid': False}}
>Thread-896::DEBUG::2014-04-10 16:50:38,623::task::579::TaskManager.Task::(_updateState) Task=`65b99bca-5782-4194-8a49-cfa01b7b7ec4`::moving from state preparing -> state finished
>Thread-896::DEBUG::2014-04-10 16:50:38,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-896::DEBUG::2014-04-10 16:50:38,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-896::DEBUG::2014-04-10 16:50:38,623::task::974::TaskManager.Task::(_decref) Task=`65b99bca-5782-4194-8a49-cfa01b7b7ec4`::ref 0 aborting False
>Thread-899::DEBUG::2014-04-10 16:50:42,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-899::DEBUG::2014-04-10 16:50:42,679::task::579::TaskManager.Task::(_updateState) Task=`8ee27215-b27b-43e0-adca-da110fa5ddbb`::moving from state init -> state preparing
>Thread-899::INFO::2014-04-10 16:50:42,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-899::INFO::2014-04-10 16:50:42,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-899::DEBUG::2014-04-10 16:50:42,680::task::1168::TaskManager.Task::(prepare) Task=`8ee27215-b27b-43e0-adca-da110fa5ddbb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-899::DEBUG::2014-04-10 16:50:42,680::task::579::TaskManager.Task::(_updateState) Task=`8ee27215-b27b-43e0-adca-da110fa5ddbb`::moving from state preparing -> state finished
>Thread-899::DEBUG::2014-04-10 16:50:42,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-899::DEBUG::2014-04-10 16:50:42,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-899::DEBUG::2014-04-10 16:50:42,681::task::974::TaskManager.Task::(_decref) Task=`8ee27215-b27b-43e0-adca-da110fa5ddbb`::ref 0 aborting False
>Thread-900::DEBUG::2014-04-10 16:50:42,687::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-900::DEBUG::2014-04-10 16:50:42,688::task::579::TaskManager.Task::(_updateState) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::moving from state init -> state preparing
>Thread-900::INFO::2014-04-10 16:50:42,688::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-900::DEBUG::2014-04-10 16:50:42,689::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`437cca20-d835-4862-8b90-0d8310e6b0eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-900::DEBUG::2014-04-10 16:50:42,689::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-900::DEBUG::2014-04-10 16:50:42,689::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-900::DEBUG::2014-04-10 16:50:42,689::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`437cca20-d835-4862-8b90-0d8310e6b0eb`::Granted request
>Thread-900::DEBUG::2014-04-10 16:50:42,690::task::811::TaskManager.Task::(resourceAcquired) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-900::DEBUG::2014-04-10 16:50:42,690::task::974::TaskManager.Task::(_decref) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::ref 1 aborting False
>Thread-900::INFO::2014-04-10 16:50:42,692::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-900::DEBUG::2014-04-10 16:50:42,693::task::1168::TaskManager.Task::(prepare) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-900::DEBUG::2014-04-10 16:50:42,693::task::579::TaskManager.Task::(_updateState) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::moving from state preparing -> state finished
>Thread-900::DEBUG::2014-04-10 16:50:42,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-900::DEBUG::2014-04-10 16:50:42,693::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-900::DEBUG::2014-04-10 16:50:42,693::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-900::DEBUG::2014-04-10 16:50:42,694::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-900::DEBUG::2014-04-10 16:50:42,694::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-900::DEBUG::2014-04-10 16:50:42,694::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-900::DEBUG::2014-04-10 16:50:42,694::task::974::TaskManager.Task::(_decref) Task=`ba1e032f-ccdf-4fb9-919e-51b8c5f94078`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:50:45,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:45,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:45,497::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267021 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:45,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000219479 s, 3.1 MB/s\n'; <rc> = 0
>Thread-904::DEBUG::2014-04-10 16:50:52,761::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-904::DEBUG::2014-04-10 16:50:52,762::task::579::TaskManager.Task::(_updateState) Task=`cc520300-14e0-4083-a6c1-be40ac26b9ac`::moving from state init -> state preparing
>Thread-904::INFO::2014-04-10 16:50:52,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-904::INFO::2014-04-10 16:50:52,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-904::DEBUG::2014-04-10 16:50:52,763::task::1168::TaskManager.Task::(prepare) Task=`cc520300-14e0-4083-a6c1-be40ac26b9ac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-904::DEBUG::2014-04-10 16:50:52,763::task::579::TaskManager.Task::(_updateState) Task=`cc520300-14e0-4083-a6c1-be40ac26b9ac`::moving from state preparing -> state finished
>Thread-904::DEBUG::2014-04-10 16:50:52,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-904::DEBUG::2014-04-10 16:50:52,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-904::DEBUG::2014-04-10 16:50:52,763::task::974::TaskManager.Task::(_decref) Task=`cc520300-14e0-4083-a6c1-be40ac26b9ac`::ref 0 aborting False
>Thread-905::DEBUG::2014-04-10 16:50:52,770::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-905::DEBUG::2014-04-10 16:50:52,770::task::579::TaskManager.Task::(_updateState) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::moving from state init -> state preparing
>Thread-905::INFO::2014-04-10 16:50:52,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-905::DEBUG::2014-04-10 16:50:52,771::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebb8f27b-9619-42e2-bdce-a396a1eafe90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-905::DEBUG::2014-04-10 16:50:52,771::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-905::DEBUG::2014-04-10 16:50:52,771::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-905::DEBUG::2014-04-10 16:50:52,771::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebb8f27b-9619-42e2-bdce-a396a1eafe90`::Granted request
>Thread-905::DEBUG::2014-04-10 16:50:52,772::task::811::TaskManager.Task::(resourceAcquired) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-905::DEBUG::2014-04-10 16:50:52,772::task::974::TaskManager.Task::(_decref) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::ref 1 aborting False
>Thread-905::INFO::2014-04-10 16:50:52,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-905::DEBUG::2014-04-10 16:50:52,774::task::1168::TaskManager.Task::(prepare) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-905::DEBUG::2014-04-10 16:50:52,774::task::579::TaskManager.Task::(_updateState) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::moving from state preparing -> state finished
>Thread-905::DEBUG::2014-04-10 16:50:52,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-905::DEBUG::2014-04-10 16:50:52,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-905::DEBUG::2014-04-10 16:50:52,775::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-905::DEBUG::2014-04-10 16:50:52,775::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-905::DEBUG::2014-04-10 16:50:52,776::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-905::DEBUG::2014-04-10 16:50:52,776::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-905::DEBUG::2014-04-10 16:50:52,776::task::974::TaskManager.Task::(_decref) Task=`58e7be2f-5ede-4215-ba08-c9cccbf8e2c0`::ref 0 aborting False
>Thread-906::DEBUG::2014-04-10 16:50:53,776::task::579::TaskManager.Task::(_updateState) Task=`eaf7dd64-b0ba-431d-ba29-d4def10e56c6`::moving from state init -> state preparing
>Thread-906::INFO::2014-04-10 16:50:53,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-906::INFO::2014-04-10 16:50:53,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267021', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219479', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '28.9', 'valid': False}}
>Thread-906::DEBUG::2014-04-10 16:50:53,776::task::1168::TaskManager.Task::(prepare) Task=`eaf7dd64-b0ba-431d-ba29-d4def10e56c6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '53.3', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267021', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000219479', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '28.9', 'valid': False}}
>Thread-906::DEBUG::2014-04-10 16:50:53,776::task::579::TaskManager.Task::(_updateState) Task=`eaf7dd64-b0ba-431d-ba29-d4def10e56c6`::moving from state preparing -> state finished
>Thread-906::DEBUG::2014-04-10 16:50:53,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-906::DEBUG::2014-04-10 16:50:53,777::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-906::DEBUG::2014-04-10 16:50:53,777::task::974::TaskManager.Task::(_decref) Task=`eaf7dd64-b0ba-431d-ba29-d4def10e56c6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:50:55,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:50:55,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:50:55,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312051 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:50:55,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000247763 s, 2.7 MB/s\n'; <rc> = 0
>Thread-857::DEBUG::2014-04-10 16:50:59,474::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-857::DEBUG::2014-04-10 16:50:59,474::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-857::INFO::2014-04-10 16:50:59,474::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-857::DEBUG::2014-04-10 16:50:59,475::task::1168::TaskManager.Task::(prepare) Task=`d7442fe2-45a6-4777-8890-311b601eef14`::finished: {'statuslist': [{'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}]}
>Thread-857::DEBUG::2014-04-10 16:50:59,475::task::579::TaskManager.Task::(_updateState) Task=`d7442fe2-45a6-4777-8890-311b601eef14`::moving from state preparing -> state finished
>Thread-857::DEBUG::2014-04-10 16:50:59,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-857::DEBUG::2014-04-10 16:50:59,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-857::DEBUG::2014-04-10 16:50:59,475::task::974::TaskManager.Task::(_decref) Task=`d7442fe2-45a6-4777-8890-311b601eef14`::ref 0 aborting False
>Thread-909::DEBUG::2014-04-10 16:50:59,508::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [19a48c43]
>Thread-909::DEBUG::2014-04-10 16:50:59,508::task::579::TaskManager.Task::(_updateState) Task=`4b96427a-73e1-4d05-a90c-043aa957935d`::moving from state init -> state preparing
>Thread-909::INFO::2014-04-10 16:50:59,509::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-909::DEBUG::2014-04-10 16:50:59,511::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-911::DEBUG::2014-04-10 16:51:03,306::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-911::DEBUG::2014-04-10 16:51:03,307::task::579::TaskManager.Task::(_updateState) Task=`d7d49d3c-2c74-4b5e-b1ea-abab631f0dcc`::moving from state init -> state preparing
>Thread-911::INFO::2014-04-10 16:51:03,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-911::INFO::2014-04-10 16:51:03,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-911::DEBUG::2014-04-10 16:51:03,308::task::1168::TaskManager.Task::(prepare) Task=`d7d49d3c-2c74-4b5e-b1ea-abab631f0dcc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-911::DEBUG::2014-04-10 16:51:03,308::task::579::TaskManager.Task::(_updateState) Task=`d7d49d3c-2c74-4b5e-b1ea-abab631f0dcc`::moving from state preparing -> state finished
>Thread-911::DEBUG::2014-04-10 16:51:03,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-911::DEBUG::2014-04-10 16:51:03,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-911::DEBUG::2014-04-10 16:51:03,309::task::974::TaskManager.Task::(_decref) Task=`d7d49d3c-2c74-4b5e-b1ea-abab631f0dcc`::ref 0 aborting False
>Thread-913::DEBUG::2014-04-10 16:51:03,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-913::DEBUG::2014-04-10 16:51:03,319::task::579::TaskManager.Task::(_updateState) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::moving from state init -> state preparing
>Thread-913::INFO::2014-04-10 16:51:03,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-913::DEBUG::2014-04-10 16:51:03,320::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`313f5a02-0e02-4471-991c-54b9b96cc13a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-913::DEBUG::2014-04-10 16:51:03,320::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-913::DEBUG::2014-04-10 16:51:03,321::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-913::DEBUG::2014-04-10 16:51:03,321::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`313f5a02-0e02-4471-991c-54b9b96cc13a`::Granted request
>Thread-913::DEBUG::2014-04-10 16:51:03,321::task::811::TaskManager.Task::(resourceAcquired) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-913::DEBUG::2014-04-10 16:51:03,321::task::974::TaskManager.Task::(_decref) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::ref 1 aborting False
>Thread-913::INFO::2014-04-10 16:51:03,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-913::DEBUG::2014-04-10 16:51:03,323::task::1168::TaskManager.Task::(prepare) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-913::DEBUG::2014-04-10 16:51:03,324::task::579::TaskManager.Task::(_updateState) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::moving from state preparing -> state finished
>Thread-913::DEBUG::2014-04-10 16:51:03,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-913::DEBUG::2014-04-10 16:51:03,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-913::DEBUG::2014-04-10 16:51:03,324::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-913::DEBUG::2014-04-10 16:51:03,325::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-913::DEBUG::2014-04-10 16:51:03,325::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-913::DEBUG::2014-04-10 16:51:03,325::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-913::DEBUG::2014-04-10 16:51:03,325::task::974::TaskManager.Task::(_decref) Task=`cf55e6a7-55ce-401c-9feb-99db0d84f132`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:51:05,660::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:05,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:05,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354293 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:05,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292357 s, 2.3 MB/s\n'; <rc> = 0
>Thread-915::DEBUG::2014-04-10 16:51:09,356::task::579::TaskManager.Task::(_updateState) Task=`3399f3b7-cd8e-4789-8136-91f7684be993`::moving from state init -> state preparing
>Thread-915::INFO::2014-04-10 16:51:09,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-915::INFO::2014-04-10 16:51:09,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354293', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292357', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.5', 'valid': False}}
>Thread-915::DEBUG::2014-04-10 16:51:09,357::task::1168::TaskManager.Task::(prepare) Task=`3399f3b7-cd8e-4789-8136-91f7684be993`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '68.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354293', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292357', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.5', 'valid': False}}
>Thread-915::DEBUG::2014-04-10 16:51:09,358::task::579::TaskManager.Task::(_updateState) Task=`3399f3b7-cd8e-4789-8136-91f7684be993`::moving from state preparing -> state finished
>Thread-915::DEBUG::2014-04-10 16:51:09,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-915::DEBUG::2014-04-10 16:51:09,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-915::DEBUG::2014-04-10 16:51:09,358::task::974::TaskManager.Task::(_decref) Task=`3399f3b7-cd8e-4789-8136-91f7684be993`::ref 0 aborting False
>Thread-864::WARNING::2014-04-10 16:51:10,513::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-864::DEBUG::2014-04-10 16:51:10,516::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-866::WARNING::2014-04-10 16:51:10,516::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-866::DEBUG::2014-04-10 16:51:10,518::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-467::ERROR::2014-04-10 16:51:10,519::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::ERROR::2014-04-10 16:51:10,519::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-918::DEBUG::2014-04-10 16:51:13,390::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-918::DEBUG::2014-04-10 16:51:13,391::task::579::TaskManager.Task::(_updateState) Task=`1a5829cb-7d5c-4be8-89e6-cf394a8b9e76`::moving from state init -> state preparing
>Thread-918::INFO::2014-04-10 16:51:13,391::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-918::INFO::2014-04-10 16:51:13,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-918::DEBUG::2014-04-10 16:51:13,392::task::1168::TaskManager.Task::(prepare) Task=`1a5829cb-7d5c-4be8-89e6-cf394a8b9e76`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-918::DEBUG::2014-04-10 16:51:13,392::task::579::TaskManager.Task::(_updateState) Task=`1a5829cb-7d5c-4be8-89e6-cf394a8b9e76`::moving from state preparing -> state finished
>Thread-918::DEBUG::2014-04-10 16:51:13,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-918::DEBUG::2014-04-10 16:51:13,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-918::DEBUG::2014-04-10 16:51:13,392::task::974::TaskManager.Task::(_decref) Task=`1a5829cb-7d5c-4be8-89e6-cf394a8b9e76`::ref 0 aborting False
>Thread-919::DEBUG::2014-04-10 16:51:13,400::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-919::DEBUG::2014-04-10 16:51:13,400::task::579::TaskManager.Task::(_updateState) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::moving from state init -> state preparing
>Thread-919::INFO::2014-04-10 16:51:13,400::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-919::DEBUG::2014-04-10 16:51:13,401::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0cc80721-2224-4c12-b3c8-939758fe2941`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-919::DEBUG::2014-04-10 16:51:13,401::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-919::DEBUG::2014-04-10 16:51:13,401::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-919::DEBUG::2014-04-10 16:51:13,401::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0cc80721-2224-4c12-b3c8-939758fe2941`::Granted request
>Thread-919::DEBUG::2014-04-10 16:51:13,402::task::811::TaskManager.Task::(resourceAcquired) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-919::DEBUG::2014-04-10 16:51:13,402::task::974::TaskManager.Task::(_decref) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::ref 1 aborting False
>Thread-919::INFO::2014-04-10 16:51:13,404::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-919::DEBUG::2014-04-10 16:51:13,404::task::1168::TaskManager.Task::(prepare) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-919::DEBUG::2014-04-10 16:51:13,404::task::579::TaskManager.Task::(_updateState) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::moving from state preparing -> state finished
>Thread-919::DEBUG::2014-04-10 16:51:13,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-919::DEBUG::2014-04-10 16:51:13,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-919::DEBUG::2014-04-10 16:51:13,405::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-919::DEBUG::2014-04-10 16:51:13,405::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-919::DEBUG::2014-04-10 16:51:13,405::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-919::DEBUG::2014-04-10 16:51:13,405::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-919::DEBUG::2014-04-10 16:51:13,405::task::974::TaskManager.Task::(_decref) Task=`47d9f39d-cf49-41c9-9712-f13164a1c930`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:51:15,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:15,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:15,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000327678 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:15,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324548 s, 2.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:51:20,520::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-467::DEBUG::2014-04-10 16:51:20,521::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:51:20,521::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-467::DEBUG::2014-04-10 16:51:20,521::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:51:20,521::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:51:20,546::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-467::DEBUG::2014-04-10 16:51:20,546::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-467::DEBUG::2014-04-10 16:51:22,587::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:51:22,680::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:51:22,680::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,681::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,682::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,682::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,682::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,683::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:51:22,683::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-927::DEBUG::2014-04-10 16:51:23,491::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-927::DEBUG::2014-04-10 16:51:23,493::task::579::TaskManager.Task::(_updateState) Task=`6c671418-ed65-4f65-aa9c-a6aa5068298d`::moving from state init -> state preparing
>Thread-927::INFO::2014-04-10 16:51:23,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-927::INFO::2014-04-10 16:51:23,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-927::DEBUG::2014-04-10 16:51:23,494::task::1168::TaskManager.Task::(prepare) Task=`6c671418-ed65-4f65-aa9c-a6aa5068298d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-927::DEBUG::2014-04-10 16:51:23,494::task::579::TaskManager.Task::(_updateState) Task=`6c671418-ed65-4f65-aa9c-a6aa5068298d`::moving from state preparing -> state finished
>Thread-927::DEBUG::2014-04-10 16:51:23,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-927::DEBUG::2014-04-10 16:51:23,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-927::DEBUG::2014-04-10 16:51:23,496::task::974::TaskManager.Task::(_decref) Task=`6c671418-ed65-4f65-aa9c-a6aa5068298d`::ref 0 aborting False
>Thread-928::DEBUG::2014-04-10 16:51:23,504::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-928::DEBUG::2014-04-10 16:51:23,505::task::579::TaskManager.Task::(_updateState) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::moving from state init -> state preparing
>Thread-928::INFO::2014-04-10 16:51:23,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-928::DEBUG::2014-04-10 16:51:23,506::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ed6a721-a785-4907-933e-cc24f798fc3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-928::DEBUG::2014-04-10 16:51:23,507::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-928::DEBUG::2014-04-10 16:51:23,507::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-928::DEBUG::2014-04-10 16:51:23,508::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ed6a721-a785-4907-933e-cc24f798fc3a`::Granted request
>Thread-928::DEBUG::2014-04-10 16:51:23,509::task::811::TaskManager.Task::(resourceAcquired) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-928::DEBUG::2014-04-10 16:51:23,509::task::974::TaskManager.Task::(_decref) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::ref 1 aborting False
>Thread-928::INFO::2014-04-10 16:51:23,515::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-928::DEBUG::2014-04-10 16:51:23,516::task::1168::TaskManager.Task::(prepare) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-928::DEBUG::2014-04-10 16:51:23,516::task::579::TaskManager.Task::(_updateState) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::moving from state preparing -> state finished
>Thread-928::DEBUG::2014-04-10 16:51:23,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-928::DEBUG::2014-04-10 16:51:23,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-928::DEBUG::2014-04-10 16:51:23,517::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-928::DEBUG::2014-04-10 16:51:23,518::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-928::DEBUG::2014-04-10 16:51:23,519::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-928::DEBUG::2014-04-10 16:51:23,519::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-928::DEBUG::2014-04-10 16:51:23,519::task::974::TaskManager.Task::(_decref) Task=`9bfd17b5-e05a-475e-bb2f-efb973496911`::ref 0 aborting False
>Thread-929::DEBUG::2014-04-10 16:51:24,565::task::579::TaskManager.Task::(_updateState) Task=`d30f29c0-83a2-434d-a158-9fc73cda7a72`::moving from state init -> state preparing
>Thread-929::INFO::2014-04-10 16:51:24,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-929::INFO::2014-04-10 16:51:24,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '14.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327678', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324548', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.7', 'valid': False}}
>Thread-929::DEBUG::2014-04-10 16:51:24,591::task::1168::TaskManager.Task::(prepare) Task=`d30f29c0-83a2-434d-a158-9fc73cda7a72`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '14.1', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327678', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324548', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.7', 'valid': False}}
>Thread-929::DEBUG::2014-04-10 16:51:24,597::task::579::TaskManager.Task::(_updateState) Task=`d30f29c0-83a2-434d-a158-9fc73cda7a72`::moving from state preparing -> state finished
>Thread-929::DEBUG::2014-04-10 16:51:24,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-929::DEBUG::2014-04-10 16:51:24,609::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-929::DEBUG::2014-04-10 16:51:24,616::task::974::TaskManager.Task::(_decref) Task=`d30f29c0-83a2-434d-a158-9fc73cda7a72`::ref 0 aborting False
>Thread-878::WARNING::2014-04-10 16:51:25,228::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-878::DEBUG::2014-04-10 16:51:25,239::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-880::WARNING::2014-04-10 16:51:25,244::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-880::DEBUG::2014-04-10 16:51:25,252::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-882::WARNING::2014-04-10 16:51:25,271::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-882::DEBUG::2014-04-10 16:51:25,275::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-884::WARNING::2014-04-10 16:51:25,276::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-884::DEBUG::2014-04-10 16:51:25,278::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-466::DEBUG::2014-04-10 16:51:25,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:25,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000634303 s, 1.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:25,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:25,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000217266 s, 3.1 MB/s\n'; <rc> = 0
>Thread-933::DEBUG::2014-04-10 16:51:33,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-933::DEBUG::2014-04-10 16:51:33,591::task::579::TaskManager.Task::(_updateState) Task=`92e9d9bf-9568-4103-99eb-3acfb9ae41e0`::moving from state init -> state preparing
>Thread-933::INFO::2014-04-10 16:51:33,591::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-933::INFO::2014-04-10 16:51:33,592::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-933::DEBUG::2014-04-10 16:51:33,592::task::1168::TaskManager.Task::(prepare) Task=`92e9d9bf-9568-4103-99eb-3acfb9ae41e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-933::DEBUG::2014-04-10 16:51:33,592::task::579::TaskManager.Task::(_updateState) Task=`92e9d9bf-9568-4103-99eb-3acfb9ae41e0`::moving from state preparing -> state finished
>Thread-933::DEBUG::2014-04-10 16:51:33,593::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-933::DEBUG::2014-04-10 16:51:33,593::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-933::DEBUG::2014-04-10 16:51:33,593::task::974::TaskManager.Task::(_decref) Task=`92e9d9bf-9568-4103-99eb-3acfb9ae41e0`::ref 0 aborting False
>Thread-934::DEBUG::2014-04-10 16:51:33,600::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-934::DEBUG::2014-04-10 16:51:33,600::task::579::TaskManager.Task::(_updateState) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::moving from state init -> state preparing
>Thread-934::INFO::2014-04-10 16:51:33,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-934::DEBUG::2014-04-10 16:51:33,601::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`512d33a8-ef89-432c-90e2-1ca9cb5aeb10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-934::DEBUG::2014-04-10 16:51:33,601::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-934::DEBUG::2014-04-10 16:51:33,601::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-934::DEBUG::2014-04-10 16:51:33,602::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`512d33a8-ef89-432c-90e2-1ca9cb5aeb10`::Granted request
>Thread-934::DEBUG::2014-04-10 16:51:33,602::task::811::TaskManager.Task::(resourceAcquired) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-934::DEBUG::2014-04-10 16:51:33,602::task::974::TaskManager.Task::(_decref) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::ref 1 aborting False
>Thread-934::INFO::2014-04-10 16:51:33,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-934::DEBUG::2014-04-10 16:51:33,605::task::1168::TaskManager.Task::(prepare) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-934::DEBUG::2014-04-10 16:51:33,605::task::579::TaskManager.Task::(_updateState) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::moving from state preparing -> state finished
>Thread-934::DEBUG::2014-04-10 16:51:33,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-934::DEBUG::2014-04-10 16:51:33,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-934::DEBUG::2014-04-10 16:51:33,606::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-934::DEBUG::2014-04-10 16:51:33,606::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-934::DEBUG::2014-04-10 16:51:33,606::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-934::DEBUG::2014-04-10 16:51:33,606::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-934::DEBUG::2014-04-10 16:51:33,607::task::974::TaskManager.Task::(_decref) Task=`ac6afd77-abeb-4565-af58-9d3914018919`::ref 0 aborting False
>Thread-891::WARNING::2014-04-10 16:51:34,894::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-893::WARNING::2014-04-10 16:51:34,897::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-891::DEBUG::2014-04-10 16:51:34,897::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-893::DEBUG::2014-04-10 16:51:34,899::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:51:34,900::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:51:34,900::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:51:35,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:35,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:35,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304473 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:35,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024593 s, 2.7 MB/s\n'; <rc> = 0
>Thread-937::DEBUG::2014-04-10 16:51:39,945::task::579::TaskManager.Task::(_updateState) Task=`69c06b1e-c509-46c8-ad39-50af5a6855d3`::moving from state init -> state preparing
>Thread-937::INFO::2014-04-10 16:51:39,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-937::INFO::2014-04-10 16:51:39,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304473', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024593', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '5.0', 'valid': False}}
>Thread-937::DEBUG::2014-04-10 16:51:39,946::task::1168::TaskManager.Task::(prepare) Task=`69c06b1e-c509-46c8-ad39-50af5a6855d3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '29.4', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304473', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024593', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '5.0', 'valid': False}}
>Thread-937::DEBUG::2014-04-10 16:51:39,946::task::579::TaskManager.Task::(_updateState) Task=`69c06b1e-c509-46c8-ad39-50af5a6855d3`::moving from state preparing -> state finished
>Thread-937::DEBUG::2014-04-10 16:51:39,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-937::DEBUG::2014-04-10 16:51:39,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-937::DEBUG::2014-04-10 16:51:39,947::task::974::TaskManager.Task::(_decref) Task=`69c06b1e-c509-46c8-ad39-50af5a6855d3`::ref 0 aborting False
>Thread-940::DEBUG::2014-04-10 16:51:44,107::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-940::DEBUG::2014-04-10 16:51:44,107::task::579::TaskManager.Task::(_updateState) Task=`200019c1-edea-45df-83e0-a088ac897504`::moving from state init -> state preparing
>Thread-940::INFO::2014-04-10 16:51:44,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-940::INFO::2014-04-10 16:51:44,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-940::DEBUG::2014-04-10 16:51:44,108::task::1168::TaskManager.Task::(prepare) Task=`200019c1-edea-45df-83e0-a088ac897504`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-940::DEBUG::2014-04-10 16:51:44,108::task::579::TaskManager.Task::(_updateState) Task=`200019c1-edea-45df-83e0-a088ac897504`::moving from state preparing -> state finished
>Thread-940::DEBUG::2014-04-10 16:51:44,108::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-940::DEBUG::2014-04-10 16:51:44,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-940::DEBUG::2014-04-10 16:51:44,108::task::974::TaskManager.Task::(_decref) Task=`200019c1-edea-45df-83e0-a088ac897504`::ref 0 aborting False
>Thread-941::DEBUG::2014-04-10 16:51:44,115::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-941::DEBUG::2014-04-10 16:51:44,116::task::579::TaskManager.Task::(_updateState) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::moving from state init -> state preparing
>Thread-941::INFO::2014-04-10 16:51:44,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-941::DEBUG::2014-04-10 16:51:44,116::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c0d99d10-15b6-4d30-aab0-386c47833efc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-941::DEBUG::2014-04-10 16:51:44,116::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-941::DEBUG::2014-04-10 16:51:44,117::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-941::DEBUG::2014-04-10 16:51:44,118::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c0d99d10-15b6-4d30-aab0-386c47833efc`::Granted request
>Thread-941::DEBUG::2014-04-10 16:51:44,118::task::811::TaskManager.Task::(resourceAcquired) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-941::DEBUG::2014-04-10 16:51:44,118::task::974::TaskManager.Task::(_decref) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::ref 1 aborting False
>Thread-941::INFO::2014-04-10 16:51:44,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-941::DEBUG::2014-04-10 16:51:44,121::task::1168::TaskManager.Task::(prepare) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-941::DEBUG::2014-04-10 16:51:44,121::task::579::TaskManager.Task::(_updateState) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::moving from state preparing -> state finished
>Thread-941::DEBUG::2014-04-10 16:51:44,121::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-941::DEBUG::2014-04-10 16:51:44,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-941::DEBUG::2014-04-10 16:51:44,121::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-941::DEBUG::2014-04-10 16:51:44,122::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-941::DEBUG::2014-04-10 16:51:44,122::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-941::DEBUG::2014-04-10 16:51:44,122::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-941::DEBUG::2014-04-10 16:51:44,122::task::974::TaskManager.Task::(_decref) Task=`0772b9ba-59ec-41ba-8e0c-cc72c8173dfc`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:51:44,901::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-466::DEBUG::2014-04-10 16:51:46,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:46,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:46,074::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377633 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:46,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348008 s, 1.9 MB/s\n'; <rc> = 0
>Thread-949::DEBUG::2014-04-10 16:51:54,186::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-949::DEBUG::2014-04-10 16:51:54,187::task::579::TaskManager.Task::(_updateState) Task=`74f6fe41-a768-4243-8354-f2bd8ce52067`::moving from state init -> state preparing
>Thread-949::INFO::2014-04-10 16:51:54,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-949::INFO::2014-04-10 16:51:54,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-949::DEBUG::2014-04-10 16:51:54,187::task::1168::TaskManager.Task::(prepare) Task=`74f6fe41-a768-4243-8354-f2bd8ce52067`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-949::DEBUG::2014-04-10 16:51:54,187::task::579::TaskManager.Task::(_updateState) Task=`74f6fe41-a768-4243-8354-f2bd8ce52067`::moving from state preparing -> state finished
>Thread-949::DEBUG::2014-04-10 16:51:54,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-949::DEBUG::2014-04-10 16:51:54,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-949::DEBUG::2014-04-10 16:51:54,188::task::974::TaskManager.Task::(_decref) Task=`74f6fe41-a768-4243-8354-f2bd8ce52067`::ref 0 aborting False
>Thread-950::DEBUG::2014-04-10 16:51:54,194::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-950::DEBUG::2014-04-10 16:51:54,194::task::579::TaskManager.Task::(_updateState) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::moving from state init -> state preparing
>Thread-950::INFO::2014-04-10 16:51:54,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-950::DEBUG::2014-04-10 16:51:54,195::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03fb59f0-e259-4042-a347-cd16cd9405a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-950::DEBUG::2014-04-10 16:51:54,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-950::DEBUG::2014-04-10 16:51:54,196::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-950::DEBUG::2014-04-10 16:51:54,196::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03fb59f0-e259-4042-a347-cd16cd9405a0`::Granted request
>Thread-950::DEBUG::2014-04-10 16:51:54,196::task::811::TaskManager.Task::(resourceAcquired) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-950::DEBUG::2014-04-10 16:51:54,196::task::974::TaskManager.Task::(_decref) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::ref 1 aborting False
>Thread-950::INFO::2014-04-10 16:51:54,198::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-950::DEBUG::2014-04-10 16:51:54,198::task::1168::TaskManager.Task::(prepare) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-950::DEBUG::2014-04-10 16:51:54,199::task::579::TaskManager.Task::(_updateState) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::moving from state preparing -> state finished
>Thread-950::DEBUG::2014-04-10 16:51:54,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-950::DEBUG::2014-04-10 16:51:54,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-950::DEBUG::2014-04-10 16:51:54,199::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-950::DEBUG::2014-04-10 16:51:54,199::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-950::DEBUG::2014-04-10 16:51:54,199::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-950::DEBUG::2014-04-10 16:51:54,200::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-950::DEBUG::2014-04-10 16:51:54,200::task::974::TaskManager.Task::(_decref) Task=`f15f6aeb-3016-4b96-9cb1-e3be0285db23`::ref 0 aborting False
>Thread-951::DEBUG::2014-04-10 16:51:55,122::task::579::TaskManager.Task::(_updateState) Task=`012ab84a-140a-45aa-b5fb-e39a54311a85`::moving from state init -> state preparing
>Thread-951::INFO::2014-04-10 16:51:55,123::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-951::INFO::2014-04-10 16:51:55,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377633', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348008', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '20.2', 'valid': False}}
>Thread-951::DEBUG::2014-04-10 16:51:55,123::task::1168::TaskManager.Task::(prepare) Task=`012ab84a-140a-45aa-b5fb-e39a54311a85`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '44.6', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377633', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348008', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '20.2', 'valid': False}}
>Thread-951::DEBUG::2014-04-10 16:51:55,123::task::579::TaskManager.Task::(_updateState) Task=`012ab84a-140a-45aa-b5fb-e39a54311a85`::moving from state preparing -> state finished
>Thread-951::DEBUG::2014-04-10 16:51:55,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-951::DEBUG::2014-04-10 16:51:55,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-951::DEBUG::2014-04-10 16:51:55,124::task::974::TaskManager.Task::(_decref) Task=`012ab84a-140a-45aa-b5fb-e39a54311a85`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:51:56,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:51:56,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:51:56,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000433386 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:51:56,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000247283 s, 2.7 MB/s\n'; <rc> = 0
>Thread-909::DEBUG::2014-04-10 16:51:59,516::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xcd1500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xcd1500>, '55cb7668-7c5e-4553-b263-c6f3f86b358f': <function findDomain at 0xcd1500>, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': <function findDomain at 0xcd1500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-909::DEBUG::2014-04-10 16:51:59,516::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain, 55cb7668-7c5e-4553-b263-c6f3f86b358f: storage.nfsSD.findDomain, dbec8cee-b5e4-4011-9dd5-7c122389a878: storage.nfsSD.findDomain}
>Thread-909::INFO::2014-04-10 16:51:59,516::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-909::DEBUG::2014-04-10 16:51:59,517::task::1168::TaskManager.Task::(prepare) Task=`4b96427a-73e1-4d05-a90c-043aa957935d`::finished: {'statuslist': [{'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-909::DEBUG::2014-04-10 16:51:59,517::task::579::TaskManager.Task::(_updateState) Task=`4b96427a-73e1-4d05-a90c-043aa957935d`::moving from state preparing -> state finished
>Thread-909::DEBUG::2014-04-10 16:51:59,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-909::DEBUG::2014-04-10 16:51:59,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-909::DEBUG::2014-04-10 16:51:59,517::task::974::TaskManager.Task::(_decref) Task=`4b96427a-73e1-4d05-a90c-043aa957935d`::ref 0 aborting False
>Thread-955::DEBUG::2014-04-10 16:52:04,267::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-955::DEBUG::2014-04-10 16:52:04,267::task::579::TaskManager.Task::(_updateState) Task=`71a94c7f-dd13-430f-ba52-8c4f21b098a6`::moving from state init -> state preparing
>Thread-955::INFO::2014-04-10 16:52:04,267::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-955::INFO::2014-04-10 16:52:04,268::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-955::DEBUG::2014-04-10 16:52:04,268::task::1168::TaskManager.Task::(prepare) Task=`71a94c7f-dd13-430f-ba52-8c4f21b098a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-955::DEBUG::2014-04-10 16:52:04,268::task::579::TaskManager.Task::(_updateState) Task=`71a94c7f-dd13-430f-ba52-8c4f21b098a6`::moving from state preparing -> state finished
>Thread-955::DEBUG::2014-04-10 16:52:04,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-955::DEBUG::2014-04-10 16:52:04,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-955::DEBUG::2014-04-10 16:52:04,269::task::974::TaskManager.Task::(_decref) Task=`71a94c7f-dd13-430f-ba52-8c4f21b098a6`::ref 0 aborting False
>Thread-957::DEBUG::2014-04-10 16:52:04,277::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-957::DEBUG::2014-04-10 16:52:04,278::task::579::TaskManager.Task::(_updateState) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::moving from state init -> state preparing
>Thread-957::INFO::2014-04-10 16:52:04,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-957::DEBUG::2014-04-10 16:52:04,278::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e09a0fa-dedb-4f6e-a909-efebf0a76b4d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-957::DEBUG::2014-04-10 16:52:04,278::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-957::DEBUG::2014-04-10 16:52:04,279::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-957::DEBUG::2014-04-10 16:52:04,279::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e09a0fa-dedb-4f6e-a909-efebf0a76b4d`::Granted request
>Thread-957::DEBUG::2014-04-10 16:52:04,279::task::811::TaskManager.Task::(resourceAcquired) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-957::DEBUG::2014-04-10 16:52:04,279::task::974::TaskManager.Task::(_decref) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::ref 1 aborting False
>Thread-957::INFO::2014-04-10 16:52:04,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-957::DEBUG::2014-04-10 16:52:04,281::task::1168::TaskManager.Task::(prepare) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-957::DEBUG::2014-04-10 16:52:04,282::task::579::TaskManager.Task::(_updateState) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::moving from state preparing -> state finished
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-957::DEBUG::2014-04-10 16:52:04,282::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-957::DEBUG::2014-04-10 16:52:04,283::task::974::TaskManager.Task::(_decref) Task=`8e0f58c6-15b8-49c1-8c1e-ba6c8627371d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:52:06,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:06,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:06,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375826 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:52:06,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290238 s, 2.3 MB/s\n'; <rc> = 0
>Thread-959::DEBUG::2014-04-10 16:52:10,312::task::579::TaskManager.Task::(_updateState) Task=`15200c19-1745-4e4e-8063-88e38ef18d04`::moving from state init -> state preparing
>Thread-959::INFO::2014-04-10 16:52:10,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-959::INFO::2014-04-10 16:52:10,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375826', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290238', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '35.4', 'valid': False}}
>Thread-959::DEBUG::2014-04-10 16:52:10,312::task::1168::TaskManager.Task::(prepare) Task=`15200c19-1745-4e4e-8063-88e38ef18d04`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '59.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375826', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290238', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '35.4', 'valid': False}}
>Thread-959::DEBUG::2014-04-10 16:52:10,313::task::579::TaskManager.Task::(_updateState) Task=`15200c19-1745-4e4e-8063-88e38ef18d04`::moving from state preparing -> state finished
>Thread-959::DEBUG::2014-04-10 16:52:10,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-959::DEBUG::2014-04-10 16:52:10,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-959::DEBUG::2014-04-10 16:52:10,313::task::974::TaskManager.Task::(_decref) Task=`15200c19-1745-4e4e-8063-88e38ef18d04`::ref 0 aborting False
>Thread-962::DEBUG::2014-04-10 16:52:14,350::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-962::DEBUG::2014-04-10 16:52:14,351::task::579::TaskManager.Task::(_updateState) Task=`254c25b2-95f6-44d3-ac41-6ec0053d78ce`::moving from state init -> state preparing
>Thread-962::INFO::2014-04-10 16:52:14,351::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-962::INFO::2014-04-10 16:52:14,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-962::DEBUG::2014-04-10 16:52:14,351::task::1168::TaskManager.Task::(prepare) Task=`254c25b2-95f6-44d3-ac41-6ec0053d78ce`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-962::DEBUG::2014-04-10 16:52:14,352::task::579::TaskManager.Task::(_updateState) Task=`254c25b2-95f6-44d3-ac41-6ec0053d78ce`::moving from state preparing -> state finished
>Thread-962::DEBUG::2014-04-10 16:52:14,352::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-962::DEBUG::2014-04-10 16:52:14,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-962::DEBUG::2014-04-10 16:52:14,352::task::974::TaskManager.Task::(_decref) Task=`254c25b2-95f6-44d3-ac41-6ec0053d78ce`::ref 0 aborting False
>Thread-963::DEBUG::2014-04-10 16:52:14,359::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-963::DEBUG::2014-04-10 16:52:14,359::task::579::TaskManager.Task::(_updateState) Task=`a36102c0-a79a-466e-a707-2214f469d805`::moving from state init -> state preparing
>Thread-963::INFO::2014-04-10 16:52:14,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-963::DEBUG::2014-04-10 16:52:14,360::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9c69965-f4f8-4e5a-90d3-2d56cc08ee82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-963::DEBUG::2014-04-10 16:52:14,360::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-963::DEBUG::2014-04-10 16:52:14,360::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-963::DEBUG::2014-04-10 16:52:14,360::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9c69965-f4f8-4e5a-90d3-2d56cc08ee82`::Granted request
>Thread-963::DEBUG::2014-04-10 16:52:14,360::task::811::TaskManager.Task::(resourceAcquired) Task=`a36102c0-a79a-466e-a707-2214f469d805`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-963::DEBUG::2014-04-10 16:52:14,361::task::974::TaskManager.Task::(_decref) Task=`a36102c0-a79a-466e-a707-2214f469d805`::ref 1 aborting False
>Thread-963::INFO::2014-04-10 16:52:14,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-963::DEBUG::2014-04-10 16:52:14,363::task::1168::TaskManager.Task::(prepare) Task=`a36102c0-a79a-466e-a707-2214f469d805`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-963::DEBUG::2014-04-10 16:52:14,363::task::579::TaskManager.Task::(_updateState) Task=`a36102c0-a79a-466e-a707-2214f469d805`::moving from state preparing -> state finished
>Thread-963::DEBUG::2014-04-10 16:52:14,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-963::DEBUG::2014-04-10 16:52:14,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-963::DEBUG::2014-04-10 16:52:14,364::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-963::DEBUG::2014-04-10 16:52:14,364::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-963::DEBUG::2014-04-10 16:52:14,364::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-963::DEBUG::2014-04-10 16:52:14,364::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-963::DEBUG::2014-04-10 16:52:14,364::task::974::TaskManager.Task::(_decref) Task=`a36102c0-a79a-466e-a707-2214f469d805`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:52:16,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:16,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:16,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386646 s, 1.7 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:52:16,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000216309 s, 3.1 MB/s\n'; <rc> = 0
>Thread-923::WARNING::2014-04-10 16:52:22,708::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-925::WARNING::2014-04-10 16:52:22,712::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-923::DEBUG::2014-04-10 16:52:22,714::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-925::DEBUG::2014-04-10 16:52:22,715::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-467::ERROR::2014-04-10 16:52:22,717::sdc::143::Storage.StorageDomainCache::(_findDomain) domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-467::ERROR::2014-04-10 16:52:22,717::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-967::DEBUG::2014-04-10 16:52:24,650::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-967::DEBUG::2014-04-10 16:52:24,651::task::579::TaskManager.Task::(_updateState) Task=`fdd8ac51-f46d-4722-9bb9-0e19276a2c21`::moving from state init -> state preparing
>Thread-967::INFO::2014-04-10 16:52:24,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-967::INFO::2014-04-10 16:52:24,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-967::DEBUG::2014-04-10 16:52:24,652::task::1168::TaskManager.Task::(prepare) Task=`fdd8ac51-f46d-4722-9bb9-0e19276a2c21`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-967::DEBUG::2014-04-10 16:52:24,652::task::579::TaskManager.Task::(_updateState) Task=`fdd8ac51-f46d-4722-9bb9-0e19276a2c21`::moving from state preparing -> state finished
>Thread-967::DEBUG::2014-04-10 16:52:24,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-967::DEBUG::2014-04-10 16:52:24,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-967::DEBUG::2014-04-10 16:52:24,652::task::974::TaskManager.Task::(_decref) Task=`fdd8ac51-f46d-4722-9bb9-0e19276a2c21`::ref 0 aborting False
>Thread-968::DEBUG::2014-04-10 16:52:24,659::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-968::DEBUG::2014-04-10 16:52:24,659::task::579::TaskManager.Task::(_updateState) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::moving from state init -> state preparing
>Thread-968::INFO::2014-04-10 16:52:24,659::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-968::DEBUG::2014-04-10 16:52:24,660::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2231e1c3-03bd-418d-982f-82fb1eb12121`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-968::DEBUG::2014-04-10 16:52:24,660::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-968::DEBUG::2014-04-10 16:52:24,660::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-968::DEBUG::2014-04-10 16:52:24,661::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2231e1c3-03bd-418d-982f-82fb1eb12121`::Granted request
>Thread-968::DEBUG::2014-04-10 16:52:24,661::task::811::TaskManager.Task::(resourceAcquired) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-968::DEBUG::2014-04-10 16:52:24,661::task::974::TaskManager.Task::(_decref) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::ref 1 aborting False
>Thread-968::INFO::2014-04-10 16:52:24,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-968::DEBUG::2014-04-10 16:52:24,663::task::1168::TaskManager.Task::(prepare) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-968::DEBUG::2014-04-10 16:52:24,664::task::579::TaskManager.Task::(_updateState) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::moving from state preparing -> state finished
>Thread-968::DEBUG::2014-04-10 16:52:24,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-968::DEBUG::2014-04-10 16:52:24,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-968::DEBUG::2014-04-10 16:52:24,664::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-968::DEBUG::2014-04-10 16:52:24,665::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-968::DEBUG::2014-04-10 16:52:24,665::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-968::DEBUG::2014-04-10 16:52:24,665::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-968::DEBUG::2014-04-10 16:52:24,665::task::974::TaskManager.Task::(_decref) Task=`22ae335a-d216-43a1-8286-625dbd78f55d`::ref 0 aborting False
>Thread-969::DEBUG::2014-04-10 16:52:25,498::task::579::TaskManager.Task::(_updateState) Task=`4051a5f9-0e24-4be6-af76-7d4ec0b80236`::moving from state init -> state preparing
>Thread-969::INFO::2014-04-10 16:52:25,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-969::INFO::2014-04-10 16:52:25,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '2.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216309', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386646', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '50.6', 'valid': False}}
>Thread-969::DEBUG::2014-04-10 16:52:25,499::task::1168::TaskManager.Task::(prepare) Task=`4051a5f9-0e24-4be6-af76-7d4ec0b80236`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '2.8', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216309', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386646', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '50.6', 'valid': False}}
>Thread-969::DEBUG::2014-04-10 16:52:25,499::task::579::TaskManager.Task::(_updateState) Task=`4051a5f9-0e24-4be6-af76-7d4ec0b80236`::moving from state preparing -> state finished
>Thread-969::DEBUG::2014-04-10 16:52:25,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-969::DEBUG::2014-04-10 16:52:25,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-969::DEBUG::2014-04-10 16:52:25,500::task::974::TaskManager.Task::(_decref) Task=`4051a5f9-0e24-4be6-af76-7d4ec0b80236`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:52:26,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:26,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:26,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270879 s, 2.5 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:52:26,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375263 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:52:32,718::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-467::DEBUG::2014-04-10 16:52:32,719::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:52:32,719::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-467::DEBUG::2014-04-10 16:52:32,719::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-467::DEBUG::2014-04-10 16:52:32,719::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:52:32,732::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-467::DEBUG::2014-04-10 16:52:32,733::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-974::DEBUG::2014-04-10 16:52:34,733::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-974::DEBUG::2014-04-10 16:52:34,733::task::579::TaskManager.Task::(_updateState) Task=`1ca7a39c-8c48-43b5-baad-8f98bfd8a185`::moving from state init -> state preparing
>Thread-974::INFO::2014-04-10 16:52:34,734::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-974::INFO::2014-04-10 16:52:34,734::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-974::DEBUG::2014-04-10 16:52:34,734::task::1168::TaskManager.Task::(prepare) Task=`1ca7a39c-8c48-43b5-baad-8f98bfd8a185`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-974::DEBUG::2014-04-10 16:52:34,734::task::579::TaskManager.Task::(_updateState) Task=`1ca7a39c-8c48-43b5-baad-8f98bfd8a185`::moving from state preparing -> state finished
>Thread-974::DEBUG::2014-04-10 16:52:34,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-974::DEBUG::2014-04-10 16:52:34,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-974::DEBUG::2014-04-10 16:52:34,735::task::974::TaskManager.Task::(_decref) Task=`1ca7a39c-8c48-43b5-baad-8f98bfd8a185`::ref 0 aborting False
>Thread-975::DEBUG::2014-04-10 16:52:34,741::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-975::DEBUG::2014-04-10 16:52:34,741::task::579::TaskManager.Task::(_updateState) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::moving from state init -> state preparing
>Thread-975::INFO::2014-04-10 16:52:34,742::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-975::DEBUG::2014-04-10 16:52:34,742::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f1da255-c6ac-46b3-ac73-b6a52fda0a66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-975::DEBUG::2014-04-10 16:52:34,742::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-975::DEBUG::2014-04-10 16:52:34,742::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-975::DEBUG::2014-04-10 16:52:34,743::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f1da255-c6ac-46b3-ac73-b6a52fda0a66`::Granted request
>Thread-975::DEBUG::2014-04-10 16:52:34,743::task::811::TaskManager.Task::(resourceAcquired) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-975::DEBUG::2014-04-10 16:52:34,743::task::974::TaskManager.Task::(_decref) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::ref 1 aborting False
>Thread-975::INFO::2014-04-10 16:52:34,746::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-975::DEBUG::2014-04-10 16:52:34,746::task::1168::TaskManager.Task::(prepare) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-975::DEBUG::2014-04-10 16:52:34,746::task::579::TaskManager.Task::(_updateState) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::moving from state preparing -> state finished
>Thread-975::DEBUG::2014-04-10 16:52:34,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-975::DEBUG::2014-04-10 16:52:34,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-975::DEBUG::2014-04-10 16:52:34,747::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-975::DEBUG::2014-04-10 16:52:34,747::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-975::DEBUG::2014-04-10 16:52:34,747::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-975::DEBUG::2014-04-10 16:52:34,747::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-975::DEBUG::2014-04-10 16:52:34,748::task::974::TaskManager.Task::(_decref) Task=`0eeb6832-d99c-4009-a163-904a35176dda`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 16:52:35,774::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:52:35,841::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:52:35,841::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,842::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,842::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,842::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,842::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,842::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-467::DEBUG::2014-04-10 16:52:35,843::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-466::DEBUG::2014-04-10 16:52:36,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:36,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:36,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254101 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:52:36,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000223491 s, 3.0 MB/s\n'; <rc> = 0
>Thread-981::DEBUG::2014-04-10 16:52:40,666::task::579::TaskManager.Task::(_updateState) Task=`dc98d053-a1ff-4b7e-9dd6-9b020b7d35c0`::moving from state init -> state preparing
>Thread-981::INFO::2014-04-10 16:52:40,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-981::INFO::2014-04-10 16:52:40,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '17.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254101', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223491', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '65.8', 'valid': False}}
>Thread-981::DEBUG::2014-04-10 16:52:40,667::task::1168::TaskManager.Task::(prepare) Task=`dc98d053-a1ff-4b7e-9dd6-9b020b7d35c0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '17.9', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254101', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223491', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '65.8', 'valid': False}}
>Thread-981::DEBUG::2014-04-10 16:52:40,667::task::579::TaskManager.Task::(_updateState) Task=`dc98d053-a1ff-4b7e-9dd6-9b020b7d35c0`::moving from state preparing -> state finished
>Thread-981::DEBUG::2014-04-10 16:52:40,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-981::DEBUG::2014-04-10 16:52:40,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-981::DEBUG::2014-04-10 16:52:40,668::task::974::TaskManager.Task::(_decref) Task=`dc98d053-a1ff-4b7e-9dd6-9b020b7d35c0`::ref 0 aborting False
>Thread-984::DEBUG::2014-04-10 16:52:44,863::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1ad889f5]
>Thread-984::DEBUG::2014-04-10 16:52:44,865::task::579::TaskManager.Task::(_updateState) Task=`4697a3f8-c2fa-4d19-9585-879dfff8742d`::moving from state init -> state preparing
>Thread-984::INFO::2014-04-10 16:52:44,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-984::INFO::2014-04-10 16:52:44,868::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-984::DEBUG::2014-04-10 16:52:44,869::task::1168::TaskManager.Task::(prepare) Task=`4697a3f8-c2fa-4d19-9585-879dfff8742d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-984::DEBUG::2014-04-10 16:52:44,870::task::579::TaskManager.Task::(_updateState) Task=`4697a3f8-c2fa-4d19-9585-879dfff8742d`::moving from state preparing -> state finished
>Thread-984::DEBUG::2014-04-10 16:52:44,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-984::DEBUG::2014-04-10 16:52:44,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-984::DEBUG::2014-04-10 16:52:44,873::task::974::TaskManager.Task::(_decref) Task=`4697a3f8-c2fa-4d19-9585-879dfff8742d`::ref 0 aborting False
>Thread-985::DEBUG::2014-04-10 16:52:44,883::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1ad889f5]
>Thread-985::DEBUG::2014-04-10 16:52:44,884::task::579::TaskManager.Task::(_updateState) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::moving from state init -> state preparing
>Thread-985::INFO::2014-04-10 16:52:44,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-985::DEBUG::2014-04-10 16:52:44,887::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32e7dfc2-ee8e-414d-ae8d-09394b57a42e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-985::DEBUG::2014-04-10 16:52:44,887::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-985::DEBUG::2014-04-10 16:52:44,888::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-985::DEBUG::2014-04-10 16:52:44,889::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32e7dfc2-ee8e-414d-ae8d-09394b57a42e`::Granted request
>Thread-985::DEBUG::2014-04-10 16:52:44,891::task::811::TaskManager.Task::(resourceAcquired) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-985::DEBUG::2014-04-10 16:52:44,892::task::974::TaskManager.Task::(_decref) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::ref 1 aborting False
>Thread-985::INFO::2014-04-10 16:52:44,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-985::DEBUG::2014-04-10 16:52:44,901::task::1168::TaskManager.Task::(prepare) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-985::DEBUG::2014-04-10 16:52:44,902::task::579::TaskManager.Task::(_updateState) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::moving from state preparing -> state finished
>Thread-985::DEBUG::2014-04-10 16:52:44,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-985::DEBUG::2014-04-10 16:52:44,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-985::DEBUG::2014-04-10 16:52:44,906::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-985::DEBUG::2014-04-10 16:52:44,907::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-942::WARNING::2014-04-10 16:52:44,907::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-985::DEBUG::2014-04-10 16:52:44,909::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-942::DEBUG::2014-04-10 16:52:44,910::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-985::DEBUG::2014-04-10 16:52:44,912::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-944::WARNING::2014-04-10 16:52:44,914::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-985::DEBUG::2014-04-10 16:52:44,915::task::974::TaskManager.Task::(_decref) Task=`d09c5b4a-2a08-4ecd-a06b-afee32f4293a`::ref 0 aborting False
>Thread-944::DEBUG::2014-04-10 16:52:44,916::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-469::ERROR::2014-04-10 16:52:44,918::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-469::ERROR::2014-04-10 16:52:44,921::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>    return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>  File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-466::DEBUG::2014-04-10 16:52:46,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:46,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:46,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256374 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:52:46,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355238 s, 1.9 MB/s\n'; <rc> = 0
>Thread-993::DEBUG::2014-04-10 16:52:55,027::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-993::DEBUG::2014-04-10 16:52:55,028::task::579::TaskManager.Task::(_updateState) Task=`29a231fa-ca08-47cb-b549-23692bf6181a`::moving from state init -> state preparing
>Thread-993::INFO::2014-04-10 16:52:55,028::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-993::INFO::2014-04-10 16:52:55,029::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-993::DEBUG::2014-04-10 16:52:55,029::task::1168::TaskManager.Task::(prepare) Task=`29a231fa-ca08-47cb-b549-23692bf6181a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-993::DEBUG::2014-04-10 16:52:55,029::task::579::TaskManager.Task::(_updateState) Task=`29a231fa-ca08-47cb-b549-23692bf6181a`::moving from state preparing -> state finished
>Thread-993::DEBUG::2014-04-10 16:52:55,029::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-993::DEBUG::2014-04-10 16:52:55,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-993::DEBUG::2014-04-10 16:52:55,029::task::974::TaskManager.Task::(_decref) Task=`29a231fa-ca08-47cb-b549-23692bf6181a`::ref 0 aborting False
>Thread-994::DEBUG::2014-04-10 16:52:55,036::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-994::DEBUG::2014-04-10 16:52:55,037::task::579::TaskManager.Task::(_updateState) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::moving from state init -> state preparing
>Thread-994::INFO::2014-04-10 16:52:55,037::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-994::DEBUG::2014-04-10 16:52:55,038::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6c4f97be-71f2-4787-9aea-430fbcc0e45c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-994::DEBUG::2014-04-10 16:52:55,038::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-994::DEBUG::2014-04-10 16:52:55,038::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-994::DEBUG::2014-04-10 16:52:55,038::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6c4f97be-71f2-4787-9aea-430fbcc0e45c`::Granted request
>Thread-994::DEBUG::2014-04-10 16:52:55,039::task::811::TaskManager.Task::(resourceAcquired) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-994::DEBUG::2014-04-10 16:52:55,039::task::974::TaskManager.Task::(_decref) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::ref 1 aborting False
>Thread-994::INFO::2014-04-10 16:52:55,041::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-994::DEBUG::2014-04-10 16:52:55,041::task::1168::TaskManager.Task::(prepare) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-994::DEBUG::2014-04-10 16:52:55,041::task::579::TaskManager.Task::(_updateState) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::moving from state preparing -> state finished
>Thread-994::DEBUG::2014-04-10 16:52:55,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-994::DEBUG::2014-04-10 16:52:55,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-994::DEBUG::2014-04-10 16:52:55,042::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-994::DEBUG::2014-04-10 16:52:55,042::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-994::DEBUG::2014-04-10 16:52:55,042::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-994::DEBUG::2014-04-10 16:52:55,042::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-994::DEBUG::2014-04-10 16:52:55,042::task::974::TaskManager.Task::(_decref) Task=`27bca1d1-1798-4c56-96ab-fafe279b48dc`::ref 0 aborting False
>Thread-995::DEBUG::2014-04-10 16:52:55,917::task::579::TaskManager.Task::(_updateState) Task=`7d4abac6-6b3d-4ff2-8d24-05753232de78`::moving from state init -> state preparing
>Thread-995::INFO::2014-04-10 16:52:55,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-995::INFO::2014-04-10 16:52:55,918::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '33.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256374', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355238', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '11.0', 'valid': False}}
>Thread-995::DEBUG::2014-04-10 16:52:55,918::task::1168::TaskManager.Task::(prepare) Task=`7d4abac6-6b3d-4ff2-8d24-05753232de78`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '33.2', 'valid': False}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256374', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355238', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '11.0', 'valid': False}}
>Thread-995::DEBUG::2014-04-10 16:52:55,918::task::579::TaskManager.Task::(_updateState) Task=`7d4abac6-6b3d-4ff2-8d24-05753232de78`::moving from state preparing -> state finished
>Thread-995::DEBUG::2014-04-10 16:52:55,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-995::DEBUG::2014-04-10 16:52:55,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-995::DEBUG::2014-04-10 16:52:55,918::task::974::TaskManager.Task::(_decref) Task=`7d4abac6-6b3d-4ff2-8d24-05753232de78`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:52:56,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:52:56,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:52:56,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358961 s, 1.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:52:56,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338828 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1000::DEBUG::2014-04-10 16:53:05,116::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1000::DEBUG::2014-04-10 16:53:05,116::task::579::TaskManager.Task::(_updateState) Task=`a7302e60-222f-4ff2-a524-6942fccbfa87`::moving from state init -> state preparing
>Thread-1000::INFO::2014-04-10 16:53:05,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1000::INFO::2014-04-10 16:53:05,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1000::DEBUG::2014-04-10 16:53:05,117::task::1168::TaskManager.Task::(prepare) Task=`a7302e60-222f-4ff2-a524-6942fccbfa87`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1000::DEBUG::2014-04-10 16:53:05,117::task::579::TaskManager.Task::(_updateState) Task=`a7302e60-222f-4ff2-a524-6942fccbfa87`::moving from state preparing -> state finished
>Thread-1000::DEBUG::2014-04-10 16:53:05,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1000::DEBUG::2014-04-10 16:53:05,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1000::DEBUG::2014-04-10 16:53:05,118::task::974::TaskManager.Task::(_decref) Task=`a7302e60-222f-4ff2-a524-6942fccbfa87`::ref 0 aborting False
>Thread-1001::DEBUG::2014-04-10 16:53:05,124::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1001::DEBUG::2014-04-10 16:53:05,125::task::579::TaskManager.Task::(_updateState) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::moving from state init -> state preparing
>Thread-1001::INFO::2014-04-10 16:53:05,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1001::DEBUG::2014-04-10 16:53:05,126::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`337332b2-d6e8-45ca-9786-7228812ac4d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1001::DEBUG::2014-04-10 16:53:05,126::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1001::DEBUG::2014-04-10 16:53:05,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1001::DEBUG::2014-04-10 16:53:05,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`337332b2-d6e8-45ca-9786-7228812ac4d9`::Granted request
>Thread-1001::DEBUG::2014-04-10 16:53:05,126::task::811::TaskManager.Task::(resourceAcquired) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1001::DEBUG::2014-04-10 16:53:05,127::task::974::TaskManager.Task::(_decref) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::ref 1 aborting False
>Thread-1001::INFO::2014-04-10 16:53:05,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-1001::DEBUG::2014-04-10 16:53:05,129::task::1168::TaskManager.Task::(prepare) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}}}
>Thread-1001::DEBUG::2014-04-10 16:53:05,129::task::579::TaskManager.Task::(_updateState) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::moving from state preparing -> state finished
>Thread-1001::DEBUG::2014-04-10 16:53:05,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1001::DEBUG::2014-04-10 16:53:05,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1001::DEBUG::2014-04-10 16:53:05,129::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1001::DEBUG::2014-04-10 16:53:05,130::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1001::DEBUG::2014-04-10 16:53:05,130::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1001::DEBUG::2014-04-10 16:53:05,130::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1001::DEBUG::2014-04-10 16:53:05,130::task::974::TaskManager.Task::(_decref) Task=`1ef2a1cd-0aa6-4556-a1e2-2a19b352009a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:06,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:06,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:06,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282062 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:06,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025322 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:09,865::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-467::DEBUG::2014-04-10 16:53:09,906::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-469::DEBUG::2014-04-10 16:53:09,942::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 16:53:09,949::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 16:53:09,950::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 16:53:09,950::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 16:53:09,951::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 16:53:09,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:53:09,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00035955 s, 1.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:09,963::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 changed its status to Valid
>Thread-1003::DEBUG::2014-04-10 16:53:09,964::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-1003::DEBUG::2014-04-10 16:53:09,965::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-1003::DEBUG::2014-04-10 16:53:09,965::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain`
>Thread-1003::DEBUG::2014-04-10 16:53:09,966::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-1004::INFO::2014-04-10 16:53:09,967::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-1005::DEBUG::2014-04-10 16:53:09,967::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-1005::DEBUG::2014-04-10 16:53:09,970::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`3174879b-99d0-43cf-a0f6-e58989b4ca30`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>Thread-1005::DEBUG::2014-04-10 16:53:09,970::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' for lock type 'exclusive'
>Thread-1005::DEBUG::2014-04-10 16:53:09,971::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free. Now locking as 'exclusive' (1 active user)
>Thread-1005::DEBUG::2014-04-10 16:53:09,971::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`3174879b-99d0-43cf-a0f6-e58989b4ca30`::Granted request
>Thread-1005::DEBUG::2014-04-10 16:53:09,971::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`01dc24f3-9939-4dec-a19d-3529a719eced`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>Thread-1005::DEBUG::2014-04-10 16:53:09,972::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' for lock type 'exclusive'
>Thread-1005::DEBUG::2014-04-10 16:53:09,972::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free. Now locking as 'exclusive' (1 active user)
>Thread-1005::DEBUG::2014-04-10 16:53:09,972::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`01dc24f3-9939-4dec-a19d-3529a719eced`::Granted request
>Thread-1005::DEBUG::2014-04-10 16:53:09,978::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-1005::DEBUG::2014-04-10 16:53:09,978::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654'
>Thread-1005::DEBUG::2014-04-10 16:53:09,978::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (0 active users)
>Thread-1005::DEBUG::2014-04-10 16:53:09,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free, finding out if anyone is waiting for it.
>Thread-1005::DEBUG::2014-04-10 16:53:09,979::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654', Clearing records.
>Thread-1005::DEBUG::2014-04-10 16:53:09,979::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654'
>Thread-1005::DEBUG::2014-04-10 16:53:09,979::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (0 active users)
>Thread-1005::DEBUG::2014-04-10 16:53:09,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free, finding out if anyone is waiting for it.
>Thread-1005::DEBUG::2014-04-10 16:53:09,980::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654', Clearing records.
>Thread-467::DEBUG::2014-04-10 16:53:09,983::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 16:53:09,990::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 16:53:09,992::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 16:53:09,992::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 16:53:09,992::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 16:53:09,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:53:10,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000355282 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:53:10,007::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 changed its status to Valid
>Thread-1006::DEBUG::2014-04-10 16:53:10,008::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-1006::DEBUG::2014-04-10 16:53:10,008::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-1006::DEBUG::2014-04-10 16:53:10,009::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain`
>Thread-1006::DEBUG::2014-04-10 16:53:10,011::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-1007::INFO::2014-04-10 16:53:10,011::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-1008::DEBUG::2014-04-10 16:53:10,011::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-1008::DEBUG::2014-04-10 16:53:10,014::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`0f77d9dc-4b5a-43e8-b96c-ff25394cad41`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>Thread-1008::DEBUG::2014-04-10 16:53:10,014::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'exclusive'
>Thread-1008::DEBUG::2014-04-10 16:53:10,014::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'exclusive' (1 active user)
>Thread-1008::DEBUG::2014-04-10 16:53:10,015::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`0f77d9dc-4b5a-43e8-b96c-ff25394cad41`::Granted request
>Thread-1008::DEBUG::2014-04-10 16:53:10,015::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`3aaee98a-4a48-437e-97a1-bd76cedb6246`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>Thread-1008::DEBUG::2014-04-10 16:53:10,015::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'exclusive'
>Thread-1008::DEBUG::2014-04-10 16:53:10,016::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'exclusive' (1 active user)
>Thread-1008::DEBUG::2014-04-10 16:53:10,016::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`3aaee98a-4a48-437e-97a1-bd76cedb6246`::Granted request
>Thread-1008::DEBUG::2014-04-10 16:53:10,021::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-1008::DEBUG::2014-04-10 16:53:10,022::sp::204::Storage.StoragePool::(_upgradePoolDomain) All domains are upgraded, unregistering from state change event
>Thread-1008::DEBUG::2014-04-10 16:53:10,022::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-1008::DEBUG::2014-04-10 16:53:10,022::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-1008::DEBUG::2014-04-10 16:53:10,022::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-1008::DEBUG::2014-04-10 16:53:10,022::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-1008::DEBUG::2014-04-10 16:53:10,023::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-1008::DEBUG::2014-04-10 16:53:10,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-1008::DEBUG::2014-04-10 16:53:10,023::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-1008::DEBUG::2014-04-10 16:53:10,023::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-1009::DEBUG::2014-04-10 16:53:11,070::task::579::TaskManager.Task::(_updateState) Task=`f8631af0-8740-4343-8c5e-205ace6f0cf1`::moving from state init -> state preparing
>Thread-1009::INFO::2014-04-10 16:53:11,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1009::INFO::2014-04-10 16:53:11,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000355282', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282062', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025322', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00035955', 'lastCheck': '1.1', 'valid': True}}
>Thread-1009::DEBUG::2014-04-10 16:53:11,071::task::1168::TaskManager.Task::(prepare) Task=`f8631af0-8740-4343-8c5e-205ace6f0cf1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000355282', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282062', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025322', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00035955', 'lastCheck': '1.1', 'valid': True}}
>Thread-1009::DEBUG::2014-04-10 16:53:11,071::task::579::TaskManager.Task::(_updateState) Task=`f8631af0-8740-4343-8c5e-205ace6f0cf1`::moving from state preparing -> state finished
>Thread-1009::DEBUG::2014-04-10 16:53:11,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1009::DEBUG::2014-04-10 16:53:11,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1009::DEBUG::2014-04-10 16:53:11,071::task::974::TaskManager.Task::(_decref) Task=`f8631af0-8740-4343-8c5e-205ace6f0cf1`::ref 0 aborting False
>Thread-1012::DEBUG::2014-04-10 16:53:15,198::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1012::DEBUG::2014-04-10 16:53:15,198::task::579::TaskManager.Task::(_updateState) Task=`c081c778-c61e-4861-b4f2-2e53ecc2c370`::moving from state init -> state preparing
>Thread-1012::INFO::2014-04-10 16:53:15,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1012::INFO::2014-04-10 16:53:15,199::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1012::DEBUG::2014-04-10 16:53:15,199::task::1168::TaskManager.Task::(prepare) Task=`c081c778-c61e-4861-b4f2-2e53ecc2c370`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1012::DEBUG::2014-04-10 16:53:15,199::task::579::TaskManager.Task::(_updateState) Task=`c081c778-c61e-4861-b4f2-2e53ecc2c370`::moving from state preparing -> state finished
>Thread-1012::DEBUG::2014-04-10 16:53:15,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1012::DEBUG::2014-04-10 16:53:15,199::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1012::DEBUG::2014-04-10 16:53:15,200::task::974::TaskManager.Task::(_decref) Task=`c081c778-c61e-4861-b4f2-2e53ecc2c370`::ref 0 aborting False
>Thread-1013::DEBUG::2014-04-10 16:53:15,206::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1013::DEBUG::2014-04-10 16:53:15,206::task::579::TaskManager.Task::(_updateState) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::moving from state init -> state preparing
>Thread-1013::INFO::2014-04-10 16:53:15,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1013::DEBUG::2014-04-10 16:53:15,207::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b1ba51e9-622a-42a2-839a-57dc6fd350cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1013::DEBUG::2014-04-10 16:53:15,207::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1013::DEBUG::2014-04-10 16:53:15,207::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1013::DEBUG::2014-04-10 16:53:15,207::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b1ba51e9-622a-42a2-839a-57dc6fd350cf`::Granted request
>Thread-1013::DEBUG::2014-04-10 16:53:15,208::task::811::TaskManager.Task::(resourceAcquired) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1013::DEBUG::2014-04-10 16:53:15,208::task::974::TaskManager.Task::(_decref) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::ref 1 aborting False
>Thread-1013::INFO::2014-04-10 16:53:15,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1013::DEBUG::2014-04-10 16:53:15,210::task::1168::TaskManager.Task::(prepare) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1013::DEBUG::2014-04-10 16:53:15,210::task::579::TaskManager.Task::(_updateState) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::moving from state preparing -> state finished
>Thread-1013::DEBUG::2014-04-10 16:53:15,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1013::DEBUG::2014-04-10 16:53:15,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1013::DEBUG::2014-04-10 16:53:15,211::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1013::DEBUG::2014-04-10 16:53:15,211::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1013::DEBUG::2014-04-10 16:53:15,211::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1013::DEBUG::2014-04-10 16:53:15,211::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1013::DEBUG::2014-04-10 16:53:15,211::task::974::TaskManager.Task::(_decref) Task=`d8c86fec-f0b6-404b-a458-fc741d2e62d9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:16,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:16,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:16,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302615 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:16,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000275573 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:19,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:53:19,976::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448975 s, 820 kB/s\n'; <rc> = 0
>Thread-469::INFO::2014-04-10 16:53:19,978::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 (id: 2)
>Thread-469::DEBUG::2014-04-10 16:53:19,979::clusterlock::192::SANLock::(acquireHostId) Host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 successfully acquired (id: 2)
>Thread-467::DEBUG::2014-04-10 16:53:20,008::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 16:53:20,023::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 16:53:20,025::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 16:53:20,031::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 16:53:20,032::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 16:53:20,032::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 16:53:20,033::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 16:53:20,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:53:20,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000330604 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::INFO::2014-04-10 16:53:20,048::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>Thread-467::DEBUG::2014-04-10 16:53:20,049::clusterlock::192::SANLock::(acquireHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>Thread-1021::DEBUG::2014-04-10 16:53:25,289::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1021::DEBUG::2014-04-10 16:53:25,289::task::579::TaskManager.Task::(_updateState) Task=`da33ba66-d67c-41ac-830d-910aeb671260`::moving from state init -> state preparing
>Thread-1021::INFO::2014-04-10 16:53:25,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1021::INFO::2014-04-10 16:53:25,290::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1021::DEBUG::2014-04-10 16:53:25,290::task::1168::TaskManager.Task::(prepare) Task=`da33ba66-d67c-41ac-830d-910aeb671260`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1021::DEBUG::2014-04-10 16:53:25,290::task::579::TaskManager.Task::(_updateState) Task=`da33ba66-d67c-41ac-830d-910aeb671260`::moving from state preparing -> state finished
>Thread-1021::DEBUG::2014-04-10 16:53:25,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1021::DEBUG::2014-04-10 16:53:25,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1021::DEBUG::2014-04-10 16:53:25,291::task::974::TaskManager.Task::(_decref) Task=`da33ba66-d67c-41ac-830d-910aeb671260`::ref 0 aborting False
>Thread-1022::DEBUG::2014-04-10 16:53:25,298::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1022::DEBUG::2014-04-10 16:53:25,298::task::579::TaskManager.Task::(_updateState) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::moving from state init -> state preparing
>Thread-1022::INFO::2014-04-10 16:53:25,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1022::DEBUG::2014-04-10 16:53:25,299::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51a05a20-ca56-4b8a-9c09-6416f2c87616`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1022::DEBUG::2014-04-10 16:53:25,299::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1022::DEBUG::2014-04-10 16:53:25,299::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1022::DEBUG::2014-04-10 16:53:25,299::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51a05a20-ca56-4b8a-9c09-6416f2c87616`::Granted request
>Thread-1022::DEBUG::2014-04-10 16:53:25,299::task::811::TaskManager.Task::(resourceAcquired) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1022::DEBUG::2014-04-10 16:53:25,300::task::974::TaskManager.Task::(_decref) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::ref 1 aborting False
>Thread-1022::INFO::2014-04-10 16:53:25,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1022::DEBUG::2014-04-10 16:53:25,302::task::1168::TaskManager.Task::(prepare) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1022::DEBUG::2014-04-10 16:53:25,302::task::579::TaskManager.Task::(_updateState) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::moving from state preparing -> state finished
>Thread-1022::DEBUG::2014-04-10 16:53:25,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1022::DEBUG::2014-04-10 16:53:25,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1022::DEBUG::2014-04-10 16:53:25,302::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1022::DEBUG::2014-04-10 16:53:25,303::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1022::DEBUG::2014-04-10 16:53:25,303::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1022::DEBUG::2014-04-10 16:53:25,303::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1022::DEBUG::2014-04-10 16:53:25,303::task::974::TaskManager.Task::(_decref) Task=`10f29fad-8de4-45a9-8f4e-b5aa2281d7cd`::ref 0 aborting False
>Thread-1023::DEBUG::2014-04-10 16:53:26,245::task::579::TaskManager.Task::(_updateState) Task=`50eb418e-3a3e-4e35-a193-fb2018e601ad`::moving from state init -> state preparing
>Thread-1023::INFO::2014-04-10 16:53:26,246::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1023::INFO::2014-04-10 16:53:26,246::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000330604', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302615', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275573', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000448975', 'lastCheck': '6.3', 'valid': True}}
>Thread-1023::DEBUG::2014-04-10 16:53:26,246::task::1168::TaskManager.Task::(prepare) Task=`50eb418e-3a3e-4e35-a193-fb2018e601ad`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000330604', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302615', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275573', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000448975', 'lastCheck': '6.3', 'valid': True}}
>Thread-1023::DEBUG::2014-04-10 16:53:26,247::task::579::TaskManager.Task::(_updateState) Task=`50eb418e-3a3e-4e35-a193-fb2018e601ad`::moving from state preparing -> state finished
>Thread-1023::DEBUG::2014-04-10 16:53:26,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1023::DEBUG::2014-04-10 16:53:26,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1023::DEBUG::2014-04-10 16:53:26,247::task::974::TaskManager.Task::(_decref) Task=`50eb418e-3a3e-4e35-a193-fb2018e601ad`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:26,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:26,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:26,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277624 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:26,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000249476 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:29,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:53:29,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449777 s, 818 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:53:30,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:53:30,061::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000546261 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1027::DEBUG::2014-04-10 16:53:35,383::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1027::DEBUG::2014-04-10 16:53:35,384::task::579::TaskManager.Task::(_updateState) Task=`8f839072-729a-4031-b145-37d5c9d0be34`::moving from state init -> state preparing
>Thread-1027::INFO::2014-04-10 16:53:35,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1027::INFO::2014-04-10 16:53:35,386::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1027::DEBUG::2014-04-10 16:53:35,387::task::1168::TaskManager.Task::(prepare) Task=`8f839072-729a-4031-b145-37d5c9d0be34`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1027::DEBUG::2014-04-10 16:53:35,387::task::579::TaskManager.Task::(_updateState) Task=`8f839072-729a-4031-b145-37d5c9d0be34`::moving from state preparing -> state finished
>Thread-1027::DEBUG::2014-04-10 16:53:35,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1027::DEBUG::2014-04-10 16:53:35,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1027::DEBUG::2014-04-10 16:53:35,388::task::974::TaskManager.Task::(_decref) Task=`8f839072-729a-4031-b145-37d5c9d0be34`::ref 0 aborting False
>Thread-1029::DEBUG::2014-04-10 16:53:35,397::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1029::DEBUG::2014-04-10 16:53:35,398::task::579::TaskManager.Task::(_updateState) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::moving from state init -> state preparing
>Thread-1029::INFO::2014-04-10 16:53:35,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1029::DEBUG::2014-04-10 16:53:35,398::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`56972b6c-08d4-4962-b3db-7a6b17ff01c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1029::DEBUG::2014-04-10 16:53:35,398::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1029::DEBUG::2014-04-10 16:53:35,399::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1029::DEBUG::2014-04-10 16:53:35,399::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`56972b6c-08d4-4962-b3db-7a6b17ff01c1`::Granted request
>Thread-1029::DEBUG::2014-04-10 16:53:35,399::task::811::TaskManager.Task::(resourceAcquired) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1029::DEBUG::2014-04-10 16:53:35,399::task::974::TaskManager.Task::(_decref) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::ref 1 aborting False
>Thread-1029::INFO::2014-04-10 16:53:35,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1029::DEBUG::2014-04-10 16:53:35,401::task::1168::TaskManager.Task::(prepare) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::task::579::TaskManager.Task::(_updateState) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::moving from state preparing -> state finished
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1029::DEBUG::2014-04-10 16:53:35,402::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1029::DEBUG::2014-04-10 16:53:35,403::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1029::DEBUG::2014-04-10 16:53:35,403::task::974::TaskManager.Task::(_decref) Task=`2cce61e6-673b-4ef5-bc0d-dd15ebe313dd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:36,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:36,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:36,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277351 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:36,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000246788 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:39,997::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:53:40,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000398792 s, 923 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:53:40,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:53:40,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000504079 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1031::DEBUG::2014-04-10 16:53:41,428::task::579::TaskManager.Task::(_updateState) Task=`ce3e5231-c16c-470f-be9b-c3f14a1459bc`::moving from state init -> state preparing
>Thread-1031::INFO::2014-04-10 16:53:41,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1031::INFO::2014-04-10 16:53:41,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000504079', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277351', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246788', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000398792', 'lastCheck': '1.4', 'valid': True}}
>Thread-1031::DEBUG::2014-04-10 16:53:41,429::task::1168::TaskManager.Task::(prepare) Task=`ce3e5231-c16c-470f-be9b-c3f14a1459bc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000504079', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277351', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246788', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000398792', 'lastCheck': '1.4', 'valid': True}}
>Thread-1031::DEBUG::2014-04-10 16:53:41,429::task::579::TaskManager.Task::(_updateState) Task=`ce3e5231-c16c-470f-be9b-c3f14a1459bc`::moving from state preparing -> state finished
>Thread-1031::DEBUG::2014-04-10 16:53:41,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1031::DEBUG::2014-04-10 16:53:41,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1031::DEBUG::2014-04-10 16:53:41,429::task::974::TaskManager.Task::(_decref) Task=`ce3e5231-c16c-470f-be9b-c3f14a1459bc`::ref 0 aborting False
>Thread-1034::DEBUG::2014-04-10 16:53:45,486::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1034::DEBUG::2014-04-10 16:53:45,486::task::579::TaskManager.Task::(_updateState) Task=`11abf0c6-256f-4d25-a438-83c0f48cc35f`::moving from state init -> state preparing
>Thread-1034::INFO::2014-04-10 16:53:45,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1034::INFO::2014-04-10 16:53:45,487::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1034::DEBUG::2014-04-10 16:53:45,487::task::1168::TaskManager.Task::(prepare) Task=`11abf0c6-256f-4d25-a438-83c0f48cc35f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1034::DEBUG::2014-04-10 16:53:45,487::task::579::TaskManager.Task::(_updateState) Task=`11abf0c6-256f-4d25-a438-83c0f48cc35f`::moving from state preparing -> state finished
>Thread-1034::DEBUG::2014-04-10 16:53:45,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1034::DEBUG::2014-04-10 16:53:45,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1034::DEBUG::2014-04-10 16:53:45,488::task::974::TaskManager.Task::(_decref) Task=`11abf0c6-256f-4d25-a438-83c0f48cc35f`::ref 0 aborting False
>Thread-1035::DEBUG::2014-04-10 16:53:45,494::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1035::DEBUG::2014-04-10 16:53:45,494::task::579::TaskManager.Task::(_updateState) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::moving from state init -> state preparing
>Thread-1035::INFO::2014-04-10 16:53:45,495::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1035::DEBUG::2014-04-10 16:53:45,495::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`17fcce9a-253c-4012-9c0d-055c287d8800`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1035::DEBUG::2014-04-10 16:53:45,495::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1035::DEBUG::2014-04-10 16:53:45,496::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1035::DEBUG::2014-04-10 16:53:45,496::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`17fcce9a-253c-4012-9c0d-055c287d8800`::Granted request
>Thread-1035::DEBUG::2014-04-10 16:53:45,496::task::811::TaskManager.Task::(resourceAcquired) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1035::DEBUG::2014-04-10 16:53:45,496::task::974::TaskManager.Task::(_decref) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::ref 1 aborting False
>Thread-1035::INFO::2014-04-10 16:53:45,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1035::DEBUG::2014-04-10 16:53:45,498::task::1168::TaskManager.Task::(prepare) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1035::DEBUG::2014-04-10 16:53:45,498::task::579::TaskManager.Task::(_updateState) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::moving from state preparing -> state finished
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1035::DEBUG::2014-04-10 16:53:45,499::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1035::DEBUG::2014-04-10 16:53:45,500::task::974::TaskManager.Task::(_decref) Task=`3e3c6ef4-3e06-47f0-877a-1e48f4124e0e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:46,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:46,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:46,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271271 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:46,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308082 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:53:50,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:53:50,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000515836 s, 713 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:53:50,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:53:50,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485605 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1039::DEBUG::2014-04-10 16:53:55,625::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1039::DEBUG::2014-04-10 16:53:55,626::task::579::TaskManager.Task::(_updateState) Task=`4174b45a-db25-4261-82d6-1572fbcf56cc`::moving from state init -> state preparing
>Thread-1039::INFO::2014-04-10 16:53:55,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1039::INFO::2014-04-10 16:53:55,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1039::DEBUG::2014-04-10 16:53:55,627::task::1168::TaskManager.Task::(prepare) Task=`4174b45a-db25-4261-82d6-1572fbcf56cc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1039::DEBUG::2014-04-10 16:53:55,627::task::579::TaskManager.Task::(_updateState) Task=`4174b45a-db25-4261-82d6-1572fbcf56cc`::moving from state preparing -> state finished
>Thread-1039::DEBUG::2014-04-10 16:53:55,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1039::DEBUG::2014-04-10 16:53:55,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1039::DEBUG::2014-04-10 16:53:55,627::task::974::TaskManager.Task::(_decref) Task=`4174b45a-db25-4261-82d6-1572fbcf56cc`::ref 0 aborting False
>Thread-1040::DEBUG::2014-04-10 16:53:55,633::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1040::DEBUG::2014-04-10 16:53:55,634::task::579::TaskManager.Task::(_updateState) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::moving from state init -> state preparing
>Thread-1040::INFO::2014-04-10 16:53:55,634::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1040::DEBUG::2014-04-10 16:53:55,634::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f21d5a39-c63d-4852-b631-3bb779088de4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1040::DEBUG::2014-04-10 16:53:55,634::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1040::DEBUG::2014-04-10 16:53:55,635::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1040::DEBUG::2014-04-10 16:53:55,635::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f21d5a39-c63d-4852-b631-3bb779088de4`::Granted request
>Thread-1040::DEBUG::2014-04-10 16:53:55,635::task::811::TaskManager.Task::(resourceAcquired) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1040::DEBUG::2014-04-10 16:53:55,635::task::974::TaskManager.Task::(_decref) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::ref 1 aborting False
>Thread-1040::INFO::2014-04-10 16:53:55,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1040::DEBUG::2014-04-10 16:53:55,637::task::1168::TaskManager.Task::(prepare) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1040::DEBUG::2014-04-10 16:53:55,638::task::579::TaskManager.Task::(_updateState) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::moving from state preparing -> state finished
>Thread-1040::DEBUG::2014-04-10 16:53:55,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1040::DEBUG::2014-04-10 16:53:55,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1040::DEBUG::2014-04-10 16:53:55,638::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1040::DEBUG::2014-04-10 16:53:55,638::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1040::DEBUG::2014-04-10 16:53:55,639::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1040::DEBUG::2014-04-10 16:53:55,639::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1040::DEBUG::2014-04-10 16:53:55,639::task::974::TaskManager.Task::(_decref) Task=`7b09b03e-d353-40fe-adb9-c5cb16f4dbed`::ref 0 aborting False
>Thread-1041::DEBUG::2014-04-10 16:53:56,597::task::579::TaskManager.Task::(_updateState) Task=`3511f39a-bb2b-4767-bd7a-cf6c388dc327`::moving from state init -> state preparing
>Thread-1041::INFO::2014-04-10 16:53:56,597::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1041::INFO::2014-04-10 16:53:56,597::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485605', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271271', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308082', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515836', 'lastCheck': '6.6', 'valid': True}}
>Thread-1041::DEBUG::2014-04-10 16:53:56,598::task::1168::TaskManager.Task::(prepare) Task=`3511f39a-bb2b-4767-bd7a-cf6c388dc327`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485605', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271271', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308082', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515836', 'lastCheck': '6.6', 'valid': True}}
>Thread-1041::DEBUG::2014-04-10 16:53:56,598::task::579::TaskManager.Task::(_updateState) Task=`3511f39a-bb2b-4767-bd7a-cf6c388dc327`::moving from state preparing -> state finished
>Thread-1041::DEBUG::2014-04-10 16:53:56,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1041::DEBUG::2014-04-10 16:53:56,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1041::DEBUG::2014-04-10 16:53:56,598::task::974::TaskManager.Task::(_decref) Task=`3511f39a-bb2b-4767-bd7a-cf6c388dc327`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:53:56,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:53:56,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:53:56,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316874 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:53:56,960::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278354 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:00,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:00,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479546 s, 767 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:00,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:00,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00042745 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1045::DEBUG::2014-04-10 16:54:05,717::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1045::DEBUG::2014-04-10 16:54:05,718::task::579::TaskManager.Task::(_updateState) Task=`08f11b11-f90d-44e9-a686-f7ff71703c86`::moving from state init -> state preparing
>Thread-1045::INFO::2014-04-10 16:54:05,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1045::INFO::2014-04-10 16:54:05,718::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1045::DEBUG::2014-04-10 16:54:05,718::task::1168::TaskManager.Task::(prepare) Task=`08f11b11-f90d-44e9-a686-f7ff71703c86`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1045::DEBUG::2014-04-10 16:54:05,719::task::579::TaskManager.Task::(_updateState) Task=`08f11b11-f90d-44e9-a686-f7ff71703c86`::moving from state preparing -> state finished
>Thread-1045::DEBUG::2014-04-10 16:54:05,719::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1045::DEBUG::2014-04-10 16:54:05,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1045::DEBUG::2014-04-10 16:54:05,719::task::974::TaskManager.Task::(_decref) Task=`08f11b11-f90d-44e9-a686-f7ff71703c86`::ref 0 aborting False
>Thread-1046::DEBUG::2014-04-10 16:54:05,726::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1046::DEBUG::2014-04-10 16:54:05,726::task::579::TaskManager.Task::(_updateState) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::moving from state init -> state preparing
>Thread-1046::INFO::2014-04-10 16:54:05,727::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1046::DEBUG::2014-04-10 16:54:05,727::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`50113d3e-cfa1-41e3-b45e-76f948ceb5d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1046::DEBUG::2014-04-10 16:54:05,727::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1046::DEBUG::2014-04-10 16:54:05,727::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1046::DEBUG::2014-04-10 16:54:05,728::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`50113d3e-cfa1-41e3-b45e-76f948ceb5d3`::Granted request
>Thread-1046::DEBUG::2014-04-10 16:54:05,728::task::811::TaskManager.Task::(resourceAcquired) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1046::DEBUG::2014-04-10 16:54:05,728::task::974::TaskManager.Task::(_decref) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::ref 1 aborting False
>Thread-1046::INFO::2014-04-10 16:54:05,730::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1046::DEBUG::2014-04-10 16:54:05,730::task::1168::TaskManager.Task::(prepare) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1046::DEBUG::2014-04-10 16:54:05,730::task::579::TaskManager.Task::(_updateState) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::moving from state preparing -> state finished
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1046::DEBUG::2014-04-10 16:54:05,731::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1046::DEBUG::2014-04-10 16:54:05,732::task::974::TaskManager.Task::(_decref) Task=`9ac9b97c-b503-499b-8909-b9e2221e3a57`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:54:07,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:07,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:07,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281925 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:54:07,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000245126 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:10,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:10,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430858 s, 854 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:10,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:10,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0004181 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1049::DEBUG::2014-04-10 16:54:11,789::task::579::TaskManager.Task::(_updateState) Task=`d3178dd0-473c-4146-afb0-dfe8f2e8eecb`::moving from state init -> state preparing
>Thread-1049::INFO::2014-04-10 16:54:11,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1049::INFO::2014-04-10 16:54:11,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004181', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281925', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245126', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430858', 'lastCheck': '1.7', 'valid': True}}
>Thread-1049::DEBUG::2014-04-10 16:54:11,790::task::1168::TaskManager.Task::(prepare) Task=`d3178dd0-473c-4146-afb0-dfe8f2e8eecb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004181', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281925', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245126', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430858', 'lastCheck': '1.7', 'valid': True}}
>Thread-1049::DEBUG::2014-04-10 16:54:11,790::task::579::TaskManager.Task::(_updateState) Task=`d3178dd0-473c-4146-afb0-dfe8f2e8eecb`::moving from state preparing -> state finished
>Thread-1049::DEBUG::2014-04-10 16:54:11,791::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1049::DEBUG::2014-04-10 16:54:11,791::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1049::DEBUG::2014-04-10 16:54:11,791::task::974::TaskManager.Task::(_decref) Task=`d3178dd0-473c-4146-afb0-dfe8f2e8eecb`::ref 0 aborting False
>Thread-1052::DEBUG::2014-04-10 16:54:15,815::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1052::DEBUG::2014-04-10 16:54:15,815::task::579::TaskManager.Task::(_updateState) Task=`98de91f6-3f89-40bf-a7ac-b62ec6e152ed`::moving from state init -> state preparing
>Thread-1052::INFO::2014-04-10 16:54:15,816::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1052::INFO::2014-04-10 16:54:15,816::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1052::DEBUG::2014-04-10 16:54:15,816::task::1168::TaskManager.Task::(prepare) Task=`98de91f6-3f89-40bf-a7ac-b62ec6e152ed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1052::DEBUG::2014-04-10 16:54:15,816::task::579::TaskManager.Task::(_updateState) Task=`98de91f6-3f89-40bf-a7ac-b62ec6e152ed`::moving from state preparing -> state finished
>Thread-1052::DEBUG::2014-04-10 16:54:15,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1052::DEBUG::2014-04-10 16:54:15,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1052::DEBUG::2014-04-10 16:54:15,817::task::974::TaskManager.Task::(_decref) Task=`98de91f6-3f89-40bf-a7ac-b62ec6e152ed`::ref 0 aborting False
>Thread-1053::DEBUG::2014-04-10 16:54:15,823::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1053::DEBUG::2014-04-10 16:54:15,823::task::579::TaskManager.Task::(_updateState) Task=`47996079-055d-4f2a-9966-82996caf5c91`::moving from state init -> state preparing
>Thread-1053::INFO::2014-04-10 16:54:15,823::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1053::DEBUG::2014-04-10 16:54:15,824::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08048885-b355-4a30-b7be-a773a0978128`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1053::DEBUG::2014-04-10 16:54:15,824::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1053::DEBUG::2014-04-10 16:54:15,824::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1053::DEBUG::2014-04-10 16:54:15,824::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08048885-b355-4a30-b7be-a773a0978128`::Granted request
>Thread-1053::DEBUG::2014-04-10 16:54:15,825::task::811::TaskManager.Task::(resourceAcquired) Task=`47996079-055d-4f2a-9966-82996caf5c91`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1053::DEBUG::2014-04-10 16:54:15,825::task::974::TaskManager.Task::(_decref) Task=`47996079-055d-4f2a-9966-82996caf5c91`::ref 1 aborting False
>Thread-1053::INFO::2014-04-10 16:54:15,827::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1053::DEBUG::2014-04-10 16:54:15,827::task::1168::TaskManager.Task::(prepare) Task=`47996079-055d-4f2a-9966-82996caf5c91`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1053::DEBUG::2014-04-10 16:54:15,827::task::579::TaskManager.Task::(_updateState) Task=`47996079-055d-4f2a-9966-82996caf5c91`::moving from state preparing -> state finished
>Thread-1053::DEBUG::2014-04-10 16:54:15,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1053::DEBUG::2014-04-10 16:54:15,827::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1053::DEBUG::2014-04-10 16:54:15,828::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1053::DEBUG::2014-04-10 16:54:15,828::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1053::DEBUG::2014-04-10 16:54:15,828::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1053::DEBUG::2014-04-10 16:54:15,828::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1053::DEBUG::2014-04-10 16:54:15,828::task::974::TaskManager.Task::(_decref) Task=`47996079-055d-4f2a-9966-82996caf5c91`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:54:17,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:17,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:17,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044765 s, 1.5 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:54:17,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248535 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:20,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:20,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477098 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:20,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:20,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446951 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1057::DEBUG::2014-04-10 16:54:25,906::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1057::DEBUG::2014-04-10 16:54:25,906::task::579::TaskManager.Task::(_updateState) Task=`e63c6949-5749-4807-bbc0-3b8eff425b50`::moving from state init -> state preparing
>Thread-1057::INFO::2014-04-10 16:54:25,907::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1057::INFO::2014-04-10 16:54:25,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1057::DEBUG::2014-04-10 16:54:25,907::task::1168::TaskManager.Task::(prepare) Task=`e63c6949-5749-4807-bbc0-3b8eff425b50`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1057::DEBUG::2014-04-10 16:54:25,907::task::579::TaskManager.Task::(_updateState) Task=`e63c6949-5749-4807-bbc0-3b8eff425b50`::moving from state preparing -> state finished
>Thread-1057::DEBUG::2014-04-10 16:54:25,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1057::DEBUG::2014-04-10 16:54:25,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1057::DEBUG::2014-04-10 16:54:25,908::task::974::TaskManager.Task::(_decref) Task=`e63c6949-5749-4807-bbc0-3b8eff425b50`::ref 0 aborting False
>Thread-1058::DEBUG::2014-04-10 16:54:25,914::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1058::DEBUG::2014-04-10 16:54:25,915::task::579::TaskManager.Task::(_updateState) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::moving from state init -> state preparing
>Thread-1058::INFO::2014-04-10 16:54:25,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1058::DEBUG::2014-04-10 16:54:25,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c251385-2613-4058-a683-130f1e6ad6a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1058::DEBUG::2014-04-10 16:54:25,915::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1058::DEBUG::2014-04-10 16:54:25,916::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1058::DEBUG::2014-04-10 16:54:25,916::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c251385-2613-4058-a683-130f1e6ad6a7`::Granted request
>Thread-1058::DEBUG::2014-04-10 16:54:25,916::task::811::TaskManager.Task::(resourceAcquired) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1058::DEBUG::2014-04-10 16:54:25,916::task::974::TaskManager.Task::(_decref) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::ref 1 aborting False
>Thread-1058::INFO::2014-04-10 16:54:25,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1058::DEBUG::2014-04-10 16:54:25,918::task::1168::TaskManager.Task::(prepare) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::task::579::TaskManager.Task::(_updateState) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::moving from state preparing -> state finished
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1058::DEBUG::2014-04-10 16:54:25,919::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1058::DEBUG::2014-04-10 16:54:25,920::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1058::DEBUG::2014-04-10 16:54:25,920::task::974::TaskManager.Task::(_decref) Task=`0a8e389b-6ea5-4ded-b5e9-2828fb3fc596`::ref 0 aborting False
>Thread-1059::DEBUG::2014-04-10 16:54:27,095::task::579::TaskManager.Task::(_updateState) Task=`967ca564-18b8-4298-b605-26422b6f2ba3`::moving from state init -> state preparing
>Thread-1059::INFO::2014-04-10 16:54:27,098::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1059::INFO::2014-04-10 16:54:27,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446951', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248535', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044765', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477098', 'lastCheck': '7.0', 'valid': True}}
>Thread-1059::DEBUG::2014-04-10 16:54:27,106::task::1168::TaskManager.Task::(prepare) Task=`967ca564-18b8-4298-b605-26422b6f2ba3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446951', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248535', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044765', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477098', 'lastCheck': '7.0', 'valid': True}}
>Thread-1059::DEBUG::2014-04-10 16:54:27,109::task::579::TaskManager.Task::(_updateState) Task=`967ca564-18b8-4298-b605-26422b6f2ba3`::moving from state preparing -> state finished
>Thread-1059::DEBUG::2014-04-10 16:54:27,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1059::DEBUG::2014-04-10 16:54:27,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1059::DEBUG::2014-04-10 16:54:27,116::task::974::TaskManager.Task::(_decref) Task=`967ca564-18b8-4298-b605-26422b6f2ba3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:54:27,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:27,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:27,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263216 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:54:27,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313597 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:30,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:30,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479051 s, 768 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:30,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:30,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448928 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1063::DEBUG::2014-04-10 16:54:36,005::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1063::DEBUG::2014-04-10 16:54:36,005::task::579::TaskManager.Task::(_updateState) Task=`00beea2a-427b-4cad-a082-461fca72e1ba`::moving from state init -> state preparing
>Thread-1063::INFO::2014-04-10 16:54:36,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1063::INFO::2014-04-10 16:54:36,006::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1063::DEBUG::2014-04-10 16:54:36,006::task::1168::TaskManager.Task::(prepare) Task=`00beea2a-427b-4cad-a082-461fca72e1ba`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1063::DEBUG::2014-04-10 16:54:36,006::task::579::TaskManager.Task::(_updateState) Task=`00beea2a-427b-4cad-a082-461fca72e1ba`::moving from state preparing -> state finished
>Thread-1063::DEBUG::2014-04-10 16:54:36,006::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1063::DEBUG::2014-04-10 16:54:36,007::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1063::DEBUG::2014-04-10 16:54:36,007::task::974::TaskManager.Task::(_decref) Task=`00beea2a-427b-4cad-a082-461fca72e1ba`::ref 0 aborting False
>Thread-1064::DEBUG::2014-04-10 16:54:36,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1064::DEBUG::2014-04-10 16:54:36,014::task::579::TaskManager.Task::(_updateState) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::moving from state init -> state preparing
>Thread-1064::INFO::2014-04-10 16:54:36,014::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1064::DEBUG::2014-04-10 16:54:36,014::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebce757c-6515-4e3a-ab30-a042e2e99bc6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1064::DEBUG::2014-04-10 16:54:36,014::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1064::DEBUG::2014-04-10 16:54:36,015::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1064::DEBUG::2014-04-10 16:54:36,015::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebce757c-6515-4e3a-ab30-a042e2e99bc6`::Granted request
>Thread-1064::DEBUG::2014-04-10 16:54:36,015::task::811::TaskManager.Task::(resourceAcquired) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1064::DEBUG::2014-04-10 16:54:36,015::task::974::TaskManager.Task::(_decref) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::ref 1 aborting False
>Thread-1064::INFO::2014-04-10 16:54:36,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1064::DEBUG::2014-04-10 16:54:36,017::task::1168::TaskManager.Task::(prepare) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::task::579::TaskManager.Task::(_updateState) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::moving from state preparing -> state finished
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1064::DEBUG::2014-04-10 16:54:36,018::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1064::DEBUG::2014-04-10 16:54:36,019::task::974::TaskManager.Task::(_decref) Task=`4445c483-1110-4552-9099-eec0c9e25ed3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:54:37,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:37,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:37,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026476 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:54:37,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288273 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:40,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:40,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000426226 s, 863 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:40,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:40,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473632 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1067::DEBUG::2014-04-10 16:54:42,384::task::579::TaskManager.Task::(_updateState) Task=`d2fa438b-b2ba-43c5-83ca-92861cc35964`::moving from state init -> state preparing
>Thread-1067::INFO::2014-04-10 16:54:42,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1067::INFO::2014-04-10 16:54:42,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473632', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026476', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288273', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426226', 'lastCheck': '2.3', 'valid': True}}
>Thread-1067::DEBUG::2014-04-10 16:54:42,384::task::1168::TaskManager.Task::(prepare) Task=`d2fa438b-b2ba-43c5-83ca-92861cc35964`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473632', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026476', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288273', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426226', 'lastCheck': '2.3', 'valid': True}}
>Thread-1067::DEBUG::2014-04-10 16:54:42,385::task::579::TaskManager.Task::(_updateState) Task=`d2fa438b-b2ba-43c5-83ca-92861cc35964`::moving from state preparing -> state finished
>Thread-1067::DEBUG::2014-04-10 16:54:42,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1067::DEBUG::2014-04-10 16:54:42,385::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1067::DEBUG::2014-04-10 16:54:42,385::task::974::TaskManager.Task::(_decref) Task=`d2fa438b-b2ba-43c5-83ca-92861cc35964`::ref 0 aborting False
>Thread-1070::DEBUG::2014-04-10 16:54:46,094::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1070::DEBUG::2014-04-10 16:54:46,094::task::579::TaskManager.Task::(_updateState) Task=`1e57c334-c119-467a-bf82-b6b5a2e59f1d`::moving from state init -> state preparing
>Thread-1070::INFO::2014-04-10 16:54:46,094::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1070::INFO::2014-04-10 16:54:46,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1070::DEBUG::2014-04-10 16:54:46,095::task::1168::TaskManager.Task::(prepare) Task=`1e57c334-c119-467a-bf82-b6b5a2e59f1d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1070::DEBUG::2014-04-10 16:54:46,095::task::579::TaskManager.Task::(_updateState) Task=`1e57c334-c119-467a-bf82-b6b5a2e59f1d`::moving from state preparing -> state finished
>Thread-1070::DEBUG::2014-04-10 16:54:46,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1070::DEBUG::2014-04-10 16:54:46,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1070::DEBUG::2014-04-10 16:54:46,095::task::974::TaskManager.Task::(_decref) Task=`1e57c334-c119-467a-bf82-b6b5a2e59f1d`::ref 0 aborting False
>Thread-1071::DEBUG::2014-04-10 16:54:46,101::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1071::DEBUG::2014-04-10 16:54:46,102::task::579::TaskManager.Task::(_updateState) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::moving from state init -> state preparing
>Thread-1071::INFO::2014-04-10 16:54:46,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1071::DEBUG::2014-04-10 16:54:46,102::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8d34ecd8-bd4f-4c6c-a584-b9fef432b7ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1071::DEBUG::2014-04-10 16:54:46,103::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1071::DEBUG::2014-04-10 16:54:46,103::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1071::DEBUG::2014-04-10 16:54:46,103::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8d34ecd8-bd4f-4c6c-a584-b9fef432b7ab`::Granted request
>Thread-1071::DEBUG::2014-04-10 16:54:46,103::task::811::TaskManager.Task::(resourceAcquired) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1071::DEBUG::2014-04-10 16:54:46,103::task::974::TaskManager.Task::(_decref) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::ref 1 aborting False
>Thread-1071::INFO::2014-04-10 16:54:46,105::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1071::DEBUG::2014-04-10 16:54:46,105::task::1168::TaskManager.Task::(prepare) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::task::579::TaskManager.Task::(_updateState) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::moving from state preparing -> state finished
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1071::DEBUG::2014-04-10 16:54:46,106::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1071::DEBUG::2014-04-10 16:54:46,107::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1071::DEBUG::2014-04-10 16:54:46,107::task::974::TaskManager.Task::(_decref) Task=`72794ab1-043b-4bb0-ac14-28e13eaa128e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:54:47,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:47,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00041259 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:54:47,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:47,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283727 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:54:50,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:54:50,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000550964 s, 668 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:54:50,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:54:50,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00054021 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1075::DEBUG::2014-04-10 16:54:56,186::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1075::DEBUG::2014-04-10 16:54:56,187::task::579::TaskManager.Task::(_updateState) Task=`6f6e1be7-fc7b-44ce-a637-1434f9ee640a`::moving from state init -> state preparing
>Thread-1075::INFO::2014-04-10 16:54:56,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1075::INFO::2014-04-10 16:54:56,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1075::DEBUG::2014-04-10 16:54:56,188::task::1168::TaskManager.Task::(prepare) Task=`6f6e1be7-fc7b-44ce-a637-1434f9ee640a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1075::DEBUG::2014-04-10 16:54:56,188::task::579::TaskManager.Task::(_updateState) Task=`6f6e1be7-fc7b-44ce-a637-1434f9ee640a`::moving from state preparing -> state finished
>Thread-1075::DEBUG::2014-04-10 16:54:56,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1075::DEBUG::2014-04-10 16:54:56,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1075::DEBUG::2014-04-10 16:54:56,188::task::974::TaskManager.Task::(_decref) Task=`6f6e1be7-fc7b-44ce-a637-1434f9ee640a`::ref 0 aborting False
>Thread-1076::DEBUG::2014-04-10 16:54:56,206::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1076::DEBUG::2014-04-10 16:54:56,207::task::579::TaskManager.Task::(_updateState) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::moving from state init -> state preparing
>Thread-1076::INFO::2014-04-10 16:54:56,207::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1076::DEBUG::2014-04-10 16:54:56,207::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9033c222-b490-404b-9bd3-c6bb11ce0bb8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1076::DEBUG::2014-04-10 16:54:56,207::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1076::DEBUG::2014-04-10 16:54:56,208::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1076::DEBUG::2014-04-10 16:54:56,208::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9033c222-b490-404b-9bd3-c6bb11ce0bb8`::Granted request
>Thread-1076::DEBUG::2014-04-10 16:54:56,208::task::811::TaskManager.Task::(resourceAcquired) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1076::DEBUG::2014-04-10 16:54:56,208::task::974::TaskManager.Task::(_decref) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::ref 1 aborting False
>Thread-1076::INFO::2014-04-10 16:54:56,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1076::DEBUG::2014-04-10 16:54:56,211::task::1168::TaskManager.Task::(prepare) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1076::DEBUG::2014-04-10 16:54:56,211::task::579::TaskManager.Task::(_updateState) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::moving from state preparing -> state finished
>Thread-1076::DEBUG::2014-04-10 16:54:56,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1076::DEBUG::2014-04-10 16:54:56,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1076::DEBUG::2014-04-10 16:54:56,212::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1076::DEBUG::2014-04-10 16:54:56,212::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1076::DEBUG::2014-04-10 16:54:56,212::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1076::DEBUG::2014-04-10 16:54:56,212::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1076::DEBUG::2014-04-10 16:54:56,213::task::974::TaskManager.Task::(_decref) Task=`5c23a15c-701b-48ee-9991-6cee98986086`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:54:57,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:54:57,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000315651 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:54:57,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:54:57,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325271 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1077::DEBUG::2014-04-10 16:54:57,552::task::579::TaskManager.Task::(_updateState) Task=`85879fa2-fb7c-4703-a4b7-bece90e9bea5`::moving from state init -> state preparing
>Thread-1077::INFO::2014-04-10 16:54:57,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1077::INFO::2014-04-10 16:54:57,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054021', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315651', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325271', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550964', 'lastCheck': '7.4', 'valid': True}}
>Thread-1077::DEBUG::2014-04-10 16:54:57,553::task::1168::TaskManager.Task::(prepare) Task=`85879fa2-fb7c-4703-a4b7-bece90e9bea5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054021', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315651', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325271', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550964', 'lastCheck': '7.4', 'valid': True}}
>Thread-1077::DEBUG::2014-04-10 16:54:57,554::task::579::TaskManager.Task::(_updateState) Task=`85879fa2-fb7c-4703-a4b7-bece90e9bea5`::moving from state preparing -> state finished
>Thread-1077::DEBUG::2014-04-10 16:54:57,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1077::DEBUG::2014-04-10 16:54:57,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1077::DEBUG::2014-04-10 16:54:57,554::task::974::TaskManager.Task::(_decref) Task=`85879fa2-fb7c-4703-a4b7-bece90e9bea5`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:55:00,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:00,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000497837 s, 739 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:00,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:00,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484032 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1081::DEBUG::2014-04-10 16:55:06,293::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-1081::DEBUG::2014-04-10 16:55:06,293::task::579::TaskManager.Task::(_updateState) Task=`4b64f7be-27fc-4730-9423-e0e7dd9c4188`::moving from state init -> state preparing
>Thread-1081::INFO::2014-04-10 16:55:06,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1081::INFO::2014-04-10 16:55:06,294::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1081::DEBUG::2014-04-10 16:55:06,294::task::1168::TaskManager.Task::(prepare) Task=`4b64f7be-27fc-4730-9423-e0e7dd9c4188`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1081::DEBUG::2014-04-10 16:55:06,294::task::579::TaskManager.Task::(_updateState) Task=`4b64f7be-27fc-4730-9423-e0e7dd9c4188`::moving from state preparing -> state finished
>Thread-1081::DEBUG::2014-04-10 16:55:06,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1081::DEBUG::2014-04-10 16:55:06,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1081::DEBUG::2014-04-10 16:55:06,295::task::974::TaskManager.Task::(_decref) Task=`4b64f7be-27fc-4730-9423-e0e7dd9c4188`::ref 0 aborting False
>Thread-1082::DEBUG::2014-04-10 16:55:06,302::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-1082::DEBUG::2014-04-10 16:55:06,302::task::579::TaskManager.Task::(_updateState) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::moving from state init -> state preparing
>Thread-1082::INFO::2014-04-10 16:55:06,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1082::DEBUG::2014-04-10 16:55:06,303::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e98cf276-2ba9-4891-b816-62924b128959`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1082::DEBUG::2014-04-10 16:55:06,303::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1082::DEBUG::2014-04-10 16:55:06,304::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1082::DEBUG::2014-04-10 16:55:06,304::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e98cf276-2ba9-4891-b816-62924b128959`::Granted request
>Thread-1082::DEBUG::2014-04-10 16:55:06,304::task::811::TaskManager.Task::(resourceAcquired) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1082::DEBUG::2014-04-10 16:55:06,304::task::974::TaskManager.Task::(_decref) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::ref 1 aborting False
>Thread-1082::INFO::2014-04-10 16:55:06,307::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1082::DEBUG::2014-04-10 16:55:06,307::task::1168::TaskManager.Task::(prepare) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::task::579::TaskManager.Task::(_updateState) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::moving from state preparing -> state finished
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1082::DEBUG::2014-04-10 16:55:06,308::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1082::DEBUG::2014-04-10 16:55:06,309::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1082::DEBUG::2014-04-10 16:55:06,309::task::974::TaskManager.Task::(_decref) Task=`b8d1cd82-6850-4c53-83c5-b2755852d8ab`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:07,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:07,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347776 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:07,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:07,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035037 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:55:10,134::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:10,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000538131 s, 684 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:10,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:10,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460162 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1085::DEBUG::2014-04-10 16:55:12,772::task::579::TaskManager.Task::(_updateState) Task=`ad46f2c0-a3db-4249-a09f-d85670429044`::moving from state init -> state preparing
>Thread-1085::INFO::2014-04-10 16:55:12,773::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1085::INFO::2014-04-10 16:55:12,773::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460162', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347776', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035037', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538131', 'lastCheck': '2.6', 'valid': True}}
>Thread-1085::DEBUG::2014-04-10 16:55:12,773::task::1168::TaskManager.Task::(prepare) Task=`ad46f2c0-a3db-4249-a09f-d85670429044`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460162', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347776', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035037', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538131', 'lastCheck': '2.6', 'valid': True}}
>Thread-1085::DEBUG::2014-04-10 16:55:12,773::task::579::TaskManager.Task::(_updateState) Task=`ad46f2c0-a3db-4249-a09f-d85670429044`::moving from state preparing -> state finished
>Thread-1085::DEBUG::2014-04-10 16:55:12,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1085::DEBUG::2014-04-10 16:55:12,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1085::DEBUG::2014-04-10 16:55:12,774::task::974::TaskManager.Task::(_decref) Task=`ad46f2c0-a3db-4249-a09f-d85670429044`::ref 0 aborting False
>Thread-1088::DEBUG::2014-04-10 16:55:16,389::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1088::DEBUG::2014-04-10 16:55:16,390::task::579::TaskManager.Task::(_updateState) Task=`8a3045e8-552e-4535-8e74-a7480e396d10`::moving from state init -> state preparing
>Thread-1088::INFO::2014-04-10 16:55:16,390::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1088::INFO::2014-04-10 16:55:16,390::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1088::DEBUG::2014-04-10 16:55:16,390::task::1168::TaskManager.Task::(prepare) Task=`8a3045e8-552e-4535-8e74-a7480e396d10`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1088::DEBUG::2014-04-10 16:55:16,391::task::579::TaskManager.Task::(_updateState) Task=`8a3045e8-552e-4535-8e74-a7480e396d10`::moving from state preparing -> state finished
>Thread-1088::DEBUG::2014-04-10 16:55:16,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1088::DEBUG::2014-04-10 16:55:16,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1088::DEBUG::2014-04-10 16:55:16,391::task::974::TaskManager.Task::(_decref) Task=`8a3045e8-552e-4535-8e74-a7480e396d10`::ref 0 aborting False
>Thread-1089::DEBUG::2014-04-10 16:55:16,398::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1089::DEBUG::2014-04-10 16:55:16,399::task::579::TaskManager.Task::(_updateState) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::moving from state init -> state preparing
>Thread-1089::INFO::2014-04-10 16:55:16,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1089::DEBUG::2014-04-10 16:55:16,399::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1435000a-1f5e-46d5-94c6-cc463214e3bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1089::DEBUG::2014-04-10 16:55:16,400::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1089::DEBUG::2014-04-10 16:55:16,400::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1089::DEBUG::2014-04-10 16:55:16,400::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1435000a-1f5e-46d5-94c6-cc463214e3bd`::Granted request
>Thread-1089::DEBUG::2014-04-10 16:55:16,400::task::811::TaskManager.Task::(resourceAcquired) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1089::DEBUG::2014-04-10 16:55:16,401::task::974::TaskManager.Task::(_decref) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::ref 1 aborting False
>Thread-1089::INFO::2014-04-10 16:55:16,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1089::DEBUG::2014-04-10 16:55:16,403::task::1168::TaskManager.Task::(prepare) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1089::DEBUG::2014-04-10 16:55:16,403::task::579::TaskManager.Task::(_updateState) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::moving from state preparing -> state finished
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1089::DEBUG::2014-04-10 16:55:16,404::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1089::DEBUG::2014-04-10 16:55:16,405::task::974::TaskManager.Task::(_decref) Task=`dd1f507a-de44-43a5-82bc-8af964074eec`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:17,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:17,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325635 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:17,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:17,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328525 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:55:20,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:20,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000467669 s, 787 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:20,218::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:20,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473104 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1093::DEBUG::2014-04-10 16:55:26,489::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1093::DEBUG::2014-04-10 16:55:26,497::task::579::TaskManager.Task::(_updateState) Task=`1a667600-9aba-474d-8411-448b3d6bb8cc`::moving from state init -> state preparing
>Thread-1093::INFO::2014-04-10 16:55:26,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1093::INFO::2014-04-10 16:55:26,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1093::DEBUG::2014-04-10 16:55:26,498::task::1168::TaskManager.Task::(prepare) Task=`1a667600-9aba-474d-8411-448b3d6bb8cc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1093::DEBUG::2014-04-10 16:55:26,498::task::579::TaskManager.Task::(_updateState) Task=`1a667600-9aba-474d-8411-448b3d6bb8cc`::moving from state preparing -> state finished
>Thread-1093::DEBUG::2014-04-10 16:55:26,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1093::DEBUG::2014-04-10 16:55:26,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1093::DEBUG::2014-04-10 16:55:26,499::task::974::TaskManager.Task::(_decref) Task=`1a667600-9aba-474d-8411-448b3d6bb8cc`::ref 0 aborting False
>Thread-1094::DEBUG::2014-04-10 16:55:26,506::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1094::DEBUG::2014-04-10 16:55:26,506::task::579::TaskManager.Task::(_updateState) Task=`4836451a-043c-468a-904c-143466545c36`::moving from state init -> state preparing
>Thread-1094::INFO::2014-04-10 16:55:26,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1094::DEBUG::2014-04-10 16:55:26,507::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0f54ad9c-bcd4-47f6-b248-55d5fb312390`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1094::DEBUG::2014-04-10 16:55:26,507::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1094::DEBUG::2014-04-10 16:55:26,508::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1094::DEBUG::2014-04-10 16:55:26,508::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0f54ad9c-bcd4-47f6-b248-55d5fb312390`::Granted request
>Thread-1094::DEBUG::2014-04-10 16:55:26,508::task::811::TaskManager.Task::(resourceAcquired) Task=`4836451a-043c-468a-904c-143466545c36`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1094::DEBUG::2014-04-10 16:55:26,508::task::974::TaskManager.Task::(_decref) Task=`4836451a-043c-468a-904c-143466545c36`::ref 1 aborting False
>Thread-1094::INFO::2014-04-10 16:55:26,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1094::DEBUG::2014-04-10 16:55:26,511::task::1168::TaskManager.Task::(prepare) Task=`4836451a-043c-468a-904c-143466545c36`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1094::DEBUG::2014-04-10 16:55:26,511::task::579::TaskManager.Task::(_updateState) Task=`4836451a-043c-468a-904c-143466545c36`::moving from state preparing -> state finished
>Thread-1094::DEBUG::2014-04-10 16:55:26,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1094::DEBUG::2014-04-10 16:55:26,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1094::DEBUG::2014-04-10 16:55:26,512::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1094::DEBUG::2014-04-10 16:55:26,512::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1094::DEBUG::2014-04-10 16:55:26,512::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1094::DEBUG::2014-04-10 16:55:26,512::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1094::DEBUG::2014-04-10 16:55:26,513::task::974::TaskManager.Task::(_decref) Task=`4836451a-043c-468a-904c-143466545c36`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:27,499::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 16:55:27,512::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 16:55:27,513::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 16:55:27,518::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 16:55:27,519::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 16:55:27,519::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 16:55:27,519::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 16:55:27,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:27,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330195 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:27,542::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 16:55:27,559::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 16:55:27,560::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 16:55:27,565::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 16:55:27,566::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 16:55:27,566::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 16:55:27,566::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 16:55:27,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:27,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309983 s, 2.2 MB/s\n'; <rc> = 0
>Thread-1103::DEBUG::2014-04-10 16:55:27,943::task::579::TaskManager.Task::(_updateState) Task=`88795342-7df9-41e2-ae75-7f6458a51bc9`::moving from state init -> state preparing
>Thread-1103::INFO::2014-04-10 16:55:27,943::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1103::INFO::2014-04-10 16:55:27,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473104', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330195', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309983', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467669', 'lastCheck': '7.8', 'valid': True}}
>Thread-1103::DEBUG::2014-04-10 16:55:27,943::task::1168::TaskManager.Task::(prepare) Task=`88795342-7df9-41e2-ae75-7f6458a51bc9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473104', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330195', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309983', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467669', 'lastCheck': '7.8', 'valid': True}}
>Thread-1103::DEBUG::2014-04-10 16:55:27,944::task::579::TaskManager.Task::(_updateState) Task=`88795342-7df9-41e2-ae75-7f6458a51bc9`::moving from state preparing -> state finished
>Thread-1103::DEBUG::2014-04-10 16:55:27,944::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1103::DEBUG::2014-04-10 16:55:27,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1103::DEBUG::2014-04-10 16:55:27,944::task::974::TaskManager.Task::(_decref) Task=`88795342-7df9-41e2-ae75-7f6458a51bc9`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:55:30,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:30,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470652 s, 782 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:30,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:30,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484698 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1107::DEBUG::2014-04-10 16:55:36,655::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1107::DEBUG::2014-04-10 16:55:36,656::task::579::TaskManager.Task::(_updateState) Task=`95ea5bbb-ec31-464c-ace5-f4f00ccab518`::moving from state init -> state preparing
>Thread-1107::INFO::2014-04-10 16:55:36,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1107::INFO::2014-04-10 16:55:36,656::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1107::DEBUG::2014-04-10 16:55:36,657::task::1168::TaskManager.Task::(prepare) Task=`95ea5bbb-ec31-464c-ace5-f4f00ccab518`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1107::DEBUG::2014-04-10 16:55:36,657::task::579::TaskManager.Task::(_updateState) Task=`95ea5bbb-ec31-464c-ace5-f4f00ccab518`::moving from state preparing -> state finished
>Thread-1107::DEBUG::2014-04-10 16:55:36,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1107::DEBUG::2014-04-10 16:55:36,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1107::DEBUG::2014-04-10 16:55:36,657::task::974::TaskManager.Task::(_decref) Task=`95ea5bbb-ec31-464c-ace5-f4f00ccab518`::ref 0 aborting False
>Thread-1108::DEBUG::2014-04-10 16:55:36,664::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1108::DEBUG::2014-04-10 16:55:36,664::task::579::TaskManager.Task::(_updateState) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::moving from state init -> state preparing
>Thread-1108::INFO::2014-04-10 16:55:36,665::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1108::DEBUG::2014-04-10 16:55:36,665::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e34f8904-b47f-4012-84cf-67bf9d7d8d77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1108::DEBUG::2014-04-10 16:55:36,665::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1108::DEBUG::2014-04-10 16:55:36,665::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1108::DEBUG::2014-04-10 16:55:36,666::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e34f8904-b47f-4012-84cf-67bf9d7d8d77`::Granted request
>Thread-1108::DEBUG::2014-04-10 16:55:36,666::task::811::TaskManager.Task::(resourceAcquired) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1108::DEBUG::2014-04-10 16:55:36,666::task::974::TaskManager.Task::(_decref) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::ref 1 aborting False
>Thread-1108::INFO::2014-04-10 16:55:36,668::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1108::DEBUG::2014-04-10 16:55:36,669::task::1168::TaskManager.Task::(prepare) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1108::DEBUG::2014-04-10 16:55:36,669::task::579::TaskManager.Task::(_updateState) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::moving from state preparing -> state finished
>Thread-1108::DEBUG::2014-04-10 16:55:36,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1108::DEBUG::2014-04-10 16:55:36,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1108::DEBUG::2014-04-10 16:55:36,670::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1108::DEBUG::2014-04-10 16:55:36,670::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1108::DEBUG::2014-04-10 16:55:36,670::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1108::DEBUG::2014-04-10 16:55:36,670::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1108::DEBUG::2014-04-10 16:55:36,670::task::974::TaskManager.Task::(_decref) Task=`a0128542-9210-4fb6-b332-16de7cde81a2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:37,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:37,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000388502 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:37,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:37,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313083 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:55:40,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:40,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464104 s, 793 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:40,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:40,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00049605 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1111::DEBUG::2014-04-10 16:55:43,099::task::579::TaskManager.Task::(_updateState) Task=`36e9ba97-9c49-4fe1-865e-9038373a223c`::moving from state init -> state preparing
>Thread-1111::INFO::2014-04-10 16:55:43,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1111::INFO::2014-04-10 16:55:43,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049605', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388502', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313083', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464104', 'lastCheck': '2.9', 'valid': True}}
>Thread-1111::DEBUG::2014-04-10 16:55:43,100::task::1168::TaskManager.Task::(prepare) Task=`36e9ba97-9c49-4fe1-865e-9038373a223c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049605', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388502', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313083', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464104', 'lastCheck': '2.9', 'valid': True}}
>Thread-1111::DEBUG::2014-04-10 16:55:43,100::task::579::TaskManager.Task::(_updateState) Task=`36e9ba97-9c49-4fe1-865e-9038373a223c`::moving from state preparing -> state finished
>Thread-1111::DEBUG::2014-04-10 16:55:43,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1111::DEBUG::2014-04-10 16:55:43,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1111::DEBUG::2014-04-10 16:55:43,100::task::974::TaskManager.Task::(_decref) Task=`36e9ba97-9c49-4fe1-865e-9038373a223c`::ref 0 aborting False
>Thread-1114::DEBUG::2014-04-10 16:55:46,761::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1114::DEBUG::2014-04-10 16:55:46,761::task::579::TaskManager.Task::(_updateState) Task=`161fe3fd-2bc1-40ad-a0c0-277844511840`::moving from state init -> state preparing
>Thread-1114::INFO::2014-04-10 16:55:46,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1114::INFO::2014-04-10 16:55:46,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1114::DEBUG::2014-04-10 16:55:46,762::task::1168::TaskManager.Task::(prepare) Task=`161fe3fd-2bc1-40ad-a0c0-277844511840`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1114::DEBUG::2014-04-10 16:55:46,762::task::579::TaskManager.Task::(_updateState) Task=`161fe3fd-2bc1-40ad-a0c0-277844511840`::moving from state preparing -> state finished
>Thread-1114::DEBUG::2014-04-10 16:55:46,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1114::DEBUG::2014-04-10 16:55:46,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1114::DEBUG::2014-04-10 16:55:46,763::task::974::TaskManager.Task::(_decref) Task=`161fe3fd-2bc1-40ad-a0c0-277844511840`::ref 0 aborting False
>Thread-1115::DEBUG::2014-04-10 16:55:46,770::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1115::DEBUG::2014-04-10 16:55:46,770::task::579::TaskManager.Task::(_updateState) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::moving from state init -> state preparing
>Thread-1115::INFO::2014-04-10 16:55:46,770::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1115::DEBUG::2014-04-10 16:55:46,771::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e94f23b-0187-420c-bdb0-16fd4726a21b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1115::DEBUG::2014-04-10 16:55:46,771::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1115::DEBUG::2014-04-10 16:55:46,771::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1115::DEBUG::2014-04-10 16:55:46,771::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e94f23b-0187-420c-bdb0-16fd4726a21b`::Granted request
>Thread-1115::DEBUG::2014-04-10 16:55:46,772::task::811::TaskManager.Task::(resourceAcquired) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1115::DEBUG::2014-04-10 16:55:46,772::task::974::TaskManager.Task::(_decref) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::ref 1 aborting False
>Thread-1115::INFO::2014-04-10 16:55:46,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1115::DEBUG::2014-04-10 16:55:46,774::task::1168::TaskManager.Task::(prepare) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1115::DEBUG::2014-04-10 16:55:46,775::task::579::TaskManager.Task::(_updateState) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::moving from state preparing -> state finished
>Thread-1115::DEBUG::2014-04-10 16:55:46,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1115::DEBUG::2014-04-10 16:55:46,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1115::DEBUG::2014-04-10 16:55:46,775::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1115::DEBUG::2014-04-10 16:55:46,775::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1115::DEBUG::2014-04-10 16:55:46,776::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1115::DEBUG::2014-04-10 16:55:46,776::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1115::DEBUG::2014-04-10 16:55:46,776::task::974::TaskManager.Task::(_decref) Task=`190682ec-2f46-4eef-8ddb-31fddef5fd82`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:47,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:47,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356367 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:47,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:47,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362223 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:55:50,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:55:50,196::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000491948 s, 748 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:55:50,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:55:50,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000465029 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1119::DEBUG::2014-04-10 16:55:56,860::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1119::DEBUG::2014-04-10 16:55:56,869::task::579::TaskManager.Task::(_updateState) Task=`8d66e0ec-a99a-4a6e-8e6e-ad0aeae428e7`::moving from state init -> state preparing
>Thread-1119::INFO::2014-04-10 16:55:56,869::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1119::INFO::2014-04-10 16:55:56,870::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1119::DEBUG::2014-04-10 16:55:56,870::task::1168::TaskManager.Task::(prepare) Task=`8d66e0ec-a99a-4a6e-8e6e-ad0aeae428e7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1119::DEBUG::2014-04-10 16:55:56,870::task::579::TaskManager.Task::(_updateState) Task=`8d66e0ec-a99a-4a6e-8e6e-ad0aeae428e7`::moving from state preparing -> state finished
>Thread-1119::DEBUG::2014-04-10 16:55:56,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1119::DEBUG::2014-04-10 16:55:56,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1119::DEBUG::2014-04-10 16:55:56,871::task::974::TaskManager.Task::(_decref) Task=`8d66e0ec-a99a-4a6e-8e6e-ad0aeae428e7`::ref 0 aborting False
>Thread-1120::DEBUG::2014-04-10 16:55:56,878::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1120::DEBUG::2014-04-10 16:55:56,878::task::579::TaskManager.Task::(_updateState) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::moving from state init -> state preparing
>Thread-1120::INFO::2014-04-10 16:55:56,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1120::DEBUG::2014-04-10 16:55:56,879::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`72a85ce6-ee9b-4fdf-936f-2dd847b464e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1120::DEBUG::2014-04-10 16:55:56,879::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1120::DEBUG::2014-04-10 16:55:56,880::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1120::DEBUG::2014-04-10 16:55:56,880::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`72a85ce6-ee9b-4fdf-936f-2dd847b464e2`::Granted request
>Thread-1120::DEBUG::2014-04-10 16:55:56,880::task::811::TaskManager.Task::(resourceAcquired) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1120::DEBUG::2014-04-10 16:55:56,880::task::974::TaskManager.Task::(_decref) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::ref 1 aborting False
>Thread-1120::INFO::2014-04-10 16:55:56,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1120::DEBUG::2014-04-10 16:55:56,883::task::1168::TaskManager.Task::(prepare) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1120::DEBUG::2014-04-10 16:55:56,883::task::579::TaskManager.Task::(_updateState) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::moving from state preparing -> state finished
>Thread-1120::DEBUG::2014-04-10 16:55:56,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1120::DEBUG::2014-04-10 16:55:56,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1120::DEBUG::2014-04-10 16:55:56,884::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1120::DEBUG::2014-04-10 16:55:56,884::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1120::DEBUG::2014-04-10 16:55:56,884::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1120::DEBUG::2014-04-10 16:55:56,884::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1120::DEBUG::2014-04-10 16:55:56,884::task::974::TaskManager.Task::(_decref) Task=`6ccd6391-d8f4-47a9-8df7-11d3b1272828`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:55:57,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:55:57,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402428 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:55:57,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:55:57,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260658 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1121::DEBUG::2014-04-10 16:55:58,267::task::579::TaskManager.Task::(_updateState) Task=`77c16ada-3f96-43e7-8b62-23e50ffb1e61`::moving from state init -> state preparing
>Thread-1121::INFO::2014-04-10 16:55:58,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1121::INFO::2014-04-10 16:55:58,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465029', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402428', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260658', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491948', 'lastCheck': '8.1', 'valid': True}}
>Thread-1121::DEBUG::2014-04-10 16:55:58,267::task::1168::TaskManager.Task::(prepare) Task=`77c16ada-3f96-43e7-8b62-23e50ffb1e61`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465029', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402428', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260658', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491948', 'lastCheck': '8.1', 'valid': True}}
>Thread-1121::DEBUG::2014-04-10 16:55:58,268::task::579::TaskManager.Task::(_updateState) Task=`77c16ada-3f96-43e7-8b62-23e50ffb1e61`::moving from state preparing -> state finished
>Thread-1121::DEBUG::2014-04-10 16:55:58,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1121::DEBUG::2014-04-10 16:55:58,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1121::DEBUG::2014-04-10 16:55:58,268::task::974::TaskManager.Task::(_decref) Task=`77c16ada-3f96-43e7-8b62-23e50ffb1e61`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:56:00,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:00,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487319 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:00,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:00,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00059753 s, 1.1 MB/s\n'; <rc> = 0
>Thread-1125::DEBUG::2014-04-10 16:56:07,476::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1125::DEBUG::2014-04-10 16:56:07,479::task::579::TaskManager.Task::(_updateState) Task=`a120bc3b-997c-47e8-b0b0-483258720341`::moving from state init -> state preparing
>Thread-1125::INFO::2014-04-10 16:56:07,481::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1125::INFO::2014-04-10 16:56:07,483::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1125::DEBUG::2014-04-10 16:56:07,484::task::1168::TaskManager.Task::(prepare) Task=`a120bc3b-997c-47e8-b0b0-483258720341`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1125::DEBUG::2014-04-10 16:56:07,484::task::579::TaskManager.Task::(_updateState) Task=`a120bc3b-997c-47e8-b0b0-483258720341`::moving from state preparing -> state finished
>Thread-1125::DEBUG::2014-04-10 16:56:07,484::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1125::DEBUG::2014-04-10 16:56:07,484::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1125::DEBUG::2014-04-10 16:56:07,484::task::974::TaskManager.Task::(_decref) Task=`a120bc3b-997c-47e8-b0b0-483258720341`::ref 0 aborting False
>Thread-1127::DEBUG::2014-04-10 16:56:07,493::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1127::DEBUG::2014-04-10 16:56:07,493::task::579::TaskManager.Task::(_updateState) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::moving from state init -> state preparing
>Thread-1127::INFO::2014-04-10 16:56:07,493::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1127::DEBUG::2014-04-10 16:56:07,494::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a80517ac-6e9b-4ba2-a046-18ab2044b9a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1127::DEBUG::2014-04-10 16:56:07,494::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1127::DEBUG::2014-04-10 16:56:07,494::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1127::DEBUG::2014-04-10 16:56:07,495::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a80517ac-6e9b-4ba2-a046-18ab2044b9a6`::Granted request
>Thread-1127::DEBUG::2014-04-10 16:56:07,495::task::811::TaskManager.Task::(resourceAcquired) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1127::DEBUG::2014-04-10 16:56:07,495::task::974::TaskManager.Task::(_decref) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::ref 1 aborting False
>Thread-1127::INFO::2014-04-10 16:56:07,497::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1127::DEBUG::2014-04-10 16:56:07,498::task::1168::TaskManager.Task::(prepare) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1127::DEBUG::2014-04-10 16:56:07,498::task::579::TaskManager.Task::(_updateState) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::moving from state preparing -> state finished
>Thread-1127::DEBUG::2014-04-10 16:56:07,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1127::DEBUG::2014-04-10 16:56:07,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1127::DEBUG::2014-04-10 16:56:07,498::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1127::DEBUG::2014-04-10 16:56:07,499::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1127::DEBUG::2014-04-10 16:56:07,499::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1127::DEBUG::2014-04-10 16:56:07,499::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1127::DEBUG::2014-04-10 16:56:07,499::task::974::TaskManager.Task::(_decref) Task=`8685172d-1249-4c9d-97e3-520862b790a0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:56:07,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:07,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383861 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:56:07,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:56:07,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029176 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:56:10,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:10,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477322 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:10,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:10,295::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000388592 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1129::DEBUG::2014-04-10 16:56:13,524::task::579::TaskManager.Task::(_updateState) Task=`c11962f2-b42e-421e-ae29-9b0068c547e1`::moving from state init -> state preparing
>Thread-1129::INFO::2014-04-10 16:56:13,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1129::INFO::2014-04-10 16:56:13,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388592', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383861', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029176', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477322', 'lastCheck': '3.3', 'valid': True}}
>Thread-1129::DEBUG::2014-04-10 16:56:13,524::task::1168::TaskManager.Task::(prepare) Task=`c11962f2-b42e-421e-ae29-9b0068c547e1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388592', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383861', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029176', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477322', 'lastCheck': '3.3', 'valid': True}}
>Thread-1129::DEBUG::2014-04-10 16:56:13,525::task::579::TaskManager.Task::(_updateState) Task=`c11962f2-b42e-421e-ae29-9b0068c547e1`::moving from state preparing -> state finished
>Thread-1129::DEBUG::2014-04-10 16:56:13,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1129::DEBUG::2014-04-10 16:56:13,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1129::DEBUG::2014-04-10 16:56:13,525::task::974::TaskManager.Task::(_decref) Task=`c11962f2-b42e-421e-ae29-9b0068c547e1`::ref 0 aborting False
>Thread-1132::DEBUG::2014-04-10 16:56:17,572::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1132::DEBUG::2014-04-10 16:56:17,572::task::579::TaskManager.Task::(_updateState) Task=`4f19bd91-fadf-4f26-8318-f93470f36bc5`::moving from state init -> state preparing
>Thread-1132::INFO::2014-04-10 16:56:17,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1132::INFO::2014-04-10 16:56:17,573::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1132::DEBUG::2014-04-10 16:56:17,573::task::1168::TaskManager.Task::(prepare) Task=`4f19bd91-fadf-4f26-8318-f93470f36bc5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1132::DEBUG::2014-04-10 16:56:17,573::task::579::TaskManager.Task::(_updateState) Task=`4f19bd91-fadf-4f26-8318-f93470f36bc5`::moving from state preparing -> state finished
>Thread-1132::DEBUG::2014-04-10 16:56:17,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1132::DEBUG::2014-04-10 16:56:17,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1132::DEBUG::2014-04-10 16:56:17,574::task::974::TaskManager.Task::(_decref) Task=`4f19bd91-fadf-4f26-8318-f93470f36bc5`::ref 0 aborting False
>Thread-1133::DEBUG::2014-04-10 16:56:17,580::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1133::DEBUG::2014-04-10 16:56:17,581::task::579::TaskManager.Task::(_updateState) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::moving from state init -> state preparing
>Thread-1133::INFO::2014-04-10 16:56:17,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1133::DEBUG::2014-04-10 16:56:17,581::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c2a67ed-8291-4df0-95f4-e5b53c23d771`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1133::DEBUG::2014-04-10 16:56:17,581::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1133::DEBUG::2014-04-10 16:56:17,582::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1133::DEBUG::2014-04-10 16:56:17,582::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c2a67ed-8291-4df0-95f4-e5b53c23d771`::Granted request
>Thread-1133::DEBUG::2014-04-10 16:56:17,582::task::811::TaskManager.Task::(resourceAcquired) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1133::DEBUG::2014-04-10 16:56:17,582::task::974::TaskManager.Task::(_decref) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::ref 1 aborting False
>Thread-1133::INFO::2014-04-10 16:56:17,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1133::DEBUG::2014-04-10 16:56:17,584::task::1168::TaskManager.Task::(prepare) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::task::579::TaskManager.Task::(_updateState) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::moving from state preparing -> state finished
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1133::DEBUG::2014-04-10 16:56:17,585::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1133::DEBUG::2014-04-10 16:56:17,586::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1133::DEBUG::2014-04-10 16:56:17,586::task::974::TaskManager.Task::(_decref) Task=`8cd81cbd-1010-4064-989b-46fd3ef58141`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:56:17,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:17,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381057 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:56:17,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:56:17,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330914 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 16:56:20,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:20,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437029 s, 842 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:20,304::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:20,310::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000512114 s, 1.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:56:27,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:27,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309345 s, 2.2 MB/s\n'; <rc> = 0
>Thread-1137::DEBUG::2014-04-10 16:56:27,656::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1137::DEBUG::2014-04-10 16:56:27,658::task::579::TaskManager.Task::(_updateState) Task=`1dec4333-948a-4a3b-a465-edd4f4628c46`::moving from state init -> state preparing
>Thread-1137::INFO::2014-04-10 16:56:27,660::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1137::INFO::2014-04-10 16:56:27,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1137::DEBUG::2014-04-10 16:56:27,665::task::1168::TaskManager.Task::(prepare) Task=`1dec4333-948a-4a3b-a465-edd4f4628c46`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-468::DEBUG::2014-04-10 16:56:27,668::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1137::DEBUG::2014-04-10 16:56:27,676::task::579::TaskManager.Task::(_updateState) Task=`1dec4333-948a-4a3b-a465-edd4f4628c46`::moving from state preparing -> state finished
>Thread-1137::DEBUG::2014-04-10 16:56:27,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1137::DEBUG::2014-04-10 16:56:27,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1137::DEBUG::2014-04-10 16:56:27,685::task::974::TaskManager.Task::(_decref) Task=`1dec4333-948a-4a3b-a465-edd4f4628c46`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 16:56:27,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000249618 s, 2.7 MB/s\n'; <rc> = 0
>Thread-1138::DEBUG::2014-04-10 16:56:27,698::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1138::DEBUG::2014-04-10 16:56:27,698::task::579::TaskManager.Task::(_updateState) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::moving from state init -> state preparing
>Thread-1138::INFO::2014-04-10 16:56:27,698::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1138::DEBUG::2014-04-10 16:56:27,699::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fd378eee-6a54-49ca-abec-213f5469dc03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1138::DEBUG::2014-04-10 16:56:27,699::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1138::DEBUG::2014-04-10 16:56:27,699::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1138::DEBUG::2014-04-10 16:56:27,700::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fd378eee-6a54-49ca-abec-213f5469dc03`::Granted request
>Thread-1138::DEBUG::2014-04-10 16:56:27,700::task::811::TaskManager.Task::(resourceAcquired) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1138::DEBUG::2014-04-10 16:56:27,700::task::974::TaskManager.Task::(_decref) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::ref 1 aborting False
>Thread-1138::INFO::2014-04-10 16:56:27,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1138::DEBUG::2014-04-10 16:56:27,703::task::1168::TaskManager.Task::(prepare) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1138::DEBUG::2014-04-10 16:56:27,703::task::579::TaskManager.Task::(_updateState) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::moving from state preparing -> state finished
>Thread-1138::DEBUG::2014-04-10 16:56:27,703::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1138::DEBUG::2014-04-10 16:56:27,703::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1138::DEBUG::2014-04-10 16:56:27,703::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1138::DEBUG::2014-04-10 16:56:27,704::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1138::DEBUG::2014-04-10 16:56:27,704::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1138::DEBUG::2014-04-10 16:56:27,704::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1138::DEBUG::2014-04-10 16:56:27,704::task::974::TaskManager.Task::(_decref) Task=`57350bb1-79f8-4ea4-99f2-370968d68287`::ref 0 aborting False
>Thread-1139::DEBUG::2014-04-10 16:56:28,700::task::579::TaskManager.Task::(_updateState) Task=`9b993d7b-d6f8-43c8-9590-7be0ba7a07ad`::moving from state init -> state preparing
>Thread-1139::INFO::2014-04-10 16:56:28,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1139::INFO::2014-04-10 16:56:28,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512114', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309345', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249618', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437029', 'lastCheck': '8.5', 'valid': True}}
>Thread-1139::DEBUG::2014-04-10 16:56:28,700::task::1168::TaskManager.Task::(prepare) Task=`9b993d7b-d6f8-43c8-9590-7be0ba7a07ad`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512114', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309345', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249618', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437029', 'lastCheck': '8.5', 'valid': True}}
>Thread-1139::DEBUG::2014-04-10 16:56:28,700::task::579::TaskManager.Task::(_updateState) Task=`9b993d7b-d6f8-43c8-9590-7be0ba7a07ad`::moving from state preparing -> state finished
>Thread-1139::DEBUG::2014-04-10 16:56:28,701::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1139::DEBUG::2014-04-10 16:56:28,701::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1139::DEBUG::2014-04-10 16:56:28,701::task::974::TaskManager.Task::(_decref) Task=`9b993d7b-d6f8-43c8-9590-7be0ba7a07ad`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:56:30,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:30,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047392 s, 777 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:30,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:30,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00062431 s, 1.1 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:56:37,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:37,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000458508 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:56:37,702::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:56:37,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369894 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1143::DEBUG::2014-04-10 16:56:37,779::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1143::DEBUG::2014-04-10 16:56:37,779::task::579::TaskManager.Task::(_updateState) Task=`176005b1-8aa0-4e43-b6a3-67173a95bbbb`::moving from state init -> state preparing
>Thread-1143::INFO::2014-04-10 16:56:37,780::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1143::INFO::2014-04-10 16:56:37,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1143::DEBUG::2014-04-10 16:56:37,780::task::1168::TaskManager.Task::(prepare) Task=`176005b1-8aa0-4e43-b6a3-67173a95bbbb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1143::DEBUG::2014-04-10 16:56:37,780::task::579::TaskManager.Task::(_updateState) Task=`176005b1-8aa0-4e43-b6a3-67173a95bbbb`::moving from state preparing -> state finished
>Thread-1143::DEBUG::2014-04-10 16:56:37,781::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1143::DEBUG::2014-04-10 16:56:37,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1143::DEBUG::2014-04-10 16:56:37,781::task::974::TaskManager.Task::(_decref) Task=`176005b1-8aa0-4e43-b6a3-67173a95bbbb`::ref 0 aborting False
>Thread-1144::DEBUG::2014-04-10 16:56:37,788::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1144::DEBUG::2014-04-10 16:56:37,788::task::579::TaskManager.Task::(_updateState) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::moving from state init -> state preparing
>Thread-1144::INFO::2014-04-10 16:56:37,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1144::DEBUG::2014-04-10 16:56:37,789::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f95a5b86-edb2-4f84-a7aa-e0483b021360`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1144::DEBUG::2014-04-10 16:56:37,789::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1144::DEBUG::2014-04-10 16:56:37,789::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1144::DEBUG::2014-04-10 16:56:37,790::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f95a5b86-edb2-4f84-a7aa-e0483b021360`::Granted request
>Thread-1144::DEBUG::2014-04-10 16:56:37,790::task::811::TaskManager.Task::(resourceAcquired) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1144::DEBUG::2014-04-10 16:56:37,790::task::974::TaskManager.Task::(_decref) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::ref 1 aborting False
>Thread-1144::INFO::2014-04-10 16:56:37,792::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1144::DEBUG::2014-04-10 16:56:37,793::task::1168::TaskManager.Task::(prepare) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1144::DEBUG::2014-04-10 16:56:37,793::task::579::TaskManager.Task::(_updateState) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::moving from state preparing -> state finished
>Thread-1144::DEBUG::2014-04-10 16:56:37,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1144::DEBUG::2014-04-10 16:56:37,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1144::DEBUG::2014-04-10 16:56:37,793::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1144::DEBUG::2014-04-10 16:56:37,794::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1144::DEBUG::2014-04-10 16:56:37,794::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1144::DEBUG::2014-04-10 16:56:37,794::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1144::DEBUG::2014-04-10 16:56:37,794::task::974::TaskManager.Task::(_decref) Task=`564145c8-4000-4ee7-a36b-14d109b405cb`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:56:40,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:40,265::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000503759 s, 731 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:40,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:40,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484281 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1147::DEBUG::2014-04-10 16:56:43,888::task::579::TaskManager.Task::(_updateState) Task=`47d52630-4788-46a1-8267-46620ce6ec46`::moving from state init -> state preparing
>Thread-1147::INFO::2014-04-10 16:56:43,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1147::INFO::2014-04-10 16:56:43,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484281', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458508', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369894', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503759', 'lastCheck': '3.6', 'valid': True}}
>Thread-1147::DEBUG::2014-04-10 16:56:43,889::task::1168::TaskManager.Task::(prepare) Task=`47d52630-4788-46a1-8267-46620ce6ec46`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484281', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458508', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369894', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503759', 'lastCheck': '3.6', 'valid': True}}
>Thread-1147::DEBUG::2014-04-10 16:56:43,889::task::579::TaskManager.Task::(_updateState) Task=`47d52630-4788-46a1-8267-46620ce6ec46`::moving from state preparing -> state finished
>Thread-1147::DEBUG::2014-04-10 16:56:43,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1147::DEBUG::2014-04-10 16:56:43,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1147::DEBUG::2014-04-10 16:56:43,890::task::974::TaskManager.Task::(_decref) Task=`47d52630-4788-46a1-8267-46620ce6ec46`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:56:47,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:47,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414596 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:56:47,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:56:47,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037365 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1150::DEBUG::2014-04-10 16:56:47,886::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1150::DEBUG::2014-04-10 16:56:47,888::task::579::TaskManager.Task::(_updateState) Task=`3725ad0c-e6e2-4549-bfe6-42c2e8ef04aa`::moving from state init -> state preparing
>Thread-1150::INFO::2014-04-10 16:56:47,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1150::INFO::2014-04-10 16:56:47,891::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1150::DEBUG::2014-04-10 16:56:47,892::task::1168::TaskManager.Task::(prepare) Task=`3725ad0c-e6e2-4549-bfe6-42c2e8ef04aa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1150::DEBUG::2014-04-10 16:56:47,893::task::579::TaskManager.Task::(_updateState) Task=`3725ad0c-e6e2-4549-bfe6-42c2e8ef04aa`::moving from state preparing -> state finished
>Thread-1150::DEBUG::2014-04-10 16:56:47,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1150::DEBUG::2014-04-10 16:56:47,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1150::DEBUG::2014-04-10 16:56:47,895::task::974::TaskManager.Task::(_decref) Task=`3725ad0c-e6e2-4549-bfe6-42c2e8ef04aa`::ref 0 aborting False
>Thread-1151::DEBUG::2014-04-10 16:56:47,907::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-1151::DEBUG::2014-04-10 16:56:47,910::task::579::TaskManager.Task::(_updateState) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::moving from state init -> state preparing
>Thread-1151::INFO::2014-04-10 16:56:47,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1151::DEBUG::2014-04-10 16:56:47,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`834b9423-4b1e-4b84-992c-17adbc0cb6e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1151::DEBUG::2014-04-10 16:56:47,917::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1151::DEBUG::2014-04-10 16:56:47,919::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1151::DEBUG::2014-04-10 16:56:47,920::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`834b9423-4b1e-4b84-992c-17adbc0cb6e4`::Granted request
>Thread-1151::DEBUG::2014-04-10 16:56:47,924::task::811::TaskManager.Task::(resourceAcquired) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1151::DEBUG::2014-04-10 16:56:47,925::task::974::TaskManager.Task::(_decref) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::ref 1 aborting False
>Thread-1151::INFO::2014-04-10 16:56:47,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1151::DEBUG::2014-04-10 16:56:47,946::task::1168::TaskManager.Task::(prepare) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1151::DEBUG::2014-04-10 16:56:47,948::task::579::TaskManager.Task::(_updateState) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::moving from state preparing -> state finished
>Thread-1151::DEBUG::2014-04-10 16:56:47,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1151::DEBUG::2014-04-10 16:56:47,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1151::DEBUG::2014-04-10 16:56:47,953::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1151::DEBUG::2014-04-10 16:56:47,955::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1151::DEBUG::2014-04-10 16:56:47,956::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1151::DEBUG::2014-04-10 16:56:47,958::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1151::DEBUG::2014-04-10 16:56:47,960::task::974::TaskManager.Task::(_decref) Task=`d97d115c-5a76-44ad-9766-9d3370fcd0fa`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:56:50,267::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 16:56:50,272::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 16:56:50,273::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 16:56:50,279::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 16:56:50,280::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 16:56:50,280::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 16:56:50,280::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 16:56:50,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:56:50,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457495 s, 804 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:56:50,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:56:50,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477656 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:56:57,668::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:56:57,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312263 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:56:57,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:56:57,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349238 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1159::DEBUG::2014-04-10 16:56:58,050::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1159::DEBUG::2014-04-10 16:56:58,065::task::579::TaskManager.Task::(_updateState) Task=`b508bb62-8cb1-4d48-87dd-fba239feb608`::moving from state init -> state preparing
>Thread-1159::INFO::2014-04-10 16:56:58,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1159::INFO::2014-04-10 16:56:58,066::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1159::DEBUG::2014-04-10 16:56:58,066::task::1168::TaskManager.Task::(prepare) Task=`b508bb62-8cb1-4d48-87dd-fba239feb608`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1159::DEBUG::2014-04-10 16:56:58,066::task::579::TaskManager.Task::(_updateState) Task=`b508bb62-8cb1-4d48-87dd-fba239feb608`::moving from state preparing -> state finished
>Thread-1159::DEBUG::2014-04-10 16:56:58,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1159::DEBUG::2014-04-10 16:56:58,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1159::DEBUG::2014-04-10 16:56:58,067::task::974::TaskManager.Task::(_decref) Task=`b508bb62-8cb1-4d48-87dd-fba239feb608`::ref 0 aborting False
>Thread-1160::DEBUG::2014-04-10 16:56:58,106::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1160::DEBUG::2014-04-10 16:56:58,106::task::579::TaskManager.Task::(_updateState) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::moving from state init -> state preparing
>Thread-1160::INFO::2014-04-10 16:56:58,107::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1160::DEBUG::2014-04-10 16:56:58,107::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ce6bc61-8aee-4bc0-b53a-6b9c6a45f073`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1160::DEBUG::2014-04-10 16:56:58,107::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1160::DEBUG::2014-04-10 16:56:58,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1160::DEBUG::2014-04-10 16:56:58,108::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ce6bc61-8aee-4bc0-b53a-6b9c6a45f073`::Granted request
>Thread-1160::DEBUG::2014-04-10 16:56:58,108::task::811::TaskManager.Task::(resourceAcquired) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1160::DEBUG::2014-04-10 16:56:58,108::task::974::TaskManager.Task::(_decref) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::ref 1 aborting False
>Thread-1160::INFO::2014-04-10 16:56:58,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1160::DEBUG::2014-04-10 16:56:58,111::task::1168::TaskManager.Task::(prepare) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1160::DEBUG::2014-04-10 16:56:58,111::task::579::TaskManager.Task::(_updateState) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::moving from state preparing -> state finished
>Thread-1160::DEBUG::2014-04-10 16:56:58,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1160::DEBUG::2014-04-10 16:56:58,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1160::DEBUG::2014-04-10 16:56:58,111::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1160::DEBUG::2014-04-10 16:56:58,112::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1160::DEBUG::2014-04-10 16:56:58,112::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1160::DEBUG::2014-04-10 16:56:58,112::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1160::DEBUG::2014-04-10 16:56:58,112::task::974::TaskManager.Task::(_decref) Task=`406bd7ab-f14a-4f85-9d53-e1b3c3b77c18`::ref 0 aborting False
>Thread-1161::DEBUG::2014-04-10 16:56:59,068::task::579::TaskManager.Task::(_updateState) Task=`4e921f26-6e70-479c-99cc-7cd17d7ca59b`::moving from state init -> state preparing
>Thread-1161::INFO::2014-04-10 16:56:59,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1161::INFO::2014-04-10 16:56:59,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477656', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312263', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349238', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457495', 'lastCheck': '8.8', 'valid': True}}
>Thread-1161::DEBUG::2014-04-10 16:56:59,068::task::1168::TaskManager.Task::(prepare) Task=`4e921f26-6e70-479c-99cc-7cd17d7ca59b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477656', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312263', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349238', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457495', 'lastCheck': '8.8', 'valid': True}}
>Thread-1161::DEBUG::2014-04-10 16:56:59,068::task::579::TaskManager.Task::(_updateState) Task=`4e921f26-6e70-479c-99cc-7cd17d7ca59b`::moving from state preparing -> state finished
>Thread-1161::DEBUG::2014-04-10 16:56:59,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1161::DEBUG::2014-04-10 16:56:59,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1161::DEBUG::2014-04-10 16:56:59,069::task::974::TaskManager.Task::(_decref) Task=`4e921f26-6e70-479c-99cc-7cd17d7ca59b`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:00,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:00,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000467533 s, 787 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:00,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:00,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000534535 s, 1.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:57:07,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:07,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350158 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:07,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:07,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370369 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1166::DEBUG::2014-04-10 16:57:08,182::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1166::DEBUG::2014-04-10 16:57:08,182::task::579::TaskManager.Task::(_updateState) Task=`a9ded7ff-3936-4932-94dc-c207e7c2bb9c`::moving from state init -> state preparing
>Thread-1166::INFO::2014-04-10 16:57:08,183::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1166::INFO::2014-04-10 16:57:08,183::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1166::DEBUG::2014-04-10 16:57:08,183::task::1168::TaskManager.Task::(prepare) Task=`a9ded7ff-3936-4932-94dc-c207e7c2bb9c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1166::DEBUG::2014-04-10 16:57:08,183::task::579::TaskManager.Task::(_updateState) Task=`a9ded7ff-3936-4932-94dc-c207e7c2bb9c`::moving from state preparing -> state finished
>Thread-1166::DEBUG::2014-04-10 16:57:08,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1166::DEBUG::2014-04-10 16:57:08,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1166::DEBUG::2014-04-10 16:57:08,184::task::974::TaskManager.Task::(_decref) Task=`a9ded7ff-3936-4932-94dc-c207e7c2bb9c`::ref 0 aborting False
>Thread-1167::DEBUG::2014-04-10 16:57:08,190::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1167::DEBUG::2014-04-10 16:57:08,190::task::579::TaskManager.Task::(_updateState) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::moving from state init -> state preparing
>Thread-1167::INFO::2014-04-10 16:57:08,190::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1167::DEBUG::2014-04-10 16:57:08,191::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1cd03be-e6dd-4b21-a20a-91fa7bf9a041`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1167::DEBUG::2014-04-10 16:57:08,191::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1167::DEBUG::2014-04-10 16:57:08,191::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1167::DEBUG::2014-04-10 16:57:08,191::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1cd03be-e6dd-4b21-a20a-91fa7bf9a041`::Granted request
>Thread-1167::DEBUG::2014-04-10 16:57:08,192::task::811::TaskManager.Task::(resourceAcquired) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1167::DEBUG::2014-04-10 16:57:08,193::task::974::TaskManager.Task::(_decref) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::ref 1 aborting False
>Thread-1167::INFO::2014-04-10 16:57:08,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1167::DEBUG::2014-04-10 16:57:08,195::task::1168::TaskManager.Task::(prepare) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1167::DEBUG::2014-04-10 16:57:08,195::task::579::TaskManager.Task::(_updateState) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::moving from state preparing -> state finished
>Thread-1167::DEBUG::2014-04-10 16:57:08,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1167::DEBUG::2014-04-10 16:57:08,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1167::DEBUG::2014-04-10 16:57:08,195::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1167::DEBUG::2014-04-10 16:57:08,196::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1167::DEBUG::2014-04-10 16:57:08,196::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1167::DEBUG::2014-04-10 16:57:08,196::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1167::DEBUG::2014-04-10 16:57:08,196::task::974::TaskManager.Task::(_decref) Task=`058301ef-0a86-43eb-aa92-a60d09f650f0`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:10,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:10,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496945 s, 741 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:10,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:10,383::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000457253 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1169::DEBUG::2014-04-10 16:57:14,215::task::579::TaskManager.Task::(_updateState) Task=`aa1b1d45-5d11-4d11-9543-d4d3836cf408`::moving from state init -> state preparing
>Thread-1169::INFO::2014-04-10 16:57:14,216::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1169::INFO::2014-04-10 16:57:14,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457253', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350158', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370369', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496945', 'lastCheck': '3.9', 'valid': True}}
>Thread-1169::DEBUG::2014-04-10 16:57:14,216::task::1168::TaskManager.Task::(prepare) Task=`aa1b1d45-5d11-4d11-9543-d4d3836cf408`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457253', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350158', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370369', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496945', 'lastCheck': '3.9', 'valid': True}}
>Thread-1169::DEBUG::2014-04-10 16:57:14,216::task::579::TaskManager.Task::(_updateState) Task=`aa1b1d45-5d11-4d11-9543-d4d3836cf408`::moving from state preparing -> state finished
>Thread-1169::DEBUG::2014-04-10 16:57:14,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1169::DEBUG::2014-04-10 16:57:14,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1169::DEBUG::2014-04-10 16:57:14,217::task::974::TaskManager.Task::(_decref) Task=`aa1b1d45-5d11-4d11-9543-d4d3836cf408`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:57:17,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:17,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365383 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:17,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:17,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313061 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1172::DEBUG::2014-04-10 16:57:18,291::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1172::DEBUG::2014-04-10 16:57:18,291::task::579::TaskManager.Task::(_updateState) Task=`4ff9e1ae-ffbb-4a9f-9915-aba04f337bf3`::moving from state init -> state preparing
>Thread-1172::INFO::2014-04-10 16:57:18,291::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1172::INFO::2014-04-10 16:57:18,292::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1172::DEBUG::2014-04-10 16:57:18,292::task::1168::TaskManager.Task::(prepare) Task=`4ff9e1ae-ffbb-4a9f-9915-aba04f337bf3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1172::DEBUG::2014-04-10 16:57:18,292::task::579::TaskManager.Task::(_updateState) Task=`4ff9e1ae-ffbb-4a9f-9915-aba04f337bf3`::moving from state preparing -> state finished
>Thread-1172::DEBUG::2014-04-10 16:57:18,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1172::DEBUG::2014-04-10 16:57:18,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1172::DEBUG::2014-04-10 16:57:18,293::task::974::TaskManager.Task::(_decref) Task=`4ff9e1ae-ffbb-4a9f-9915-aba04f337bf3`::ref 0 aborting False
>Thread-1173::DEBUG::2014-04-10 16:57:18,299::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1173::DEBUG::2014-04-10 16:57:18,299::task::579::TaskManager.Task::(_updateState) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::moving from state init -> state preparing
>Thread-1173::INFO::2014-04-10 16:57:18,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1173::DEBUG::2014-04-10 16:57:18,300::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4bf203b9-0506-4214-8c1c-bcc082159e36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1173::DEBUG::2014-04-10 16:57:18,300::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1173::DEBUG::2014-04-10 16:57:18,301::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1173::DEBUG::2014-04-10 16:57:18,301::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4bf203b9-0506-4214-8c1c-bcc082159e36`::Granted request
>Thread-1173::DEBUG::2014-04-10 16:57:18,301::task::811::TaskManager.Task::(resourceAcquired) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1173::DEBUG::2014-04-10 16:57:18,301::task::974::TaskManager.Task::(_decref) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::ref 1 aborting False
>Thread-1173::INFO::2014-04-10 16:57:18,304::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1173::DEBUG::2014-04-10 16:57:18,304::task::1168::TaskManager.Task::(prepare) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1173::DEBUG::2014-04-10 16:57:18,304::task::579::TaskManager.Task::(_updateState) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::moving from state preparing -> state finished
>Thread-1173::DEBUG::2014-04-10 16:57:18,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1173::DEBUG::2014-04-10 16:57:18,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1173::DEBUG::2014-04-10 16:57:18,305::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1173::DEBUG::2014-04-10 16:57:18,305::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1173::DEBUG::2014-04-10 16:57:18,305::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1173::DEBUG::2014-04-10 16:57:18,305::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1173::DEBUG::2014-04-10 16:57:18,305::task::974::TaskManager.Task::(_decref) Task=`39c0fc13-6144-4e67-b678-ef8f21efbd3f`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:20,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:20,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000601891 s, 611 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:20,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:20,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000499111 s, 1.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:57:27,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:27,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000486307 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:27,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:27,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344705 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1177::DEBUG::2014-04-10 16:57:28,372::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1177::DEBUG::2014-04-10 16:57:28,388::task::579::TaskManager.Task::(_updateState) Task=`f94ec642-6123-42fe-a5bb-196b042f5321`::moving from state init -> state preparing
>Thread-1177::INFO::2014-04-10 16:57:28,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1177::INFO::2014-04-10 16:57:28,388::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1177::DEBUG::2014-04-10 16:57:28,389::task::1168::TaskManager.Task::(prepare) Task=`f94ec642-6123-42fe-a5bb-196b042f5321`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1177::DEBUG::2014-04-10 16:57:28,389::task::579::TaskManager.Task::(_updateState) Task=`f94ec642-6123-42fe-a5bb-196b042f5321`::moving from state preparing -> state finished
>Thread-1177::DEBUG::2014-04-10 16:57:28,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1177::DEBUG::2014-04-10 16:57:28,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1177::DEBUG::2014-04-10 16:57:28,389::task::974::TaskManager.Task::(_decref) Task=`f94ec642-6123-42fe-a5bb-196b042f5321`::ref 0 aborting False
>Thread-1178::DEBUG::2014-04-10 16:57:28,396::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1178::DEBUG::2014-04-10 16:57:28,396::task::579::TaskManager.Task::(_updateState) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::moving from state init -> state preparing
>Thread-1178::INFO::2014-04-10 16:57:28,397::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1178::DEBUG::2014-04-10 16:57:28,397::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b45cb9e-ffac-4c1c-9634-c627afa38a82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1178::DEBUG::2014-04-10 16:57:28,397::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1178::DEBUG::2014-04-10 16:57:28,398::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1178::DEBUG::2014-04-10 16:57:28,398::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b45cb9e-ffac-4c1c-9634-c627afa38a82`::Granted request
>Thread-1178::DEBUG::2014-04-10 16:57:28,398::task::811::TaskManager.Task::(resourceAcquired) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1178::DEBUG::2014-04-10 16:57:28,398::task::974::TaskManager.Task::(_decref) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::ref 1 aborting False
>Thread-1178::INFO::2014-04-10 16:57:28,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1178::DEBUG::2014-04-10 16:57:28,401::task::1168::TaskManager.Task::(prepare) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1178::DEBUG::2014-04-10 16:57:28,401::task::579::TaskManager.Task::(_updateState) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::moving from state preparing -> state finished
>Thread-1178::DEBUG::2014-04-10 16:57:28,401::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1178::DEBUG::2014-04-10 16:57:28,401::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1178::DEBUG::2014-04-10 16:57:28,401::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1178::DEBUG::2014-04-10 16:57:28,402::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1178::DEBUG::2014-04-10 16:57:28,402::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1178::DEBUG::2014-04-10 16:57:28,402::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1178::DEBUG::2014-04-10 16:57:28,402::task::974::TaskManager.Task::(_decref) Task=`0aa89104-d16c-4740-a89f-f8775710a7ab`::ref 0 aborting False
>Thread-1179::DEBUG::2014-04-10 16:57:29,369::task::579::TaskManager.Task::(_updateState) Task=`57e335f9-b982-461c-a192-945483659097`::moving from state init -> state preparing
>Thread-1179::INFO::2014-04-10 16:57:29,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1179::INFO::2014-04-10 16:57:29,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499111', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486307', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344705', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601891', 'lastCheck': '9.0', 'valid': True}}
>Thread-1179::DEBUG::2014-04-10 16:57:29,370::task::1168::TaskManager.Task::(prepare) Task=`57e335f9-b982-461c-a192-945483659097`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499111', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486307', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344705', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601891', 'lastCheck': '9.0', 'valid': True}}
>Thread-1179::DEBUG::2014-04-10 16:57:29,370::task::579::TaskManager.Task::(_updateState) Task=`57e335f9-b982-461c-a192-945483659097`::moving from state preparing -> state finished
>Thread-1179::DEBUG::2014-04-10 16:57:29,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1179::DEBUG::2014-04-10 16:57:29,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1179::DEBUG::2014-04-10 16:57:29,370::task::974::TaskManager.Task::(_decref) Task=`57e335f9-b982-461c-a192-945483659097`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:30,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:30,348::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476944 s, 772 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:30,406::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:30,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480863 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:57:37,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:37,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00041439 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:37,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:37,791::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000447353 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1183::DEBUG::2014-04-10 16:57:38,480::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1183::DEBUG::2014-04-10 16:57:38,481::task::579::TaskManager.Task::(_updateState) Task=`ad84c7d1-391f-4248-bf84-98113fa990f4`::moving from state init -> state preparing
>Thread-1183::INFO::2014-04-10 16:57:38,481::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1183::INFO::2014-04-10 16:57:38,482::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1183::DEBUG::2014-04-10 16:57:38,483::task::1168::TaskManager.Task::(prepare) Task=`ad84c7d1-391f-4248-bf84-98113fa990f4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1183::DEBUG::2014-04-10 16:57:38,483::task::579::TaskManager.Task::(_updateState) Task=`ad84c7d1-391f-4248-bf84-98113fa990f4`::moving from state preparing -> state finished
>Thread-1183::DEBUG::2014-04-10 16:57:38,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1183::DEBUG::2014-04-10 16:57:38,484::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1183::DEBUG::2014-04-10 16:57:38,484::task::974::TaskManager.Task::(_decref) Task=`ad84c7d1-391f-4248-bf84-98113fa990f4`::ref 0 aborting False
>Thread-1185::DEBUG::2014-04-10 16:57:38,491::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1185::DEBUG::2014-04-10 16:57:38,491::task::579::TaskManager.Task::(_updateState) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::moving from state init -> state preparing
>Thread-1185::INFO::2014-04-10 16:57:38,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1185::DEBUG::2014-04-10 16:57:38,492::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb390bdf-bf33-4018-ba20-711826d8e348`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1185::DEBUG::2014-04-10 16:57:38,492::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1185::DEBUG::2014-04-10 16:57:38,492::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1185::DEBUG::2014-04-10 16:57:38,493::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb390bdf-bf33-4018-ba20-711826d8e348`::Granted request
>Thread-1185::DEBUG::2014-04-10 16:57:38,493::task::811::TaskManager.Task::(resourceAcquired) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1185::DEBUG::2014-04-10 16:57:38,493::task::974::TaskManager.Task::(_decref) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::ref 1 aborting False
>Thread-1185::INFO::2014-04-10 16:57:38,495::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1185::DEBUG::2014-04-10 16:57:38,495::task::1168::TaskManager.Task::(prepare) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1185::DEBUG::2014-04-10 16:57:38,495::task::579::TaskManager.Task::(_updateState) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::moving from state preparing -> state finished
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1185::DEBUG::2014-04-10 16:57:38,496::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1185::DEBUG::2014-04-10 16:57:38,497::task::974::TaskManager.Task::(_decref) Task=`6f750d86-3017-49ec-9f06-af61a6ba4683`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:40,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:40,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000434023 s, 848 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:40,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:40,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458447 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1187::DEBUG::2014-04-10 16:57:44,525::task::579::TaskManager.Task::(_updateState) Task=`1e7355e3-38f4-48bb-ab88-f94a49dc5b6e`::moving from state init -> state preparing
>Thread-1187::INFO::2014-04-10 16:57:44,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1187::INFO::2014-04-10 16:57:44,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458447', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041439', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447353', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434023', 'lastCheck': '4.2', 'valid': True}}
>Thread-1187::DEBUG::2014-04-10 16:57:44,526::task::1168::TaskManager.Task::(prepare) Task=`1e7355e3-38f4-48bb-ab88-f94a49dc5b6e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458447', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041439', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447353', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434023', 'lastCheck': '4.2', 'valid': True}}
>Thread-1187::DEBUG::2014-04-10 16:57:44,526::task::579::TaskManager.Task::(_updateState) Task=`1e7355e3-38f4-48bb-ab88-f94a49dc5b6e`::moving from state preparing -> state finished
>Thread-1187::DEBUG::2014-04-10 16:57:44,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1187::DEBUG::2014-04-10 16:57:44,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1187::DEBUG::2014-04-10 16:57:44,526::task::974::TaskManager.Task::(_decref) Task=`1e7355e3-38f4-48bb-ab88-f94a49dc5b6e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:57:47,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:47,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000480756 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:47,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:47,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000406935 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1190::DEBUG::2014-04-10 16:57:48,586::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-1190::DEBUG::2014-04-10 16:57:48,587::task::579::TaskManager.Task::(_updateState) Task=`9f41d27d-afe4-4e0d-86f2-379a7bc6ca58`::moving from state init -> state preparing
>Thread-1190::INFO::2014-04-10 16:57:48,587::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1190::INFO::2014-04-10 16:57:48,587::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1190::DEBUG::2014-04-10 16:57:48,587::task::1168::TaskManager.Task::(prepare) Task=`9f41d27d-afe4-4e0d-86f2-379a7bc6ca58`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1190::DEBUG::2014-04-10 16:57:48,588::task::579::TaskManager.Task::(_updateState) Task=`9f41d27d-afe4-4e0d-86f2-379a7bc6ca58`::moving from state preparing -> state finished
>Thread-1190::DEBUG::2014-04-10 16:57:48,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1190::DEBUG::2014-04-10 16:57:48,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1190::DEBUG::2014-04-10 16:57:48,588::task::974::TaskManager.Task::(_decref) Task=`9f41d27d-afe4-4e0d-86f2-379a7bc6ca58`::ref 0 aborting False
>Thread-1191::DEBUG::2014-04-10 16:57:48,595::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-1191::DEBUG::2014-04-10 16:57:48,595::task::579::TaskManager.Task::(_updateState) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::moving from state init -> state preparing
>Thread-1191::INFO::2014-04-10 16:57:48,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1191::DEBUG::2014-04-10 16:57:48,596::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8c50f964-16a6-4e63-a86e-c8b803ee54fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1191::DEBUG::2014-04-10 16:57:48,596::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1191::DEBUG::2014-04-10 16:57:48,596::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1191::DEBUG::2014-04-10 16:57:48,597::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8c50f964-16a6-4e63-a86e-c8b803ee54fe`::Granted request
>Thread-1191::DEBUG::2014-04-10 16:57:48,598::task::811::TaskManager.Task::(resourceAcquired) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1191::DEBUG::2014-04-10 16:57:48,598::task::974::TaskManager.Task::(_decref) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::ref 1 aborting False
>Thread-1191::INFO::2014-04-10 16:57:48,600::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1191::DEBUG::2014-04-10 16:57:48,600::task::1168::TaskManager.Task::(prepare) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1191::DEBUG::2014-04-10 16:57:48,600::task::579::TaskManager.Task::(_updateState) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::moving from state preparing -> state finished
>Thread-1191::DEBUG::2014-04-10 16:57:48,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1191::DEBUG::2014-04-10 16:57:48,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1191::DEBUG::2014-04-10 16:57:48,601::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1191::DEBUG::2014-04-10 16:57:48,601::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1191::DEBUG::2014-04-10 16:57:48,601::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1191::DEBUG::2014-04-10 16:57:48,602::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1191::DEBUG::2014-04-10 16:57:48,602::task::974::TaskManager.Task::(_decref) Task=`10ddd230-6639-4d5d-a907-ad1c836916d9`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:57:50,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:57:50,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000435647 s, 845 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:57:50,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:57:50,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475088 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:57:57,759::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:57:57,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383624 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:57:57,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:57:57,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343256 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1195::DEBUG::2014-04-10 16:57:58,676::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1195::DEBUG::2014-04-10 16:57:58,698::task::579::TaskManager.Task::(_updateState) Task=`efa77e2e-f829-4431-8214-d046550e5d48`::moving from state init -> state preparing
>Thread-1195::INFO::2014-04-10 16:57:58,699::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1195::INFO::2014-04-10 16:57:58,699::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1195::DEBUG::2014-04-10 16:57:58,699::task::1168::TaskManager.Task::(prepare) Task=`efa77e2e-f829-4431-8214-d046550e5d48`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1195::DEBUG::2014-04-10 16:57:58,699::task::579::TaskManager.Task::(_updateState) Task=`efa77e2e-f829-4431-8214-d046550e5d48`::moving from state preparing -> state finished
>Thread-1195::DEBUG::2014-04-10 16:57:58,699::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1195::DEBUG::2014-04-10 16:57:58,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1195::DEBUG::2014-04-10 16:57:58,700::task::974::TaskManager.Task::(_decref) Task=`efa77e2e-f829-4431-8214-d046550e5d48`::ref 0 aborting False
>Thread-1196::DEBUG::2014-04-10 16:57:58,706::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1196::DEBUG::2014-04-10 16:57:58,707::task::579::TaskManager.Task::(_updateState) Task=`d2d38006-f232-4002-ac86-7202b3189704`::moving from state init -> state preparing
>Thread-1196::INFO::2014-04-10 16:57:58,707::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1196::DEBUG::2014-04-10 16:57:58,708::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d6221e57-5b41-4f1a-8c0e-2e7e25a11c59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1196::DEBUG::2014-04-10 16:57:58,708::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1196::DEBUG::2014-04-10 16:57:58,708::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1196::DEBUG::2014-04-10 16:57:58,708::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d6221e57-5b41-4f1a-8c0e-2e7e25a11c59`::Granted request
>Thread-1196::DEBUG::2014-04-10 16:57:58,709::task::811::TaskManager.Task::(resourceAcquired) Task=`d2d38006-f232-4002-ac86-7202b3189704`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1196::DEBUG::2014-04-10 16:57:58,709::task::974::TaskManager.Task::(_decref) Task=`d2d38006-f232-4002-ac86-7202b3189704`::ref 1 aborting False
>Thread-1196::INFO::2014-04-10 16:57:58,711::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1196::DEBUG::2014-04-10 16:57:58,711::task::1168::TaskManager.Task::(prepare) Task=`d2d38006-f232-4002-ac86-7202b3189704`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1196::DEBUG::2014-04-10 16:57:58,711::task::579::TaskManager.Task::(_updateState) Task=`d2d38006-f232-4002-ac86-7202b3189704`::moving from state preparing -> state finished
>Thread-1196::DEBUG::2014-04-10 16:57:58,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1196::DEBUG::2014-04-10 16:57:58,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1196::DEBUG::2014-04-10 16:57:58,712::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1196::DEBUG::2014-04-10 16:57:58,712::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1196::DEBUG::2014-04-10 16:57:58,712::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1196::DEBUG::2014-04-10 16:57:58,712::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1196::DEBUG::2014-04-10 16:57:58,713::task::974::TaskManager.Task::(_decref) Task=`d2d38006-f232-4002-ac86-7202b3189704`::ref 0 aborting False
>Thread-1197::DEBUG::2014-04-10 16:57:59,681::task::579::TaskManager.Task::(_updateState) Task=`10cc3fac-3d46-47ac-ace4-5daf092781be`::moving from state init -> state preparing
>Thread-1197::INFO::2014-04-10 16:57:59,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1197::INFO::2014-04-10 16:57:59,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475088', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383624', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343256', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435647', 'lastCheck': '9.3', 'valid': True}}
>Thread-1197::DEBUG::2014-04-10 16:57:59,682::task::1168::TaskManager.Task::(prepare) Task=`10cc3fac-3d46-47ac-ace4-5daf092781be`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475088', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383624', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343256', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435647', 'lastCheck': '9.3', 'valid': True}}
>Thread-1197::DEBUG::2014-04-10 16:57:59,682::task::579::TaskManager.Task::(_updateState) Task=`10cc3fac-3d46-47ac-ace4-5daf092781be`::moving from state preparing -> state finished
>Thread-1197::DEBUG::2014-04-10 16:57:59,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1197::DEBUG::2014-04-10 16:57:59,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1197::DEBUG::2014-04-10 16:57:59,683::task::974::TaskManager.Task::(_decref) Task=`10cc3fac-3d46-47ac-ace4-5daf092781be`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:00,380::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:00,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000516578 s, 712 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:00,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:00,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410039 s, 1.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:58:07,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:07,779::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000436019 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:07,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:07,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371776 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1201::DEBUG::2014-04-10 16:58:08,784::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1201::DEBUG::2014-04-10 16:58:08,785::task::579::TaskManager.Task::(_updateState) Task=`c83b7765-65ba-4f26-83bf-df7a68afddeb`::moving from state init -> state preparing
>Thread-1201::INFO::2014-04-10 16:58:08,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1201::INFO::2014-04-10 16:58:08,785::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1201::DEBUG::2014-04-10 16:58:08,785::task::1168::TaskManager.Task::(prepare) Task=`c83b7765-65ba-4f26-83bf-df7a68afddeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1201::DEBUG::2014-04-10 16:58:08,785::task::579::TaskManager.Task::(_updateState) Task=`c83b7765-65ba-4f26-83bf-df7a68afddeb`::moving from state preparing -> state finished
>Thread-1201::DEBUG::2014-04-10 16:58:08,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1201::DEBUG::2014-04-10 16:58:08,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1201::DEBUG::2014-04-10 16:58:08,786::task::974::TaskManager.Task::(_decref) Task=`c83b7765-65ba-4f26-83bf-df7a68afddeb`::ref 0 aborting False
>Thread-1202::DEBUG::2014-04-10 16:58:08,793::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1202::DEBUG::2014-04-10 16:58:08,793::task::579::TaskManager.Task::(_updateState) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::moving from state init -> state preparing
>Thread-1202::INFO::2014-04-10 16:58:08,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1202::DEBUG::2014-04-10 16:58:08,794::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`128bba50-80e0-48c6-9427-30ff61553e02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1202::DEBUG::2014-04-10 16:58:08,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1202::DEBUG::2014-04-10 16:58:08,794::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1202::DEBUG::2014-04-10 16:58:08,794::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`128bba50-80e0-48c6-9427-30ff61553e02`::Granted request
>Thread-1202::DEBUG::2014-04-10 16:58:08,795::task::811::TaskManager.Task::(resourceAcquired) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1202::DEBUG::2014-04-10 16:58:08,795::task::974::TaskManager.Task::(_decref) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::ref 1 aborting False
>Thread-1202::INFO::2014-04-10 16:58:08,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1202::DEBUG::2014-04-10 16:58:08,797::task::1168::TaskManager.Task::(prepare) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1202::DEBUG::2014-04-10 16:58:08,797::task::579::TaskManager.Task::(_updateState) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::moving from state preparing -> state finished
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1202::DEBUG::2014-04-10 16:58:08,798::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1202::DEBUG::2014-04-10 16:58:08,799::task::974::TaskManager.Task::(_decref) Task=`7c3d4a7b-059f-43d3-800e-18d5c5413da8`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:10,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:10,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000518532 s, 710 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:10,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:10,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473945 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1205::DEBUG::2014-04-10 16:58:14,845::task::579::TaskManager.Task::(_updateState) Task=`a85e058e-84d7-4f7b-ae30-1fc1d5822743`::moving from state init -> state preparing
>Thread-1205::INFO::2014-04-10 16:58:14,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1205::INFO::2014-04-10 16:58:14,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473945', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436019', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371776', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518532', 'lastCheck': '4.4', 'valid': True}}
>Thread-1205::DEBUG::2014-04-10 16:58:14,845::task::1168::TaskManager.Task::(prepare) Task=`a85e058e-84d7-4f7b-ae30-1fc1d5822743`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473945', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436019', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371776', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518532', 'lastCheck': '4.4', 'valid': True}}
>Thread-1205::DEBUG::2014-04-10 16:58:14,846::task::579::TaskManager.Task::(_updateState) Task=`a85e058e-84d7-4f7b-ae30-1fc1d5822743`::moving from state preparing -> state finished
>Thread-1205::DEBUG::2014-04-10 16:58:14,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1205::DEBUG::2014-04-10 16:58:14,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1205::DEBUG::2014-04-10 16:58:14,846::task::974::TaskManager.Task::(_decref) Task=`a85e058e-84d7-4f7b-ae30-1fc1d5822743`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:58:17,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:17,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421697 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:17,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:17,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337495 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1208::DEBUG::2014-04-10 16:58:18,874::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1208::DEBUG::2014-04-10 16:58:18,874::task::579::TaskManager.Task::(_updateState) Task=`ebda9c2b-e0c4-4260-ae04-374fa2d3774f`::moving from state init -> state preparing
>Thread-1208::INFO::2014-04-10 16:58:18,875::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1208::INFO::2014-04-10 16:58:18,875::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1208::DEBUG::2014-04-10 16:58:18,875::task::1168::TaskManager.Task::(prepare) Task=`ebda9c2b-e0c4-4260-ae04-374fa2d3774f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1208::DEBUG::2014-04-10 16:58:18,875::task::579::TaskManager.Task::(_updateState) Task=`ebda9c2b-e0c4-4260-ae04-374fa2d3774f`::moving from state preparing -> state finished
>Thread-1208::DEBUG::2014-04-10 16:58:18,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1208::DEBUG::2014-04-10 16:58:18,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1208::DEBUG::2014-04-10 16:58:18,876::task::974::TaskManager.Task::(_decref) Task=`ebda9c2b-e0c4-4260-ae04-374fa2d3774f`::ref 0 aborting False
>Thread-1209::DEBUG::2014-04-10 16:58:18,883::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1209::DEBUG::2014-04-10 16:58:18,883::task::579::TaskManager.Task::(_updateState) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::moving from state init -> state preparing
>Thread-1209::INFO::2014-04-10 16:58:18,883::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1209::DEBUG::2014-04-10 16:58:18,884::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9f72296-3ddc-4d24-a348-f277dae431e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1209::DEBUG::2014-04-10 16:58:18,884::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1209::DEBUG::2014-04-10 16:58:18,884::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1209::DEBUG::2014-04-10 16:58:18,884::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9f72296-3ddc-4d24-a348-f277dae431e3`::Granted request
>Thread-1209::DEBUG::2014-04-10 16:58:18,885::task::811::TaskManager.Task::(resourceAcquired) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1209::DEBUG::2014-04-10 16:58:18,885::task::974::TaskManager.Task::(_decref) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::ref 1 aborting False
>Thread-1209::INFO::2014-04-10 16:58:18,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1209::DEBUG::2014-04-10 16:58:18,887::task::1168::TaskManager.Task::(prepare) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1209::DEBUG::2014-04-10 16:58:18,887::task::579::TaskManager.Task::(_updateState) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::moving from state preparing -> state finished
>Thread-1209::DEBUG::2014-04-10 16:58:18,888::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1209::DEBUG::2014-04-10 16:58:18,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1209::DEBUG::2014-04-10 16:58:18,888::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1209::DEBUG::2014-04-10 16:58:18,888::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1209::DEBUG::2014-04-10 16:58:18,888::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1209::DEBUG::2014-04-10 16:58:18,889::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1209::DEBUG::2014-04-10 16:58:18,889::task::974::TaskManager.Task::(_decref) Task=`965673c8-b45d-4afa-b52a-23a6632c46f3`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:20,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:20,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00041402 s, 889 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:20,474::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 16:58:20,488::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 16:58:20,490::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 16:58:20,495::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 16:58:20,497::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 16:58:20,497::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 16:58:20,497::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 16:58:20,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:20,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000422874 s, 1.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:58:27,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:27,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317629 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:27,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:27,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350809 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1217::DEBUG::2014-04-10 16:58:28,964::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1217::DEBUG::2014-04-10 16:58:28,979::task::579::TaskManager.Task::(_updateState) Task=`5d516225-feaf-437f-be6b-40ff6784573c`::moving from state init -> state preparing
>Thread-1217::INFO::2014-04-10 16:58:28,980::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1217::INFO::2014-04-10 16:58:28,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1217::DEBUG::2014-04-10 16:58:28,980::task::1168::TaskManager.Task::(prepare) Task=`5d516225-feaf-437f-be6b-40ff6784573c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1217::DEBUG::2014-04-10 16:58:28,980::task::579::TaskManager.Task::(_updateState) Task=`5d516225-feaf-437f-be6b-40ff6784573c`::moving from state preparing -> state finished
>Thread-1217::DEBUG::2014-04-10 16:58:28,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1217::DEBUG::2014-04-10 16:58:28,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1217::DEBUG::2014-04-10 16:58:28,981::task::974::TaskManager.Task::(_decref) Task=`5d516225-feaf-437f-be6b-40ff6784573c`::ref 0 aborting False
>Thread-1218::DEBUG::2014-04-10 16:58:28,988::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1218::DEBUG::2014-04-10 16:58:28,988::task::579::TaskManager.Task::(_updateState) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::moving from state init -> state preparing
>Thread-1218::INFO::2014-04-10 16:58:28,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1218::DEBUG::2014-04-10 16:58:28,989::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f94976db-5980-4d8f-9596-c24c15d6f8f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1218::DEBUG::2014-04-10 16:58:28,989::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1218::DEBUG::2014-04-10 16:58:28,990::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1218::DEBUG::2014-04-10 16:58:28,990::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f94976db-5980-4d8f-9596-c24c15d6f8f0`::Granted request
>Thread-1218::DEBUG::2014-04-10 16:58:28,991::task::811::TaskManager.Task::(resourceAcquired) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1218::DEBUG::2014-04-10 16:58:28,991::task::974::TaskManager.Task::(_decref) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::ref 1 aborting False
>Thread-1218::INFO::2014-04-10 16:58:28,993::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1218::DEBUG::2014-04-10 16:58:28,993::task::1168::TaskManager.Task::(prepare) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1218::DEBUG::2014-04-10 16:58:28,993::task::579::TaskManager.Task::(_updateState) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::moving from state preparing -> state finished
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1218::DEBUG::2014-04-10 16:58:28,994::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1218::DEBUG::2014-04-10 16:58:28,995::task::974::TaskManager.Task::(_decref) Task=`ddf5d7f0-da0a-4553-99e4-67b5539fc7b9`::ref 0 aborting False
>Thread-1219::DEBUG::2014-04-10 16:58:29,996::task::579::TaskManager.Task::(_updateState) Task=`e5dfc85b-0614-432e-8943-39f3d9af2ce4`::moving from state init -> state preparing
>Thread-1219::INFO::2014-04-10 16:58:29,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1219::INFO::2014-04-10 16:58:29,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422874', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317629', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350809', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041402', 'lastCheck': '9.6', 'valid': True}}
>Thread-1219::DEBUG::2014-04-10 16:58:29,996::task::1168::TaskManager.Task::(prepare) Task=`e5dfc85b-0614-432e-8943-39f3d9af2ce4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422874', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317629', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350809', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041402', 'lastCheck': '9.6', 'valid': True}}
>Thread-1219::DEBUG::2014-04-10 16:58:29,996::task::579::TaskManager.Task::(_updateState) Task=`e5dfc85b-0614-432e-8943-39f3d9af2ce4`::moving from state preparing -> state finished
>Thread-1219::DEBUG::2014-04-10 16:58:29,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1219::DEBUG::2014-04-10 16:58:29,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1219::DEBUG::2014-04-10 16:58:29,997::task::974::TaskManager.Task::(_decref) Task=`e5dfc85b-0614-432e-8943-39f3d9af2ce4`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:30,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:30,433::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487114 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:30,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:30,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000558312 s, 1.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:58:37,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:37,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000495448 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:37,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:37,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272834 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1223::DEBUG::2014-04-10 16:58:39,079::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1223::DEBUG::2014-04-10 16:58:39,080::task::579::TaskManager.Task::(_updateState) Task=`899110fb-4c21-446a-9a39-d3312d4d9f7f`::moving from state init -> state preparing
>Thread-1223::INFO::2014-04-10 16:58:39,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1223::INFO::2014-04-10 16:58:39,080::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1223::DEBUG::2014-04-10 16:58:39,080::task::1168::TaskManager.Task::(prepare) Task=`899110fb-4c21-446a-9a39-d3312d4d9f7f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1223::DEBUG::2014-04-10 16:58:39,081::task::579::TaskManager.Task::(_updateState) Task=`899110fb-4c21-446a-9a39-d3312d4d9f7f`::moving from state preparing -> state finished
>Thread-1223::DEBUG::2014-04-10 16:58:39,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1223::DEBUG::2014-04-10 16:58:39,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1223::DEBUG::2014-04-10 16:58:39,081::task::974::TaskManager.Task::(_decref) Task=`899110fb-4c21-446a-9a39-d3312d4d9f7f`::ref 0 aborting False
>Thread-1224::DEBUG::2014-04-10 16:58:39,088::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1224::DEBUG::2014-04-10 16:58:39,088::task::579::TaskManager.Task::(_updateState) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::moving from state init -> state preparing
>Thread-1224::INFO::2014-04-10 16:58:39,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1224::DEBUG::2014-04-10 16:58:39,089::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e70a943d-4200-4184-8ba7-b349af75c3c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1224::DEBUG::2014-04-10 16:58:39,089::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1224::DEBUG::2014-04-10 16:58:39,089::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1224::DEBUG::2014-04-10 16:58:39,089::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e70a943d-4200-4184-8ba7-b349af75c3c5`::Granted request
>Thread-1224::DEBUG::2014-04-10 16:58:39,089::task::811::TaskManager.Task::(resourceAcquired) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1224::DEBUG::2014-04-10 16:58:39,090::task::974::TaskManager.Task::(_decref) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::ref 1 aborting False
>Thread-1224::INFO::2014-04-10 16:58:39,091::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1224::DEBUG::2014-04-10 16:58:39,091::task::1168::TaskManager.Task::(prepare) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::task::579::TaskManager.Task::(_updateState) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::moving from state preparing -> state finished
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1224::DEBUG::2014-04-10 16:58:39,092::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1224::DEBUG::2014-04-10 16:58:39,093::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1224::DEBUG::2014-04-10 16:58:39,093::task::974::TaskManager.Task::(_decref) Task=`a8e16bad-7b7d-487f-be34-4c23f5b07693`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:40,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:40,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000494885 s, 744 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:40,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:40,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000520914 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1227::DEBUG::2014-04-10 16:58:45,152::task::579::TaskManager.Task::(_updateState) Task=`44a1dd62-83ba-41b9-8f6a-0dd941161867`::moving from state init -> state preparing
>Thread-1227::INFO::2014-04-10 16:58:45,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1227::INFO::2014-04-10 16:58:45,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520914', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495448', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272834', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494885', 'lastCheck': '4.7', 'valid': True}}
>Thread-1227::DEBUG::2014-04-10 16:58:45,153::task::1168::TaskManager.Task::(prepare) Task=`44a1dd62-83ba-41b9-8f6a-0dd941161867`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520914', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495448', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272834', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494885', 'lastCheck': '4.7', 'valid': True}}
>Thread-1227::DEBUG::2014-04-10 16:58:45,153::task::579::TaskManager.Task::(_updateState) Task=`44a1dd62-83ba-41b9-8f6a-0dd941161867`::moving from state preparing -> state finished
>Thread-1227::DEBUG::2014-04-10 16:58:45,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1227::DEBUG::2014-04-10 16:58:45,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1227::DEBUG::2014-04-10 16:58:45,153::task::974::TaskManager.Task::(_decref) Task=`44a1dd62-83ba-41b9-8f6a-0dd941161867`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:58:47,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:47,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366154 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:47,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:47,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356114 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1230::DEBUG::2014-04-10 16:58:49,169::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-1230::DEBUG::2014-04-10 16:58:49,169::task::579::TaskManager.Task::(_updateState) Task=`cf9953de-dd41-4ff6-a0cb-c10845740822`::moving from state init -> state preparing
>Thread-1230::INFO::2014-04-10 16:58:49,169::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1230::INFO::2014-04-10 16:58:49,170::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1230::DEBUG::2014-04-10 16:58:49,170::task::1168::TaskManager.Task::(prepare) Task=`cf9953de-dd41-4ff6-a0cb-c10845740822`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1230::DEBUG::2014-04-10 16:58:49,170::task::579::TaskManager.Task::(_updateState) Task=`cf9953de-dd41-4ff6-a0cb-c10845740822`::moving from state preparing -> state finished
>Thread-1230::DEBUG::2014-04-10 16:58:49,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1230::DEBUG::2014-04-10 16:58:49,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1230::DEBUG::2014-04-10 16:58:49,171::task::974::TaskManager.Task::(_decref) Task=`cf9953de-dd41-4ff6-a0cb-c10845740822`::ref 0 aborting False
>Thread-1231::DEBUG::2014-04-10 16:58:49,177::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-1231::DEBUG::2014-04-10 16:58:49,178::task::579::TaskManager.Task::(_updateState) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::moving from state init -> state preparing
>Thread-1231::INFO::2014-04-10 16:58:49,178::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1231::DEBUG::2014-04-10 16:58:49,178::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8e8e9953-65a3-480e-b3d6-3f111f59080a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1231::DEBUG::2014-04-10 16:58:49,178::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1231::DEBUG::2014-04-10 16:58:49,179::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1231::DEBUG::2014-04-10 16:58:49,179::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8e8e9953-65a3-480e-b3d6-3f111f59080a`::Granted request
>Thread-1231::DEBUG::2014-04-10 16:58:49,179::task::811::TaskManager.Task::(resourceAcquired) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1231::DEBUG::2014-04-10 16:58:49,179::task::974::TaskManager.Task::(_decref) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::ref 1 aborting False
>Thread-1231::INFO::2014-04-10 16:58:49,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1231::DEBUG::2014-04-10 16:58:49,182::task::1168::TaskManager.Task::(prepare) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1231::DEBUG::2014-04-10 16:58:49,182::task::579::TaskManager.Task::(_updateState) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::moving from state preparing -> state finished
>Thread-1231::DEBUG::2014-04-10 16:58:49,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1231::DEBUG::2014-04-10 16:58:49,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1231::DEBUG::2014-04-10 16:58:49,183::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1231::DEBUG::2014-04-10 16:58:49,183::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1231::DEBUG::2014-04-10 16:58:49,183::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1231::DEBUG::2014-04-10 16:58:49,183::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1231::DEBUG::2014-04-10 16:58:49,183::task::974::TaskManager.Task::(_decref) Task=`c052ae59-7616-4e55-9ae4-9d3f74445fbf`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:58:50,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:58:50,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000421439 s, 873 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:58:50,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:58:50,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473301 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:58:57,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:58:57,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000417108 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:58:57,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:58:57,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000454189 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1235::DEBUG::2014-04-10 16:58:59,309::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-1235::DEBUG::2014-04-10 16:58:59,326::task::579::TaskManager.Task::(_updateState) Task=`90d9d2d4-f075-43bc-83d6-52a1f622aa6f`::moving from state init -> state preparing
>Thread-1235::INFO::2014-04-10 16:58:59,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1235::INFO::2014-04-10 16:58:59,327::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1235::DEBUG::2014-04-10 16:58:59,327::task::1168::TaskManager.Task::(prepare) Task=`90d9d2d4-f075-43bc-83d6-52a1f622aa6f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1235::DEBUG::2014-04-10 16:58:59,327::task::579::TaskManager.Task::(_updateState) Task=`90d9d2d4-f075-43bc-83d6-52a1f622aa6f`::moving from state preparing -> state finished
>Thread-1235::DEBUG::2014-04-10 16:58:59,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1235::DEBUG::2014-04-10 16:58:59,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1235::DEBUG::2014-04-10 16:58:59,328::task::974::TaskManager.Task::(_decref) Task=`90d9d2d4-f075-43bc-83d6-52a1f622aa6f`::ref 0 aborting False
>Thread-1236::DEBUG::2014-04-10 16:58:59,334::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-1236::DEBUG::2014-04-10 16:58:59,335::task::579::TaskManager.Task::(_updateState) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::moving from state init -> state preparing
>Thread-1236::INFO::2014-04-10 16:58:59,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1236::DEBUG::2014-04-10 16:58:59,336::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d9b89ab4-03a4-4b78-b9ae-12a00028c8b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1236::DEBUG::2014-04-10 16:58:59,336::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1236::DEBUG::2014-04-10 16:58:59,336::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1236::DEBUG::2014-04-10 16:58:59,336::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d9b89ab4-03a4-4b78-b9ae-12a00028c8b7`::Granted request
>Thread-1236::DEBUG::2014-04-10 16:58:59,337::task::811::TaskManager.Task::(resourceAcquired) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1236::DEBUG::2014-04-10 16:58:59,337::task::974::TaskManager.Task::(_decref) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::ref 1 aborting False
>Thread-1236::INFO::2014-04-10 16:58:59,339::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1236::DEBUG::2014-04-10 16:58:59,339::task::1168::TaskManager.Task::(prepare) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1236::DEBUG::2014-04-10 16:58:59,339::task::579::TaskManager.Task::(_updateState) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::moving from state preparing -> state finished
>Thread-1236::DEBUG::2014-04-10 16:58:59,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1236::DEBUG::2014-04-10 16:58:59,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1236::DEBUG::2014-04-10 16:58:59,339::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1236::DEBUG::2014-04-10 16:58:59,340::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1236::DEBUG::2014-04-10 16:58:59,340::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1236::DEBUG::2014-04-10 16:58:59,340::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1236::DEBUG::2014-04-10 16:58:59,340::task::974::TaskManager.Task::(_decref) Task=`19e30ee7-596d-4b5f-a545-68576e6cec8b`::ref 0 aborting False
>Thread-1237::DEBUG::2014-04-10 16:59:00,314::task::579::TaskManager.Task::(_updateState) Task=`4d830d8f-fb71-4312-9aea-15c78671a7f3`::moving from state init -> state preparing
>Thread-1237::INFO::2014-04-10 16:59:00,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1237::INFO::2014-04-10 16:59:00,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473301', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417108', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454189', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421439', 'lastCheck': '9.9', 'valid': True}}
>Thread-1237::DEBUG::2014-04-10 16:59:00,315::task::1168::TaskManager.Task::(prepare) Task=`4d830d8f-fb71-4312-9aea-15c78671a7f3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473301', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417108', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454189', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421439', 'lastCheck': '9.9', 'valid': True}}
>Thread-1237::DEBUG::2014-04-10 16:59:00,315::task::579::TaskManager.Task::(_updateState) Task=`4d830d8f-fb71-4312-9aea-15c78671a7f3`::moving from state preparing -> state finished
>Thread-1237::DEBUG::2014-04-10 16:59:00,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1237::DEBUG::2014-04-10 16:59:00,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1237::DEBUG::2014-04-10 16:59:00,315::task::974::TaskManager.Task::(_decref) Task=`4d830d8f-fb71-4312-9aea-15c78671a7f3`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:00,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:00,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449281 s, 819 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:00,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:00,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000489869 s, 1.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:59:07,862::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:07,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000468183 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:07,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:07,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372587 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1241::DEBUG::2014-04-10 16:59:09,434::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-1241::DEBUG::2014-04-10 16:59:09,434::task::579::TaskManager.Task::(_updateState) Task=`cdf2a772-a049-442f-9d0f-abfae7693c1e`::moving from state init -> state preparing
>Thread-1241::INFO::2014-04-10 16:59:09,435::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1241::INFO::2014-04-10 16:59:09,435::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1241::DEBUG::2014-04-10 16:59:09,435::task::1168::TaskManager.Task::(prepare) Task=`cdf2a772-a049-442f-9d0f-abfae7693c1e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1241::DEBUG::2014-04-10 16:59:09,435::task::579::TaskManager.Task::(_updateState) Task=`cdf2a772-a049-442f-9d0f-abfae7693c1e`::moving from state preparing -> state finished
>Thread-1241::DEBUG::2014-04-10 16:59:09,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1241::DEBUG::2014-04-10 16:59:09,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1241::DEBUG::2014-04-10 16:59:09,436::task::974::TaskManager.Task::(_decref) Task=`cdf2a772-a049-442f-9d0f-abfae7693c1e`::ref 0 aborting False
>Thread-1243::DEBUG::2014-04-10 16:59:09,445::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-1243::DEBUG::2014-04-10 16:59:09,445::task::579::TaskManager.Task::(_updateState) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::moving from state init -> state preparing
>Thread-1243::INFO::2014-04-10 16:59:09,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1243::DEBUG::2014-04-10 16:59:09,446::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d68fca64-dc3f-4b4a-b4ba-7cf895b56711`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1243::DEBUG::2014-04-10 16:59:09,446::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1243::DEBUG::2014-04-10 16:59:09,446::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1243::DEBUG::2014-04-10 16:59:09,446::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d68fca64-dc3f-4b4a-b4ba-7cf895b56711`::Granted request
>Thread-1243::DEBUG::2014-04-10 16:59:09,447::task::811::TaskManager.Task::(resourceAcquired) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1243::DEBUG::2014-04-10 16:59:09,447::task::974::TaskManager.Task::(_decref) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::ref 1 aborting False
>Thread-1243::INFO::2014-04-10 16:59:09,449::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1243::DEBUG::2014-04-10 16:59:09,449::task::1168::TaskManager.Task::(prepare) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1243::DEBUG::2014-04-10 16:59:09,449::task::579::TaskManager.Task::(_updateState) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::moving from state preparing -> state finished
>Thread-1243::DEBUG::2014-04-10 16:59:09,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1243::DEBUG::2014-04-10 16:59:09,450::task::974::TaskManager.Task::(_decref) Task=`0c2634ef-869b-4978-a4e0-83082d2f157a`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:10,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:10,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000507068 s, 726 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:10,593::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:10,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000509745 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1245::DEBUG::2014-04-10 16:59:15,509::task::579::TaskManager.Task::(_updateState) Task=`a9f3ea22-f4c4-47cb-9542-c4c001328aad`::moving from state init -> state preparing
>Thread-1245::INFO::2014-04-10 16:59:15,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1245::INFO::2014-04-10 16:59:15,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509745', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468183', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372587', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507068', 'lastCheck': '5.0', 'valid': True}}
>Thread-1245::DEBUG::2014-04-10 16:59:15,510::task::1168::TaskManager.Task::(prepare) Task=`a9f3ea22-f4c4-47cb-9542-c4c001328aad`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509745', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468183', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372587', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507068', 'lastCheck': '5.0', 'valid': True}}
>Thread-1245::DEBUG::2014-04-10 16:59:15,510::task::579::TaskManager.Task::(_updateState) Task=`a9f3ea22-f4c4-47cb-9542-c4c001328aad`::moving from state preparing -> state finished
>Thread-1245::DEBUG::2014-04-10 16:59:15,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1245::DEBUG::2014-04-10 16:59:15,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1245::DEBUG::2014-04-10 16:59:15,511::task::974::TaskManager.Task::(_decref) Task=`a9f3ea22-f4c4-47cb-9542-c4c001328aad`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:59:17,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:17,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000484122 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:17,922::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:17,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000452461 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1248::DEBUG::2014-04-10 16:59:19,539::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1248::DEBUG::2014-04-10 16:59:19,540::task::579::TaskManager.Task::(_updateState) Task=`ca113b0f-c414-40f1-8666-1ec8b64e910e`::moving from state init -> state preparing
>Thread-1248::INFO::2014-04-10 16:59:19,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1248::INFO::2014-04-10 16:59:19,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1248::DEBUG::2014-04-10 16:59:19,541::task::1168::TaskManager.Task::(prepare) Task=`ca113b0f-c414-40f1-8666-1ec8b64e910e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1248::DEBUG::2014-04-10 16:59:19,541::task::579::TaskManager.Task::(_updateState) Task=`ca113b0f-c414-40f1-8666-1ec8b64e910e`::moving from state preparing -> state finished
>Thread-1248::DEBUG::2014-04-10 16:59:19,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1248::DEBUG::2014-04-10 16:59:19,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1248::DEBUG::2014-04-10 16:59:19,541::task::974::TaskManager.Task::(_decref) Task=`ca113b0f-c414-40f1-8666-1ec8b64e910e`::ref 0 aborting False
>Thread-1249::DEBUG::2014-04-10 16:59:19,548::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1249::DEBUG::2014-04-10 16:59:19,549::task::579::TaskManager.Task::(_updateState) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::moving from state init -> state preparing
>Thread-1249::INFO::2014-04-10 16:59:19,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1249::DEBUG::2014-04-10 16:59:19,549::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bfa928ae-5d0c-4d75-aba4-bfd23c92d971`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1249::DEBUG::2014-04-10 16:59:19,549::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1249::DEBUG::2014-04-10 16:59:19,550::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1249::DEBUG::2014-04-10 16:59:19,550::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bfa928ae-5d0c-4d75-aba4-bfd23c92d971`::Granted request
>Thread-1249::DEBUG::2014-04-10 16:59:19,550::task::811::TaskManager.Task::(resourceAcquired) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1249::DEBUG::2014-04-10 16:59:19,551::task::974::TaskManager.Task::(_decref) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::ref 1 aborting False
>Thread-1249::INFO::2014-04-10 16:59:19,553::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1249::DEBUG::2014-04-10 16:59:19,553::task::1168::TaskManager.Task::(prepare) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1249::DEBUG::2014-04-10 16:59:19,553::task::579::TaskManager.Task::(_updateState) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::moving from state preparing -> state finished
>Thread-1249::DEBUG::2014-04-10 16:59:19,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1249::DEBUG::2014-04-10 16:59:19,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1249::DEBUG::2014-04-10 16:59:19,554::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1249::DEBUG::2014-04-10 16:59:19,554::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1249::DEBUG::2014-04-10 16:59:19,554::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1249::DEBUG::2014-04-10 16:59:19,554::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1249::DEBUG::2014-04-10 16:59:19,554::task::974::TaskManager.Task::(_decref) Task=`427b5f7e-a534-4c76-aad3-0b92f7d74135`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:20,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:20,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000565969 s, 650 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:20,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:20,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000362421 s, 1.8 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:59:27,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:27,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296203 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:27,936::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:27,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000257275 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1253::DEBUG::2014-04-10 16:59:29,696::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1253::DEBUG::2014-04-10 16:59:29,708::task::579::TaskManager.Task::(_updateState) Task=`746ebf41-c318-4e7f-9356-dbc13f96f124`::moving from state init -> state preparing
>Thread-1253::INFO::2014-04-10 16:59:29,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1253::INFO::2014-04-10 16:59:29,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1253::DEBUG::2014-04-10 16:59:29,708::task::1168::TaskManager.Task::(prepare) Task=`746ebf41-c318-4e7f-9356-dbc13f96f124`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1253::DEBUG::2014-04-10 16:59:29,709::task::579::TaskManager.Task::(_updateState) Task=`746ebf41-c318-4e7f-9356-dbc13f96f124`::moving from state preparing -> state finished
>Thread-1253::DEBUG::2014-04-10 16:59:29,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1253::DEBUG::2014-04-10 16:59:29,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1253::DEBUG::2014-04-10 16:59:29,709::task::974::TaskManager.Task::(_decref) Task=`746ebf41-c318-4e7f-9356-dbc13f96f124`::ref 0 aborting False
>Thread-1254::DEBUG::2014-04-10 16:59:29,716::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1254::DEBUG::2014-04-10 16:59:29,716::task::579::TaskManager.Task::(_updateState) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::moving from state init -> state preparing
>Thread-1254::INFO::2014-04-10 16:59:29,716::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1254::DEBUG::2014-04-10 16:59:29,717::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8953716-5dbb-4947-8aff-3a33bbd6eaba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1254::DEBUG::2014-04-10 16:59:29,717::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1254::DEBUG::2014-04-10 16:59:29,717::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1254::DEBUG::2014-04-10 16:59:29,717::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8953716-5dbb-4947-8aff-3a33bbd6eaba`::Granted request
>Thread-1254::DEBUG::2014-04-10 16:59:29,718::task::811::TaskManager.Task::(resourceAcquired) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1254::DEBUG::2014-04-10 16:59:29,718::task::974::TaskManager.Task::(_decref) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::ref 1 aborting False
>Thread-1254::INFO::2014-04-10 16:59:29,720::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1254::DEBUG::2014-04-10 16:59:29,720::task::1168::TaskManager.Task::(prepare) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1254::DEBUG::2014-04-10 16:59:29,720::task::579::TaskManager.Task::(_updateState) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::moving from state preparing -> state finished
>Thread-1254::DEBUG::2014-04-10 16:59:29,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1254::DEBUG::2014-04-10 16:59:29,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1254::DEBUG::2014-04-10 16:59:29,721::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1254::DEBUG::2014-04-10 16:59:29,721::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1254::DEBUG::2014-04-10 16:59:29,721::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1254::DEBUG::2014-04-10 16:59:29,721::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1254::DEBUG::2014-04-10 16:59:29,721::task::974::TaskManager.Task::(_decref) Task=`5f6b8c13-e6b7-4e91-93a2-5c1ff974c6ca`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:30,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:30,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000395224 s, 931 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:30,623::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:30,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00047875 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1255::DEBUG::2014-04-10 16:59:30,678::task::579::TaskManager.Task::(_updateState) Task=`4319eb9a-0611-4112-8253-384c194c2867`::moving from state init -> state preparing
>Thread-1255::INFO::2014-04-10 16:59:30,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1255::INFO::2014-04-10 16:59:30,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047875', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296203', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257275', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395224', 'lastCheck': '0.2', 'valid': True}}
>Thread-1255::DEBUG::2014-04-10 16:59:30,679::task::1168::TaskManager.Task::(prepare) Task=`4319eb9a-0611-4112-8253-384c194c2867`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047875', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296203', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257275', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395224', 'lastCheck': '0.2', 'valid': True}}
>Thread-1255::DEBUG::2014-04-10 16:59:30,679::task::579::TaskManager.Task::(_updateState) Task=`4319eb9a-0611-4112-8253-384c194c2867`::moving from state preparing -> state finished
>Thread-1255::DEBUG::2014-04-10 16:59:30,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1255::DEBUG::2014-04-10 16:59:30,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1255::DEBUG::2014-04-10 16:59:30,679::task::974::TaskManager.Task::(_decref) Task=`4319eb9a-0611-4112-8253-384c194c2867`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:59:37,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:37,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027797 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:37,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:37,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292027 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1259::DEBUG::2014-04-10 16:59:39,813::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1259::DEBUG::2014-04-10 16:59:39,813::task::579::TaskManager.Task::(_updateState) Task=`0928779a-f97e-4b94-9c5a-e9e7c4035f71`::moving from state init -> state preparing
>Thread-1259::INFO::2014-04-10 16:59:39,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1259::INFO::2014-04-10 16:59:39,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1259::DEBUG::2014-04-10 16:59:39,814::task::1168::TaskManager.Task::(prepare) Task=`0928779a-f97e-4b94-9c5a-e9e7c4035f71`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1259::DEBUG::2014-04-10 16:59:39,814::task::579::TaskManager.Task::(_updateState) Task=`0928779a-f97e-4b94-9c5a-e9e7c4035f71`::moving from state preparing -> state finished
>Thread-1259::DEBUG::2014-04-10 16:59:39,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1259::DEBUG::2014-04-10 16:59:39,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1259::DEBUG::2014-04-10 16:59:39,814::task::974::TaskManager.Task::(_decref) Task=`0928779a-f97e-4b94-9c5a-e9e7c4035f71`::ref 0 aborting False
>Thread-1261::DEBUG::2014-04-10 16:59:39,824::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1261::DEBUG::2014-04-10 16:59:39,824::task::579::TaskManager.Task::(_updateState) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::moving from state init -> state preparing
>Thread-1261::INFO::2014-04-10 16:59:39,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1261::DEBUG::2014-04-10 16:59:39,825::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cd07a152-138a-4187-b440-207f00da194d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1261::DEBUG::2014-04-10 16:59:39,825::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1261::DEBUG::2014-04-10 16:59:39,825::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1261::DEBUG::2014-04-10 16:59:39,825::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cd07a152-138a-4187-b440-207f00da194d`::Granted request
>Thread-1261::DEBUG::2014-04-10 16:59:39,825::task::811::TaskManager.Task::(resourceAcquired) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1261::DEBUG::2014-04-10 16:59:39,826::task::974::TaskManager.Task::(_decref) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::ref 1 aborting False
>Thread-1261::INFO::2014-04-10 16:59:39,827::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::task::1168::TaskManager.Task::(prepare) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::task::579::TaskManager.Task::(_updateState) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::moving from state preparing -> state finished
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1261::DEBUG::2014-04-10 16:59:39,828::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1261::DEBUG::2014-04-10 16:59:39,829::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1261::DEBUG::2014-04-10 16:59:39,829::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1261::DEBUG::2014-04-10 16:59:39,829::task::974::TaskManager.Task::(_decref) Task=`2c31968c-0050-484c-a86f-11b8dfd4f0c4`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:40,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:40,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000482068 s, 763 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:40,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:40,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000467343 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1263::DEBUG::2014-04-10 16:59:45,859::task::579::TaskManager.Task::(_updateState) Task=`26602ced-5b3c-481e-afdb-8a19f0026b4e`::moving from state init -> state preparing
>Thread-1263::INFO::2014-04-10 16:59:45,859::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1263::INFO::2014-04-10 16:59:45,859::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467343', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027797', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292027', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482068', 'lastCheck': '5.3', 'valid': True}}
>Thread-1263::DEBUG::2014-04-10 16:59:45,860::task::1168::TaskManager.Task::(prepare) Task=`26602ced-5b3c-481e-afdb-8a19f0026b4e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467343', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027797', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292027', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482068', 'lastCheck': '5.3', 'valid': True}}
>Thread-1263::DEBUG::2014-04-10 16:59:45,860::task::579::TaskManager.Task::(_updateState) Task=`26602ced-5b3c-481e-afdb-8a19f0026b4e`::moving from state preparing -> state finished
>Thread-1263::DEBUG::2014-04-10 16:59:45,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1263::DEBUG::2014-04-10 16:59:45,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1263::DEBUG::2014-04-10 16:59:45,860::task::974::TaskManager.Task::(_decref) Task=`26602ced-5b3c-481e-afdb-8a19f0026b4e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 16:59:47,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:47,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334172 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:47,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:47,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000253453 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1266::DEBUG::2014-04-10 16:59:49,910::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1266::DEBUG::2014-04-10 16:59:49,910::task::579::TaskManager.Task::(_updateState) Task=`2c579e84-abf7-4ac0-a502-74c891a79221`::moving from state init -> state preparing
>Thread-1266::INFO::2014-04-10 16:59:49,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1266::INFO::2014-04-10 16:59:49,911::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1266::DEBUG::2014-04-10 16:59:49,911::task::1168::TaskManager.Task::(prepare) Task=`2c579e84-abf7-4ac0-a502-74c891a79221`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1266::DEBUG::2014-04-10 16:59:49,911::task::579::TaskManager.Task::(_updateState) Task=`2c579e84-abf7-4ac0-a502-74c891a79221`::moving from state preparing -> state finished
>Thread-1266::DEBUG::2014-04-10 16:59:49,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1266::DEBUG::2014-04-10 16:59:49,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1266::DEBUG::2014-04-10 16:59:49,912::task::974::TaskManager.Task::(_decref) Task=`2c579e84-abf7-4ac0-a502-74c891a79221`::ref 0 aborting False
>Thread-1267::DEBUG::2014-04-10 16:59:49,919::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1267::DEBUG::2014-04-10 16:59:49,919::task::579::TaskManager.Task::(_updateState) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::moving from state init -> state preparing
>Thread-1267::INFO::2014-04-10 16:59:49,919::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1267::DEBUG::2014-04-10 16:59:49,920::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f085e493-1465-4039-9c66-7f12607f9c1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1267::DEBUG::2014-04-10 16:59:49,920::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1267::DEBUG::2014-04-10 16:59:49,920::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1267::DEBUG::2014-04-10 16:59:49,920::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f085e493-1465-4039-9c66-7f12607f9c1e`::Granted request
>Thread-1267::DEBUG::2014-04-10 16:59:49,921::task::811::TaskManager.Task::(resourceAcquired) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1267::DEBUG::2014-04-10 16:59:49,921::task::974::TaskManager.Task::(_decref) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::ref 1 aborting False
>Thread-1267::INFO::2014-04-10 16:59:49,924::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1267::DEBUG::2014-04-10 16:59:49,924::task::1168::TaskManager.Task::(prepare) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1267::DEBUG::2014-04-10 16:59:49,924::task::579::TaskManager.Task::(_updateState) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::moving from state preparing -> state finished
>Thread-1267::DEBUG::2014-04-10 16:59:49,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1267::DEBUG::2014-04-10 16:59:49,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1267::DEBUG::2014-04-10 16:59:49,925::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1267::DEBUG::2014-04-10 16:59:49,925::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1267::DEBUG::2014-04-10 16:59:49,925::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1267::DEBUG::2014-04-10 16:59:49,925::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1267::DEBUG::2014-04-10 16:59:49,925::task::974::TaskManager.Task::(_decref) Task=`c3ef315b-28a6-480d-a02f-ac0a5c65dfd1`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 16:59:50,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 16:59:50,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477182 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 16:59:50,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 16:59:50,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000492878 s, 1.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 16:59:57,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 16:59:57,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274102 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 16:59:57,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 16:59:57,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000245658 s, 2.7 MB/s\n'; <rc> = 0
>Thread-1271::DEBUG::2014-04-10 17:00:00,183::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1271::DEBUG::2014-04-10 17:00:00,184::task::579::TaskManager.Task::(_updateState) Task=`afcbb4c0-05a8-4a26-ad6c-aadbfc6a5297`::moving from state init -> state preparing
>Thread-1271::INFO::2014-04-10 17:00:00,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1271::INFO::2014-04-10 17:00:00,185::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1271::DEBUG::2014-04-10 17:00:00,185::task::1168::TaskManager.Task::(prepare) Task=`afcbb4c0-05a8-4a26-ad6c-aadbfc6a5297`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1271::DEBUG::2014-04-10 17:00:00,185::task::579::TaskManager.Task::(_updateState) Task=`afcbb4c0-05a8-4a26-ad6c-aadbfc6a5297`::moving from state preparing -> state finished
>Thread-1271::DEBUG::2014-04-10 17:00:00,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1271::DEBUG::2014-04-10 17:00:00,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1271::DEBUG::2014-04-10 17:00:00,185::task::974::TaskManager.Task::(_decref) Task=`afcbb4c0-05a8-4a26-ad6c-aadbfc6a5297`::ref 0 aborting False
>Thread-1272::DEBUG::2014-04-10 17:00:00,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1272::DEBUG::2014-04-10 17:00:00,192::task::579::TaskManager.Task::(_updateState) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::moving from state init -> state preparing
>Thread-1272::INFO::2014-04-10 17:00:00,192::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1272::DEBUG::2014-04-10 17:00:00,193::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2965b0a0-a5e5-458b-b228-dec0a84e641f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1272::DEBUG::2014-04-10 17:00:00,193::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1272::DEBUG::2014-04-10 17:00:00,193::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1272::DEBUG::2014-04-10 17:00:00,193::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2965b0a0-a5e5-458b-b228-dec0a84e641f`::Granted request
>Thread-1272::DEBUG::2014-04-10 17:00:00,194::task::811::TaskManager.Task::(resourceAcquired) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1272::DEBUG::2014-04-10 17:00:00,194::task::974::TaskManager.Task::(_decref) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::ref 1 aborting False
>Thread-1272::INFO::2014-04-10 17:00:00,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1272::DEBUG::2014-04-10 17:00:00,196::task::1168::TaskManager.Task::(prepare) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1272::DEBUG::2014-04-10 17:00:00,196::task::579::TaskManager.Task::(_updateState) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::moving from state preparing -> state finished
>Thread-1272::DEBUG::2014-04-10 17:00:00,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1272::DEBUG::2014-04-10 17:00:00,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1272::DEBUG::2014-04-10 17:00:00,196::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1272::DEBUG::2014-04-10 17:00:00,197::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1272::DEBUG::2014-04-10 17:00:00,197::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1272::DEBUG::2014-04-10 17:00:00,197::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1272::DEBUG::2014-04-10 17:00:00,197::task::974::TaskManager.Task::(_decref) Task=`4de39f4b-2473-4a95-95ed-07292331229e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:00:00,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:00:00,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480585 s, 766 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:00:00,668::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:00,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000408014 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1273::DEBUG::2014-04-10 17:00:01,023::task::579::TaskManager.Task::(_updateState) Task=`20df22c2-8776-48a8-8e54-05aaa861ddef`::moving from state init -> state preparing
>Thread-1273::INFO::2014-04-10 17:00:01,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1273::INFO::2014-04-10 17:00:01,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408014', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274102', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245658', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480585', 'lastCheck': '0.5', 'valid': True}}
>Thread-1273::DEBUG::2014-04-10 17:00:01,023::task::1168::TaskManager.Task::(prepare) Task=`20df22c2-8776-48a8-8e54-05aaa861ddef`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408014', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274102', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245658', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480585', 'lastCheck': '0.5', 'valid': True}}
>Thread-1273::DEBUG::2014-04-10 17:00:01,024::task::579::TaskManager.Task::(_updateState) Task=`20df22c2-8776-48a8-8e54-05aaa861ddef`::moving from state preparing -> state finished
>Thread-1273::DEBUG::2014-04-10 17:00:01,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1273::DEBUG::2014-04-10 17:00:01,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1273::DEBUG::2014-04-10 17:00:01,024::task::974::TaskManager.Task::(_decref) Task=`20df22c2-8776-48a8-8e54-05aaa861ddef`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:00:07,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:00:07,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397316 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:07,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:07,997::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240198 s, 2.8 MB/s\n'; <rc> = 0
>Thread-1278::DEBUG::2014-04-10 17:00:10,292::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-1278::DEBUG::2014-04-10 17:00:10,292::task::579::TaskManager.Task::(_updateState) Task=`76bd2afe-1a74-488e-9ba2-6118fd46cd0c`::moving from state init -> state preparing
>Thread-1278::INFO::2014-04-10 17:00:10,293::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1278::INFO::2014-04-10 17:00:10,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1278::DEBUG::2014-04-10 17:00:10,293::task::1168::TaskManager.Task::(prepare) Task=`76bd2afe-1a74-488e-9ba2-6118fd46cd0c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1278::DEBUG::2014-04-10 17:00:10,293::task::579::TaskManager.Task::(_updateState) Task=`76bd2afe-1a74-488e-9ba2-6118fd46cd0c`::moving from state preparing -> state finished
>Thread-1278::DEBUG::2014-04-10 17:00:10,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1278::DEBUG::2014-04-10 17:00:10,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1278::DEBUG::2014-04-10 17:00:10,294::task::974::TaskManager.Task::(_decref) Task=`76bd2afe-1a74-488e-9ba2-6118fd46cd0c`::ref 0 aborting False
>Thread-1279::DEBUG::2014-04-10 17:00:10,300::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-1279::DEBUG::2014-04-10 17:00:10,301::task::579::TaskManager.Task::(_updateState) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::moving from state init -> state preparing
>Thread-1279::INFO::2014-04-10 17:00:10,301::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1279::DEBUG::2014-04-10 17:00:10,301::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ce6c088-044a-43a0-b2c2-5ef22a922b85`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1279::DEBUG::2014-04-10 17:00:10,302::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1279::DEBUG::2014-04-10 17:00:10,302::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1279::DEBUG::2014-04-10 17:00:10,302::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ce6c088-044a-43a0-b2c2-5ef22a922b85`::Granted request
>Thread-1279::DEBUG::2014-04-10 17:00:10,302::task::811::TaskManager.Task::(resourceAcquired) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1279::DEBUG::2014-04-10 17:00:10,303::task::974::TaskManager.Task::(_decref) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::ref 1 aborting False
>Thread-1279::INFO::2014-04-10 17:00:10,304::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::task::1168::TaskManager.Task::(prepare) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::task::579::TaskManager.Task::(_updateState) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::moving from state preparing -> state finished
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1279::DEBUG::2014-04-10 17:00:10,305::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1279::DEBUG::2014-04-10 17:00:10,306::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1279::DEBUG::2014-04-10 17:00:10,306::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1279::DEBUG::2014-04-10 17:00:10,306::task::974::TaskManager.Task::(_decref) Task=`1376d526-c7b9-434f-b276-02298b06ad76`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:00:10,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:00:10,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000520486 s, 707 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:00:10,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:10,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460657 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1281::DEBUG::2014-04-10 17:00:16,237::task::579::TaskManager.Task::(_updateState) Task=`4d5d46fd-2d34-4544-9ab4-ae52c67c7274`::moving from state init -> state preparing
>Thread-1281::INFO::2014-04-10 17:00:16,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1281::INFO::2014-04-10 17:00:16,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460657', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397316', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240198', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520486', 'lastCheck': '5.7', 'valid': True}}
>Thread-1281::DEBUG::2014-04-10 17:00:16,238::task::1168::TaskManager.Task::(prepare) Task=`4d5d46fd-2d34-4544-9ab4-ae52c67c7274`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460657', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397316', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240198', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520486', 'lastCheck': '5.7', 'valid': True}}
>Thread-1281::DEBUG::2014-04-10 17:00:16,238::task::579::TaskManager.Task::(_updateState) Task=`4d5d46fd-2d34-4544-9ab4-ae52c67c7274`::moving from state preparing -> state finished
>Thread-1281::DEBUG::2014-04-10 17:00:16,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1281::DEBUG::2014-04-10 17:00:16,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1281::DEBUG::2014-04-10 17:00:16,238::task::974::TaskManager.Task::(_decref) Task=`4d5d46fd-2d34-4544-9ab4-ae52c67c7274`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:00:17,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:00:17,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276424 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:18,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:18,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240557 s, 2.8 MB/s\n'; <rc> = 0
>Thread-1284::DEBUG::2014-04-10 17:00:20,397::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1284::DEBUG::2014-04-10 17:00:20,398::task::579::TaskManager.Task::(_updateState) Task=`155c788f-583c-4be3-85b5-f85bbbb31d83`::moving from state init -> state preparing
>Thread-1284::INFO::2014-04-10 17:00:20,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1284::INFO::2014-04-10 17:00:20,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1284::DEBUG::2014-04-10 17:00:20,398::task::1168::TaskManager.Task::(prepare) Task=`155c788f-583c-4be3-85b5-f85bbbb31d83`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1284::DEBUG::2014-04-10 17:00:20,398::task::579::TaskManager.Task::(_updateState) Task=`155c788f-583c-4be3-85b5-f85bbbb31d83`::moving from state preparing -> state finished
>Thread-1284::DEBUG::2014-04-10 17:00:20,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1284::DEBUG::2014-04-10 17:00:20,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1284::DEBUG::2014-04-10 17:00:20,399::task::974::TaskManager.Task::(_decref) Task=`155c788f-583c-4be3-85b5-f85bbbb31d83`::ref 0 aborting False
>Thread-1285::DEBUG::2014-04-10 17:00:20,406::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1285::DEBUG::2014-04-10 17:00:20,406::task::579::TaskManager.Task::(_updateState) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::moving from state init -> state preparing
>Thread-1285::INFO::2014-04-10 17:00:20,406::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1285::DEBUG::2014-04-10 17:00:20,406::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7965f94-9025-4c57-afe0-5f7587679a40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1285::DEBUG::2014-04-10 17:00:20,407::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1285::DEBUG::2014-04-10 17:00:20,407::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1285::DEBUG::2014-04-10 17:00:20,407::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7965f94-9025-4c57-afe0-5f7587679a40`::Granted request
>Thread-1285::DEBUG::2014-04-10 17:00:20,407::task::811::TaskManager.Task::(resourceAcquired) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1285::DEBUG::2014-04-10 17:00:20,407::task::974::TaskManager.Task::(_decref) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::ref 1 aborting False
>Thread-1285::INFO::2014-04-10 17:00:20,409::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1285::DEBUG::2014-04-10 17:00:20,409::task::1168::TaskManager.Task::(prepare) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::task::579::TaskManager.Task::(_updateState) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::moving from state preparing -> state finished
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1285::DEBUG::2014-04-10 17:00:20,410::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1285::DEBUG::2014-04-10 17:00:20,411::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1285::DEBUG::2014-04-10 17:00:20,411::task::974::TaskManager.Task::(_decref) Task=`b1ad0497-fb71-4c98-bd89-2124ac59fb3e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:00:20,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:00:20,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447837 s, 822 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:00:20,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:20,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000423043 s, 1.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:00:27,993::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:00:28,007::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:00:28,008::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:00:28,013::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 17:00:28,014::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:00:28,016::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:00:28,017::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:00:28,020::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:00:28,048::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:00:28,052::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:00:28,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:28,065::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 17:00:28,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000224 s, 3.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:28,071::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:00:28,072::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:00:28,073::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:00:28,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:28,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025505 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1297::DEBUG::2014-04-10 17:00:30,487::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-1297::DEBUG::2014-04-10 17:00:30,503::task::579::TaskManager.Task::(_updateState) Task=`021846c6-3910-424d-b652-e098e9e7d2fb`::moving from state init -> state preparing
>Thread-1297::INFO::2014-04-10 17:00:30,503::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1297::INFO::2014-04-10 17:00:30,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1297::DEBUG::2014-04-10 17:00:30,504::task::1168::TaskManager.Task::(prepare) Task=`021846c6-3910-424d-b652-e098e9e7d2fb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1297::DEBUG::2014-04-10 17:00:30,504::task::579::TaskManager.Task::(_updateState) Task=`021846c6-3910-424d-b652-e098e9e7d2fb`::moving from state preparing -> state finished
>Thread-1297::DEBUG::2014-04-10 17:00:30,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1297::DEBUG::2014-04-10 17:00:30,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1297::DEBUG::2014-04-10 17:00:30,504::task::974::TaskManager.Task::(_decref) Task=`021846c6-3910-424d-b652-e098e9e7d2fb`::ref 0 aborting False
>Thread-1298::DEBUG::2014-04-10 17:00:30,511::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-1298::DEBUG::2014-04-10 17:00:30,512::task::579::TaskManager.Task::(_updateState) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::moving from state init -> state preparing
>Thread-1298::INFO::2014-04-10 17:00:30,512::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1298::DEBUG::2014-04-10 17:00:30,513::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee491979-5d71-44e2-ad7b-33d1c8ee7574`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1298::DEBUG::2014-04-10 17:00:30,513::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1298::DEBUG::2014-04-10 17:00:30,513::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1298::DEBUG::2014-04-10 17:00:30,513::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee491979-5d71-44e2-ad7b-33d1c8ee7574`::Granted request
>Thread-1298::DEBUG::2014-04-10 17:00:30,515::task::811::TaskManager.Task::(resourceAcquired) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1298::DEBUG::2014-04-10 17:00:30,515::task::974::TaskManager.Task::(_decref) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::ref 1 aborting False
>Thread-1298::INFO::2014-04-10 17:00:30,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1298::DEBUG::2014-04-10 17:00:30,517::task::1168::TaskManager.Task::(prepare) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1298::DEBUG::2014-04-10 17:00:30,517::task::579::TaskManager.Task::(_updateState) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::moving from state preparing -> state finished
>Thread-1298::DEBUG::2014-04-10 17:00:30,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1298::DEBUG::2014-04-10 17:00:30,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1298::DEBUG::2014-04-10 17:00:30,518::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1298::DEBUG::2014-04-10 17:00:30,518::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1298::DEBUG::2014-04-10 17:00:30,518::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1298::DEBUG::2014-04-10 17:00:30,518::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1298::DEBUG::2014-04-10 17:00:30,518::task::974::TaskManager.Task::(_decref) Task=`f139b134-f798-4904-a43a-ee5581d2544a`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:00:30,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:00:30,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480171 s, 766 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:00:30,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:30,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445209 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1299::DEBUG::2014-04-10 17:00:31,411::task::579::TaskManager.Task::(_updateState) Task=`561ace37-afde-4081-bdca-b48ce834c13b`::moving from state init -> state preparing
>Thread-1299::INFO::2014-04-10 17:00:31,411::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1299::INFO::2014-04-10 17:00:31,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445209', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025505', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480171', 'lastCheck': '0.8', 'valid': True}}
>Thread-1299::DEBUG::2014-04-10 17:00:31,412::task::1168::TaskManager.Task::(prepare) Task=`561ace37-afde-4081-bdca-b48ce834c13b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445209', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000224', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025505', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480171', 'lastCheck': '0.8', 'valid': True}}
>Thread-1299::DEBUG::2014-04-10 17:00:31,412::task::579::TaskManager.Task::(_updateState) Task=`561ace37-afde-4081-bdca-b48ce834c13b`::moving from state preparing -> state finished
>Thread-1299::DEBUG::2014-04-10 17:00:31,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1299::DEBUG::2014-04-10 17:00:31,412::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1299::DEBUG::2014-04-10 17:00:31,413::task::974::TaskManager.Task::(_decref) Task=`561ace37-afde-4081-bdca-b48ce834c13b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:00:38,089::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:00:38,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305899 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:38,123::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:38,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252628 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:00:40,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1303::DEBUG::2014-04-10 17:00:40,617::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1303::DEBUG::2014-04-10 17:00:40,619::task::579::TaskManager.Task::(_updateState) Task=`29c4af26-5687-4bf1-87ed-21f3152e07d9`::moving from state init -> state preparing
>Thread-1303::INFO::2014-04-10 17:00:40,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1303::INFO::2014-04-10 17:00:40,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1303::DEBUG::2014-04-10 17:00:40,624::task::1168::TaskManager.Task::(prepare) Task=`29c4af26-5687-4bf1-87ed-21f3152e07d9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-469::DEBUG::2014-04-10 17:00:40,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451623 s, 815 kB/s\n'; <rc> = 0
>Thread-1303::DEBUG::2014-04-10 17:00:40,625::task::579::TaskManager.Task::(_updateState) Task=`29c4af26-5687-4bf1-87ed-21f3152e07d9`::moving from state preparing -> state finished
>Thread-1303::DEBUG::2014-04-10 17:00:40,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1303::DEBUG::2014-04-10 17:00:40,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1303::DEBUG::2014-04-10 17:00:40,627::task::974::TaskManager.Task::(_decref) Task=`29c4af26-5687-4bf1-87ed-21f3152e07d9`::ref 0 aborting False
>Thread-1304::DEBUG::2014-04-10 17:00:40,636::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1304::DEBUG::2014-04-10 17:00:40,637::task::579::TaskManager.Task::(_updateState) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::moving from state init -> state preparing
>Thread-1304::INFO::2014-04-10 17:00:40,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1304::DEBUG::2014-04-10 17:00:40,638::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a54d1ff0-a2a8-4e23-821a-5caf16fa139b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1304::DEBUG::2014-04-10 17:00:40,638::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1304::DEBUG::2014-04-10 17:00:40,638::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1304::DEBUG::2014-04-10 17:00:40,638::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a54d1ff0-a2a8-4e23-821a-5caf16fa139b`::Granted request
>Thread-1304::DEBUG::2014-04-10 17:00:40,639::task::811::TaskManager.Task::(resourceAcquired) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1304::DEBUG::2014-04-10 17:00:40,639::task::974::TaskManager.Task::(_decref) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::ref 1 aborting False
>Thread-1304::INFO::2014-04-10 17:00:40,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1304::DEBUG::2014-04-10 17:00:40,641::task::1168::TaskManager.Task::(prepare) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1304::DEBUG::2014-04-10 17:00:40,641::task::579::TaskManager.Task::(_updateState) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::moving from state preparing -> state finished
>Thread-1304::DEBUG::2014-04-10 17:00:40,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1304::DEBUG::2014-04-10 17:00:40,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1304::DEBUG::2014-04-10 17:00:40,642::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1304::DEBUG::2014-04-10 17:00:40,642::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1304::DEBUG::2014-04-10 17:00:40,642::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1304::DEBUG::2014-04-10 17:00:40,643::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1304::DEBUG::2014-04-10 17:00:40,643::task::974::TaskManager.Task::(_decref) Task=`f337381f-33a4-499b-8d6e-8d5ae499cef8`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:00:40,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:40,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000497435 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1307::DEBUG::2014-04-10 17:00:46,716::task::579::TaskManager.Task::(_updateState) Task=`5691245e-0c32-4d16-b8e9-c1de5ff17aaf`::moving from state init -> state preparing
>Thread-1307::INFO::2014-04-10 17:00:46,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1307::INFO::2014-04-10 17:00:46,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497435', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305899', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252628', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451623', 'lastCheck': '6.1', 'valid': True}}
>Thread-1307::DEBUG::2014-04-10 17:00:46,717::task::1168::TaskManager.Task::(prepare) Task=`5691245e-0c32-4d16-b8e9-c1de5ff17aaf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497435', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305899', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252628', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451623', 'lastCheck': '6.1', 'valid': True}}
>Thread-1307::DEBUG::2014-04-10 17:00:46,717::task::579::TaskManager.Task::(_updateState) Task=`5691245e-0c32-4d16-b8e9-c1de5ff17aaf`::moving from state preparing -> state finished
>Thread-1307::DEBUG::2014-04-10 17:00:46,717::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1307::DEBUG::2014-04-10 17:00:46,717::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1307::DEBUG::2014-04-10 17:00:46,718::task::974::TaskManager.Task::(_decref) Task=`5691245e-0c32-4d16-b8e9-c1de5ff17aaf`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:00:48,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:00:48,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286849 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:48,162::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:48,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256817 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:00:50,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:00:50,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000552738 s, 666 kB/s\n'; <rc> = 0
>Thread-1310::DEBUG::2014-04-10 17:00:50,727::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1310::DEBUG::2014-04-10 17:00:50,727::task::579::TaskManager.Task::(_updateState) Task=`213cc317-dd79-4ad0-ada7-aaae2cdebdb3`::moving from state init -> state preparing
>Thread-1310::INFO::2014-04-10 17:00:50,728::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1310::INFO::2014-04-10 17:00:50,728::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1310::DEBUG::2014-04-10 17:00:50,728::task::1168::TaskManager.Task::(prepare) Task=`213cc317-dd79-4ad0-ada7-aaae2cdebdb3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1310::DEBUG::2014-04-10 17:00:50,728::task::579::TaskManager.Task::(_updateState) Task=`213cc317-dd79-4ad0-ada7-aaae2cdebdb3`::moving from state preparing -> state finished
>Thread-1310::DEBUG::2014-04-10 17:00:50,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1310::DEBUG::2014-04-10 17:00:50,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1310::DEBUG::2014-04-10 17:00:50,729::task::974::TaskManager.Task::(_decref) Task=`213cc317-dd79-4ad0-ada7-aaae2cdebdb3`::ref 0 aborting False
>Thread-1311::DEBUG::2014-04-10 17:00:50,736::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1311::DEBUG::2014-04-10 17:00:50,736::task::579::TaskManager.Task::(_updateState) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::moving from state init -> state preparing
>Thread-1311::INFO::2014-04-10 17:00:50,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1311::DEBUG::2014-04-10 17:00:50,737::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d58321-20d3-4156-955c-fcd8ec4a92cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1311::DEBUG::2014-04-10 17:00:50,737::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1311::DEBUG::2014-04-10 17:00:50,737::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1311::DEBUG::2014-04-10 17:00:50,737::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d58321-20d3-4156-955c-fcd8ec4a92cb`::Granted request
>Thread-1311::DEBUG::2014-04-10 17:00:50,741::task::811::TaskManager.Task::(resourceAcquired) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1311::DEBUG::2014-04-10 17:00:50,744::task::974::TaskManager.Task::(_decref) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::ref 1 aborting False
>Thread-1311::INFO::2014-04-10 17:00:50,761::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1311::DEBUG::2014-04-10 17:00:50,762::task::1168::TaskManager.Task::(prepare) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1311::DEBUG::2014-04-10 17:00:50,763::task::579::TaskManager.Task::(_updateState) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::moving from state preparing -> state finished
>Thread-1311::DEBUG::2014-04-10 17:00:50,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1311::DEBUG::2014-04-10 17:00:50,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1311::DEBUG::2014-04-10 17:00:50,768::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1311::DEBUG::2014-04-10 17:00:50,770::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1311::DEBUG::2014-04-10 17:00:50,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1311::DEBUG::2014-04-10 17:00:50,772::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1311::DEBUG::2014-04-10 17:00:50,774::task::974::TaskManager.Task::(_decref) Task=`cc59c69a-cca9-40fd-a4b0-06901ccdda90`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:00:50,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:00:50,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000340265 s, 1.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:00:58,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:00:58,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309831 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:00:58,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:00:58,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248164 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:00,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:00,655::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000455032 s, 809 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:00,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:00,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000525756 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1315::DEBUG::2014-04-10 17:01:00,880::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-1315::DEBUG::2014-04-10 17:01:00,881::task::579::TaskManager.Task::(_updateState) Task=`aae62892-a671-418c-82e2-760517159bdf`::moving from state init -> state preparing
>Thread-1315::INFO::2014-04-10 17:01:00,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1315::INFO::2014-04-10 17:01:00,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1315::DEBUG::2014-04-10 17:01:00,882::task::1168::TaskManager.Task::(prepare) Task=`aae62892-a671-418c-82e2-760517159bdf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1315::DEBUG::2014-04-10 17:01:00,882::task::579::TaskManager.Task::(_updateState) Task=`aae62892-a671-418c-82e2-760517159bdf`::moving from state preparing -> state finished
>Thread-1315::DEBUG::2014-04-10 17:01:00,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1315::DEBUG::2014-04-10 17:01:00,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1315::DEBUG::2014-04-10 17:01:00,883::task::974::TaskManager.Task::(_decref) Task=`aae62892-a671-418c-82e2-760517159bdf`::ref 0 aborting False
>Thread-1316::DEBUG::2014-04-10 17:01:00,890::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-1316::DEBUG::2014-04-10 17:01:00,890::task::579::TaskManager.Task::(_updateState) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::moving from state init -> state preparing
>Thread-1316::INFO::2014-04-10 17:01:00,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1316::DEBUG::2014-04-10 17:01:00,891::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f59b8afb-1468-46b6-b6e8-ad5e1e50f812`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1316::DEBUG::2014-04-10 17:01:00,891::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1316::DEBUG::2014-04-10 17:01:00,891::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1316::DEBUG::2014-04-10 17:01:00,891::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f59b8afb-1468-46b6-b6e8-ad5e1e50f812`::Granted request
>Thread-1316::DEBUG::2014-04-10 17:01:00,892::task::811::TaskManager.Task::(resourceAcquired) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1316::DEBUG::2014-04-10 17:01:00,892::task::974::TaskManager.Task::(_decref) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::ref 1 aborting False
>Thread-1316::INFO::2014-04-10 17:01:00,894::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1316::DEBUG::2014-04-10 17:01:00,894::task::1168::TaskManager.Task::(prepare) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1316::DEBUG::2014-04-10 17:01:00,894::task::579::TaskManager.Task::(_updateState) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::moving from state preparing -> state finished
>Thread-1316::DEBUG::2014-04-10 17:01:00,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1316::DEBUG::2014-04-10 17:01:00,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1316::DEBUG::2014-04-10 17:01:00,895::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1316::DEBUG::2014-04-10 17:01:00,895::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1316::DEBUG::2014-04-10 17:01:00,895::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1316::DEBUG::2014-04-10 17:01:00,896::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1316::DEBUG::2014-04-10 17:01:00,896::task::974::TaskManager.Task::(_decref) Task=`3b12fd13-9a45-412b-8338-b0f34c9b16bd`::ref 0 aborting False
>Thread-1317::DEBUG::2014-04-10 17:01:02,323::task::579::TaskManager.Task::(_updateState) Task=`f5c0336d-91fb-402c-85fa-1e1029812a42`::moving from state init -> state preparing
>Thread-1317::INFO::2014-04-10 17:01:02,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1317::INFO::2014-04-10 17:01:02,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525756', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309831', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248164', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455032', 'lastCheck': '1.7', 'valid': True}}
>Thread-1317::DEBUG::2014-04-10 17:01:02,324::task::1168::TaskManager.Task::(prepare) Task=`f5c0336d-91fb-402c-85fa-1e1029812a42`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525756', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309831', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248164', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455032', 'lastCheck': '1.7', 'valid': True}}
>Thread-1317::DEBUG::2014-04-10 17:01:02,324::task::579::TaskManager.Task::(_updateState) Task=`f5c0336d-91fb-402c-85fa-1e1029812a42`::moving from state preparing -> state finished
>Thread-1317::DEBUG::2014-04-10 17:01:02,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1317::DEBUG::2014-04-10 17:01:02,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1317::DEBUG::2014-04-10 17:01:02,325::task::974::TaskManager.Task::(_decref) Task=`f5c0336d-91fb-402c-85fa-1e1029812a42`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:08,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:08,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034122 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:08,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:08,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000245281 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:10,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:10,671::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000418056 s, 880 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:10,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:10,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000492132 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1321::DEBUG::2014-04-10 17:01:11,412::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1321::DEBUG::2014-04-10 17:01:11,413::task::579::TaskManager.Task::(_updateState) Task=`ac75d0ec-1277-42f3-a143-71736b7d88d7`::moving from state init -> state preparing
>Thread-1321::INFO::2014-04-10 17:01:11,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1321::INFO::2014-04-10 17:01:11,413::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1321::DEBUG::2014-04-10 17:01:11,413::task::1168::TaskManager.Task::(prepare) Task=`ac75d0ec-1277-42f3-a143-71736b7d88d7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1321::DEBUG::2014-04-10 17:01:11,413::task::579::TaskManager.Task::(_updateState) Task=`ac75d0ec-1277-42f3-a143-71736b7d88d7`::moving from state preparing -> state finished
>Thread-1321::DEBUG::2014-04-10 17:01:11,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1321::DEBUG::2014-04-10 17:01:11,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1321::DEBUG::2014-04-10 17:01:11,414::task::974::TaskManager.Task::(_decref) Task=`ac75d0ec-1277-42f3-a143-71736b7d88d7`::ref 0 aborting False
>Thread-1322::DEBUG::2014-04-10 17:01:11,421::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1322::DEBUG::2014-04-10 17:01:11,421::task::579::TaskManager.Task::(_updateState) Task=`51fcc61e-0341-4402-875d-550624f57aec`::moving from state init -> state preparing
>Thread-1322::INFO::2014-04-10 17:01:11,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1322::DEBUG::2014-04-10 17:01:11,422::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4dca17b9-6c97-48ac-befd-83ac39ef22b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1322::DEBUG::2014-04-10 17:01:11,422::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1322::DEBUG::2014-04-10 17:01:11,423::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1322::DEBUG::2014-04-10 17:01:11,423::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4dca17b9-6c97-48ac-befd-83ac39ef22b1`::Granted request
>Thread-1322::DEBUG::2014-04-10 17:01:11,424::task::811::TaskManager.Task::(resourceAcquired) Task=`51fcc61e-0341-4402-875d-550624f57aec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1322::DEBUG::2014-04-10 17:01:11,424::task::974::TaskManager.Task::(_decref) Task=`51fcc61e-0341-4402-875d-550624f57aec`::ref 1 aborting False
>Thread-1322::INFO::2014-04-10 17:01:11,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1322::DEBUG::2014-04-10 17:01:11,426::task::1168::TaskManager.Task::(prepare) Task=`51fcc61e-0341-4402-875d-550624f57aec`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1322::DEBUG::2014-04-10 17:01:11,426::task::579::TaskManager.Task::(_updateState) Task=`51fcc61e-0341-4402-875d-550624f57aec`::moving from state preparing -> state finished
>Thread-1322::DEBUG::2014-04-10 17:01:11,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1322::DEBUG::2014-04-10 17:01:11,427::task::974::TaskManager.Task::(_decref) Task=`51fcc61e-0341-4402-875d-550624f57aec`::ref 0 aborting False
>Thread-1325::DEBUG::2014-04-10 17:01:17,483::task::579::TaskManager.Task::(_updateState) Task=`b5fbbe2e-5d09-433e-a3b5-83219ba63132`::moving from state init -> state preparing
>Thread-1325::INFO::2014-04-10 17:01:17,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1325::INFO::2014-04-10 17:01:17,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492132', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034122', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245281', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418056', 'lastCheck': '6.8', 'valid': True}}
>Thread-1325::DEBUG::2014-04-10 17:01:17,484::task::1168::TaskManager.Task::(prepare) Task=`b5fbbe2e-5d09-433e-a3b5-83219ba63132`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492132', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034122', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000245281', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418056', 'lastCheck': '6.8', 'valid': True}}
>Thread-1325::DEBUG::2014-04-10 17:01:17,484::task::579::TaskManager.Task::(_updateState) Task=`b5fbbe2e-5d09-433e-a3b5-83219ba63132`::moving from state preparing -> state finished
>Thread-1325::DEBUG::2014-04-10 17:01:17,485::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1325::DEBUG::2014-04-10 17:01:17,485::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1325::DEBUG::2014-04-10 17:01:17,485::task::974::TaskManager.Task::(_decref) Task=`b5fbbe2e-5d09-433e-a3b5-83219ba63132`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:18,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:18,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280687 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:18,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:18,287::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000285802 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:20,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:20,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448113 s, 821 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:20,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:20,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000415068 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1328::DEBUG::2014-04-10 17:01:21,506::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1328::DEBUG::2014-04-10 17:01:21,506::task::579::TaskManager.Task::(_updateState) Task=`85365ff7-6a2b-4478-a086-37d78879c111`::moving from state init -> state preparing
>Thread-1328::INFO::2014-04-10 17:01:21,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1328::INFO::2014-04-10 17:01:21,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1328::DEBUG::2014-04-10 17:01:21,507::task::1168::TaskManager.Task::(prepare) Task=`85365ff7-6a2b-4478-a086-37d78879c111`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1328::DEBUG::2014-04-10 17:01:21,507::task::579::TaskManager.Task::(_updateState) Task=`85365ff7-6a2b-4478-a086-37d78879c111`::moving from state preparing -> state finished
>Thread-1328::DEBUG::2014-04-10 17:01:21,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1328::DEBUG::2014-04-10 17:01:21,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1328::DEBUG::2014-04-10 17:01:21,508::task::974::TaskManager.Task::(_decref) Task=`85365ff7-6a2b-4478-a086-37d78879c111`::ref 0 aborting False
>Thread-1329::DEBUG::2014-04-10 17:01:21,515::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1329::DEBUG::2014-04-10 17:01:21,515::task::579::TaskManager.Task::(_updateState) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::moving from state init -> state preparing
>Thread-1329::INFO::2014-04-10 17:01:21,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1329::DEBUG::2014-04-10 17:01:21,516::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55d9db23-3857-423f-a96e-db4b2c43865e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1329::DEBUG::2014-04-10 17:01:21,516::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1329::DEBUG::2014-04-10 17:01:21,516::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1329::DEBUG::2014-04-10 17:01:21,516::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55d9db23-3857-423f-a96e-db4b2c43865e`::Granted request
>Thread-1329::DEBUG::2014-04-10 17:01:21,517::task::811::TaskManager.Task::(resourceAcquired) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1329::DEBUG::2014-04-10 17:01:21,517::task::974::TaskManager.Task::(_decref) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::ref 1 aborting False
>Thread-1329::INFO::2014-04-10 17:01:21,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1329::DEBUG::2014-04-10 17:01:21,519::task::1168::TaskManager.Task::(prepare) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1329::DEBUG::2014-04-10 17:01:21,520::task::579::TaskManager.Task::(_updateState) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::moving from state preparing -> state finished
>Thread-1329::DEBUG::2014-04-10 17:01:21,520::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1329::DEBUG::2014-04-10 17:01:21,520::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1329::DEBUG::2014-04-10 17:01:21,520::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1329::DEBUG::2014-04-10 17:01:21,520::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1329::DEBUG::2014-04-10 17:01:21,521::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1329::DEBUG::2014-04-10 17:01:21,521::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1329::DEBUG::2014-04-10 17:01:21,521::task::974::TaskManager.Task::(_decref) Task=`9ecdbcd2-569b-41d3-9789-7e66074d026b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:28,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:28,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300465 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:28,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:28,326::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00021325 s, 3.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:30,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:30,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00038963 s, 944 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:30,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:30,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000409796 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1333::DEBUG::2014-04-10 17:01:31,612::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1333::DEBUG::2014-04-10 17:01:31,613::task::579::TaskManager.Task::(_updateState) Task=`c76ac410-3d9e-4f41-a47f-4ff94687dbf4`::moving from state init -> state preparing
>Thread-1333::INFO::2014-04-10 17:01:31,613::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1333::INFO::2014-04-10 17:01:31,614::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1333::DEBUG::2014-04-10 17:01:31,614::task::1168::TaskManager.Task::(prepare) Task=`c76ac410-3d9e-4f41-a47f-4ff94687dbf4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1333::DEBUG::2014-04-10 17:01:31,614::task::579::TaskManager.Task::(_updateState) Task=`c76ac410-3d9e-4f41-a47f-4ff94687dbf4`::moving from state preparing -> state finished
>Thread-1333::DEBUG::2014-04-10 17:01:31,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1333::DEBUG::2014-04-10 17:01:31,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1333::DEBUG::2014-04-10 17:01:31,614::task::974::TaskManager.Task::(_decref) Task=`c76ac410-3d9e-4f41-a47f-4ff94687dbf4`::ref 0 aborting False
>Thread-1334::DEBUG::2014-04-10 17:01:31,621::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1334::DEBUG::2014-04-10 17:01:31,630::task::579::TaskManager.Task::(_updateState) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::moving from state init -> state preparing
>Thread-1334::INFO::2014-04-10 17:01:31,630::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1334::DEBUG::2014-04-10 17:01:31,631::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b2b96e8a-248d-4e9d-b1fd-42d9a3309adb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1334::DEBUG::2014-04-10 17:01:31,631::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1334::DEBUG::2014-04-10 17:01:31,631::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1334::DEBUG::2014-04-10 17:01:31,631::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b2b96e8a-248d-4e9d-b1fd-42d9a3309adb`::Granted request
>Thread-1334::DEBUG::2014-04-10 17:01:31,632::task::811::TaskManager.Task::(resourceAcquired) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1334::DEBUG::2014-04-10 17:01:31,632::task::974::TaskManager.Task::(_decref) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::ref 1 aborting False
>Thread-1334::INFO::2014-04-10 17:01:31,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1334::DEBUG::2014-04-10 17:01:31,634::task::1168::TaskManager.Task::(prepare) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1334::DEBUG::2014-04-10 17:01:31,634::task::579::TaskManager.Task::(_updateState) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::moving from state preparing -> state finished
>Thread-1334::DEBUG::2014-04-10 17:01:31,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1334::DEBUG::2014-04-10 17:01:31,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1334::DEBUG::2014-04-10 17:01:31,635::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1334::DEBUG::2014-04-10 17:01:31,635::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1334::DEBUG::2014-04-10 17:01:31,635::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1334::DEBUG::2014-04-10 17:01:31,636::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1334::DEBUG::2014-04-10 17:01:31,636::task::974::TaskManager.Task::(_decref) Task=`7bcd0ecf-d5e6-42b1-aa86-a7ebff0a0965`::ref 0 aborting False
>Thread-1335::DEBUG::2014-04-10 17:01:32,656::task::579::TaskManager.Task::(_updateState) Task=`76d87fe6-5942-452d-9fef-d892406c7713`::moving from state init -> state preparing
>Thread-1335::INFO::2014-04-10 17:01:32,656::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1335::INFO::2014-04-10 17:01:32,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409796', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300465', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021325', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038963', 'lastCheck': '2.0', 'valid': True}}
>Thread-1335::DEBUG::2014-04-10 17:01:32,656::task::1168::TaskManager.Task::(prepare) Task=`76d87fe6-5942-452d-9fef-d892406c7713`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409796', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300465', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00021325', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038963', 'lastCheck': '2.0', 'valid': True}}
>Thread-1335::DEBUG::2014-04-10 17:01:32,656::task::579::TaskManager.Task::(_updateState) Task=`76d87fe6-5942-452d-9fef-d892406c7713`::moving from state preparing -> state finished
>Thread-1335::DEBUG::2014-04-10 17:01:32,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1335::DEBUG::2014-04-10 17:01:32,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1335::DEBUG::2014-04-10 17:01:32,657::task::974::TaskManager.Task::(_decref) Task=`76d87fe6-5942-452d-9fef-d892406c7713`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:38,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:38,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000291974 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:38,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:38,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259032 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:40,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:40,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000407911 s, 902 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:40,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:40,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478918 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1340::DEBUG::2014-04-10 17:01:41,891::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1340::DEBUG::2014-04-10 17:01:41,892::task::579::TaskManager.Task::(_updateState) Task=`bd49bc92-be91-4c97-aa5c-e095b42d491d`::moving from state init -> state preparing
>Thread-1340::INFO::2014-04-10 17:01:41,892::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1340::INFO::2014-04-10 17:01:41,892::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1340::DEBUG::2014-04-10 17:01:41,892::task::1168::TaskManager.Task::(prepare) Task=`bd49bc92-be91-4c97-aa5c-e095b42d491d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1340::DEBUG::2014-04-10 17:01:41,892::task::579::TaskManager.Task::(_updateState) Task=`bd49bc92-be91-4c97-aa5c-e095b42d491d`::moving from state preparing -> state finished
>Thread-1340::DEBUG::2014-04-10 17:01:41,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1340::DEBUG::2014-04-10 17:01:41,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1340::DEBUG::2014-04-10 17:01:41,893::task::974::TaskManager.Task::(_decref) Task=`bd49bc92-be91-4c97-aa5c-e095b42d491d`::ref 0 aborting False
>Thread-1341::DEBUG::2014-04-10 17:01:41,899::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1341::DEBUG::2014-04-10 17:01:41,899::task::579::TaskManager.Task::(_updateState) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::moving from state init -> state preparing
>Thread-1341::INFO::2014-04-10 17:01:41,899::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1341::DEBUG::2014-04-10 17:01:41,900::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`135f9f4c-0253-4032-b8e2-c719b9a2fbcd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1341::DEBUG::2014-04-10 17:01:41,900::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1341::DEBUG::2014-04-10 17:01:41,900::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1341::DEBUG::2014-04-10 17:01:41,900::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`135f9f4c-0253-4032-b8e2-c719b9a2fbcd`::Granted request
>Thread-1341::DEBUG::2014-04-10 17:01:41,900::task::811::TaskManager.Task::(resourceAcquired) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1341::DEBUG::2014-04-10 17:01:41,901::task::974::TaskManager.Task::(_decref) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::ref 1 aborting False
>Thread-1341::INFO::2014-04-10 17:01:41,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1341::DEBUG::2014-04-10 17:01:41,902::task::1168::TaskManager.Task::(prepare) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1341::DEBUG::2014-04-10 17:01:41,903::task::579::TaskManager.Task::(_updateState) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::moving from state preparing -> state finished
>Thread-1341::DEBUG::2014-04-10 17:01:41,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1341::DEBUG::2014-04-10 17:01:41,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1341::DEBUG::2014-04-10 17:01:41,903::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1341::DEBUG::2014-04-10 17:01:41,903::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1341::DEBUG::2014-04-10 17:01:41,904::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1341::DEBUG::2014-04-10 17:01:41,904::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1341::DEBUG::2014-04-10 17:01:41,904::task::974::TaskManager.Task::(_decref) Task=`b8ea8034-ea4a-4dbc-ba54-05564e22f118`::ref 0 aborting False
>Thread-1343::DEBUG::2014-04-10 17:01:47,811::task::579::TaskManager.Task::(_updateState) Task=`42f91b34-47c3-41b7-b510-06feb55c06e9`::moving from state init -> state preparing
>Thread-1343::INFO::2014-04-10 17:01:47,811::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1343::INFO::2014-04-10 17:01:47,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478918', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291974', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259032', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407911', 'lastCheck': '7.1', 'valid': True}}
>Thread-1343::DEBUG::2014-04-10 17:01:47,812::task::1168::TaskManager.Task::(prepare) Task=`42f91b34-47c3-41b7-b510-06feb55c06e9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478918', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291974', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259032', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407911', 'lastCheck': '7.1', 'valid': True}}
>Thread-1343::DEBUG::2014-04-10 17:01:47,812::task::579::TaskManager.Task::(_updateState) Task=`42f91b34-47c3-41b7-b510-06feb55c06e9`::moving from state preparing -> state finished
>Thread-1343::DEBUG::2014-04-10 17:01:47,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1343::DEBUG::2014-04-10 17:01:47,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1343::DEBUG::2014-04-10 17:01:47,812::task::974::TaskManager.Task::(_decref) Task=`42f91b34-47c3-41b7-b510-06feb55c06e9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:48,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:48,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266657 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:48,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:48,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265012 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:01:50,713::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:01:50,719::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:01:50,721::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:01:50,726::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:01:50,728::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:01:50,728::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:01:50,728::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:01:50,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:01:50,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000467344 s, 787 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:01:50,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:01:50,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455992 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1350::DEBUG::2014-04-10 17:01:51,993::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1350::DEBUG::2014-04-10 17:01:51,994::task::579::TaskManager.Task::(_updateState) Task=`a6cb2fc9-4eb5-4a03-8878-07d8b1ffe9e3`::moving from state init -> state preparing
>Thread-1350::INFO::2014-04-10 17:01:51,994::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1350::INFO::2014-04-10 17:01:51,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1350::DEBUG::2014-04-10 17:01:51,994::task::1168::TaskManager.Task::(prepare) Task=`a6cb2fc9-4eb5-4a03-8878-07d8b1ffe9e3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1350::DEBUG::2014-04-10 17:01:51,995::task::579::TaskManager.Task::(_updateState) Task=`a6cb2fc9-4eb5-4a03-8878-07d8b1ffe9e3`::moving from state preparing -> state finished
>Thread-1350::DEBUG::2014-04-10 17:01:51,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1350::DEBUG::2014-04-10 17:01:51,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1350::DEBUG::2014-04-10 17:01:51,995::task::974::TaskManager.Task::(_decref) Task=`a6cb2fc9-4eb5-4a03-8878-07d8b1ffe9e3`::ref 0 aborting False
>Thread-1351::DEBUG::2014-04-10 17:01:52,002::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1351::DEBUG::2014-04-10 17:01:52,002::task::579::TaskManager.Task::(_updateState) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::moving from state init -> state preparing
>Thread-1351::INFO::2014-04-10 17:01:52,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1351::DEBUG::2014-04-10 17:01:52,003::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`65cb45ad-f58e-4dd1-b7da-6824205c880c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1351::DEBUG::2014-04-10 17:01:52,003::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1351::DEBUG::2014-04-10 17:01:52,003::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1351::DEBUG::2014-04-10 17:01:52,003::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`65cb45ad-f58e-4dd1-b7da-6824205c880c`::Granted request
>Thread-1351::DEBUG::2014-04-10 17:01:52,004::task::811::TaskManager.Task::(resourceAcquired) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1351::DEBUG::2014-04-10 17:01:52,004::task::974::TaskManager.Task::(_decref) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::ref 1 aborting False
>Thread-1351::INFO::2014-04-10 17:01:52,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1351::DEBUG::2014-04-10 17:01:52,006::task::1168::TaskManager.Task::(prepare) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1351::DEBUG::2014-04-10 17:01:52,007::task::579::TaskManager.Task::(_updateState) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::moving from state preparing -> state finished
>Thread-1351::DEBUG::2014-04-10 17:01:52,007::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1351::DEBUG::2014-04-10 17:01:52,007::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1351::DEBUG::2014-04-10 17:01:52,007::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1351::DEBUG::2014-04-10 17:01:52,007::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1351::DEBUG::2014-04-10 17:01:52,008::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1351::DEBUG::2014-04-10 17:01:52,008::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1351::DEBUG::2014-04-10 17:01:52,008::task::974::TaskManager.Task::(_decref) Task=`eee32806-f7ac-4198-a53b-d0a3e4d8433e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:01:58,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:01:58,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283963 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:01:58,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:01:58,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000234794 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:00,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:00,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488495 s, 753 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:00,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:00,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000487374 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1355::DEBUG::2014-04-10 17:02:02,099::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1355::DEBUG::2014-04-10 17:02:02,109::task::579::TaskManager.Task::(_updateState) Task=`44f7953e-b46d-49ed-a53c-a1c627d3c7a3`::moving from state init -> state preparing
>Thread-1355::INFO::2014-04-10 17:02:02,109::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1355::INFO::2014-04-10 17:02:02,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1355::DEBUG::2014-04-10 17:02:02,109::task::1168::TaskManager.Task::(prepare) Task=`44f7953e-b46d-49ed-a53c-a1c627d3c7a3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1355::DEBUG::2014-04-10 17:02:02,110::task::579::TaskManager.Task::(_updateState) Task=`44f7953e-b46d-49ed-a53c-a1c627d3c7a3`::moving from state preparing -> state finished
>Thread-1355::DEBUG::2014-04-10 17:02:02,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1355::DEBUG::2014-04-10 17:02:02,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1355::DEBUG::2014-04-10 17:02:02,110::task::974::TaskManager.Task::(_decref) Task=`44f7953e-b46d-49ed-a53c-a1c627d3c7a3`::ref 0 aborting False
>Thread-1356::DEBUG::2014-04-10 17:02:02,117::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1356::DEBUG::2014-04-10 17:02:02,117::task::579::TaskManager.Task::(_updateState) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::moving from state init -> state preparing
>Thread-1356::INFO::2014-04-10 17:02:02,118::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1356::DEBUG::2014-04-10 17:02:02,118::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`707ce350-0fe6-4bf8-b610-8018ec480603`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1356::DEBUG::2014-04-10 17:02:02,118::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1356::DEBUG::2014-04-10 17:02:02,119::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1356::DEBUG::2014-04-10 17:02:02,119::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`707ce350-0fe6-4bf8-b610-8018ec480603`::Granted request
>Thread-1356::DEBUG::2014-04-10 17:02:02,119::task::811::TaskManager.Task::(resourceAcquired) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1356::DEBUG::2014-04-10 17:02:02,119::task::974::TaskManager.Task::(_decref) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::ref 1 aborting False
>Thread-1356::INFO::2014-04-10 17:02:02,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1356::DEBUG::2014-04-10 17:02:02,122::task::1168::TaskManager.Task::(prepare) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1356::DEBUG::2014-04-10 17:02:02,122::task::579::TaskManager.Task::(_updateState) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::moving from state preparing -> state finished
>Thread-1356::DEBUG::2014-04-10 17:02:02,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1356::DEBUG::2014-04-10 17:02:02,122::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1356::DEBUG::2014-04-10 17:02:02,123::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1356::DEBUG::2014-04-10 17:02:02,123::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1356::DEBUG::2014-04-10 17:02:02,123::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1356::DEBUG::2014-04-10 17:02:02,123::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1356::DEBUG::2014-04-10 17:02:02,123::task::974::TaskManager.Task::(_decref) Task=`1fadff7d-1b0e-4956-9164-3a3ccfec0e32`::ref 0 aborting False
>Thread-1357::DEBUG::2014-04-10 17:02:02,967::task::579::TaskManager.Task::(_updateState) Task=`c1821308-6528-48b6-923c-4f485f1361e3`::moving from state init -> state preparing
>Thread-1357::INFO::2014-04-10 17:02:02,967::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1357::INFO::2014-04-10 17:02:02,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487374', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283963', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234794', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488495', 'lastCheck': '2.2', 'valid': True}}
>Thread-1357::DEBUG::2014-04-10 17:02:02,968::task::1168::TaskManager.Task::(prepare) Task=`c1821308-6528-48b6-923c-4f485f1361e3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487374', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283963', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000234794', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488495', 'lastCheck': '2.2', 'valid': True}}
>Thread-1357::DEBUG::2014-04-10 17:02:02,968::task::579::TaskManager.Task::(_updateState) Task=`c1821308-6528-48b6-923c-4f485f1361e3`::moving from state preparing -> state finished
>Thread-1357::DEBUG::2014-04-10 17:02:02,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1357::DEBUG::2014-04-10 17:02:02,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1357::DEBUG::2014-04-10 17:02:02,968::task::974::TaskManager.Task::(_decref) Task=`c1821308-6528-48b6-923c-4f485f1361e3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:08,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:08,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282332 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:08,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:08,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000236284 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:10,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:10,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000507747 s, 725 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:10,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:10,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000383759 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1362::DEBUG::2014-04-10 17:02:12,214::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1362::DEBUG::2014-04-10 17:02:12,215::task::579::TaskManager.Task::(_updateState) Task=`445bab3c-d759-43ae-ac96-7e867adb0aeb`::moving from state init -> state preparing
>Thread-1362::INFO::2014-04-10 17:02:12,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1362::INFO::2014-04-10 17:02:12,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1362::DEBUG::2014-04-10 17:02:12,216::task::1168::TaskManager.Task::(prepare) Task=`445bab3c-d759-43ae-ac96-7e867adb0aeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1362::DEBUG::2014-04-10 17:02:12,216::task::579::TaskManager.Task::(_updateState) Task=`445bab3c-d759-43ae-ac96-7e867adb0aeb`::moving from state preparing -> state finished
>Thread-1362::DEBUG::2014-04-10 17:02:12,216::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1362::DEBUG::2014-04-10 17:02:12,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1362::DEBUG::2014-04-10 17:02:12,216::task::974::TaskManager.Task::(_decref) Task=`445bab3c-d759-43ae-ac96-7e867adb0aeb`::ref 0 aborting False
>Thread-1363::DEBUG::2014-04-10 17:02:12,223::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1363::DEBUG::2014-04-10 17:02:12,223::task::579::TaskManager.Task::(_updateState) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::moving from state init -> state preparing
>Thread-1363::INFO::2014-04-10 17:02:12,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1363::DEBUG::2014-04-10 17:02:12,224::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7fff6530-5fa6-4bc6-ac75-853fce8eec12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1363::DEBUG::2014-04-10 17:02:12,224::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1363::DEBUG::2014-04-10 17:02:12,224::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1363::DEBUG::2014-04-10 17:02:12,224::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7fff6530-5fa6-4bc6-ac75-853fce8eec12`::Granted request
>Thread-1363::DEBUG::2014-04-10 17:02:12,225::task::811::TaskManager.Task::(resourceAcquired) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1363::DEBUG::2014-04-10 17:02:12,225::task::974::TaskManager.Task::(_decref) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::ref 1 aborting False
>Thread-1363::INFO::2014-04-10 17:02:12,227::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1363::DEBUG::2014-04-10 17:02:12,227::task::1168::TaskManager.Task::(prepare) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1363::DEBUG::2014-04-10 17:02:12,227::task::579::TaskManager.Task::(_updateState) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::moving from state preparing -> state finished
>Thread-1363::DEBUG::2014-04-10 17:02:12,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1363::DEBUG::2014-04-10 17:02:12,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1363::DEBUG::2014-04-10 17:02:12,228::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1363::DEBUG::2014-04-10 17:02:12,228::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1363::DEBUG::2014-04-10 17:02:12,228::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1363::DEBUG::2014-04-10 17:02:12,228::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1363::DEBUG::2014-04-10 17:02:12,228::task::974::TaskManager.Task::(_decref) Task=`fd1f8376-7eb3-46e5-8aaf-2e6e2d9b1c58`::ref 0 aborting False
>Thread-1365::DEBUG::2014-04-10 17:02:18,152::task::579::TaskManager.Task::(_updateState) Task=`abd2af3a-e118-4c3d-b227-b456039af68e`::moving from state init -> state preparing
>Thread-1365::INFO::2014-04-10 17:02:18,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1365::INFO::2014-04-10 17:02:18,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383759', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282332', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236284', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507747', 'lastCheck': '7.4', 'valid': True}}
>Thread-1365::DEBUG::2014-04-10 17:02:18,153::task::1168::TaskManager.Task::(prepare) Task=`abd2af3a-e118-4c3d-b227-b456039af68e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383759', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282332', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236284', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507747', 'lastCheck': '7.4', 'valid': True}}
>Thread-1365::DEBUG::2014-04-10 17:02:18,153::task::579::TaskManager.Task::(_updateState) Task=`abd2af3a-e118-4c3d-b227-b456039af68e`::moving from state preparing -> state finished
>Thread-1365::DEBUG::2014-04-10 17:02:18,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1365::DEBUG::2014-04-10 17:02:18,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1365::DEBUG::2014-04-10 17:02:18,154::task::974::TaskManager.Task::(_decref) Task=`abd2af3a-e118-4c3d-b227-b456039af68e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:18,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:18,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346902 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:18,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:18,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233861 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:20,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:20,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476838 s, 772 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:20,920::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:20,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000452671 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1368::DEBUG::2014-04-10 17:02:22,312::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-1368::DEBUG::2014-04-10 17:02:22,313::task::579::TaskManager.Task::(_updateState) Task=`921e88bf-1dcf-463d-a001-1f5515c3abef`::moving from state init -> state preparing
>Thread-1368::INFO::2014-04-10 17:02:22,313::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1368::INFO::2014-04-10 17:02:22,313::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1368::DEBUG::2014-04-10 17:02:22,314::task::1168::TaskManager.Task::(prepare) Task=`921e88bf-1dcf-463d-a001-1f5515c3abef`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1368::DEBUG::2014-04-10 17:02:22,314::task::579::TaskManager.Task::(_updateState) Task=`921e88bf-1dcf-463d-a001-1f5515c3abef`::moving from state preparing -> state finished
>Thread-1368::DEBUG::2014-04-10 17:02:22,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1368::DEBUG::2014-04-10 17:02:22,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1368::DEBUG::2014-04-10 17:02:22,314::task::974::TaskManager.Task::(_decref) Task=`921e88bf-1dcf-463d-a001-1f5515c3abef`::ref 0 aborting False
>Thread-1369::DEBUG::2014-04-10 17:02:22,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-1369::DEBUG::2014-04-10 17:02:22,321::task::579::TaskManager.Task::(_updateState) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::moving from state init -> state preparing
>Thread-1369::INFO::2014-04-10 17:02:22,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1369::DEBUG::2014-04-10 17:02:22,322::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fdee8d2c-15dd-408e-b741-d6b8eff9a8e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1369::DEBUG::2014-04-10 17:02:22,322::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1369::DEBUG::2014-04-10 17:02:22,322::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1369::DEBUG::2014-04-10 17:02:22,323::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fdee8d2c-15dd-408e-b741-d6b8eff9a8e9`::Granted request
>Thread-1369::DEBUG::2014-04-10 17:02:22,323::task::811::TaskManager.Task::(resourceAcquired) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1369::DEBUG::2014-04-10 17:02:22,323::task::974::TaskManager.Task::(_decref) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::ref 1 aborting False
>Thread-1369::INFO::2014-04-10 17:02:22,325::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1369::DEBUG::2014-04-10 17:02:22,326::task::1168::TaskManager.Task::(prepare) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1369::DEBUG::2014-04-10 17:02:22,326::task::579::TaskManager.Task::(_updateState) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::moving from state preparing -> state finished
>Thread-1369::DEBUG::2014-04-10 17:02:22,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1369::DEBUG::2014-04-10 17:02:22,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1369::DEBUG::2014-04-10 17:02:22,326::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1369::DEBUG::2014-04-10 17:02:22,327::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1369::DEBUG::2014-04-10 17:02:22,327::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1369::DEBUG::2014-04-10 17:02:22,327::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1369::DEBUG::2014-04-10 17:02:22,327::task::974::TaskManager.Task::(_decref) Task=`9d6732d3-a73c-4783-9f62-7461cfed003f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:28,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:28,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278677 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:28,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:28,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028523 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:30,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:30,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000435909 s, 844 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:30,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:30,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468758 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1373::DEBUG::2014-04-10 17:02:32,428::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1373::DEBUG::2014-04-10 17:02:32,432::task::579::TaskManager.Task::(_updateState) Task=`d0282184-acfa-4e24-ba14-17b7a206b2b6`::moving from state init -> state preparing
>Thread-1373::INFO::2014-04-10 17:02:32,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1373::INFO::2014-04-10 17:02:32,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1373::DEBUG::2014-04-10 17:02:32,433::task::1168::TaskManager.Task::(prepare) Task=`d0282184-acfa-4e24-ba14-17b7a206b2b6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1373::DEBUG::2014-04-10 17:02:32,433::task::579::TaskManager.Task::(_updateState) Task=`d0282184-acfa-4e24-ba14-17b7a206b2b6`::moving from state preparing -> state finished
>Thread-1373::DEBUG::2014-04-10 17:02:32,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1373::DEBUG::2014-04-10 17:02:32,433::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1373::DEBUG::2014-04-10 17:02:32,433::task::974::TaskManager.Task::(_decref) Task=`d0282184-acfa-4e24-ba14-17b7a206b2b6`::ref 0 aborting False
>Thread-1374::DEBUG::2014-04-10 17:02:32,440::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1374::DEBUG::2014-04-10 17:02:32,440::task::579::TaskManager.Task::(_updateState) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::moving from state init -> state preparing
>Thread-1374::INFO::2014-04-10 17:02:32,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1374::DEBUG::2014-04-10 17:02:32,441::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6526802-d36c-4c3a-8707-6a02e2bdb473`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1374::DEBUG::2014-04-10 17:02:32,441::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1374::DEBUG::2014-04-10 17:02:32,441::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1374::DEBUG::2014-04-10 17:02:32,441::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6526802-d36c-4c3a-8707-6a02e2bdb473`::Granted request
>Thread-1374::DEBUG::2014-04-10 17:02:32,441::task::811::TaskManager.Task::(resourceAcquired) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1374::DEBUG::2014-04-10 17:02:32,442::task::974::TaskManager.Task::(_decref) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::ref 1 aborting False
>Thread-1374::INFO::2014-04-10 17:02:32,443::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::task::1168::TaskManager.Task::(prepare) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::task::579::TaskManager.Task::(_updateState) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::moving from state preparing -> state finished
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1374::DEBUG::2014-04-10 17:02:32,444::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1374::DEBUG::2014-04-10 17:02:32,445::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1374::DEBUG::2014-04-10 17:02:32,445::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1374::DEBUG::2014-04-10 17:02:32,445::task::974::TaskManager.Task::(_decref) Task=`cdba3562-98a1-48c4-b537-cd7c87404505`::ref 0 aborting False
>Thread-1375::DEBUG::2014-04-10 17:02:33,306::task::579::TaskManager.Task::(_updateState) Task=`20a6c5f9-3d08-4090-8108-a83af82105ab`::moving from state init -> state preparing
>Thread-1375::INFO::2014-04-10 17:02:33,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1375::INFO::2014-04-10 17:02:33,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468758', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278677', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028523', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435909', 'lastCheck': '2.5', 'valid': True}}
>Thread-1375::DEBUG::2014-04-10 17:02:33,307::task::1168::TaskManager.Task::(prepare) Task=`20a6c5f9-3d08-4090-8108-a83af82105ab`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468758', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278677', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028523', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435909', 'lastCheck': '2.5', 'valid': True}}
>Thread-1375::DEBUG::2014-04-10 17:02:33,307::task::579::TaskManager.Task::(_updateState) Task=`20a6c5f9-3d08-4090-8108-a83af82105ab`::moving from state preparing -> state finished
>Thread-1375::DEBUG::2014-04-10 17:02:33,307::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1375::DEBUG::2014-04-10 17:02:33,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1375::DEBUG::2014-04-10 17:02:33,307::task::974::TaskManager.Task::(_decref) Task=`20a6c5f9-3d08-4090-8108-a83af82105ab`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:38,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:38,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287331 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:38,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:38,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233774 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:40,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:40,808::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457483 s, 804 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:40,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:40,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459366 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1380::DEBUG::2014-04-10 17:02:42,533::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1380::DEBUG::2014-04-10 17:02:42,534::task::579::TaskManager.Task::(_updateState) Task=`646e53c9-3c14-43bf-95a2-5bd5a302df47`::moving from state init -> state preparing
>Thread-1380::INFO::2014-04-10 17:02:42,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1380::INFO::2014-04-10 17:02:42,534::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1380::DEBUG::2014-04-10 17:02:42,534::task::1168::TaskManager.Task::(prepare) Task=`646e53c9-3c14-43bf-95a2-5bd5a302df47`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1380::DEBUG::2014-04-10 17:02:42,535::task::579::TaskManager.Task::(_updateState) Task=`646e53c9-3c14-43bf-95a2-5bd5a302df47`::moving from state preparing -> state finished
>Thread-1380::DEBUG::2014-04-10 17:02:42,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1380::DEBUG::2014-04-10 17:02:42,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1380::DEBUG::2014-04-10 17:02:42,535::task::974::TaskManager.Task::(_decref) Task=`646e53c9-3c14-43bf-95a2-5bd5a302df47`::ref 0 aborting False
>Thread-1381::DEBUG::2014-04-10 17:02:42,541::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1381::DEBUG::2014-04-10 17:02:42,542::task::579::TaskManager.Task::(_updateState) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::moving from state init -> state preparing
>Thread-1381::INFO::2014-04-10 17:02:42,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1381::DEBUG::2014-04-10 17:02:42,542::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e5748a4a-647d-4f8f-a306-a27d1b7f7a97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1381::DEBUG::2014-04-10 17:02:42,542::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1381::DEBUG::2014-04-10 17:02:42,543::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1381::DEBUG::2014-04-10 17:02:42,543::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e5748a4a-647d-4f8f-a306-a27d1b7f7a97`::Granted request
>Thread-1381::DEBUG::2014-04-10 17:02:42,543::task::811::TaskManager.Task::(resourceAcquired) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1381::DEBUG::2014-04-10 17:02:42,543::task::974::TaskManager.Task::(_decref) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::ref 1 aborting False
>Thread-1381::INFO::2014-04-10 17:02:42,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1381::DEBUG::2014-04-10 17:02:42,545::task::1168::TaskManager.Task::(prepare) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1381::DEBUG::2014-04-10 17:02:42,545::task::579::TaskManager.Task::(_updateState) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::moving from state preparing -> state finished
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1381::DEBUG::2014-04-10 17:02:42,546::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1381::DEBUG::2014-04-10 17:02:42,547::task::974::TaskManager.Task::(_decref) Task=`2e87c8ca-71d1-40fb-8560-ea04edcbc79b`::ref 0 aborting False
>Thread-1383::DEBUG::2014-04-10 17:02:48,475::task::579::TaskManager.Task::(_updateState) Task=`822c2cec-0013-41e9-b5f5-33800f0209fa`::moving from state init -> state preparing
>Thread-1383::INFO::2014-04-10 17:02:48,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1383::INFO::2014-04-10 17:02:48,476::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459366', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287331', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233774', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457483', 'lastCheck': '7.7', 'valid': True}}
>Thread-1383::DEBUG::2014-04-10 17:02:48,476::task::1168::TaskManager.Task::(prepare) Task=`822c2cec-0013-41e9-b5f5-33800f0209fa`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459366', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287331', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000233774', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457483', 'lastCheck': '7.7', 'valid': True}}
>Thread-1383::DEBUG::2014-04-10 17:02:48,476::task::579::TaskManager.Task::(_updateState) Task=`822c2cec-0013-41e9-b5f5-33800f0209fa`::moving from state preparing -> state finished
>Thread-1383::DEBUG::2014-04-10 17:02:48,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1383::DEBUG::2014-04-10 17:02:48,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1383::DEBUG::2014-04-10 17:02:48,476::task::974::TaskManager.Task::(_decref) Task=`822c2cec-0013-41e9-b5f5-33800f0209fa`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:48,611::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:48,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033348 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:48,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:48,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277804 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:02:50,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:02:50,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000395676 s, 930 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:02:50,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:02:50,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000420847 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1386::DEBUG::2014-04-10 17:02:52,666::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1386::DEBUG::2014-04-10 17:02:52,667::task::579::TaskManager.Task::(_updateState) Task=`58dc6d78-cfdc-4764-a689-a1a653c8414d`::moving from state init -> state preparing
>Thread-1386::INFO::2014-04-10 17:02:52,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1386::INFO::2014-04-10 17:02:52,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1386::DEBUG::2014-04-10 17:02:52,668::task::1168::TaskManager.Task::(prepare) Task=`58dc6d78-cfdc-4764-a689-a1a653c8414d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1386::DEBUG::2014-04-10 17:02:52,668::task::579::TaskManager.Task::(_updateState) Task=`58dc6d78-cfdc-4764-a689-a1a653c8414d`::moving from state preparing -> state finished
>Thread-1386::DEBUG::2014-04-10 17:02:52,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1386::DEBUG::2014-04-10 17:02:52,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1386::DEBUG::2014-04-10 17:02:52,669::task::974::TaskManager.Task::(_decref) Task=`58dc6d78-cfdc-4764-a689-a1a653c8414d`::ref 0 aborting False
>Thread-1387::DEBUG::2014-04-10 17:02:52,675::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1387::DEBUG::2014-04-10 17:02:52,675::task::579::TaskManager.Task::(_updateState) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::moving from state init -> state preparing
>Thread-1387::INFO::2014-04-10 17:02:52,676::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1387::DEBUG::2014-04-10 17:02:52,676::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0199011-b9db-4ff1-851d-299d50f49bcc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1387::DEBUG::2014-04-10 17:02:52,676::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1387::DEBUG::2014-04-10 17:02:52,677::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1387::DEBUG::2014-04-10 17:02:52,677::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0199011-b9db-4ff1-851d-299d50f49bcc`::Granted request
>Thread-1387::DEBUG::2014-04-10 17:02:52,677::task::811::TaskManager.Task::(resourceAcquired) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1387::DEBUG::2014-04-10 17:02:52,677::task::974::TaskManager.Task::(_decref) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::ref 1 aborting False
>Thread-1387::INFO::2014-04-10 17:02:52,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1387::DEBUG::2014-04-10 17:02:52,680::task::1168::TaskManager.Task::(prepare) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1387::DEBUG::2014-04-10 17:02:52,680::task::579::TaskManager.Task::(_updateState) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::moving from state preparing -> state finished
>Thread-1387::DEBUG::2014-04-10 17:02:52,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1387::DEBUG::2014-04-10 17:02:52,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1387::DEBUG::2014-04-10 17:02:52,680::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1387::DEBUG::2014-04-10 17:02:52,681::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1387::DEBUG::2014-04-10 17:02:52,681::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1387::DEBUG::2014-04-10 17:02:52,681::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1387::DEBUG::2014-04-10 17:02:52,681::task::974::TaskManager.Task::(_decref) Task=`949f0751-4619-4f23-8c63-6b4eb4f8b191`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:02:58,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:02:58,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286346 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:02:58,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:02:58,695::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255489 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:03:00,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:00,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000506492 s, 727 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:00,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:00,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000423082 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1391::DEBUG::2014-04-10 17:03:02,799::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1391::DEBUG::2014-04-10 17:03:02,806::task::579::TaskManager.Task::(_updateState) Task=`b82a15b7-b630-41c5-886f-f9939f4704cd`::moving from state init -> state preparing
>Thread-1391::INFO::2014-04-10 17:03:02,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1391::INFO::2014-04-10 17:03:02,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1391::DEBUG::2014-04-10 17:03:02,807::task::1168::TaskManager.Task::(prepare) Task=`b82a15b7-b630-41c5-886f-f9939f4704cd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1391::DEBUG::2014-04-10 17:03:02,807::task::579::TaskManager.Task::(_updateState) Task=`b82a15b7-b630-41c5-886f-f9939f4704cd`::moving from state preparing -> state finished
>Thread-1391::DEBUG::2014-04-10 17:03:02,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1391::DEBUG::2014-04-10 17:03:02,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1391::DEBUG::2014-04-10 17:03:02,808::task::974::TaskManager.Task::(_decref) Task=`b82a15b7-b630-41c5-886f-f9939f4704cd`::ref 0 aborting False
>Thread-1392::DEBUG::2014-04-10 17:03:02,814::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1392::DEBUG::2014-04-10 17:03:02,815::task::579::TaskManager.Task::(_updateState) Task=`e654cead-b082-4487-85ce-2c684867c79c`::moving from state init -> state preparing
>Thread-1392::INFO::2014-04-10 17:03:02,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1392::DEBUG::2014-04-10 17:03:02,815::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3267a196-7764-48aa-aa86-26b92253c42c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1392::DEBUG::2014-04-10 17:03:02,815::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1392::DEBUG::2014-04-10 17:03:02,816::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1392::DEBUG::2014-04-10 17:03:02,816::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3267a196-7764-48aa-aa86-26b92253c42c`::Granted request
>Thread-1392::DEBUG::2014-04-10 17:03:02,816::task::811::TaskManager.Task::(resourceAcquired) Task=`e654cead-b082-4487-85ce-2c684867c79c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1392::DEBUG::2014-04-10 17:03:02,816::task::974::TaskManager.Task::(_decref) Task=`e654cead-b082-4487-85ce-2c684867c79c`::ref 1 aborting False
>Thread-1392::INFO::2014-04-10 17:03:02,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1392::DEBUG::2014-04-10 17:03:02,818::task::1168::TaskManager.Task::(prepare) Task=`e654cead-b082-4487-85ce-2c684867c79c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1392::DEBUG::2014-04-10 17:03:02,818::task::579::TaskManager.Task::(_updateState) Task=`e654cead-b082-4487-85ce-2c684867c79c`::moving from state preparing -> state finished
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1392::DEBUG::2014-04-10 17:03:02,819::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1392::DEBUG::2014-04-10 17:03:02,820::task::974::TaskManager.Task::(_decref) Task=`e654cead-b082-4487-85ce-2c684867c79c`::ref 0 aborting False
>Thread-1393::DEBUG::2014-04-10 17:03:03,632::task::579::TaskManager.Task::(_updateState) Task=`ad08e0e7-d868-4276-8fef-1bb3d9f946aa`::moving from state init -> state preparing
>Thread-1393::INFO::2014-04-10 17:03:03,632::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1393::INFO::2014-04-10 17:03:03,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423082', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286346', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255489', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506492', 'lastCheck': '2.8', 'valid': True}}
>Thread-1393::DEBUG::2014-04-10 17:03:03,633::task::1168::TaskManager.Task::(prepare) Task=`ad08e0e7-d868-4276-8fef-1bb3d9f946aa`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423082', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286346', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255489', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506492', 'lastCheck': '2.8', 'valid': True}}
>Thread-1393::DEBUG::2014-04-10 17:03:03,633::task::579::TaskManager.Task::(_updateState) Task=`ad08e0e7-d868-4276-8fef-1bb3d9f946aa`::moving from state preparing -> state finished
>Thread-1393::DEBUG::2014-04-10 17:03:03,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1393::DEBUG::2014-04-10 17:03:03,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1393::DEBUG::2014-04-10 17:03:03,633::task::974::TaskManager.Task::(_decref) Task=`ad08e0e7-d868-4276-8fef-1bb3d9f946aa`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:08,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:08,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367898 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:08,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:08,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033225 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:03:10,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:10,860::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000526028 s, 700 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:10,994::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:11,000::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455032 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1398::DEBUG::2014-04-10 17:03:12,896::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1398::DEBUG::2014-04-10 17:03:12,897::task::579::TaskManager.Task::(_updateState) Task=`a39701b4-dd2d-4932-8049-5a4ad2ade544`::moving from state init -> state preparing
>Thread-1398::INFO::2014-04-10 17:03:12,897::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1398::INFO::2014-04-10 17:03:12,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1398::DEBUG::2014-04-10 17:03:12,898::task::1168::TaskManager.Task::(prepare) Task=`a39701b4-dd2d-4932-8049-5a4ad2ade544`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1398::DEBUG::2014-04-10 17:03:12,898::task::579::TaskManager.Task::(_updateState) Task=`a39701b4-dd2d-4932-8049-5a4ad2ade544`::moving from state preparing -> state finished
>Thread-1398::DEBUG::2014-04-10 17:03:12,898::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1398::DEBUG::2014-04-10 17:03:12,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1398::DEBUG::2014-04-10 17:03:12,898::task::974::TaskManager.Task::(_decref) Task=`a39701b4-dd2d-4932-8049-5a4ad2ade544`::ref 0 aborting False
>Thread-1399::DEBUG::2014-04-10 17:03:12,905::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1399::DEBUG::2014-04-10 17:03:12,905::task::579::TaskManager.Task::(_updateState) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::moving from state init -> state preparing
>Thread-1399::INFO::2014-04-10 17:03:12,905::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1399::DEBUG::2014-04-10 17:03:12,906::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3c582867-84c1-4147-8713-698380e5cfb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1399::DEBUG::2014-04-10 17:03:12,906::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1399::DEBUG::2014-04-10 17:03:12,906::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1399::DEBUG::2014-04-10 17:03:12,906::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3c582867-84c1-4147-8713-698380e5cfb5`::Granted request
>Thread-1399::DEBUG::2014-04-10 17:03:12,907::task::811::TaskManager.Task::(resourceAcquired) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1399::DEBUG::2014-04-10 17:03:12,907::task::974::TaskManager.Task::(_decref) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::ref 1 aborting False
>Thread-1399::INFO::2014-04-10 17:03:12,908::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1399::DEBUG::2014-04-10 17:03:12,909::task::1168::TaskManager.Task::(prepare) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1399::DEBUG::2014-04-10 17:03:12,909::task::579::TaskManager.Task::(_updateState) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::moving from state preparing -> state finished
>Thread-1399::DEBUG::2014-04-10 17:03:12,909::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1399::DEBUG::2014-04-10 17:03:12,909::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1399::DEBUG::2014-04-10 17:03:12,909::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1399::DEBUG::2014-04-10 17:03:12,910::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1399::DEBUG::2014-04-10 17:03:12,910::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1399::DEBUG::2014-04-10 17:03:12,910::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1399::DEBUG::2014-04-10 17:03:12,910::task::974::TaskManager.Task::(_decref) Task=`6d916361-e68b-4c5b-a158-b9af39e20451`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:18,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:18,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036658 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:18,759::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:18,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292879 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1401::DEBUG::2014-04-10 17:03:18,815::task::579::TaskManager.Task::(_updateState) Task=`bb36a38b-229a-4e57-9f48-35d8298efa79`::moving from state init -> state preparing
>Thread-1401::INFO::2014-04-10 17:03:18,815::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1401::INFO::2014-04-10 17:03:18,815::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455032', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036658', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292879', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526028', 'lastCheck': '8.0', 'valid': True}}
>Thread-1401::DEBUG::2014-04-10 17:03:18,815::task::1168::TaskManager.Task::(prepare) Task=`bb36a38b-229a-4e57-9f48-35d8298efa79`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455032', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036658', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292879', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526028', 'lastCheck': '8.0', 'valid': True}}
>Thread-1401::DEBUG::2014-04-10 17:03:18,816::task::579::TaskManager.Task::(_updateState) Task=`bb36a38b-229a-4e57-9f48-35d8298efa79`::moving from state preparing -> state finished
>Thread-1401::DEBUG::2014-04-10 17:03:18,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1401::DEBUG::2014-04-10 17:03:18,816::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1401::DEBUG::2014-04-10 17:03:18,816::task::974::TaskManager.Task::(_decref) Task=`bb36a38b-229a-4e57-9f48-35d8298efa79`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:03:20,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:20,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480007 s, 767 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:21,004::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:03:21,019::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:03:21,020::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:03:21,026::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:03:21,027::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:03:21,028::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:03:21,028::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:03:21,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:21,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000341361 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1408::DEBUG::2014-04-10 17:03:23,004::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1408::DEBUG::2014-04-10 17:03:23,005::task::579::TaskManager.Task::(_updateState) Task=`e45e2796-135a-4663-94ad-b0398d8cfed1`::moving from state init -> state preparing
>Thread-1408::INFO::2014-04-10 17:03:23,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1408::INFO::2014-04-10 17:03:23,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1408::DEBUG::2014-04-10 17:03:23,005::task::1168::TaskManager.Task::(prepare) Task=`e45e2796-135a-4663-94ad-b0398d8cfed1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1408::DEBUG::2014-04-10 17:03:23,006::task::579::TaskManager.Task::(_updateState) Task=`e45e2796-135a-4663-94ad-b0398d8cfed1`::moving from state preparing -> state finished
>Thread-1408::DEBUG::2014-04-10 17:03:23,006::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1408::DEBUG::2014-04-10 17:03:23,006::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1408::DEBUG::2014-04-10 17:03:23,006::task::974::TaskManager.Task::(_decref) Task=`e45e2796-135a-4663-94ad-b0398d8cfed1`::ref 0 aborting False
>Thread-1409::DEBUG::2014-04-10 17:03:23,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1409::DEBUG::2014-04-10 17:03:23,013::task::579::TaskManager.Task::(_updateState) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::moving from state init -> state preparing
>Thread-1409::INFO::2014-04-10 17:03:23,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1409::DEBUG::2014-04-10 17:03:23,014::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13329bb1-0c99-48a6-bb69-cac13b725423`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1409::DEBUG::2014-04-10 17:03:23,014::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1409::DEBUG::2014-04-10 17:03:23,014::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1409::DEBUG::2014-04-10 17:03:23,014::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13329bb1-0c99-48a6-bb69-cac13b725423`::Granted request
>Thread-1409::DEBUG::2014-04-10 17:03:23,015::task::811::TaskManager.Task::(resourceAcquired) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1409::DEBUG::2014-04-10 17:03:23,015::task::974::TaskManager.Task::(_decref) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::ref 1 aborting False
>Thread-1409::INFO::2014-04-10 17:03:23,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1409::DEBUG::2014-04-10 17:03:23,017::task::1168::TaskManager.Task::(prepare) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1409::DEBUG::2014-04-10 17:03:23,017::task::579::TaskManager.Task::(_updateState) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::moving from state preparing -> state finished
>Thread-1409::DEBUG::2014-04-10 17:03:23,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1409::DEBUG::2014-04-10 17:03:23,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1409::DEBUG::2014-04-10 17:03:23,018::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1409::DEBUG::2014-04-10 17:03:23,018::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1409::DEBUG::2014-04-10 17:03:23,018::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1409::DEBUG::2014-04-10 17:03:23,019::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1409::DEBUG::2014-04-10 17:03:23,019::task::974::TaskManager.Task::(_decref) Task=`bfc117c0-554e-403f-86f9-774f30ce587c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:28,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:28,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410162 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:28,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:28,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345156 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:03:30,885::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:30,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000513709 s, 716 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:31,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:31,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000449865 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1413::DEBUG::2014-04-10 17:03:33,093::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1413::DEBUG::2014-04-10 17:03:33,102::task::579::TaskManager.Task::(_updateState) Task=`cf62a6e0-ea09-4da0-b32a-867d37d53f4c`::moving from state init -> state preparing
>Thread-1413::INFO::2014-04-10 17:03:33,102::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1413::INFO::2014-04-10 17:03:33,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1413::DEBUG::2014-04-10 17:03:33,102::task::1168::TaskManager.Task::(prepare) Task=`cf62a6e0-ea09-4da0-b32a-867d37d53f4c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1413::DEBUG::2014-04-10 17:03:33,102::task::579::TaskManager.Task::(_updateState) Task=`cf62a6e0-ea09-4da0-b32a-867d37d53f4c`::moving from state preparing -> state finished
>Thread-1413::DEBUG::2014-04-10 17:03:33,103::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1413::DEBUG::2014-04-10 17:03:33,103::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1413::DEBUG::2014-04-10 17:03:33,103::task::974::TaskManager.Task::(_decref) Task=`cf62a6e0-ea09-4da0-b32a-867d37d53f4c`::ref 0 aborting False
>Thread-1414::DEBUG::2014-04-10 17:03:33,109::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1414::DEBUG::2014-04-10 17:03:33,110::task::579::TaskManager.Task::(_updateState) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::moving from state init -> state preparing
>Thread-1414::INFO::2014-04-10 17:03:33,110::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1414::DEBUG::2014-04-10 17:03:33,110::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d8364c12-5879-4426-b045-59aee3856490`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1414::DEBUG::2014-04-10 17:03:33,110::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1414::DEBUG::2014-04-10 17:03:33,111::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1414::DEBUG::2014-04-10 17:03:33,111::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d8364c12-5879-4426-b045-59aee3856490`::Granted request
>Thread-1414::DEBUG::2014-04-10 17:03:33,111::task::811::TaskManager.Task::(resourceAcquired) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1414::DEBUG::2014-04-10 17:03:33,111::task::974::TaskManager.Task::(_decref) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::ref 1 aborting False
>Thread-1414::INFO::2014-04-10 17:03:33,113::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1414::DEBUG::2014-04-10 17:03:33,113::task::1168::TaskManager.Task::(prepare) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::task::579::TaskManager.Task::(_updateState) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::moving from state preparing -> state finished
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1414::DEBUG::2014-04-10 17:03:33,114::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1414::DEBUG::2014-04-10 17:03:33,115::task::974::TaskManager.Task::(_decref) Task=`453f46ae-4be9-46c3-a874-b07178dba0df`::ref 0 aborting False
>Thread-1415::DEBUG::2014-04-10 17:03:33,976::task::579::TaskManager.Task::(_updateState) Task=`df0b3bfa-cc8b-4132-88d4-875150a3b3ac`::moving from state init -> state preparing
>Thread-1415::INFO::2014-04-10 17:03:33,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1415::INFO::2014-04-10 17:03:33,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449865', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410162', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345156', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513709', 'lastCheck': '3.1', 'valid': True}}
>Thread-1415::DEBUG::2014-04-10 17:03:33,977::task::1168::TaskManager.Task::(prepare) Task=`df0b3bfa-cc8b-4132-88d4-875150a3b3ac`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449865', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410162', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345156', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513709', 'lastCheck': '3.1', 'valid': True}}
>Thread-1415::DEBUG::2014-04-10 17:03:33,977::task::579::TaskManager.Task::(_updateState) Task=`df0b3bfa-cc8b-4132-88d4-875150a3b3ac`::moving from state preparing -> state finished
>Thread-1415::DEBUG::2014-04-10 17:03:33,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1415::DEBUG::2014-04-10 17:03:33,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1415::DEBUG::2014-04-10 17:03:33,978::task::974::TaskManager.Task::(_decref) Task=`df0b3bfa-cc8b-4132-88d4-875150a3b3ac`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:38,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:38,815::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375616 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:38,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:38,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345522 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:03:40,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:40,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000459366 s, 801 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:41,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:41,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459078 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1420::DEBUG::2014-04-10 17:03:43,259::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1420::DEBUG::2014-04-10 17:03:43,260::task::579::TaskManager.Task::(_updateState) Task=`cd1b9f0d-5d04-4d5a-9883-c124dde344a5`::moving from state init -> state preparing
>Thread-1420::INFO::2014-04-10 17:03:43,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1420::INFO::2014-04-10 17:03:43,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1420::DEBUG::2014-04-10 17:03:43,260::task::1168::TaskManager.Task::(prepare) Task=`cd1b9f0d-5d04-4d5a-9883-c124dde344a5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1420::DEBUG::2014-04-10 17:03:43,260::task::579::TaskManager.Task::(_updateState) Task=`cd1b9f0d-5d04-4d5a-9883-c124dde344a5`::moving from state preparing -> state finished
>Thread-1420::DEBUG::2014-04-10 17:03:43,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1420::DEBUG::2014-04-10 17:03:43,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1420::DEBUG::2014-04-10 17:03:43,261::task::974::TaskManager.Task::(_decref) Task=`cd1b9f0d-5d04-4d5a-9883-c124dde344a5`::ref 0 aborting False
>Thread-1421::DEBUG::2014-04-10 17:03:43,267::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1421::DEBUG::2014-04-10 17:03:43,268::task::579::TaskManager.Task::(_updateState) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::moving from state init -> state preparing
>Thread-1421::INFO::2014-04-10 17:03:43,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1421::DEBUG::2014-04-10 17:03:43,268::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae85c757-0b2c-4403-857e-ef64d486da96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1421::DEBUG::2014-04-10 17:03:43,269::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1421::DEBUG::2014-04-10 17:03:43,269::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1421::DEBUG::2014-04-10 17:03:43,269::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae85c757-0b2c-4403-857e-ef64d486da96`::Granted request
>Thread-1421::DEBUG::2014-04-10 17:03:43,269::task::811::TaskManager.Task::(resourceAcquired) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1421::DEBUG::2014-04-10 17:03:43,269::task::974::TaskManager.Task::(_decref) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::ref 1 aborting False
>Thread-1421::INFO::2014-04-10 17:03:43,271::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1421::DEBUG::2014-04-10 17:03:43,271::task::1168::TaskManager.Task::(prepare) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::task::579::TaskManager.Task::(_updateState) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::moving from state preparing -> state finished
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1421::DEBUG::2014-04-10 17:03:43,272::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1421::DEBUG::2014-04-10 17:03:43,273::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1421::DEBUG::2014-04-10 17:03:43,273::task::974::TaskManager.Task::(_decref) Task=`e4a73f17-8b50-46f5-ad72-dd324e12917b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:48,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:48,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356941 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:48,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:48,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382616 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1423::DEBUG::2014-04-10 17:03:49,128::task::579::TaskManager.Task::(_updateState) Task=`1181d34e-37a7-47d5-bb0c-9e07d898cc02`::moving from state init -> state preparing
>Thread-1423::INFO::2014-04-10 17:03:49,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1423::INFO::2014-04-10 17:03:49,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459078', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356941', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382616', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459366', 'lastCheck': '8.2', 'valid': True}}
>Thread-1423::DEBUG::2014-04-10 17:03:49,129::task::1168::TaskManager.Task::(prepare) Task=`1181d34e-37a7-47d5-bb0c-9e07d898cc02`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459078', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356941', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382616', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459366', 'lastCheck': '8.2', 'valid': True}}
>Thread-1423::DEBUG::2014-04-10 17:03:49,129::task::579::TaskManager.Task::(_updateState) Task=`1181d34e-37a7-47d5-bb0c-9e07d898cc02`::moving from state preparing -> state finished
>Thread-1423::DEBUG::2014-04-10 17:03:49,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1423::DEBUG::2014-04-10 17:03:49,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1423::DEBUG::2014-04-10 17:03:49,130::task::974::TaskManager.Task::(_decref) Task=`1181d34e-37a7-47d5-bb0c-9e07d898cc02`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:03:50,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:03:50,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000568334 s, 648 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:03:51,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:03:51,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480545 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1426::DEBUG::2014-04-10 17:03:53,391::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1426::DEBUG::2014-04-10 17:03:53,391::task::579::TaskManager.Task::(_updateState) Task=`d74044e6-1990-470d-a833-dd0dc391f4e9`::moving from state init -> state preparing
>Thread-1426::INFO::2014-04-10 17:03:53,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1426::INFO::2014-04-10 17:03:53,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1426::DEBUG::2014-04-10 17:03:53,392::task::1168::TaskManager.Task::(prepare) Task=`d74044e6-1990-470d-a833-dd0dc391f4e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1426::DEBUG::2014-04-10 17:03:53,392::task::579::TaskManager.Task::(_updateState) Task=`d74044e6-1990-470d-a833-dd0dc391f4e9`::moving from state preparing -> state finished
>Thread-1426::DEBUG::2014-04-10 17:03:53,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1426::DEBUG::2014-04-10 17:03:53,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1426::DEBUG::2014-04-10 17:03:53,393::task::974::TaskManager.Task::(_decref) Task=`d74044e6-1990-470d-a833-dd0dc391f4e9`::ref 0 aborting False
>Thread-1427::DEBUG::2014-04-10 17:03:53,399::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1427::DEBUG::2014-04-10 17:03:53,399::task::579::TaskManager.Task::(_updateState) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::moving from state init -> state preparing
>Thread-1427::INFO::2014-04-10 17:03:53,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1427::DEBUG::2014-04-10 17:03:53,400::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74a89e25-0ecd-4aa9-a441-01fb90823fb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1427::DEBUG::2014-04-10 17:03:53,400::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1427::DEBUG::2014-04-10 17:03:53,400::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1427::DEBUG::2014-04-10 17:03:53,400::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74a89e25-0ecd-4aa9-a441-01fb90823fb9`::Granted request
>Thread-1427::DEBUG::2014-04-10 17:03:53,401::task::811::TaskManager.Task::(resourceAcquired) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1427::DEBUG::2014-04-10 17:03:53,401::task::974::TaskManager.Task::(_decref) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::ref 1 aborting False
>Thread-1427::INFO::2014-04-10 17:03:53,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1427::DEBUG::2014-04-10 17:03:53,403::task::1168::TaskManager.Task::(prepare) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1427::DEBUG::2014-04-10 17:03:53,403::task::579::TaskManager.Task::(_updateState) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::moving from state preparing -> state finished
>Thread-1427::DEBUG::2014-04-10 17:03:53,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1427::DEBUG::2014-04-10 17:03:53,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1427::DEBUG::2014-04-10 17:03:53,403::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1427::DEBUG::2014-04-10 17:03:53,404::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1427::DEBUG::2014-04-10 17:03:53,404::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1427::DEBUG::2014-04-10 17:03:53,404::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1427::DEBUG::2014-04-10 17:03:53,404::task::974::TaskManager.Task::(_decref) Task=`61e127ac-6fdc-4ec1-be87-7469ec34109e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:03:58,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:03:58,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302347 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:03:58,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:03:58,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368041 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:04:00,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:00,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000395749 s, 930 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:04:01,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:01,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398873 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1431::DEBUG::2014-04-10 17:04:03,480::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1431::DEBUG::2014-04-10 17:04:03,491::task::579::TaskManager.Task::(_updateState) Task=`15dcd65b-d231-44aa-8167-5026d90db421`::moving from state init -> state preparing
>Thread-1431::INFO::2014-04-10 17:04:03,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1431::INFO::2014-04-10 17:04:03,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1431::DEBUG::2014-04-10 17:04:03,491::task::1168::TaskManager.Task::(prepare) Task=`15dcd65b-d231-44aa-8167-5026d90db421`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1431::DEBUG::2014-04-10 17:04:03,491::task::579::TaskManager.Task::(_updateState) Task=`15dcd65b-d231-44aa-8167-5026d90db421`::moving from state preparing -> state finished
>Thread-1431::DEBUG::2014-04-10 17:04:03,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1431::DEBUG::2014-04-10 17:04:03,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1431::DEBUG::2014-04-10 17:04:03,492::task::974::TaskManager.Task::(_decref) Task=`15dcd65b-d231-44aa-8167-5026d90db421`::ref 0 aborting False
>Thread-1432::DEBUG::2014-04-10 17:04:03,498::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1432::DEBUG::2014-04-10 17:04:03,499::task::579::TaskManager.Task::(_updateState) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::moving from state init -> state preparing
>Thread-1432::INFO::2014-04-10 17:04:03,499::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1432::DEBUG::2014-04-10 17:04:03,499::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25a596ba-198c-41ea-abe3-8c9711f2e1e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1432::DEBUG::2014-04-10 17:04:03,500::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1432::DEBUG::2014-04-10 17:04:03,500::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1432::DEBUG::2014-04-10 17:04:03,500::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25a596ba-198c-41ea-abe3-8c9711f2e1e7`::Granted request
>Thread-1432::DEBUG::2014-04-10 17:04:03,500::task::811::TaskManager.Task::(resourceAcquired) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1432::DEBUG::2014-04-10 17:04:03,500::task::974::TaskManager.Task::(_decref) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::ref 1 aborting False
>Thread-1432::INFO::2014-04-10 17:04:03,502::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1432::DEBUG::2014-04-10 17:04:03,502::task::1168::TaskManager.Task::(prepare) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::task::579::TaskManager.Task::(_updateState) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::moving from state preparing -> state finished
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1432::DEBUG::2014-04-10 17:04:03,503::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1432::DEBUG::2014-04-10 17:04:03,504::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1432::DEBUG::2014-04-10 17:04:03,504::task::974::TaskManager.Task::(_decref) Task=`cfecccb7-d2a3-4236-8325-2e66a13a53eb`::ref 0 aborting False
>Thread-1433::DEBUG::2014-04-10 17:04:04,285::task::579::TaskManager.Task::(_updateState) Task=`340c8d8c-f081-42a0-8734-1109f0787d99`::moving from state init -> state preparing
>Thread-1433::INFO::2014-04-10 17:04:04,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1433::INFO::2014-04-10 17:04:04,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398873', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302347', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368041', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395749', 'lastCheck': '3.3', 'valid': True}}
>Thread-1433::DEBUG::2014-04-10 17:04:04,286::task::1168::TaskManager.Task::(prepare) Task=`340c8d8c-f081-42a0-8734-1109f0787d99`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398873', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302347', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368041', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395749', 'lastCheck': '3.3', 'valid': True}}
>Thread-1433::DEBUG::2014-04-10 17:04:04,286::task::579::TaskManager.Task::(_updateState) Task=`340c8d8c-f081-42a0-8734-1109f0787d99`::moving from state preparing -> state finished
>Thread-1433::DEBUG::2014-04-10 17:04:04,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1433::DEBUG::2014-04-10 17:04:04,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1433::DEBUG::2014-04-10 17:04:04,287::task::974::TaskManager.Task::(_decref) Task=`340c8d8c-f081-42a0-8734-1109f0787d99`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:04:08,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:08,914::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000467772 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:08,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:08,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311069 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:04:10,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:10,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486888 s, 756 kB/s\n'; <rc> = 0
>Thread-1437::DEBUG::2014-04-10 17:04:11,036::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmCreate with ({'custom': {'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1device_14708876-1be3-4f9e-94fe-12cebd1e1388': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=14708876-1be3-4f9e-94fe-12cebd1e1388, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fd181a61-26b0-4601-9939-7a2b02bcbfc1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27da': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=29f87ea5-36e2-4c03-a68b-cb50443d27da, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fa4d059c-ddab-4c3a-8509-341559f8e558, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=e54df04e-31c0-4569-a0d7-42d5a8528617, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Conroe', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'specParams': {}, 'readonly': 'false', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179'}, {'specParams': {}, 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'smartcardEnable': 'false', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'vm2', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [5f6576a1]
>Thread-1437::INFO::2014-04-10 17:04:11,038::API::648::vds::(_getNetworkIp) network None: using 0
>Thread-1437::INFO::2014-04-10 17:04:11,038::clientIF::394::vds::(createVm) vmContainerLock acquired by vm af1debb5-7b64-4d09-8455-850ddba3e546
>Thread-1437::DEBUG::2014-04-10 17:04:11,042::clientIF::407::vds::(createVm) Total desktops after creation of af1debb5-7b64-4d09-8455-850ddba3e546 is 1
>Thread-1438::DEBUG::2014-04-10 17:04:11,043::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Start
>Thread-1437::DEBUG::2014-04-10 17:04:11,044::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1device_14708876-1be3-4f9e-94fe-12cebd1e1388': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=14708876-1be3-4f9e-94fe-12cebd1e1388, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fd181a61-26b0-4601-9939-7a2b02bcbfc1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27da': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=29f87ea5-36e2-4c03-a68b-cb50443d27da, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fa4d059c-ddab-4c3a-8509-341559f8e558, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=e54df04e-31c0-4569-a0d7-42d5a8528617, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'specParams': {}, 'readonly': 'false', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179'}, {'specParams': {}, 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm2', 'display': 'qxl', 'nice': '0'}}
>Thread-1438::DEBUG::2014-04-10 17:04:11,046::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::_ongoingCreations acquired
>Thread-1438::INFO::2014-04-10 17:04:11,047::vm::3011::vm.Vm::(_run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::VM wrapper has started
>Thread-1438::DEBUG::2014-04-10 17:04:11,051::task::579::TaskManager.Task::(_updateState) Task=`49d53584-0dfe-4562-ba80-44cea704429b`::moving from state init -> state preparing
>Thread-1438::INFO::2014-04-10 17:04:11,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc', options=None)
>Thread-1438::INFO::2014-04-10 17:04:11,059::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-1438::DEBUG::2014-04-10 17:04:11,059::task::1168::TaskManager.Task::(prepare) Task=`49d53584-0dfe-4562-ba80-44cea704429b`::finished: {'truesize': '0', 'apparentsize': '2147483648'}
>Thread-1438::DEBUG::2014-04-10 17:04:11,060::task::579::TaskManager.Task::(_updateState) Task=`49d53584-0dfe-4562-ba80-44cea704429b`::moving from state preparing -> state finished
>Thread-1438::DEBUG::2014-04-10 17:04:11,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1438::DEBUG::2014-04-10 17:04:11,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1438::DEBUG::2014-04-10 17:04:11,060::task::974::TaskManager.Task::(_decref) Task=`49d53584-0dfe-4562-ba80-44cea704429b`::ref 0 aborting False
>Thread-1438::INFO::2014-04-10 17:04:11,060::clientIF::353::vds::(prepareVolumePath) prepared volume path: 
>Thread-1438::DEBUG::2014-04-10 17:04:11,061::task::579::TaskManager.Task::(_updateState) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::moving from state init -> state preparing
>Thread-1438::INFO::2014-04-10 17:04:11,061::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', leafUUID='7879e1b7-c238-4222-95eb-e922c5cf80dc')
>Thread-1438::DEBUG::2014-04-10 17:04:11,061::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`7ddee614-f0dd-4d14-ad8b-b9897420bf79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage'
>Thread-1438::DEBUG::2014-04-10 17:04:11,062::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-1438::DEBUG::2014-04-10 17:04:11,062::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-1438::DEBUG::2014-04-10 17:04:11,062::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`7ddee614-f0dd-4d14-ad8b-b9897420bf79`::Granted request
>Thread-1438::DEBUG::2014-04-10 17:04:11,062::task::811::TaskManager.Task::(resourceAcquired) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-1438::DEBUG::2014-04-10 17:04:11,063::task::974::TaskManager.Task::(_decref) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::ref 1 aborting False
>Thread-1438::WARNING::2014-04-10 17:04:11,065::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 already exists
>Thread-1438::DEBUG::2014-04-10 17:04:11,065::fileSD::429::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/fe90abc5-8638-40e8-b394-9082b3217731
>Thread-1438::DEBUG::2014-04-10 17:04:11,066::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 7879e1b7-c238-4222-95eb-e922c5cf80dc
>Thread-1438::INFO::2014-04-10 17:04:11,068::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imgVolumesInfo': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}
>Thread-1438::DEBUG::2014-04-10 17:04:11,068::task::1168::TaskManager.Task::(prepare) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::finished: {'info': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'imgVolumesInfo': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}
>Thread-1438::DEBUG::2014-04-10 17:04:11,068::task::579::TaskManager.Task::(_updateState) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::moving from state preparing -> state finished
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-1438::DEBUG::2014-04-10 17:04:11,069::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-1438::DEBUG::2014-04-10 17:04:11,070::task::974::TaskManager.Task::(_decref) Task=`f31a234f-1e69-4a68-9d31-06e70ca361e7`::ref 0 aborting False
>Thread-1438::INFO::2014-04-10 17:04:11,070::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc
>Thread-1438::DEBUG::2014-04-10 17:04:11,080::vm::1486::vm.Vm::(blockDev) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to determine if the path '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc' is a block device
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 1483, in blockDev
>    self._blockDev = utils.isBlockDevice(self.path)
>  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 101, in isBlockDevice
>    return stat.S_ISBLK(os.stat(path).st_mode)
>OSError: [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc'
>Thread-1438::DEBUG::2014-04-10 17:04:11,081::vm::1486::vm.Vm::(blockDev) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Unable to determine if the path '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc' is a block device
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 1483, in blockDev
>    self._blockDev = utils.isBlockDevice(self.path)
>  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 101, in isBlockDevice
>    return stat.S_ISBLK(os.stat(path).st_mode)
>OSError: [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc'
>Thread-1438::DEBUG::2014-04-10 17:04:11,086::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/10_faqemu' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:11,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:11,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000383766 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1438::DEBUG::2014-04-10 17:04:11,143::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1438::INFO::2014-04-10 17:04:11,143::hooks::100::root::(_runHooksDir) 
>Thread-1438::DEBUG::2014-04-10 17:04:11,144::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_qemucmdline' (cwd None)
>Thread-1438::DEBUG::2014-04-10 17:04:11,202::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1438::INFO::2014-04-10 17:04:11,202::hooks::100::root::(_runHooksDir) 
>Thread-1438::DEBUG::2014-04-10 17:04:11,202::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
>Thread-1438::DEBUG::2014-04-10 17:04:11,255::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1438::INFO::2014-04-10 17:04:11,255::hooks::100::root::(_runHooksDir) 
>Thread-1438::DEBUG::2014-04-10 17:04:11,256::vm::3073::vm.Vm::(_run) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::<?xml version="1.0" encoding="utf-8"?>
><domain type="kvm">
>	<name>vm2</name>
>	<uuid>af1debb5-7b64-4d09-8455-850ddba3e546</uuid>
>	<memory>1048576</memory>
>	<currentMemory>1048576</currentMemory>
>	<vcpu>1</vcpu>
>	<memtune>
>		<min_guarantee>1048576</min_guarantee>
>	</memtune>
>	<devices>
>		<channel type="unix">
>			<target name="com.redhat.rhevm.vdsm" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.com.redhat.rhevm.vdsm"/>
>		</channel>
>		<channel type="unix">
>			<target name="org.qemu.guest_agent.0" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.org.qemu.guest_agent.0"/>
>		</channel>
>		<input bus="ps2" type="mouse"/>
>		<channel type="spicevmc">
>			<target name="com.redhat.spice.0" type="virtio"/>
>		</channel>
>		<graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice">
>			<channel mode="secure" name="main"/>
>			<channel mode="secure" name="inputs"/>
>			<channel mode="secure" name="cursor"/>
>			<channel mode="secure" name="playback"/>
>			<channel mode="secure" name="record"/>
>			<channel mode="secure" name="display"/>
>			<channel mode="secure" name="usbredir"/>
>			<channel mode="secure" name="smartcard"/>
>		</graphics>
>		<controller model="virtio-scsi" type="scsi">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/>
>		</controller>
>		<video>
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/>
>			<model heads="1" type="qxl" vram="32768"/>
>		</video>
>		<interface type="bridge">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/>
>			<mac address="00:01:a4:a5:a5:06"/>
>			<model type="virtio"/>
>			<source bridge="rhevm"/>
>			<filterref filter="vdsm-no-mac-spoofing"/>
>			<link state="up"/>
>		</interface>
>		<disk device="cdrom" snapshot="no" type="file">
>			<address bus="1" controller="0" target="0" type="drive" unit="0"/>
>			<source file="" startupPolicy="optional"/>
>			<target bus="ide" dev="hdc"/>
>			<readonly/>
>			<serial/>
>		</disk>
>		<disk device="disk" snapshot="no" type="file">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/>
>			<source file="/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc"/>
>			<target bus="virtio" dev="vda"/>
>			<serial>fe90abc5-8638-40e8-b394-9082b3217731</serial>
>			<driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/>
>		</disk>
>		<memballoon model="virtio"/>
>	</devices>
>	<os>
>		<type arch="x86_64" machine="rhel6.5.0">hvm</type>
>		<smbios mode="sysinfo"/>
>	</os>
>	<sysinfo type="smbios">
>		<system>
>			<entry name="manufacturer">Red Hat</entry>
>			<entry name="product">RHEV Hypervisor</entry>
>			<entry name="version">6Server-6.5.0.1.el6</entry>
>			<entry name="serial">94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082</entry>
>			<entry name="uuid">af1debb5-7b64-4d09-8455-850ddba3e546</entry>
>		</system>
>	</sysinfo>
>	<clock adjustment="0" offset="variable">
>		<timer name="rtc" tickpolicy="catchup"/>
>	</clock>
>	<features>
>		<acpi/>
>	</features>
>	<cpu match="exact">
>		<model>Conroe</model>
>		<topology cores="1" sockets="1" threads="1"/>
>	</cpu>
></domain>
>
>Thread-1438::DEBUG::2014-04-10 17:04:11,271::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 38 edom: 18 level: 2 message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory
>Thread-1438::DEBUG::2014-04-10 17:04:11,271::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::_ongoingCreations released
>Thread-1438::ERROR::2014-04-10 17:04:11,271::vm::2203::vm.Vm::(_startUnderlyingVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::The vm start process failed
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 2163, in _startUnderlyingVm
>    self._run()
>  File "/usr/share/vdsm/vm.py", line 3107, in _run
>    self._connection.createXML(domxml, flags),
>  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper
>    ret = f(*args, **kwargs)
>  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2665, in createXML
>    if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)
>libvirtError: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory
>Thread-1438::DEBUG::2014-04-10 17:04:11,278::vm::2657::vm.Vm::(setDownStatus) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Changed state to Down: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory
>Thread-1441::DEBUG::2014-04-10 17:04:13,408::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-1441::DEBUG::2014-04-10 17:04:13,408::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '0', 'exitMessage': "cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory", 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'timeOffset': '0', 'exitCode': 1}]}
>Thread-1442::DEBUG::2014-04-10 17:04:13,420::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('af1debb5-7b64-4d09-8455-850ddba3e546',) {}
>Thread-1442::INFO::2014-04-10 17:04:13,420::API::324::vds::(destroy) vmContainerLock acquired by vm af1debb5-7b64-4d09-8455-850ddba3e546
>Thread-1442::DEBUG::2014-04-10 17:04:13,420::vm::4533::vm.Vm::(destroy) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::destroy Called
>Thread-1442::INFO::2014-04-10 17:04:13,421::vm::4479::vm.Vm::(releaseVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Release VM resources
>Thread-1442::WARNING::2014-04-10 17:04:13,421::vm::1851::vm.Vm::(_set_lastStatus) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::trying to set state to Powering down when already Down
>Thread-1442::WARNING::2014-04-10 17:04:13,421::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x7f373827a590>> _customize:<bound method Drive._customize of <vm.Drive object at 0x7f373827a590>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address  bus="1"  controller="0"  target="0"  type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x7f373827a590>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x7f373827a590>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x7f373827a590>> address:{' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'} apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': 'af1debb5-7b64-4d09-8455-850ddba3e546', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1device_14708876-1be3-4f9e-94fe-12cebd1e1388': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=14708876-1be3-4f9e-94fe-12cebd1e1388, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27dadevice_fd181a61-26b0-4601-9939-7a2b02bcbfc1': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fd181a61-26b0-4601-9939-7a2b02bcbfc1, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617device_29f87ea5-36e2-4c03-a68b-cb50443d27da': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=29f87ea5-36e2-4c03-a68b-cb50443d27da, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=fa4d059c-ddab-4c3a-8509-341559f8e558, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_fa4d059c-ddab-4c3a-8509-341559f8e558device_e54df04e-31c0-4569-a0d7-42d5a8528617': 'VmDevice {vmId=af1debb5-7b64-4d09-8455-850ddba3e546, deviceId=e54df04e-31c0-4569-a0d7-42d5a8528617, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'exitMessage': "cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc': No such file or directory", 'transparentHugePages': 'true', 'devices': [{'specParams': {}, 'deviceId': '31c14772-b51b-4e45-a92d-dac6796a221c', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6d10a30b-a08b-4d8a-abb0-c0bd4632f7bb', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:06', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'f52ee26e-672c-4351-8f7c-fb6de08dbc59', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '3c666899-b23a-4f65-b6a1-418bb4be0dab', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '2147483648', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731', 'readonly': 'false', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'reqsize': '0', 'format': 'raw', 'deviceId': 'fe90abc5-8638-40e8-b394-9082b3217731', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'propagateErrors': 'off', 'optional': 'false', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'specParams': {}, 'volumeChain': [{'domainID': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc', 'volumeID': '7879e1b7-c238-4222-95eb-e922c5cf80dc', 'leasePath': '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/images/fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc.lease', 'imageID': 'fe90abc5-8638-40e8-b394-9082b3217731'}]}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '242ac500-3441-46b9-ab24-0711ec65f179', 'target': 1048576}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm2', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x7f373827a590>> device:cdrom deviceId:3c666899-b23a-4f65-b6a1-418bb4be0dab extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x7f373827a590>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x7f373827a590>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x7f373827a590>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x7f373827a590>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x7f373827a590>> log:<logUtils.SimpleLogAdapter instance at 0x7f373419b9e0> name:hdc networkDev:False path: readonly:true reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>Thread-1442::DEBUG::2014-04-10 17:04:13,423::task::579::TaskManager.Task::(_updateState) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::moving from state init -> state preparing
>Thread-1442::INFO::2014-04-10 17:04:13,423::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', volUUID=None)
>Thread-1442::DEBUG::2014-04-10 17:04:13,423::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`46f5a28f-cffe-4154-8479-db89e955b207`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage'
>Thread-1442::DEBUG::2014-04-10 17:04:13,423::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-1442::DEBUG::2014-04-10 17:04:13,424::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-1442::DEBUG::2014-04-10 17:04:13,424::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`46f5a28f-cffe-4154-8479-db89e955b207`::Granted request
>Thread-1442::DEBUG::2014-04-10 17:04:13,424::task::811::TaskManager.Task::(resourceAcquired) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-1442::DEBUG::2014-04-10 17:04:13,424::task::974::TaskManager.Task::(_decref) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::ref 1 aborting False
>Thread-1442::INFO::2014-04-10 17:04:13,425::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None
>Thread-1442::DEBUG::2014-04-10 17:04:13,425::task::1168::TaskManager.Task::(prepare) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::finished: None
>Thread-1442::DEBUG::2014-04-10 17:04:13,425::task::579::TaskManager.Task::(_updateState) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::moving from state preparing -> state finished
>Thread-1442::DEBUG::2014-04-10 17:04:13,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>}
>Thread-1442::DEBUG::2014-04-10 17:04:13,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1442::DEBUG::2014-04-10 17:04:13,425::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>Thread-1442::DEBUG::2014-04-10 17:04:13,426::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>Thread-1442::DEBUG::2014-04-10 17:04:13,426::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>Thread-1442::DEBUG::2014-04-10 17:04:13,426::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>Thread-1442::DEBUG::2014-04-10 17:04:13,426::task::974::TaskManager.Task::(_decref) Task=`6b95ae7e-fe4c-4605-819a-f552a1290d96`::ref 0 aborting False
>Thread-1442::WARNING::2014-04-10 17:04:13,426::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.com.redhat.rhevm.vdsm already removed
>Thread-1442::WARNING::2014-04-10 17:04:13,426::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/af1debb5-7b64-4d09-8455-850ddba3e546.org.qemu.guest_agent.0 already removed
>Thread-1442::DEBUG::2014-04-10 17:04:13,427::task::579::TaskManager.Task::(_updateState) Task=`1f7a14bc-b96f-4714-b30c-5424505b9292`::moving from state init -> state preparing
>Thread-1442::INFO::2014-04-10 17:04:13,427::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='af1debb5-7b64-4d09-8455-850ddba3e546')
>Thread-1442::INFO::2014-04-10 17:04:13,443::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None
>Thread-1442::DEBUG::2014-04-10 17:04:13,443::task::1168::TaskManager.Task::(prepare) Task=`1f7a14bc-b96f-4714-b30c-5424505b9292`::finished: None
>Thread-1442::DEBUG::2014-04-10 17:04:13,443::task::579::TaskManager.Task::(_updateState) Task=`1f7a14bc-b96f-4714-b30c-5424505b9292`::moving from state preparing -> state finished
>Thread-1442::DEBUG::2014-04-10 17:04:13,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1442::DEBUG::2014-04-10 17:04:13,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1442::DEBUG::2014-04-10 17:04:13,444::task::974::TaskManager.Task::(_decref) Task=`1f7a14bc-b96f-4714-b30c-5424505b9292`::ref 0 aborting False
>Thread-1442::DEBUG::2014-04-10 17:04:13,444::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-1444::DEBUG::2014-04-10 17:04:13,630::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-1444::DEBUG::2014-04-10 17:04:13,630::task::579::TaskManager.Task::(_updateState) Task=`61c5b8a6-efa6-45fb-b55a-70b24163883b`::moving from state init -> state preparing
>Thread-1444::INFO::2014-04-10 17:04:13,630::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1444::INFO::2014-04-10 17:04:13,631::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1444::DEBUG::2014-04-10 17:04:13,631::task::1168::TaskManager.Task::(prepare) Task=`61c5b8a6-efa6-45fb-b55a-70b24163883b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1444::DEBUG::2014-04-10 17:04:13,631::task::579::TaskManager.Task::(_updateState) Task=`61c5b8a6-efa6-45fb-b55a-70b24163883b`::moving from state preparing -> state finished
>Thread-1444::DEBUG::2014-04-10 17:04:13,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1444::DEBUG::2014-04-10 17:04:13,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1444::DEBUG::2014-04-10 17:04:13,631::task::974::TaskManager.Task::(_decref) Task=`61c5b8a6-efa6-45fb-b55a-70b24163883b`::ref 0 aborting False
>Thread-1445::DEBUG::2014-04-10 17:04:13,638::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-1445::DEBUG::2014-04-10 17:04:13,638::task::579::TaskManager.Task::(_updateState) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::moving from state init -> state preparing
>Thread-1445::INFO::2014-04-10 17:04:13,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1445::DEBUG::2014-04-10 17:04:13,639::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51895f55-15eb-4836-b35b-39aa3f2ec55d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1445::DEBUG::2014-04-10 17:04:13,639::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1445::DEBUG::2014-04-10 17:04:13,639::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1445::DEBUG::2014-04-10 17:04:13,639::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51895f55-15eb-4836-b35b-39aa3f2ec55d`::Granted request
>Thread-1445::DEBUG::2014-04-10 17:04:13,640::task::811::TaskManager.Task::(resourceAcquired) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1445::DEBUG::2014-04-10 17:04:13,640::task::974::TaskManager.Task::(_decref) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::ref 1 aborting False
>Thread-1445::INFO::2014-04-10 17:04:13,642::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1445::DEBUG::2014-04-10 17:04:13,642::task::1168::TaskManager.Task::(prepare) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1445::DEBUG::2014-04-10 17:04:13,642::task::579::TaskManager.Task::(_updateState) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::moving from state preparing -> state finished
>Thread-1445::DEBUG::2014-04-10 17:04:13,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1445::DEBUG::2014-04-10 17:04:13,643::task::974::TaskManager.Task::(_decref) Task=`3fef1277-1db9-4c2c-b82a-d096aff6802b`::ref 0 aborting False
>Thread-1442::DEBUG::2014-04-10 17:04:13,691::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1442::INFO::2014-04-10 17:04:13,692::hooks::100::root::(_runHooksDir) 
>Thread-1442::DEBUG::2014-04-10 17:04:13,692::vm::4527::vm.Vm::(deleteVm) vmId=`af1debb5-7b64-4d09-8455-850ddba3e546`::Total desktops after destroy of af1debb5-7b64-4d09-8455-850ddba3e546 is 0
>Thread-1442::DEBUG::2014-04-10 17:04:13,692::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>Thread-466::DEBUG::2014-04-10 17:04:18,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:18,937::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410968 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:18,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:18,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321114 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1448::DEBUG::2014-04-10 17:04:19,812::task::579::TaskManager.Task::(_updateState) Task=`0f172175-1f94-4d05-b21e-39c21cc7be90`::moving from state init -> state preparing
>Thread-1448::INFO::2014-04-10 17:04:19,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1448::INFO::2014-04-10 17:04:19,813::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383766', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410968', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321114', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486888', 'lastCheck': '8.9', 'valid': True}}
>Thread-1448::DEBUG::2014-04-10 17:04:19,813::task::1168::TaskManager.Task::(prepare) Task=`0f172175-1f94-4d05-b21e-39c21cc7be90`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383766', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410968', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321114', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486888', 'lastCheck': '8.9', 'valid': True}}
>Thread-1448::DEBUG::2014-04-10 17:04:19,813::task::579::TaskManager.Task::(_updateState) Task=`0f172175-1f94-4d05-b21e-39c21cc7be90`::moving from state preparing -> state finished
>Thread-1448::DEBUG::2014-04-10 17:04:19,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1448::DEBUG::2014-04-10 17:04:19,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1448::DEBUG::2014-04-10 17:04:19,814::task::974::TaskManager.Task::(_decref) Task=`0f172175-1f94-4d05-b21e-39c21cc7be90`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:04:20,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:20,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478629 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:04:21,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:21,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000535245 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1451::DEBUG::2014-04-10 17:04:23,739::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1451::DEBUG::2014-04-10 17:04:23,739::task::579::TaskManager.Task::(_updateState) Task=`238a8ddd-b3a4-4430-9f72-68cfd5e34b37`::moving from state init -> state preparing
>Thread-1451::INFO::2014-04-10 17:04:23,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1451::INFO::2014-04-10 17:04:23,740::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1451::DEBUG::2014-04-10 17:04:23,740::task::1168::TaskManager.Task::(prepare) Task=`238a8ddd-b3a4-4430-9f72-68cfd5e34b37`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1451::DEBUG::2014-04-10 17:04:23,740::task::579::TaskManager.Task::(_updateState) Task=`238a8ddd-b3a4-4430-9f72-68cfd5e34b37`::moving from state preparing -> state finished
>Thread-1451::DEBUG::2014-04-10 17:04:23,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1451::DEBUG::2014-04-10 17:04:23,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1451::DEBUG::2014-04-10 17:04:23,740::task::974::TaskManager.Task::(_decref) Task=`238a8ddd-b3a4-4430-9f72-68cfd5e34b37`::ref 0 aborting False
>Thread-1452::DEBUG::2014-04-10 17:04:23,747::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1452::DEBUG::2014-04-10 17:04:23,747::task::579::TaskManager.Task::(_updateState) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::moving from state init -> state preparing
>Thread-1452::INFO::2014-04-10 17:04:23,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1452::DEBUG::2014-04-10 17:04:23,748::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b0ac899d-584f-4b79-afe2-edc20c6d96dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1452::DEBUG::2014-04-10 17:04:23,748::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1452::DEBUG::2014-04-10 17:04:23,748::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1452::DEBUG::2014-04-10 17:04:23,748::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b0ac899d-584f-4b79-afe2-edc20c6d96dd`::Granted request
>Thread-1452::DEBUG::2014-04-10 17:04:23,749::task::811::TaskManager.Task::(resourceAcquired) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1452::DEBUG::2014-04-10 17:04:23,749::task::974::TaskManager.Task::(_decref) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::ref 1 aborting False
>Thread-1452::INFO::2014-04-10 17:04:23,751::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1452::DEBUG::2014-04-10 17:04:23,751::task::1168::TaskManager.Task::(prepare) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1452::DEBUG::2014-04-10 17:04:23,751::task::579::TaskManager.Task::(_updateState) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::moving from state preparing -> state finished
>Thread-1452::DEBUG::2014-04-10 17:04:23,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1452::DEBUG::2014-04-10 17:04:23,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1452::DEBUG::2014-04-10 17:04:23,751::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1452::DEBUG::2014-04-10 17:04:23,752::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1452::DEBUG::2014-04-10 17:04:23,752::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1452::DEBUG::2014-04-10 17:04:23,752::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1452::DEBUG::2014-04-10 17:04:23,752::task::974::TaskManager.Task::(_decref) Task=`d96af0f9-5d4a-4f3b-9dac-21d301271c09`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:04:28,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:28,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00072891 s, 921 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:28,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:29,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264744 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:04:30,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:30,986::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000518305 s, 710 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:04:31,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:31,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000441939 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1456::DEBUG::2014-04-10 17:04:33,829::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1456::DEBUG::2014-04-10 17:04:33,830::task::579::TaskManager.Task::(_updateState) Task=`075f9129-dbdf-4a99-9d6f-b8688df1d672`::moving from state init -> state preparing
>Thread-1456::INFO::2014-04-10 17:04:33,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1456::INFO::2014-04-10 17:04:33,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1456::DEBUG::2014-04-10 17:04:33,830::task::1168::TaskManager.Task::(prepare) Task=`075f9129-dbdf-4a99-9d6f-b8688df1d672`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1456::DEBUG::2014-04-10 17:04:33,830::task::579::TaskManager.Task::(_updateState) Task=`075f9129-dbdf-4a99-9d6f-b8688df1d672`::moving from state preparing -> state finished
>Thread-1456::DEBUG::2014-04-10 17:04:33,831::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1456::DEBUG::2014-04-10 17:04:33,831::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1456::DEBUG::2014-04-10 17:04:33,831::task::974::TaskManager.Task::(_decref) Task=`075f9129-dbdf-4a99-9d6f-b8688df1d672`::ref 0 aborting False
>Thread-1457::DEBUG::2014-04-10 17:04:33,838::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1457::DEBUG::2014-04-10 17:04:33,838::task::579::TaskManager.Task::(_updateState) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::moving from state init -> state preparing
>Thread-1457::INFO::2014-04-10 17:04:33,838::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1457::DEBUG::2014-04-10 17:04:33,839::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3d79d9e-c715-488f-870c-a5b47ca956fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1457::DEBUG::2014-04-10 17:04:33,839::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1457::DEBUG::2014-04-10 17:04:33,839::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1457::DEBUG::2014-04-10 17:04:33,839::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3d79d9e-c715-488f-870c-a5b47ca956fc`::Granted request
>Thread-1457::DEBUG::2014-04-10 17:04:33,840::task::811::TaskManager.Task::(resourceAcquired) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1457::DEBUG::2014-04-10 17:04:33,840::task::974::TaskManager.Task::(_decref) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::ref 1 aborting False
>Thread-1457::INFO::2014-04-10 17:04:33,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1457::DEBUG::2014-04-10 17:04:33,842::task::1168::TaskManager.Task::(prepare) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1457::DEBUG::2014-04-10 17:04:33,842::task::579::TaskManager.Task::(_updateState) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::moving from state preparing -> state finished
>Thread-1457::DEBUG::2014-04-10 17:04:33,842::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1457::DEBUG::2014-04-10 17:04:33,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1457::DEBUG::2014-04-10 17:04:33,843::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1457::DEBUG::2014-04-10 17:04:33,843::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1457::DEBUG::2014-04-10 17:04:33,843::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1457::DEBUG::2014-04-10 17:04:33,843::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1457::DEBUG::2014-04-10 17:04:33,843::task::974::TaskManager.Task::(_decref) Task=`e4589c2d-fa14-492a-ac65-a3b437f4ede5`::ref 0 aborting False
>Thread-1458::DEBUG::2014-04-10 17:04:34,974::task::579::TaskManager.Task::(_updateState) Task=`35145c68-1e64-4f66-a11d-0fc3bf2753cd`::moving from state init -> state preparing
>Thread-1458::INFO::2014-04-10 17:04:34,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1458::INFO::2014-04-10 17:04:34,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441939', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072891', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264744', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518305', 'lastCheck': '4.0', 'valid': True}}
>Thread-1458::DEBUG::2014-04-10 17:04:34,975::task::1168::TaskManager.Task::(prepare) Task=`35145c68-1e64-4f66-a11d-0fc3bf2753cd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441939', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072891', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264744', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518305', 'lastCheck': '4.0', 'valid': True}}
>Thread-1458::DEBUG::2014-04-10 17:04:34,975::task::579::TaskManager.Task::(_updateState) Task=`35145c68-1e64-4f66-a11d-0fc3bf2753cd`::moving from state preparing -> state finished
>Thread-1458::DEBUG::2014-04-10 17:04:34,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1458::DEBUG::2014-04-10 17:04:34,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1458::DEBUG::2014-04-10 17:04:34,976::task::974::TaskManager.Task::(_decref) Task=`35145c68-1e64-4f66-a11d-0fc3bf2753cd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:04:39,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:39,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281866 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:39,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:39,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254012 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:04:40,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:41,005::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366334 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:04:41,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:41,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000471897 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1462::DEBUG::2014-04-10 17:04:43,919::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1462::DEBUG::2014-04-10 17:04:43,920::task::579::TaskManager.Task::(_updateState) Task=`2f475a2b-0b37-454d-ab48-633205435170`::moving from state init -> state preparing
>Thread-1462::INFO::2014-04-10 17:04:43,920::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1462::INFO::2014-04-10 17:04:43,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1462::DEBUG::2014-04-10 17:04:43,921::task::1168::TaskManager.Task::(prepare) Task=`2f475a2b-0b37-454d-ab48-633205435170`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1462::DEBUG::2014-04-10 17:04:43,921::task::579::TaskManager.Task::(_updateState) Task=`2f475a2b-0b37-454d-ab48-633205435170`::moving from state preparing -> state finished
>Thread-1462::DEBUG::2014-04-10 17:04:43,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1462::DEBUG::2014-04-10 17:04:43,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1462::DEBUG::2014-04-10 17:04:43,921::task::974::TaskManager.Task::(_decref) Task=`2f475a2b-0b37-454d-ab48-633205435170`::ref 0 aborting False
>Thread-1463::DEBUG::2014-04-10 17:04:43,928::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1463::DEBUG::2014-04-10 17:04:43,928::task::579::TaskManager.Task::(_updateState) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::moving from state init -> state preparing
>Thread-1463::INFO::2014-04-10 17:04:43,929::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1463::DEBUG::2014-04-10 17:04:43,929::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93c3767b-a2cd-4461-9769-cd89174ba6f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1463::DEBUG::2014-04-10 17:04:43,929::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1463::DEBUG::2014-04-10 17:04:43,930::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1463::DEBUG::2014-04-10 17:04:43,930::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93c3767b-a2cd-4461-9769-cd89174ba6f1`::Granted request
>Thread-1463::DEBUG::2014-04-10 17:04:43,930::task::811::TaskManager.Task::(resourceAcquired) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1463::DEBUG::2014-04-10 17:04:43,930::task::974::TaskManager.Task::(_decref) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::ref 1 aborting False
>Thread-1463::INFO::2014-04-10 17:04:43,932::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1463::DEBUG::2014-04-10 17:04:43,932::task::1168::TaskManager.Task::(prepare) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1463::DEBUG::2014-04-10 17:04:43,932::task::579::TaskManager.Task::(_updateState) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::moving from state preparing -> state finished
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1463::DEBUG::2014-04-10 17:04:43,933::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1463::DEBUG::2014-04-10 17:04:43,934::task::974::TaskManager.Task::(_decref) Task=`db916ce0-8142-4b2b-a957-934148b50b16`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:04:49,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:49,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:49,117::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395917 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:49,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289183 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1466::DEBUG::2014-04-10 17:04:50,135::task::579::TaskManager.Task::(_updateState) Task=`a989ce02-0cbb-41d1-a279-33121e850ef2`::moving from state init -> state preparing
>Thread-1466::INFO::2014-04-10 17:04:50,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1466::INFO::2014-04-10 17:04:50,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471897', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395917', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289183', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366334', 'lastCheck': '9.1', 'valid': True}}
>Thread-1466::DEBUG::2014-04-10 17:04:50,136::task::1168::TaskManager.Task::(prepare) Task=`a989ce02-0cbb-41d1-a279-33121e850ef2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471897', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395917', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289183', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366334', 'lastCheck': '9.1', 'valid': True}}
>Thread-1466::DEBUG::2014-04-10 17:04:50,137::task::579::TaskManager.Task::(_updateState) Task=`a989ce02-0cbb-41d1-a279-33121e850ef2`::moving from state preparing -> state finished
>Thread-1466::DEBUG::2014-04-10 17:04:50,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1466::DEBUG::2014-04-10 17:04:50,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1466::DEBUG::2014-04-10 17:04:50,137::task::974::TaskManager.Task::(_decref) Task=`a989ce02-0cbb-41d1-a279-33121e850ef2`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:04:51,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:04:51,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000491515 s, 749 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:04:51,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:04:51,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494469 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1469::DEBUG::2014-04-10 17:04:54,009::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1469::DEBUG::2014-04-10 17:04:54,010::task::579::TaskManager.Task::(_updateState) Task=`c8d16981-8d26-4678-b9b8-22ef32fc656d`::moving from state init -> state preparing
>Thread-1469::INFO::2014-04-10 17:04:54,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1469::INFO::2014-04-10 17:04:54,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1469::DEBUG::2014-04-10 17:04:54,011::task::1168::TaskManager.Task::(prepare) Task=`c8d16981-8d26-4678-b9b8-22ef32fc656d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1469::DEBUG::2014-04-10 17:04:54,011::task::579::TaskManager.Task::(_updateState) Task=`c8d16981-8d26-4678-b9b8-22ef32fc656d`::moving from state preparing -> state finished
>Thread-1469::DEBUG::2014-04-10 17:04:54,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1469::DEBUG::2014-04-10 17:04:54,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1469::DEBUG::2014-04-10 17:04:54,011::task::974::TaskManager.Task::(_decref) Task=`c8d16981-8d26-4678-b9b8-22ef32fc656d`::ref 0 aborting False
>Thread-1470::DEBUG::2014-04-10 17:04:54,018::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1470::DEBUG::2014-04-10 17:04:54,018::task::579::TaskManager.Task::(_updateState) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::moving from state init -> state preparing
>Thread-1470::INFO::2014-04-10 17:04:54,018::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1470::DEBUG::2014-04-10 17:04:54,018::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`53c3cf3c-249b-4e06-aef7-1e93e1fc4416`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1470::DEBUG::2014-04-10 17:04:54,019::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1470::DEBUG::2014-04-10 17:04:54,019::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1470::DEBUG::2014-04-10 17:04:54,019::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`53c3cf3c-249b-4e06-aef7-1e93e1fc4416`::Granted request
>Thread-1470::DEBUG::2014-04-10 17:04:54,019::task::811::TaskManager.Task::(resourceAcquired) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1470::DEBUG::2014-04-10 17:04:54,019::task::974::TaskManager.Task::(_decref) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::ref 1 aborting False
>Thread-1470::INFO::2014-04-10 17:04:54,021::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1470::DEBUG::2014-04-10 17:04:54,021::task::1168::TaskManager.Task::(prepare) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::task::579::TaskManager.Task::(_updateState) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::moving from state preparing -> state finished
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1470::DEBUG::2014-04-10 17:04:54,022::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1470::DEBUG::2014-04-10 17:04:54,023::task::974::TaskManager.Task::(_decref) Task=`aba0f57e-0f3c-4210-bfd2-fd3ecc0f63e9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:04:59,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:04:59,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:04:59,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000413295 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:04:59,163::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278327 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:05:01,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:01,035::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044864 s, 820 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:01,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:01,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000435327 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1474::DEBUG::2014-04-10 17:05:04,099::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-1474::DEBUG::2014-04-10 17:05:04,100::task::579::TaskManager.Task::(_updateState) Task=`a3d50d1f-eb50-4489-9294-52ccf7873c82`::moving from state init -> state preparing
>Thread-1474::INFO::2014-04-10 17:05:04,100::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1474::INFO::2014-04-10 17:05:04,100::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1474::DEBUG::2014-04-10 17:05:04,100::task::1168::TaskManager.Task::(prepare) Task=`a3d50d1f-eb50-4489-9294-52ccf7873c82`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1474::DEBUG::2014-04-10 17:05:04,101::task::579::TaskManager.Task::(_updateState) Task=`a3d50d1f-eb50-4489-9294-52ccf7873c82`::moving from state preparing -> state finished
>Thread-1474::DEBUG::2014-04-10 17:05:04,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1474::DEBUG::2014-04-10 17:05:04,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1474::DEBUG::2014-04-10 17:05:04,101::task::974::TaskManager.Task::(_decref) Task=`a3d50d1f-eb50-4489-9294-52ccf7873c82`::ref 0 aborting False
>Thread-1475::DEBUG::2014-04-10 17:05:04,107::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-1475::DEBUG::2014-04-10 17:05:04,108::task::579::TaskManager.Task::(_updateState) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::moving from state init -> state preparing
>Thread-1475::INFO::2014-04-10 17:05:04,108::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1475::DEBUG::2014-04-10 17:05:04,109::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5ceba78-e61b-40d4-9681-7743b3647e3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1475::DEBUG::2014-04-10 17:05:04,109::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1475::DEBUG::2014-04-10 17:05:04,109::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1475::DEBUG::2014-04-10 17:05:04,109::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5ceba78-e61b-40d4-9681-7743b3647e3d`::Granted request
>Thread-1475::DEBUG::2014-04-10 17:05:04,109::task::811::TaskManager.Task::(resourceAcquired) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1475::DEBUG::2014-04-10 17:05:04,110::task::974::TaskManager.Task::(_decref) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::ref 1 aborting False
>Thread-1475::INFO::2014-04-10 17:05:04,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::task::1168::TaskManager.Task::(prepare) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::task::579::TaskManager.Task::(_updateState) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::moving from state preparing -> state finished
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1475::DEBUG::2014-04-10 17:05:04,112::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1475::DEBUG::2014-04-10 17:05:04,113::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1475::DEBUG::2014-04-10 17:05:04,113::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1475::DEBUG::2014-04-10 17:05:04,113::task::974::TaskManager.Task::(_decref) Task=`b6ab6313-f162-46c1-9cf6-a6d2dba499af`::ref 0 aborting False
>Thread-1476::DEBUG::2014-04-10 17:05:05,529::task::579::TaskManager.Task::(_updateState) Task=`b2de7c53-9579-40e8-9771-63870ad06c5f`::moving from state init -> state preparing
>Thread-1476::INFO::2014-04-10 17:05:05,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1476::INFO::2014-04-10 17:05:05,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435327', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413295', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278327', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044864', 'lastCheck': '4.5', 'valid': True}}
>Thread-1476::DEBUG::2014-04-10 17:05:05,530::task::1168::TaskManager.Task::(prepare) Task=`b2de7c53-9579-40e8-9771-63870ad06c5f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435327', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413295', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278327', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044864', 'lastCheck': '4.5', 'valid': True}}
>Thread-1476::DEBUG::2014-04-10 17:05:05,530::task::579::TaskManager.Task::(_updateState) Task=`b2de7c53-9579-40e8-9771-63870ad06c5f`::moving from state preparing -> state finished
>Thread-1476::DEBUG::2014-04-10 17:05:05,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1476::DEBUG::2014-04-10 17:05:05,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1476::DEBUG::2014-04-10 17:05:05,530::task::974::TaskManager.Task::(_decref) Task=`b2de7c53-9579-40e8-9771-63870ad06c5f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:09,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:09,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000569863 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:09,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:05:09,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310912 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:05:11,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:11,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489218 s, 752 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:11,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:11,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000483511 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1480::DEBUG::2014-04-10 17:05:14,199::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1480::DEBUG::2014-04-10 17:05:14,199::task::579::TaskManager.Task::(_updateState) Task=`aa4a368d-41ff-4b0a-8955-fc1cdf86abc8`::moving from state init -> state preparing
>Thread-1480::INFO::2014-04-10 17:05:14,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1480::INFO::2014-04-10 17:05:14,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1480::DEBUG::2014-04-10 17:05:14,200::task::1168::TaskManager.Task::(prepare) Task=`aa4a368d-41ff-4b0a-8955-fc1cdf86abc8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1480::DEBUG::2014-04-10 17:05:14,200::task::579::TaskManager.Task::(_updateState) Task=`aa4a368d-41ff-4b0a-8955-fc1cdf86abc8`::moving from state preparing -> state finished
>Thread-1480::DEBUG::2014-04-10 17:05:14,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1480::DEBUG::2014-04-10 17:05:14,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1480::DEBUG::2014-04-10 17:05:14,201::task::974::TaskManager.Task::(_decref) Task=`aa4a368d-41ff-4b0a-8955-fc1cdf86abc8`::ref 0 aborting False
>Thread-1481::DEBUG::2014-04-10 17:05:14,207::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1481::DEBUG::2014-04-10 17:05:14,207::task::579::TaskManager.Task::(_updateState) Task=`47489ec1-d317-446b-b004-eee457960554`::moving from state init -> state preparing
>Thread-1481::INFO::2014-04-10 17:05:14,207::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1481::DEBUG::2014-04-10 17:05:14,208::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9620a907-0b02-4f56-9012-d39e70d67abb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1481::DEBUG::2014-04-10 17:05:14,208::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1481::DEBUG::2014-04-10 17:05:14,208::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1481::DEBUG::2014-04-10 17:05:14,208::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9620a907-0b02-4f56-9012-d39e70d67abb`::Granted request
>Thread-1481::DEBUG::2014-04-10 17:05:14,209::task::811::TaskManager.Task::(resourceAcquired) Task=`47489ec1-d317-446b-b004-eee457960554`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1481::DEBUG::2014-04-10 17:05:14,209::task::974::TaskManager.Task::(_decref) Task=`47489ec1-d317-446b-b004-eee457960554`::ref 1 aborting False
>Thread-1481::INFO::2014-04-10 17:05:14,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1481::DEBUG::2014-04-10 17:05:14,211::task::1168::TaskManager.Task::(prepare) Task=`47489ec1-d317-446b-b004-eee457960554`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1481::DEBUG::2014-04-10 17:05:14,211::task::579::TaskManager.Task::(_updateState) Task=`47489ec1-d317-446b-b004-eee457960554`::moving from state preparing -> state finished
>Thread-1481::DEBUG::2014-04-10 17:05:14,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1481::DEBUG::2014-04-10 17:05:14,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1481::DEBUG::2014-04-10 17:05:14,212::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1481::DEBUG::2014-04-10 17:05:14,212::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1481::DEBUG::2014-04-10 17:05:14,212::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1481::DEBUG::2014-04-10 17:05:14,212::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1481::DEBUG::2014-04-10 17:05:14,212::task::974::TaskManager.Task::(_decref) Task=`47489ec1-d317-446b-b004-eee457960554`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:19,211::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:05:19,227::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:19,228::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283839 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:19,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295358 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1484::DEBUG::2014-04-10 17:05:20,716::task::579::TaskManager.Task::(_updateState) Task=`9616e4d9-6002-4a18-ae52-c32533220d76`::moving from state init -> state preparing
>Thread-1484::INFO::2014-04-10 17:05:20,717::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1484::INFO::2014-04-10 17:05:20,717::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483511', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283839', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295358', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489218', 'lastCheck': '9.7', 'valid': True}}
>Thread-1484::DEBUG::2014-04-10 17:05:20,717::task::1168::TaskManager.Task::(prepare) Task=`9616e4d9-6002-4a18-ae52-c32533220d76`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483511', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283839', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295358', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489218', 'lastCheck': '9.7', 'valid': True}}
>Thread-1484::DEBUG::2014-04-10 17:05:20,717::task::579::TaskManager.Task::(_updateState) Task=`9616e4d9-6002-4a18-ae52-c32533220d76`::moving from state preparing -> state finished
>Thread-1484::DEBUG::2014-04-10 17:05:20,718::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1484::DEBUG::2014-04-10 17:05:20,718::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1484::DEBUG::2014-04-10 17:05:20,718::task::974::TaskManager.Task::(_decref) Task=`9616e4d9-6002-4a18-ae52-c32533220d76`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:05:21,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:21,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000501445 s, 734 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:21,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:21,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000356084 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1487::DEBUG::2014-04-10 17:05:24,289::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1487::DEBUG::2014-04-10 17:05:24,304::task::579::TaskManager.Task::(_updateState) Task=`e72ad0a9-7c5d-4350-8d10-5eb2eca12abf`::moving from state init -> state preparing
>Thread-1487::INFO::2014-04-10 17:05:24,304::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1487::INFO::2014-04-10 17:05:24,304::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1487::DEBUG::2014-04-10 17:05:24,305::task::1168::TaskManager.Task::(prepare) Task=`e72ad0a9-7c5d-4350-8d10-5eb2eca12abf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1487::DEBUG::2014-04-10 17:05:24,305::task::579::TaskManager.Task::(_updateState) Task=`e72ad0a9-7c5d-4350-8d10-5eb2eca12abf`::moving from state preparing -> state finished
>Thread-1487::DEBUG::2014-04-10 17:05:24,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1487::DEBUG::2014-04-10 17:05:24,305::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1487::DEBUG::2014-04-10 17:05:24,305::task::974::TaskManager.Task::(_decref) Task=`e72ad0a9-7c5d-4350-8d10-5eb2eca12abf`::ref 0 aborting False
>Thread-1488::DEBUG::2014-04-10 17:05:24,327::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1488::DEBUG::2014-04-10 17:05:24,327::task::579::TaskManager.Task::(_updateState) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::moving from state init -> state preparing
>Thread-1488::INFO::2014-04-10 17:05:24,327::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1488::DEBUG::2014-04-10 17:05:24,328::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`322b7cb2-b0f1-4e2a-97af-a79af9f3ce91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1488::DEBUG::2014-04-10 17:05:24,328::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1488::DEBUG::2014-04-10 17:05:24,328::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1488::DEBUG::2014-04-10 17:05:24,328::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`322b7cb2-b0f1-4e2a-97af-a79af9f3ce91`::Granted request
>Thread-1488::DEBUG::2014-04-10 17:05:24,329::task::811::TaskManager.Task::(resourceAcquired) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1488::DEBUG::2014-04-10 17:05:24,329::task::974::TaskManager.Task::(_decref) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::ref 1 aborting False
>Thread-1488::INFO::2014-04-10 17:05:24,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1488::DEBUG::2014-04-10 17:05:24,331::task::1168::TaskManager.Task::(prepare) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1488::DEBUG::2014-04-10 17:05:24,331::task::579::TaskManager.Task::(_updateState) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::moving from state preparing -> state finished
>Thread-1488::DEBUG::2014-04-10 17:05:24,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1488::DEBUG::2014-04-10 17:05:24,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1488::DEBUG::2014-04-10 17:05:24,332::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1488::DEBUG::2014-04-10 17:05:24,332::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1488::DEBUG::2014-04-10 17:05:24,332::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1488::DEBUG::2014-04-10 17:05:24,333::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1488::DEBUG::2014-04-10 17:05:24,333::task::974::TaskManager.Task::(_decref) Task=`e21e0ccb-d99c-4bb4-b3ac-b4c398956df9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:29,242::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 17:05:29,243::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:05:29,252::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:05:29,254::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:05:29,254::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:05:29,255::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:05:29,259::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 17:05:29,260::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:05:29,261::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:05:29,262::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-466::DEBUG::2014-04-10 17:05:29,262::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:05:29,262::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::INFO::2014-04-10 17:05:29,262::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:05:29,263::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:05:29,271::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:29,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:29,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366797 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:29,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254799 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:05:31,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:31,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484031 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:31,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:31,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000564993 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1500::DEBUG::2014-04-10 17:05:34,420::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1500::DEBUG::2014-04-10 17:05:34,430::task::579::TaskManager.Task::(_updateState) Task=`da02530f-56af-4d48-af99-280632dd4a3c`::moving from state init -> state preparing
>Thread-1500::INFO::2014-04-10 17:05:34,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1500::INFO::2014-04-10 17:05:34,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1500::DEBUG::2014-04-10 17:05:34,431::task::1168::TaskManager.Task::(prepare) Task=`da02530f-56af-4d48-af99-280632dd4a3c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1500::DEBUG::2014-04-10 17:05:34,432::task::579::TaskManager.Task::(_updateState) Task=`da02530f-56af-4d48-af99-280632dd4a3c`::moving from state preparing -> state finished
>Thread-1500::DEBUG::2014-04-10 17:05:34,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1500::DEBUG::2014-04-10 17:05:34,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1500::DEBUG::2014-04-10 17:05:34,432::task::974::TaskManager.Task::(_decref) Task=`da02530f-56af-4d48-af99-280632dd4a3c`::ref 0 aborting False
>Thread-1501::DEBUG::2014-04-10 17:05:34,439::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1501::DEBUG::2014-04-10 17:05:34,439::task::579::TaskManager.Task::(_updateState) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::moving from state init -> state preparing
>Thread-1501::INFO::2014-04-10 17:05:34,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1501::DEBUG::2014-04-10 17:05:34,440::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2bff4b9-8eee-45b1-b329-cfa53d5be14f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1501::DEBUG::2014-04-10 17:05:34,440::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1501::DEBUG::2014-04-10 17:05:34,440::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1501::DEBUG::2014-04-10 17:05:34,441::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2bff4b9-8eee-45b1-b329-cfa53d5be14f`::Granted request
>Thread-1501::DEBUG::2014-04-10 17:05:34,441::task::811::TaskManager.Task::(resourceAcquired) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1501::DEBUG::2014-04-10 17:05:34,441::task::974::TaskManager.Task::(_decref) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::ref 1 aborting False
>Thread-1501::INFO::2014-04-10 17:05:34,443::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1501::DEBUG::2014-04-10 17:05:34,444::task::1168::TaskManager.Task::(prepare) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1501::DEBUG::2014-04-10 17:05:34,444::task::579::TaskManager.Task::(_updateState) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::moving from state preparing -> state finished
>Thread-1501::DEBUG::2014-04-10 17:05:34,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1501::DEBUG::2014-04-10 17:05:34,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1501::DEBUG::2014-04-10 17:05:34,444::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1501::DEBUG::2014-04-10 17:05:34,445::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1501::DEBUG::2014-04-10 17:05:34,445::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1501::DEBUG::2014-04-10 17:05:34,445::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1501::DEBUG::2014-04-10 17:05:34,445::task::974::TaskManager.Task::(_decref) Task=`213661b8-fcb6-41ec-ab23-715a67d90906`::ref 0 aborting False
>Thread-1502::DEBUG::2014-04-10 17:05:35,878::task::579::TaskManager.Task::(_updateState) Task=`4bc7aae6-5ce1-4794-bd95-3e6ac36f6d65`::moving from state init -> state preparing
>Thread-1502::INFO::2014-04-10 17:05:35,879::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1502::INFO::2014-04-10 17:05:35,879::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564993', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366797', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254799', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484031', 'lastCheck': '4.8', 'valid': True}}
>Thread-1502::DEBUG::2014-04-10 17:05:35,879::task::1168::TaskManager.Task::(prepare) Task=`4bc7aae6-5ce1-4794-bd95-3e6ac36f6d65`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564993', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366797', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254799', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484031', 'lastCheck': '4.8', 'valid': True}}
>Thread-1502::DEBUG::2014-04-10 17:05:35,879::task::579::TaskManager.Task::(_updateState) Task=`4bc7aae6-5ce1-4794-bd95-3e6ac36f6d65`::moving from state preparing -> state finished
>Thread-1502::DEBUG::2014-04-10 17:05:35,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1502::DEBUG::2014-04-10 17:05:35,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1502::DEBUG::2014-04-10 17:05:35,880::task::974::TaskManager.Task::(_decref) Task=`4bc7aae6-5ce1-4794-bd95-3e6ac36f6d65`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:39,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:39,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000472294 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:39,316::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:05:39,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000495718 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:05:41,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:41,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000528897 s, 696 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:41,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:41,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000403348 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1506::DEBUG::2014-04-10 17:05:44,527::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-1506::DEBUG::2014-04-10 17:05:44,528::task::579::TaskManager.Task::(_updateState) Task=`3ce6473b-fa6e-43d4-9d5d-e5a74531d340`::moving from state init -> state preparing
>Thread-1506::INFO::2014-04-10 17:05:44,528::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1506::INFO::2014-04-10 17:05:44,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1506::DEBUG::2014-04-10 17:05:44,529::task::1168::TaskManager.Task::(prepare) Task=`3ce6473b-fa6e-43d4-9d5d-e5a74531d340`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1506::DEBUG::2014-04-10 17:05:44,529::task::579::TaskManager.Task::(_updateState) Task=`3ce6473b-fa6e-43d4-9d5d-e5a74531d340`::moving from state preparing -> state finished
>Thread-1506::DEBUG::2014-04-10 17:05:44,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1506::DEBUG::2014-04-10 17:05:44,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1506::DEBUG::2014-04-10 17:05:44,529::task::974::TaskManager.Task::(_decref) Task=`3ce6473b-fa6e-43d4-9d5d-e5a74531d340`::ref 0 aborting False
>Thread-1507::DEBUG::2014-04-10 17:05:44,536::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-1507::DEBUG::2014-04-10 17:05:44,537::task::579::TaskManager.Task::(_updateState) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::moving from state init -> state preparing
>Thread-1507::INFO::2014-04-10 17:05:44,537::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1507::DEBUG::2014-04-10 17:05:44,537::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f0484f6-d0b5-4beb-bc9d-8bcb43895958`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1507::DEBUG::2014-04-10 17:05:44,538::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1507::DEBUG::2014-04-10 17:05:44,538::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1507::DEBUG::2014-04-10 17:05:44,538::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f0484f6-d0b5-4beb-bc9d-8bcb43895958`::Granted request
>Thread-1507::DEBUG::2014-04-10 17:05:44,538::task::811::TaskManager.Task::(resourceAcquired) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1507::DEBUG::2014-04-10 17:05:44,538::task::974::TaskManager.Task::(_decref) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::ref 1 aborting False
>Thread-1507::INFO::2014-04-10 17:05:44,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139012538368', 'isoprefix': '', 'alerts': [], 'disktotal': '910879686656', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139011555328', 'isoprefix': '', 'alerts': [], 'disktotal': '910878703616', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::task::1168::TaskManager.Task::(prepare) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139012538368', 'isoprefix': '', 'alerts': [], 'disktotal': '910879686656', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139011555328', 'isoprefix': '', 'alerts': [], 'disktotal': '910878703616', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::task::579::TaskManager.Task::(_updateState) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::moving from state preparing -> state finished
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1507::DEBUG::2014-04-10 17:05:44,541::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1507::DEBUG::2014-04-10 17:05:44,542::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1507::DEBUG::2014-04-10 17:05:44,542::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1507::DEBUG::2014-04-10 17:05:44,542::task::974::TaskManager.Task::(_decref) Task=`f47d9dff-8b6d-4c3d-b5c4-c3ad2e714314`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:49,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:49,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000399537 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:49,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:05:49,335::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366901 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1510::DEBUG::2014-04-10 17:05:51,038::task::579::TaskManager.Task::(_updateState) Task=`81eb16ab-e270-442c-905d-b84ea0549c52`::moving from state init -> state preparing
>Thread-1510::INFO::2014-04-10 17:05:51,038::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1510::INFO::2014-04-10 17:05:51,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403348', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399537', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366901', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528897', 'lastCheck': '9.9', 'valid': True}}
>Thread-1510::DEBUG::2014-04-10 17:05:51,039::task::1168::TaskManager.Task::(prepare) Task=`81eb16ab-e270-442c-905d-b84ea0549c52`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403348', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399537', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366901', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528897', 'lastCheck': '9.9', 'valid': True}}
>Thread-1510::DEBUG::2014-04-10 17:05:51,039::task::579::TaskManager.Task::(_updateState) Task=`81eb16ab-e270-442c-905d-b84ea0549c52`::moving from state preparing -> state finished
>Thread-1510::DEBUG::2014-04-10 17:05:51,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1510::DEBUG::2014-04-10 17:05:51,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1510::DEBUG::2014-04-10 17:05:51,039::task::974::TaskManager.Task::(_decref) Task=`81eb16ab-e270-442c-905d-b84ea0549c52`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:05:51,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:05:51,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000555796 s, 662 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:05:51,260::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:05:51,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000512316 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1513::DEBUG::2014-04-10 17:05:54,659::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-1513::DEBUG::2014-04-10 17:05:54,660::task::579::TaskManager.Task::(_updateState) Task=`05092c3d-c941-423e-85a6-65bc9677b008`::moving from state init -> state preparing
>Thread-1513::INFO::2014-04-10 17:05:54,660::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1513::INFO::2014-04-10 17:05:54,661::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1513::DEBUG::2014-04-10 17:05:54,661::task::1168::TaskManager.Task::(prepare) Task=`05092c3d-c941-423e-85a6-65bc9677b008`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1513::DEBUG::2014-04-10 17:05:54,661::task::579::TaskManager.Task::(_updateState) Task=`05092c3d-c941-423e-85a6-65bc9677b008`::moving from state preparing -> state finished
>Thread-1513::DEBUG::2014-04-10 17:05:54,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1513::DEBUG::2014-04-10 17:05:54,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1513::DEBUG::2014-04-10 17:05:54,661::task::974::TaskManager.Task::(_decref) Task=`05092c3d-c941-423e-85a6-65bc9677b008`::ref 0 aborting False
>Thread-1514::DEBUG::2014-04-10 17:05:54,669::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-1514::DEBUG::2014-04-10 17:05:54,669::task::579::TaskManager.Task::(_updateState) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::moving from state init -> state preparing
>Thread-1514::INFO::2014-04-10 17:05:54,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1514::DEBUG::2014-04-10 17:05:54,670::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fd283e9f-cbd0-41d6-8a47-704b0d1856d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1514::DEBUG::2014-04-10 17:05:54,670::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1514::DEBUG::2014-04-10 17:05:54,670::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1514::DEBUG::2014-04-10 17:05:54,670::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fd283e9f-cbd0-41d6-8a47-704b0d1856d5`::Granted request
>Thread-1514::DEBUG::2014-04-10 17:05:54,671::task::811::TaskManager.Task::(resourceAcquired) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1514::DEBUG::2014-04-10 17:05:54,671::task::974::TaskManager.Task::(_decref) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::ref 1 aborting False
>Thread-1514::INFO::2014-04-10 17:05:54,673::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081416704', 'isoprefix': '', 'alerts': [], 'disktotal': '910948564992', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081416704', 'isoprefix': '', 'alerts': [], 'disktotal': '910948564992', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1514::DEBUG::2014-04-10 17:05:54,673::task::1168::TaskManager.Task::(prepare) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081416704', 'isoprefix': '', 'alerts': [], 'disktotal': '910948564992', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081416704', 'isoprefix': '', 'alerts': [], 'disktotal': '910948564992', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1514::DEBUG::2014-04-10 17:05:54,674::task::579::TaskManager.Task::(_updateState) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::moving from state preparing -> state finished
>Thread-1514::DEBUG::2014-04-10 17:05:54,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1514::DEBUG::2014-04-10 17:05:54,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1514::DEBUG::2014-04-10 17:05:54,674::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1514::DEBUG::2014-04-10 17:05:54,675::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1514::DEBUG::2014-04-10 17:05:54,675::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1514::DEBUG::2014-04-10 17:05:54,675::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1514::DEBUG::2014-04-10 17:05:54,675::task::974::TaskManager.Task::(_decref) Task=`f96afd31-4cd5-4c4d-90ba-7b5a0028b66b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:05:59,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:05:59,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000426897 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:05:59,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:05:59,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353305 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:01,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:01,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000422201 s, 872 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:01,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:01,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000443284 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1518::DEBUG::2014-04-10 17:06:04,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1518::DEBUG::2014-04-10 17:06:04,767::task::579::TaskManager.Task::(_updateState) Task=`4979ea4e-15ea-4947-8c0e-e488b709d212`::moving from state init -> state preparing
>Thread-1518::INFO::2014-04-10 17:06:04,767::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1518::INFO::2014-04-10 17:06:04,767::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1518::DEBUG::2014-04-10 17:06:04,767::task::1168::TaskManager.Task::(prepare) Task=`4979ea4e-15ea-4947-8c0e-e488b709d212`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1518::DEBUG::2014-04-10 17:06:04,768::task::579::TaskManager.Task::(_updateState) Task=`4979ea4e-15ea-4947-8c0e-e488b709d212`::moving from state preparing -> state finished
>Thread-1518::DEBUG::2014-04-10 17:06:04,768::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1518::DEBUG::2014-04-10 17:06:04,768::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1518::DEBUG::2014-04-10 17:06:04,768::task::974::TaskManager.Task::(_decref) Task=`4979ea4e-15ea-4947-8c0e-e488b709d212`::ref 0 aborting False
>Thread-1519::DEBUG::2014-04-10 17:06:04,775::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1519::DEBUG::2014-04-10 17:06:04,776::task::579::TaskManager.Task::(_updateState) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::moving from state init -> state preparing
>Thread-1519::INFO::2014-04-10 17:06:04,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1519::DEBUG::2014-04-10 17:06:04,776::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6476b876-4faa-4610-a6ed-010e5a302343`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1519::DEBUG::2014-04-10 17:06:04,777::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1519::DEBUG::2014-04-10 17:06:04,777::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1519::DEBUG::2014-04-10 17:06:04,777::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6476b876-4faa-4610-a6ed-010e5a302343`::Granted request
>Thread-1519::DEBUG::2014-04-10 17:06:04,777::task::811::TaskManager.Task::(resourceAcquired) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1519::DEBUG::2014-04-10 17:06:04,778::task::974::TaskManager.Task::(_decref) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::ref 1 aborting False
>Thread-1519::INFO::2014-04-10 17:06:04,780::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1519::DEBUG::2014-04-10 17:06:04,780::task::1168::TaskManager.Task::(prepare) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1519::DEBUG::2014-04-10 17:06:04,780::task::579::TaskManager.Task::(_updateState) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::moving from state preparing -> state finished
>Thread-1519::DEBUG::2014-04-10 17:06:04,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1519::DEBUG::2014-04-10 17:06:04,780::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1519::DEBUG::2014-04-10 17:06:04,781::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1519::DEBUG::2014-04-10 17:06:04,781::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1519::DEBUG::2014-04-10 17:06:04,781::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1519::DEBUG::2014-04-10 17:06:04,781::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1519::DEBUG::2014-04-10 17:06:04,781::task::974::TaskManager.Task::(_decref) Task=`6951510b-95ec-45a5-aeb6-8dede5a4a5e5`::ref 0 aborting False
>Thread-1520::DEBUG::2014-04-10 17:06:06,195::task::579::TaskManager.Task::(_updateState) Task=`35625992-3bd0-416d-82d3-e08f0c25209d`::moving from state init -> state preparing
>Thread-1520::INFO::2014-04-10 17:06:06,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1520::INFO::2014-04-10 17:06:06,196::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443284', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426897', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353305', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422201', 'lastCheck': '5.1', 'valid': True}}
>Thread-1520::DEBUG::2014-04-10 17:06:06,196::task::1168::TaskManager.Task::(prepare) Task=`35625992-3bd0-416d-82d3-e08f0c25209d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443284', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426897', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353305', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422201', 'lastCheck': '5.1', 'valid': True}}
>Thread-1520::DEBUG::2014-04-10 17:06:06,196::task::579::TaskManager.Task::(_updateState) Task=`35625992-3bd0-416d-82d3-e08f0c25209d`::moving from state preparing -> state finished
>Thread-1520::DEBUG::2014-04-10 17:06:06,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1520::DEBUG::2014-04-10 17:06:06,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1520::DEBUG::2014-04-10 17:06:06,197::task::974::TaskManager.Task::(_decref) Task=`35625992-3bd0-416d-82d3-e08f0c25209d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:09,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:09,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0004108 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:09,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:09,371::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000404824 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:11,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:11,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000498939 s, 738 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:11,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:11,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000438829 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1524::DEBUG::2014-04-10 17:06:15,261::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-1524::DEBUG::2014-04-10 17:06:15,262::task::579::TaskManager.Task::(_updateState) Task=`1fae5178-689d-475a-b17a-675fd127020c`::moving from state init -> state preparing
>Thread-1524::INFO::2014-04-10 17:06:15,262::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1524::INFO::2014-04-10 17:06:15,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1524::DEBUG::2014-04-10 17:06:15,263::task::1168::TaskManager.Task::(prepare) Task=`1fae5178-689d-475a-b17a-675fd127020c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1524::DEBUG::2014-04-10 17:06:15,263::task::579::TaskManager.Task::(_updateState) Task=`1fae5178-689d-475a-b17a-675fd127020c`::moving from state preparing -> state finished
>Thread-1524::DEBUG::2014-04-10 17:06:15,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1524::DEBUG::2014-04-10 17:06:15,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1524::DEBUG::2014-04-10 17:06:15,264::task::974::TaskManager.Task::(_decref) Task=`1fae5178-689d-475a-b17a-675fd127020c`::ref 0 aborting False
>Thread-1525::DEBUG::2014-04-10 17:06:15,271::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-1525::DEBUG::2014-04-10 17:06:15,271::task::579::TaskManager.Task::(_updateState) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::moving from state init -> state preparing
>Thread-1525::INFO::2014-04-10 17:06:15,271::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1525::DEBUG::2014-04-10 17:06:15,272::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c5c4652-39a6-4b83-bf09-5745ddac7246`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1525::DEBUG::2014-04-10 17:06:15,272::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1525::DEBUG::2014-04-10 17:06:15,272::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1525::DEBUG::2014-04-10 17:06:15,273::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c5c4652-39a6-4b83-bf09-5745ddac7246`::Granted request
>Thread-1525::DEBUG::2014-04-10 17:06:15,273::task::811::TaskManager.Task::(resourceAcquired) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1525::DEBUG::2014-04-10 17:06:15,273::task::974::TaskManager.Task::(_decref) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::ref 1 aborting False
>Thread-1525::INFO::2014-04-10 17:06:15,275::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1525::DEBUG::2014-04-10 17:06:15,276::task::1168::TaskManager.Task::(prepare) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1525::DEBUG::2014-04-10 17:06:15,276::task::579::TaskManager.Task::(_updateState) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::moving from state preparing -> state finished
>Thread-1525::DEBUG::2014-04-10 17:06:15,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1525::DEBUG::2014-04-10 17:06:15,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1525::DEBUG::2014-04-10 17:06:15,276::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1525::DEBUG::2014-04-10 17:06:15,277::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1525::DEBUG::2014-04-10 17:06:15,277::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1525::DEBUG::2014-04-10 17:06:15,277::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1525::DEBUG::2014-04-10 17:06:15,277::task::974::TaskManager.Task::(_decref) Task=`46d0469f-5632-48c3-925c-01ee1d7ee110`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:19,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:19,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372265 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:19,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:19,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335364 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:21,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:21,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000443921 s, 829 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:21,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:21,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000388609 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1528::DEBUG::2014-04-10 17:06:21,381::task::579::TaskManager.Task::(_updateState) Task=`dd3fd7f9-379a-4c7f-9dee-e3cad2c86d0c`::moving from state init -> state preparing
>Thread-1528::INFO::2014-04-10 17:06:21,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1528::INFO::2014-04-10 17:06:21,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388609', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372265', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335364', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443921', 'lastCheck': '0.2', 'valid': True}}
>Thread-1528::DEBUG::2014-04-10 17:06:21,382::task::1168::TaskManager.Task::(prepare) Task=`dd3fd7f9-379a-4c7f-9dee-e3cad2c86d0c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388609', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372265', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335364', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443921', 'lastCheck': '0.2', 'valid': True}}
>Thread-1528::DEBUG::2014-04-10 17:06:21,382::task::579::TaskManager.Task::(_updateState) Task=`dd3fd7f9-379a-4c7f-9dee-e3cad2c86d0c`::moving from state preparing -> state finished
>Thread-1528::DEBUG::2014-04-10 17:06:21,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1528::DEBUG::2014-04-10 17:06:21,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1528::DEBUG::2014-04-10 17:06:21,382::task::974::TaskManager.Task::(_decref) Task=`dd3fd7f9-379a-4c7f-9dee-e3cad2c86d0c`::ref 0 aborting False
>Thread-1531::DEBUG::2014-04-10 17:06:25,345::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1531::DEBUG::2014-04-10 17:06:25,346::task::579::TaskManager.Task::(_updateState) Task=`423c036d-e767-4f16-b29b-54e0c1175c3b`::moving from state init -> state preparing
>Thread-1531::INFO::2014-04-10 17:06:25,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1531::INFO::2014-04-10 17:06:25,346::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1531::DEBUG::2014-04-10 17:06:25,347::task::1168::TaskManager.Task::(prepare) Task=`423c036d-e767-4f16-b29b-54e0c1175c3b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1531::DEBUG::2014-04-10 17:06:25,347::task::579::TaskManager.Task::(_updateState) Task=`423c036d-e767-4f16-b29b-54e0c1175c3b`::moving from state preparing -> state finished
>Thread-1531::DEBUG::2014-04-10 17:06:25,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1531::DEBUG::2014-04-10 17:06:25,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1531::DEBUG::2014-04-10 17:06:25,347::task::974::TaskManager.Task::(_decref) Task=`423c036d-e767-4f16-b29b-54e0c1175c3b`::ref 0 aborting False
>Thread-1532::DEBUG::2014-04-10 17:06:25,354::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1532::DEBUG::2014-04-10 17:06:25,354::task::579::TaskManager.Task::(_updateState) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::moving from state init -> state preparing
>Thread-1532::INFO::2014-04-10 17:06:25,355::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1532::DEBUG::2014-04-10 17:06:25,355::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`719b6aa2-31e8-496f-bc18-0e68034d18c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1532::DEBUG::2014-04-10 17:06:25,355::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1532::DEBUG::2014-04-10 17:06:25,355::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1532::DEBUG::2014-04-10 17:06:25,356::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`719b6aa2-31e8-496f-bc18-0e68034d18c2`::Granted request
>Thread-1532::DEBUG::2014-04-10 17:06:25,356::task::811::TaskManager.Task::(resourceAcquired) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1532::DEBUG::2014-04-10 17:06:25,356::task::974::TaskManager.Task::(_decref) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::ref 1 aborting False
>Thread-1532::INFO::2014-04-10 17:06:25,358::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1532::DEBUG::2014-04-10 17:06:25,359::task::1168::TaskManager.Task::(prepare) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1532::DEBUG::2014-04-10 17:06:25,359::task::579::TaskManager.Task::(_updateState) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::moving from state preparing -> state finished
>Thread-1532::DEBUG::2014-04-10 17:06:25,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1532::DEBUG::2014-04-10 17:06:25,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1532::DEBUG::2014-04-10 17:06:25,359::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1532::DEBUG::2014-04-10 17:06:25,360::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1532::DEBUG::2014-04-10 17:06:25,360::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1532::DEBUG::2014-04-10 17:06:25,360::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1532::DEBUG::2014-04-10 17:06:25,360::task::974::TaskManager.Task::(_decref) Task=`f9c815b1-9a78-45b8-be6d-a85db01e8439`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:29,389::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:29,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300396 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:29,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:29,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252231 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:31,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:31,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000491767 s, 748 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:31,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:31,326::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00039295 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1536::DEBUG::2014-04-10 17:06:35,436::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1536::DEBUG::2014-04-10 17:06:35,436::task::579::TaskManager.Task::(_updateState) Task=`e719d113-a6fc-420d-a38f-8a52ccb82df9`::moving from state init -> state preparing
>Thread-1536::INFO::2014-04-10 17:06:35,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1536::INFO::2014-04-10 17:06:35,437::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1536::DEBUG::2014-04-10 17:06:35,437::task::1168::TaskManager.Task::(prepare) Task=`e719d113-a6fc-420d-a38f-8a52ccb82df9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1536::DEBUG::2014-04-10 17:06:35,437::task::579::TaskManager.Task::(_updateState) Task=`e719d113-a6fc-420d-a38f-8a52ccb82df9`::moving from state preparing -> state finished
>Thread-1536::DEBUG::2014-04-10 17:06:35,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1536::DEBUG::2014-04-10 17:06:35,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1536::DEBUG::2014-04-10 17:06:35,438::task::974::TaskManager.Task::(_decref) Task=`e719d113-a6fc-420d-a38f-8a52ccb82df9`::ref 0 aborting False
>Thread-1537::DEBUG::2014-04-10 17:06:35,445::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1537::DEBUG::2014-04-10 17:06:35,445::task::579::TaskManager.Task::(_updateState) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::moving from state init -> state preparing
>Thread-1537::INFO::2014-04-10 17:06:35,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1537::DEBUG::2014-04-10 17:06:35,446::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29b8a8d4-50f8-4606-be42-a15ca59763e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1537::DEBUG::2014-04-10 17:06:35,446::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1537::DEBUG::2014-04-10 17:06:35,447::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1537::DEBUG::2014-04-10 17:06:35,447::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29b8a8d4-50f8-4606-be42-a15ca59763e2`::Granted request
>Thread-1537::DEBUG::2014-04-10 17:06:35,447::task::811::TaskManager.Task::(resourceAcquired) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1537::DEBUG::2014-04-10 17:06:35,447::task::974::TaskManager.Task::(_decref) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::ref 1 aborting False
>Thread-1537::INFO::2014-04-10 17:06:35,450::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1537::DEBUG::2014-04-10 17:06:35,450::task::1168::TaskManager.Task::(prepare) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1537::DEBUG::2014-04-10 17:06:35,450::task::579::TaskManager.Task::(_updateState) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::moving from state preparing -> state finished
>Thread-1537::DEBUG::2014-04-10 17:06:35,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1537::DEBUG::2014-04-10 17:06:35,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1537::DEBUG::2014-04-10 17:06:35,451::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1537::DEBUG::2014-04-10 17:06:35,451::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1537::DEBUG::2014-04-10 17:06:35,451::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1537::DEBUG::2014-04-10 17:06:35,451::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1537::DEBUG::2014-04-10 17:06:35,451::task::974::TaskManager.Task::(_decref) Task=`0e0085eb-1dbd-41be-bdc3-58f2ebd24efd`::ref 0 aborting False
>Thread-1538::DEBUG::2014-04-10 17:06:36,581::task::579::TaskManager.Task::(_updateState) Task=`555a31ee-3f20-41ad-8a13-ca752bc36b2f`::moving from state init -> state preparing
>Thread-1538::INFO::2014-04-10 17:06:36,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1538::INFO::2014-04-10 17:06:36,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039295', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300396', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252231', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491767', 'lastCheck': '5.4', 'valid': True}}
>Thread-1538::DEBUG::2014-04-10 17:06:36,581::task::1168::TaskManager.Task::(prepare) Task=`555a31ee-3f20-41ad-8a13-ca752bc36b2f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039295', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300396', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252231', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491767', 'lastCheck': '5.4', 'valid': True}}
>Thread-1538::DEBUG::2014-04-10 17:06:36,581::task::579::TaskManager.Task::(_updateState) Task=`555a31ee-3f20-41ad-8a13-ca752bc36b2f`::moving from state preparing -> state finished
>Thread-1538::DEBUG::2014-04-10 17:06:36,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1538::DEBUG::2014-04-10 17:06:36,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1538::DEBUG::2014-04-10 17:06:36,582::task::974::TaskManager.Task::(_decref) Task=`555a31ee-3f20-41ad-8a13-ca752bc36b2f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:39,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:39,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265493 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:39,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:39,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286779 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:41,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:41,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464762 s, 792 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:41,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:41,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000510226 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1542::DEBUG::2014-04-10 17:06:45,535::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1542::DEBUG::2014-04-10 17:06:45,536::task::579::TaskManager.Task::(_updateState) Task=`db45e14a-2601-460b-a881-af4aeae80b68`::moving from state init -> state preparing
>Thread-1542::INFO::2014-04-10 17:06:45,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1542::INFO::2014-04-10 17:06:45,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1542::DEBUG::2014-04-10 17:06:45,537::task::1168::TaskManager.Task::(prepare) Task=`db45e14a-2601-460b-a881-af4aeae80b68`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1542::DEBUG::2014-04-10 17:06:45,537::task::579::TaskManager.Task::(_updateState) Task=`db45e14a-2601-460b-a881-af4aeae80b68`::moving from state preparing -> state finished
>Thread-1542::DEBUG::2014-04-10 17:06:45,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1542::DEBUG::2014-04-10 17:06:45,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1542::DEBUG::2014-04-10 17:06:45,538::task::974::TaskManager.Task::(_decref) Task=`db45e14a-2601-460b-a881-af4aeae80b68`::ref 0 aborting False
>Thread-1543::DEBUG::2014-04-10 17:06:45,544::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1543::DEBUG::2014-04-10 17:06:45,545::task::579::TaskManager.Task::(_updateState) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::moving from state init -> state preparing
>Thread-1543::INFO::2014-04-10 17:06:45,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1543::DEBUG::2014-04-10 17:06:45,546::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`378a3fe4-180c-4d57-a1ea-15b56b77a4ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1543::DEBUG::2014-04-10 17:06:45,547::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1543::DEBUG::2014-04-10 17:06:45,547::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1543::DEBUG::2014-04-10 17:06:45,547::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`378a3fe4-180c-4d57-a1ea-15b56b77a4ae`::Granted request
>Thread-1543::DEBUG::2014-04-10 17:06:45,547::task::811::TaskManager.Task::(resourceAcquired) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1543::DEBUG::2014-04-10 17:06:45,548::task::974::TaskManager.Task::(_decref) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::ref 1 aborting False
>Thread-1543::INFO::2014-04-10 17:06:45,550::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1543::DEBUG::2014-04-10 17:06:45,550::task::1168::TaskManager.Task::(prepare) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1543::DEBUG::2014-04-10 17:06:45,550::task::579::TaskManager.Task::(_updateState) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::moving from state preparing -> state finished
>Thread-1543::DEBUG::2014-04-10 17:06:45,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1543::DEBUG::2014-04-10 17:06:45,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1543::DEBUG::2014-04-10 17:06:45,551::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1543::DEBUG::2014-04-10 17:06:45,551::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1543::DEBUG::2014-04-10 17:06:45,551::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1543::DEBUG::2014-04-10 17:06:45,551::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1543::DEBUG::2014-04-10 17:06:45,551::task::974::TaskManager.Task::(_decref) Task=`61fd6a44-59d7-4850-adfd-c42fd008bee4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:49,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:49,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296117 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:49,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:49,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288776 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:06:51,193::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:06:51,198::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:06:51,200::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:06:51,205::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:06:51,207::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:06:51,207::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:06:51,207::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:06:51,212::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:06:51,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000401818 s, 916 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:06:51,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:06:51,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000402063 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1550::DEBUG::2014-04-10 17:06:51,926::task::579::TaskManager.Task::(_updateState) Task=`8b88de20-c52e-467f-8bfe-df9c277435cd`::moving from state init -> state preparing
>Thread-1550::INFO::2014-04-10 17:06:51,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1550::INFO::2014-04-10 17:06:51,927::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402063', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296117', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288776', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401818', 'lastCheck': '0.7', 'valid': True}}
>Thread-1550::DEBUG::2014-04-10 17:06:51,927::task::1168::TaskManager.Task::(prepare) Task=`8b88de20-c52e-467f-8bfe-df9c277435cd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402063', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296117', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288776', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401818', 'lastCheck': '0.7', 'valid': True}}
>Thread-1550::DEBUG::2014-04-10 17:06:51,927::task::579::TaskManager.Task::(_updateState) Task=`8b88de20-c52e-467f-8bfe-df9c277435cd`::moving from state preparing -> state finished
>Thread-1550::DEBUG::2014-04-10 17:06:51,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1550::DEBUG::2014-04-10 17:06:51,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1550::DEBUG::2014-04-10 17:06:51,928::task::974::TaskManager.Task::(_decref) Task=`8b88de20-c52e-467f-8bfe-df9c277435cd`::ref 0 aborting False
>Thread-1553::DEBUG::2014-04-10 17:06:55,666::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1553::DEBUG::2014-04-10 17:06:55,667::task::579::TaskManager.Task::(_updateState) Task=`232acf74-5250-4c5e-ab60-d6e221223309`::moving from state init -> state preparing
>Thread-1553::INFO::2014-04-10 17:06:55,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1553::INFO::2014-04-10 17:06:55,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1553::DEBUG::2014-04-10 17:06:55,668::task::1168::TaskManager.Task::(prepare) Task=`232acf74-5250-4c5e-ab60-d6e221223309`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1553::DEBUG::2014-04-10 17:06:55,668::task::579::TaskManager.Task::(_updateState) Task=`232acf74-5250-4c5e-ab60-d6e221223309`::moving from state preparing -> state finished
>Thread-1553::DEBUG::2014-04-10 17:06:55,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1553::DEBUG::2014-04-10 17:06:55,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1553::DEBUG::2014-04-10 17:06:55,669::task::974::TaskManager.Task::(_decref) Task=`232acf74-5250-4c5e-ab60-d6e221223309`::ref 0 aborting False
>Thread-1554::DEBUG::2014-04-10 17:06:55,675::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1554::DEBUG::2014-04-10 17:06:55,675::task::579::TaskManager.Task::(_updateState) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::moving from state init -> state preparing
>Thread-1554::INFO::2014-04-10 17:06:55,676::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1554::DEBUG::2014-04-10 17:06:55,676::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a0d9861a-7594-4d26-bcdd-35662f50cf0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1554::DEBUG::2014-04-10 17:06:55,676::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1554::DEBUG::2014-04-10 17:06:55,677::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1554::DEBUG::2014-04-10 17:06:55,677::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a0d9861a-7594-4d26-bcdd-35662f50cf0b`::Granted request
>Thread-1554::DEBUG::2014-04-10 17:06:55,677::task::811::TaskManager.Task::(resourceAcquired) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1554::DEBUG::2014-04-10 17:06:55,677::task::974::TaskManager.Task::(_decref) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::ref 1 aborting False
>Thread-1554::INFO::2014-04-10 17:06:55,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1554::DEBUG::2014-04-10 17:06:55,680::task::1168::TaskManager.Task::(prepare) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1554::DEBUG::2014-04-10 17:06:55,680::task::579::TaskManager.Task::(_updateState) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::moving from state preparing -> state finished
>Thread-1554::DEBUG::2014-04-10 17:06:55,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1554::DEBUG::2014-04-10 17:06:55,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1554::DEBUG::2014-04-10 17:06:55,680::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1554::DEBUG::2014-04-10 17:06:55,681::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1554::DEBUG::2014-04-10 17:06:55,681::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1554::DEBUG::2014-04-10 17:06:55,681::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1554::DEBUG::2014-04-10 17:06:55,681::task::974::TaskManager.Task::(_decref) Task=`7cb0542f-ac1f-4fa5-9a97-8bad3d5b8505`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:06:59,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:06:59,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345937 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:06:59,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:06:59,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256447 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:01,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:01,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000428615 s, 859 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:01,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:01,371::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000465535 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1558::DEBUG::2014-04-10 17:07:05,798::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1558::DEBUG::2014-04-10 17:07:05,799::task::579::TaskManager.Task::(_updateState) Task=`69ca9c8f-9c28-4d61-bcb0-748d71c1f1a9`::moving from state init -> state preparing
>Thread-1558::INFO::2014-04-10 17:07:05,799::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1558::INFO::2014-04-10 17:07:05,799::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1558::DEBUG::2014-04-10 17:07:05,799::task::1168::TaskManager.Task::(prepare) Task=`69ca9c8f-9c28-4d61-bcb0-748d71c1f1a9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1558::DEBUG::2014-04-10 17:07:05,800::task::579::TaskManager.Task::(_updateState) Task=`69ca9c8f-9c28-4d61-bcb0-748d71c1f1a9`::moving from state preparing -> state finished
>Thread-1558::DEBUG::2014-04-10 17:07:05,800::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1558::DEBUG::2014-04-10 17:07:05,800::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1558::DEBUG::2014-04-10 17:07:05,800::task::974::TaskManager.Task::(_decref) Task=`69ca9c8f-9c28-4d61-bcb0-748d71c1f1a9`::ref 0 aborting False
>Thread-1559::DEBUG::2014-04-10 17:07:05,807::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1559::DEBUG::2014-04-10 17:07:05,807::task::579::TaskManager.Task::(_updateState) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::moving from state init -> state preparing
>Thread-1559::INFO::2014-04-10 17:07:05,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1559::DEBUG::2014-04-10 17:07:05,808::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7924a0de-86ef-42dd-b6b6-f5fad2576ad7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1559::DEBUG::2014-04-10 17:07:05,808::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1559::DEBUG::2014-04-10 17:07:05,808::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1559::DEBUG::2014-04-10 17:07:05,808::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7924a0de-86ef-42dd-b6b6-f5fad2576ad7`::Granted request
>Thread-1559::DEBUG::2014-04-10 17:07:05,809::task::811::TaskManager.Task::(resourceAcquired) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1559::DEBUG::2014-04-10 17:07:05,809::task::974::TaskManager.Task::(_decref) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::ref 1 aborting False
>Thread-1559::INFO::2014-04-10 17:07:05,811::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1559::DEBUG::2014-04-10 17:07:05,811::task::1168::TaskManager.Task::(prepare) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1559::DEBUG::2014-04-10 17:07:05,811::task::579::TaskManager.Task::(_updateState) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::moving from state preparing -> state finished
>Thread-1559::DEBUG::2014-04-10 17:07:05,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1559::DEBUG::2014-04-10 17:07:05,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1559::DEBUG::2014-04-10 17:07:05,812::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1559::DEBUG::2014-04-10 17:07:05,812::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1559::DEBUG::2014-04-10 17:07:05,812::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1559::DEBUG::2014-04-10 17:07:05,812::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1559::DEBUG::2014-04-10 17:07:05,812::task::974::TaskManager.Task::(_decref) Task=`92b502ba-8e4c-4eb1-bc6f-326243778e55`::ref 0 aborting False
>Thread-1560::DEBUG::2014-04-10 17:07:07,093::task::579::TaskManager.Task::(_updateState) Task=`0d8490ab-639e-4e6a-976b-8042fe207dc0`::moving from state init -> state preparing
>Thread-1560::INFO::2014-04-10 17:07:07,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1560::INFO::2014-04-10 17:07:07,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465535', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345937', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256447', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428615', 'lastCheck': '5.8', 'valid': True}}
>Thread-1560::DEBUG::2014-04-10 17:07:07,094::task::1168::TaskManager.Task::(prepare) Task=`0d8490ab-639e-4e6a-976b-8042fe207dc0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465535', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345937', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256447', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428615', 'lastCheck': '5.8', 'valid': True}}
>Thread-1560::DEBUG::2014-04-10 17:07:07,094::task::579::TaskManager.Task::(_updateState) Task=`0d8490ab-639e-4e6a-976b-8042fe207dc0`::moving from state preparing -> state finished
>Thread-1560::DEBUG::2014-04-10 17:07:07,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1560::DEBUG::2014-04-10 17:07:07,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1560::DEBUG::2014-04-10 17:07:07,094::task::974::TaskManager.Task::(_decref) Task=`0d8490ab-639e-4e6a-976b-8042fe207dc0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:09,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:09,544::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028045 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:09,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:09,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300656 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:11,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:11,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000495862 s, 742 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:11,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:11,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0004307 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1564::DEBUG::2014-04-10 17:07:15,932::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1564::DEBUG::2014-04-10 17:07:15,932::task::579::TaskManager.Task::(_updateState) Task=`1ae8f652-7880-4b7a-8879-87510487cda6`::moving from state init -> state preparing
>Thread-1564::INFO::2014-04-10 17:07:15,933::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1564::INFO::2014-04-10 17:07:15,933::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1564::DEBUG::2014-04-10 17:07:15,933::task::1168::TaskManager.Task::(prepare) Task=`1ae8f652-7880-4b7a-8879-87510487cda6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1564::DEBUG::2014-04-10 17:07:15,933::task::579::TaskManager.Task::(_updateState) Task=`1ae8f652-7880-4b7a-8879-87510487cda6`::moving from state preparing -> state finished
>Thread-1564::DEBUG::2014-04-10 17:07:15,933::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1564::DEBUG::2014-04-10 17:07:15,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1564::DEBUG::2014-04-10 17:07:15,934::task::974::TaskManager.Task::(_decref) Task=`1ae8f652-7880-4b7a-8879-87510487cda6`::ref 0 aborting False
>Thread-1565::DEBUG::2014-04-10 17:07:15,941::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1565::DEBUG::2014-04-10 17:07:15,941::task::579::TaskManager.Task::(_updateState) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::moving from state init -> state preparing
>Thread-1565::INFO::2014-04-10 17:07:15,941::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1565::DEBUG::2014-04-10 17:07:15,942::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dfea273f-04e7-4b93-a217-3d896a73a595`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1565::DEBUG::2014-04-10 17:07:15,942::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1565::DEBUG::2014-04-10 17:07:15,942::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1565::DEBUG::2014-04-10 17:07:15,943::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dfea273f-04e7-4b93-a217-3d896a73a595`::Granted request
>Thread-1565::DEBUG::2014-04-10 17:07:15,943::task::811::TaskManager.Task::(resourceAcquired) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1565::DEBUG::2014-04-10 17:07:15,943::task::974::TaskManager.Task::(_decref) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::ref 1 aborting False
>Thread-1565::INFO::2014-04-10 17:07:15,945::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1565::DEBUG::2014-04-10 17:07:15,946::task::1168::TaskManager.Task::(prepare) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1565::DEBUG::2014-04-10 17:07:15,946::task::579::TaskManager.Task::(_updateState) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::moving from state preparing -> state finished
>Thread-1565::DEBUG::2014-04-10 17:07:15,946::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1565::DEBUG::2014-04-10 17:07:15,946::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1565::DEBUG::2014-04-10 17:07:15,946::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1565::DEBUG::2014-04-10 17:07:15,947::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1565::DEBUG::2014-04-10 17:07:15,947::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1565::DEBUG::2014-04-10 17:07:15,947::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1565::DEBUG::2014-04-10 17:07:15,947::task::974::TaskManager.Task::(_decref) Task=`16e15dfd-d097-416b-a68f-eefa56969436`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:19,557::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:19,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000301099 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:19,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:19,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024866 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:21,273::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:21,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000383346 s, 960 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:21,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:21,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000488215 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1568::DEBUG::2014-04-10 17:07:22,319::task::579::TaskManager.Task::(_updateState) Task=`a6d10f51-cc40-44d4-8f38-36700058bbd3`::moving from state init -> state preparing
>Thread-1568::INFO::2014-04-10 17:07:22,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1568::INFO::2014-04-10 17:07:22,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488215', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301099', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024866', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383346', 'lastCheck': '1.0', 'valid': True}}
>Thread-1568::DEBUG::2014-04-10 17:07:22,320::task::1168::TaskManager.Task::(prepare) Task=`a6d10f51-cc40-44d4-8f38-36700058bbd3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488215', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301099', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024866', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383346', 'lastCheck': '1.0', 'valid': True}}
>Thread-1568::DEBUG::2014-04-10 17:07:22,320::task::579::TaskManager.Task::(_updateState) Task=`a6d10f51-cc40-44d4-8f38-36700058bbd3`::moving from state preparing -> state finished
>Thread-1568::DEBUG::2014-04-10 17:07:22,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1568::DEBUG::2014-04-10 17:07:22,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1568::DEBUG::2014-04-10 17:07:22,320::task::974::TaskManager.Task::(_decref) Task=`a6d10f51-cc40-44d4-8f38-36700058bbd3`::ref 0 aborting False
>Thread-1571::DEBUG::2014-04-10 17:07:26,021::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1571::DEBUG::2014-04-10 17:07:26,021::task::579::TaskManager.Task::(_updateState) Task=`b3d0e7ab-7512-435b-aabc-5c754bc642ee`::moving from state init -> state preparing
>Thread-1571::INFO::2014-04-10 17:07:26,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1571::INFO::2014-04-10 17:07:26,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1571::DEBUG::2014-04-10 17:07:26,022::task::1168::TaskManager.Task::(prepare) Task=`b3d0e7ab-7512-435b-aabc-5c754bc642ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1571::DEBUG::2014-04-10 17:07:26,022::task::579::TaskManager.Task::(_updateState) Task=`b3d0e7ab-7512-435b-aabc-5c754bc642ee`::moving from state preparing -> state finished
>Thread-1571::DEBUG::2014-04-10 17:07:26,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1571::DEBUG::2014-04-10 17:07:26,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1571::DEBUG::2014-04-10 17:07:26,023::task::974::TaskManager.Task::(_decref) Task=`b3d0e7ab-7512-435b-aabc-5c754bc642ee`::ref 0 aborting False
>Thread-1572::DEBUG::2014-04-10 17:07:26,030::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1572::DEBUG::2014-04-10 17:07:26,030::task::579::TaskManager.Task::(_updateState) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::moving from state init -> state preparing
>Thread-1572::INFO::2014-04-10 17:07:26,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1572::DEBUG::2014-04-10 17:07:26,031::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d13d946f-36dd-4c69-924a-6f09cee4fead`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1572::DEBUG::2014-04-10 17:07:26,031::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1572::DEBUG::2014-04-10 17:07:26,031::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1572::DEBUG::2014-04-10 17:07:26,032::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d13d946f-36dd-4c69-924a-6f09cee4fead`::Granted request
>Thread-1572::DEBUG::2014-04-10 17:07:26,033::task::811::TaskManager.Task::(resourceAcquired) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1572::DEBUG::2014-04-10 17:07:26,033::task::974::TaskManager.Task::(_decref) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::ref 1 aborting False
>Thread-1572::INFO::2014-04-10 17:07:26,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1572::DEBUG::2014-04-10 17:07:26,036::task::1168::TaskManager.Task::(prepare) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1572::DEBUG::2014-04-10 17:07:26,036::task::579::TaskManager.Task::(_updateState) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::moving from state preparing -> state finished
>Thread-1572::DEBUG::2014-04-10 17:07:26,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1572::DEBUG::2014-04-10 17:07:26,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1572::DEBUG::2014-04-10 17:07:26,036::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1572::DEBUG::2014-04-10 17:07:26,037::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1572::DEBUG::2014-04-10 17:07:26,037::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1572::DEBUG::2014-04-10 17:07:26,037::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1572::DEBUG::2014-04-10 17:07:26,037::task::974::TaskManager.Task::(_decref) Task=`24cfe725-42cb-498e-9616-dd5dd5f409bb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:29,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:29,617::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282567 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:29,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:29,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0002547 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:31,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:31,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000441871 s, 833 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:31,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:31,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00045525 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1576::DEBUG::2014-04-10 17:07:36,144::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1576::DEBUG::2014-04-10 17:07:36,145::task::579::TaskManager.Task::(_updateState) Task=`384049fd-374c-4e2f-93dc-37a1bc1ff732`::moving from state init -> state preparing
>Thread-1576::INFO::2014-04-10 17:07:36,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1576::INFO::2014-04-10 17:07:36,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1576::DEBUG::2014-04-10 17:07:36,145::task::1168::TaskManager.Task::(prepare) Task=`384049fd-374c-4e2f-93dc-37a1bc1ff732`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1576::DEBUG::2014-04-10 17:07:36,145::task::579::TaskManager.Task::(_updateState) Task=`384049fd-374c-4e2f-93dc-37a1bc1ff732`::moving from state preparing -> state finished
>Thread-1576::DEBUG::2014-04-10 17:07:36,146::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1576::DEBUG::2014-04-10 17:07:36,146::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1576::DEBUG::2014-04-10 17:07:36,146::task::974::TaskManager.Task::(_decref) Task=`384049fd-374c-4e2f-93dc-37a1bc1ff732`::ref 0 aborting False
>Thread-1577::DEBUG::2014-04-10 17:07:36,153::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1577::DEBUG::2014-04-10 17:07:36,153::task::579::TaskManager.Task::(_updateState) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::moving from state init -> state preparing
>Thread-1577::INFO::2014-04-10 17:07:36,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1577::DEBUG::2014-04-10 17:07:36,154::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2205ef4e-0885-43af-a5ad-09e9da57c649`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1577::DEBUG::2014-04-10 17:07:36,154::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1577::DEBUG::2014-04-10 17:07:36,154::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1577::DEBUG::2014-04-10 17:07:36,154::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2205ef4e-0885-43af-a5ad-09e9da57c649`::Granted request
>Thread-1577::DEBUG::2014-04-10 17:07:36,155::task::811::TaskManager.Task::(resourceAcquired) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1577::DEBUG::2014-04-10 17:07:36,155::task::974::TaskManager.Task::(_decref) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::ref 1 aborting False
>Thread-1577::INFO::2014-04-10 17:07:36,157::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1577::DEBUG::2014-04-10 17:07:36,157::task::1168::TaskManager.Task::(prepare) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1577::DEBUG::2014-04-10 17:07:36,157::task::579::TaskManager.Task::(_updateState) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::moving from state preparing -> state finished
>Thread-1577::DEBUG::2014-04-10 17:07:36,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1577::DEBUG::2014-04-10 17:07:36,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1577::DEBUG::2014-04-10 17:07:36,158::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1577::DEBUG::2014-04-10 17:07:36,158::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1577::DEBUG::2014-04-10 17:07:36,158::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1577::DEBUG::2014-04-10 17:07:36,158::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1577::DEBUG::2014-04-10 17:07:36,158::task::974::TaskManager.Task::(_decref) Task=`faafbc1b-32c8-4e50-b38d-d6bc723ef974`::ref 0 aborting False
>Thread-1578::DEBUG::2014-04-10 17:07:37,499::task::579::TaskManager.Task::(_updateState) Task=`52936950-716a-464b-b2e5-8db2ca9d4c86`::moving from state init -> state preparing
>Thread-1578::INFO::2014-04-10 17:07:37,499::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1578::INFO::2014-04-10 17:07:37,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045525', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282567', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002547', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441871', 'lastCheck': '6.2', 'valid': True}}
>Thread-1578::DEBUG::2014-04-10 17:07:37,499::task::1168::TaskManager.Task::(prepare) Task=`52936950-716a-464b-b2e5-8db2ca9d4c86`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045525', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282567', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0002547', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441871', 'lastCheck': '6.2', 'valid': True}}
>Thread-1578::DEBUG::2014-04-10 17:07:37,499::task::579::TaskManager.Task::(_updateState) Task=`52936950-716a-464b-b2e5-8db2ca9d4c86`::moving from state preparing -> state finished
>Thread-1578::DEBUG::2014-04-10 17:07:37,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1578::DEBUG::2014-04-10 17:07:37,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1578::DEBUG::2014-04-10 17:07:37,500::task::974::TaskManager.Task::(_decref) Task=`52936950-716a-464b-b2e5-8db2ca9d4c86`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:39,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:39,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276528 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:39,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:39,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000235844 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:41,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:41,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000377986 s, 974 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:41,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:41,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000590163 s, 1.1 MB/s\n'; <rc> = 0
>Thread-1582::DEBUG::2014-04-10 17:07:46,244::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1582::DEBUG::2014-04-10 17:07:46,245::task::579::TaskManager.Task::(_updateState) Task=`e1d5c78c-cc05-4179-b34b-40f18ad6e07c`::moving from state init -> state preparing
>Thread-1582::INFO::2014-04-10 17:07:46,245::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1582::INFO::2014-04-10 17:07:46,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1582::DEBUG::2014-04-10 17:07:46,246::task::1168::TaskManager.Task::(prepare) Task=`e1d5c78c-cc05-4179-b34b-40f18ad6e07c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1582::DEBUG::2014-04-10 17:07:46,246::task::579::TaskManager.Task::(_updateState) Task=`e1d5c78c-cc05-4179-b34b-40f18ad6e07c`::moving from state preparing -> state finished
>Thread-1582::DEBUG::2014-04-10 17:07:46,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1582::DEBUG::2014-04-10 17:07:46,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1582::DEBUG::2014-04-10 17:07:46,246::task::974::TaskManager.Task::(_decref) Task=`e1d5c78c-cc05-4179-b34b-40f18ad6e07c`::ref 0 aborting False
>Thread-1583::DEBUG::2014-04-10 17:07:46,253::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1583::DEBUG::2014-04-10 17:07:46,253::task::579::TaskManager.Task::(_updateState) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::moving from state init -> state preparing
>Thread-1583::INFO::2014-04-10 17:07:46,254::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1583::DEBUG::2014-04-10 17:07:46,254::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c1f4c67-0d7d-41be-980c-abf9085d67a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1583::DEBUG::2014-04-10 17:07:46,254::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1583::DEBUG::2014-04-10 17:07:46,255::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1583::DEBUG::2014-04-10 17:07:46,255::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c1f4c67-0d7d-41be-980c-abf9085d67a3`::Granted request
>Thread-1583::DEBUG::2014-04-10 17:07:46,255::task::811::TaskManager.Task::(resourceAcquired) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1583::DEBUG::2014-04-10 17:07:46,255::task::974::TaskManager.Task::(_decref) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::ref 1 aborting False
>Thread-1583::INFO::2014-04-10 17:07:46,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1583::DEBUG::2014-04-10 17:07:46,258::task::1168::TaskManager.Task::(prepare) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1583::DEBUG::2014-04-10 17:07:46,258::task::579::TaskManager.Task::(_updateState) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::moving from state preparing -> state finished
>Thread-1583::DEBUG::2014-04-10 17:07:46,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1583::DEBUG::2014-04-10 17:07:46,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1583::DEBUG::2014-04-10 17:07:46,259::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1583::DEBUG::2014-04-10 17:07:46,259::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1583::DEBUG::2014-04-10 17:07:46,259::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1583::DEBUG::2014-04-10 17:07:46,259::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1583::DEBUG::2014-04-10 17:07:46,259::task::974::TaskManager.Task::(_decref) Task=`11c9fb68-2b2a-4598-9a08-d54bc1e24df7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:49,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:49,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371404 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:49,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:49,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239134 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:07:51,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:07:51,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000377205 s, 976 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:07:51,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:07:51,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000449594 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1586::DEBUG::2014-04-10 17:07:52,837::task::579::TaskManager.Task::(_updateState) Task=`b80ca049-29fe-41fb-b1a9-b40a8dc6a96b`::moving from state init -> state preparing
>Thread-1586::INFO::2014-04-10 17:07:52,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1586::INFO::2014-04-10 17:07:52,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449594', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371404', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239134', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377205', 'lastCheck': '1.5', 'valid': True}}
>Thread-1586::DEBUG::2014-04-10 17:07:52,838::task::1168::TaskManager.Task::(prepare) Task=`b80ca049-29fe-41fb-b1a9-b40a8dc6a96b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449594', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371404', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239134', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377205', 'lastCheck': '1.5', 'valid': True}}
>Thread-1586::DEBUG::2014-04-10 17:07:52,838::task::579::TaskManager.Task::(_updateState) Task=`b80ca049-29fe-41fb-b1a9-b40a8dc6a96b`::moving from state preparing -> state finished
>Thread-1586::DEBUG::2014-04-10 17:07:52,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1586::DEBUG::2014-04-10 17:07:52,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1586::DEBUG::2014-04-10 17:07:52,839::task::974::TaskManager.Task::(_decref) Task=`b80ca049-29fe-41fb-b1a9-b40a8dc6a96b`::ref 0 aborting False
>Thread-1589::DEBUG::2014-04-10 17:07:56,341::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1589::DEBUG::2014-04-10 17:07:56,341::task::579::TaskManager.Task::(_updateState) Task=`f39f41db-ba53-4568-a5f5-df8914ee3868`::moving from state init -> state preparing
>Thread-1589::INFO::2014-04-10 17:07:56,342::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1589::INFO::2014-04-10 17:07:56,342::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1589::DEBUG::2014-04-10 17:07:56,342::task::1168::TaskManager.Task::(prepare) Task=`f39f41db-ba53-4568-a5f5-df8914ee3868`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1589::DEBUG::2014-04-10 17:07:56,342::task::579::TaskManager.Task::(_updateState) Task=`f39f41db-ba53-4568-a5f5-df8914ee3868`::moving from state preparing -> state finished
>Thread-1589::DEBUG::2014-04-10 17:07:56,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1589::DEBUG::2014-04-10 17:07:56,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1589::DEBUG::2014-04-10 17:07:56,343::task::974::TaskManager.Task::(_decref) Task=`f39f41db-ba53-4568-a5f5-df8914ee3868`::ref 0 aborting False
>Thread-1590::DEBUG::2014-04-10 17:07:56,349::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1590::DEBUG::2014-04-10 17:07:56,350::task::579::TaskManager.Task::(_updateState) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::moving from state init -> state preparing
>Thread-1590::INFO::2014-04-10 17:07:56,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1590::DEBUG::2014-04-10 17:07:56,351::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad970759-3529-4367-9576-470a44df57ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1590::DEBUG::2014-04-10 17:07:56,351::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1590::DEBUG::2014-04-10 17:07:56,351::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1590::DEBUG::2014-04-10 17:07:56,351::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad970759-3529-4367-9576-470a44df57ae`::Granted request
>Thread-1590::DEBUG::2014-04-10 17:07:56,352::task::811::TaskManager.Task::(resourceAcquired) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1590::DEBUG::2014-04-10 17:07:56,352::task::974::TaskManager.Task::(_decref) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::ref 1 aborting False
>Thread-1590::INFO::2014-04-10 17:07:56,354::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1590::DEBUG::2014-04-10 17:07:56,354::task::1168::TaskManager.Task::(prepare) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1590::DEBUG::2014-04-10 17:07:56,354::task::579::TaskManager.Task::(_updateState) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::moving from state preparing -> state finished
>Thread-1590::DEBUG::2014-04-10 17:07:56,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1590::DEBUG::2014-04-10 17:07:56,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1590::DEBUG::2014-04-10 17:07:56,355::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1590::DEBUG::2014-04-10 17:07:56,355::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1590::DEBUG::2014-04-10 17:07:56,355::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1590::DEBUG::2014-04-10 17:07:56,356::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1590::DEBUG::2014-04-10 17:07:56,356::task::974::TaskManager.Task::(_decref) Task=`32a2b685-362b-481e-abb4-3164aecb7696`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:07:59,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:07:59,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269413 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:07:59,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:07:59,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263708 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:01,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:01,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476477 s, 772 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:01,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:01,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000436728 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1594::DEBUG::2014-04-10 17:08:06,432::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1594::DEBUG::2014-04-10 17:08:06,440::task::579::TaskManager.Task::(_updateState) Task=`31215fc4-176a-4f9c-8e32-2108c2f00b51`::moving from state init -> state preparing
>Thread-1594::INFO::2014-04-10 17:08:06,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1594::INFO::2014-04-10 17:08:06,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1594::DEBUG::2014-04-10 17:08:06,441::task::1168::TaskManager.Task::(prepare) Task=`31215fc4-176a-4f9c-8e32-2108c2f00b51`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1594::DEBUG::2014-04-10 17:08:06,441::task::579::TaskManager.Task::(_updateState) Task=`31215fc4-176a-4f9c-8e32-2108c2f00b51`::moving from state preparing -> state finished
>Thread-1594::DEBUG::2014-04-10 17:08:06,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1594::DEBUG::2014-04-10 17:08:06,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1594::DEBUG::2014-04-10 17:08:06,442::task::974::TaskManager.Task::(_decref) Task=`31215fc4-176a-4f9c-8e32-2108c2f00b51`::ref 0 aborting False
>Thread-1595::DEBUG::2014-04-10 17:08:06,449::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1595::DEBUG::2014-04-10 17:08:06,449::task::579::TaskManager.Task::(_updateState) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::moving from state init -> state preparing
>Thread-1595::INFO::2014-04-10 17:08:06,450::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1595::DEBUG::2014-04-10 17:08:06,450::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`30447055-70c9-4e02-849e-07688eb9c809`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1595::DEBUG::2014-04-10 17:08:06,450::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1595::DEBUG::2014-04-10 17:08:06,450::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1595::DEBUG::2014-04-10 17:08:06,451::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`30447055-70c9-4e02-849e-07688eb9c809`::Granted request
>Thread-1595::DEBUG::2014-04-10 17:08:06,452::task::811::TaskManager.Task::(resourceAcquired) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1595::DEBUG::2014-04-10 17:08:06,452::task::974::TaskManager.Task::(_decref) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::ref 1 aborting False
>Thread-1595::INFO::2014-04-10 17:08:06,454::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1595::DEBUG::2014-04-10 17:08:06,454::task::1168::TaskManager.Task::(prepare) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1595::DEBUG::2014-04-10 17:08:06,454::task::579::TaskManager.Task::(_updateState) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::moving from state preparing -> state finished
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1595::DEBUG::2014-04-10 17:08:06,455::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1595::DEBUG::2014-04-10 17:08:06,456::task::974::TaskManager.Task::(_decref) Task=`9d421a5a-bf4a-46bc-8f22-a328d2bee381`::ref 0 aborting False
>Thread-1596::DEBUG::2014-04-10 17:08:07,992::task::579::TaskManager.Task::(_updateState) Task=`946da4a7-15fe-4592-9e36-4195b24a68da`::moving from state init -> state preparing
>Thread-1596::INFO::2014-04-10 17:08:07,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1596::INFO::2014-04-10 17:08:07,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436728', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269413', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263708', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476477', 'lastCheck': '6.6', 'valid': True}}
>Thread-1596::DEBUG::2014-04-10 17:08:07,992::task::1168::TaskManager.Task::(prepare) Task=`946da4a7-15fe-4592-9e36-4195b24a68da`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436728', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269413', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263708', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476477', 'lastCheck': '6.6', 'valid': True}}
>Thread-1596::DEBUG::2014-04-10 17:08:07,993::task::579::TaskManager.Task::(_updateState) Task=`946da4a7-15fe-4592-9e36-4195b24a68da`::moving from state preparing -> state finished
>Thread-1596::DEBUG::2014-04-10 17:08:07,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1596::DEBUG::2014-04-10 17:08:07,993::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1596::DEBUG::2014-04-10 17:08:07,993::task::974::TaskManager.Task::(_decref) Task=`946da4a7-15fe-4592-9e36-4195b24a68da`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:09,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:09,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261368 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:09,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:09,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248149 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:11,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:11,406::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000418497 s, 879 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:11,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:11,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000489056 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1600::DEBUG::2014-04-10 17:08:16,539::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1600::DEBUG::2014-04-10 17:08:16,547::task::579::TaskManager.Task::(_updateState) Task=`35b95d84-8165-4abd-95e0-ef07c2295384`::moving from state init -> state preparing
>Thread-1600::INFO::2014-04-10 17:08:16,547::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1600::INFO::2014-04-10 17:08:16,547::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1600::DEBUG::2014-04-10 17:08:16,547::task::1168::TaskManager.Task::(prepare) Task=`35b95d84-8165-4abd-95e0-ef07c2295384`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1600::DEBUG::2014-04-10 17:08:16,548::task::579::TaskManager.Task::(_updateState) Task=`35b95d84-8165-4abd-95e0-ef07c2295384`::moving from state preparing -> state finished
>Thread-1600::DEBUG::2014-04-10 17:08:16,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1600::DEBUG::2014-04-10 17:08:16,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1600::DEBUG::2014-04-10 17:08:16,548::task::974::TaskManager.Task::(_decref) Task=`35b95d84-8165-4abd-95e0-ef07c2295384`::ref 0 aborting False
>Thread-1601::DEBUG::2014-04-10 17:08:16,555::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1601::DEBUG::2014-04-10 17:08:16,555::task::579::TaskManager.Task::(_updateState) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::moving from state init -> state preparing
>Thread-1601::INFO::2014-04-10 17:08:16,556::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1601::DEBUG::2014-04-10 17:08:16,556::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84d5609c-f5e9-4c4a-a78d-d785bd1bcb32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1601::DEBUG::2014-04-10 17:08:16,556::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1601::DEBUG::2014-04-10 17:08:16,557::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1601::DEBUG::2014-04-10 17:08:16,557::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84d5609c-f5e9-4c4a-a78d-d785bd1bcb32`::Granted request
>Thread-1601::DEBUG::2014-04-10 17:08:16,557::task::811::TaskManager.Task::(resourceAcquired) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1601::DEBUG::2014-04-10 17:08:16,557::task::974::TaskManager.Task::(_decref) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::ref 1 aborting False
>Thread-1601::INFO::2014-04-10 17:08:16,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1601::DEBUG::2014-04-10 17:08:16,560::task::1168::TaskManager.Task::(prepare) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1601::DEBUG::2014-04-10 17:08:16,560::task::579::TaskManager.Task::(_updateState) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::moving from state preparing -> state finished
>Thread-1601::DEBUG::2014-04-10 17:08:16,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1601::DEBUG::2014-04-10 17:08:16,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1601::DEBUG::2014-04-10 17:08:16,561::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1601::DEBUG::2014-04-10 17:08:16,561::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1601::DEBUG::2014-04-10 17:08:16,561::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1601::DEBUG::2014-04-10 17:08:16,561::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1601::DEBUG::2014-04-10 17:08:16,561::task::974::TaskManager.Task::(_decref) Task=`f3eae3a3-193a-4bce-814f-26a34eedf686`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:19,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:19,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000257443 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:19,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:19,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000230337 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:21,413::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:21,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000359134 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:21,494::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:08:21,507::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:08:21,508::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:08:21,514::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:08:21,515::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:08:21,516::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:08:21,516::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:08:21,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:21,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000378517 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1608::DEBUG::2014-04-10 17:08:23,185::task::579::TaskManager.Task::(_updateState) Task=`ebacfa28-4ebf-4520-8840-4dbd021b671a`::moving from state init -> state preparing
>Thread-1608::INFO::2014-04-10 17:08:23,185::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1608::INFO::2014-04-10 17:08:23,185::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378517', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257443', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000230337', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359134', 'lastCheck': '1.8', 'valid': True}}
>Thread-1608::DEBUG::2014-04-10 17:08:23,186::task::1168::TaskManager.Task::(prepare) Task=`ebacfa28-4ebf-4520-8840-4dbd021b671a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378517', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257443', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000230337', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359134', 'lastCheck': '1.8', 'valid': True}}
>Thread-1608::DEBUG::2014-04-10 17:08:23,186::task::579::TaskManager.Task::(_updateState) Task=`ebacfa28-4ebf-4520-8840-4dbd021b671a`::moving from state preparing -> state finished
>Thread-1608::DEBUG::2014-04-10 17:08:23,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1608::DEBUG::2014-04-10 17:08:23,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1608::DEBUG::2014-04-10 17:08:23,186::task::974::TaskManager.Task::(_decref) Task=`ebacfa28-4ebf-4520-8840-4dbd021b671a`::ref 0 aborting False
>Thread-1611::DEBUG::2014-04-10 17:08:26,729::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1611::DEBUG::2014-04-10 17:08:26,729::task::579::TaskManager.Task::(_updateState) Task=`daeda75a-8f61-4bf4-b319-616179d1633d`::moving from state init -> state preparing
>Thread-1611::INFO::2014-04-10 17:08:26,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1611::INFO::2014-04-10 17:08:26,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1611::DEBUG::2014-04-10 17:08:26,730::task::1168::TaskManager.Task::(prepare) Task=`daeda75a-8f61-4bf4-b319-616179d1633d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1611::DEBUG::2014-04-10 17:08:26,730::task::579::TaskManager.Task::(_updateState) Task=`daeda75a-8f61-4bf4-b319-616179d1633d`::moving from state preparing -> state finished
>Thread-1611::DEBUG::2014-04-10 17:08:26,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1611::DEBUG::2014-04-10 17:08:26,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1611::DEBUG::2014-04-10 17:08:26,731::task::974::TaskManager.Task::(_decref) Task=`daeda75a-8f61-4bf4-b319-616179d1633d`::ref 0 aborting False
>Thread-1612::DEBUG::2014-04-10 17:08:26,737::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1612::DEBUG::2014-04-10 17:08:26,737::task::579::TaskManager.Task::(_updateState) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::moving from state init -> state preparing
>Thread-1612::INFO::2014-04-10 17:08:26,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1612::DEBUG::2014-04-10 17:08:26,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b771bd4-5afa-4eaa-8d34-ca5ae1b840eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1612::DEBUG::2014-04-10 17:08:26,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1612::DEBUG::2014-04-10 17:08:26,739::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1612::DEBUG::2014-04-10 17:08:26,739::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b771bd4-5afa-4eaa-8d34-ca5ae1b840eb`::Granted request
>Thread-1612::DEBUG::2014-04-10 17:08:26,739::task::811::TaskManager.Task::(resourceAcquired) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1612::DEBUG::2014-04-10 17:08:26,739::task::974::TaskManager.Task::(_decref) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::ref 1 aborting False
>Thread-1612::INFO::2014-04-10 17:08:26,741::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1612::DEBUG::2014-04-10 17:08:26,741::task::1168::TaskManager.Task::(prepare) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::task::579::TaskManager.Task::(_updateState) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::moving from state preparing -> state finished
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1612::DEBUG::2014-04-10 17:08:26,742::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1612::DEBUG::2014-04-10 17:08:26,743::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1612::DEBUG::2014-04-10 17:08:26,743::task::974::TaskManager.Task::(_decref) Task=`345c97d5-ea3e-43e6-b47c-c2499ea643ba`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:29,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:29,838::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272798 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:29,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:29,855::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000253301 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:31,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:31,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000507696 s, 725 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:31,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:31,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000548096 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1616::DEBUG::2014-04-10 17:08:36,836::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1616::DEBUG::2014-04-10 17:08:36,836::task::579::TaskManager.Task::(_updateState) Task=`6384c545-5fe4-4b23-ae09-d9036a0f4cd3`::moving from state init -> state preparing
>Thread-1616::INFO::2014-04-10 17:08:36,837::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1616::INFO::2014-04-10 17:08:36,837::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1616::DEBUG::2014-04-10 17:08:36,837::task::1168::TaskManager.Task::(prepare) Task=`6384c545-5fe4-4b23-ae09-d9036a0f4cd3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1616::DEBUG::2014-04-10 17:08:36,837::task::579::TaskManager.Task::(_updateState) Task=`6384c545-5fe4-4b23-ae09-d9036a0f4cd3`::moving from state preparing -> state finished
>Thread-1616::DEBUG::2014-04-10 17:08:36,838::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1616::DEBUG::2014-04-10 17:08:36,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1616::DEBUG::2014-04-10 17:08:36,838::task::974::TaskManager.Task::(_decref) Task=`6384c545-5fe4-4b23-ae09-d9036a0f4cd3`::ref 0 aborting False
>Thread-1617::DEBUG::2014-04-10 17:08:36,844::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1617::DEBUG::2014-04-10 17:08:36,845::task::579::TaskManager.Task::(_updateState) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::moving from state init -> state preparing
>Thread-1617::INFO::2014-04-10 17:08:36,845::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1617::DEBUG::2014-04-10 17:08:36,845::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`05b84d75-9b5f-4c7a-be9f-cc45c33fbba7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1617::DEBUG::2014-04-10 17:08:36,845::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1617::DEBUG::2014-04-10 17:08:36,846::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1617::DEBUG::2014-04-10 17:08:36,846::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`05b84d75-9b5f-4c7a-be9f-cc45c33fbba7`::Granted request
>Thread-1617::DEBUG::2014-04-10 17:08:36,846::task::811::TaskManager.Task::(resourceAcquired) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1617::DEBUG::2014-04-10 17:08:36,846::task::974::TaskManager.Task::(_decref) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::ref 1 aborting False
>Thread-1617::INFO::2014-04-10 17:08:36,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1617::DEBUG::2014-04-10 17:08:36,848::task::1168::TaskManager.Task::(prepare) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::task::579::TaskManager.Task::(_updateState) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::moving from state preparing -> state finished
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1617::DEBUG::2014-04-10 17:08:36,849::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1617::DEBUG::2014-04-10 17:08:36,850::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1617::DEBUG::2014-04-10 17:08:36,850::task::974::TaskManager.Task::(_decref) Task=`4c8b4abc-a4e8-4acc-9e86-9d55d35a1335`::ref 0 aborting False
>Thread-1618::DEBUG::2014-04-10 17:08:38,354::task::579::TaskManager.Task::(_updateState) Task=`4261d0ac-5c99-4dc1-963a-3bacf49ee3ed`::moving from state init -> state preparing
>Thread-1618::INFO::2014-04-10 17:08:38,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1618::INFO::2014-04-10 17:08:38,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548096', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272798', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253301', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507696', 'lastCheck': '6.9', 'valid': True}}
>Thread-1618::DEBUG::2014-04-10 17:08:38,354::task::1168::TaskManager.Task::(prepare) Task=`4261d0ac-5c99-4dc1-963a-3bacf49ee3ed`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548096', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272798', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253301', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507696', 'lastCheck': '6.9', 'valid': True}}
>Thread-1618::DEBUG::2014-04-10 17:08:38,355::task::579::TaskManager.Task::(_updateState) Task=`4261d0ac-5c99-4dc1-963a-3bacf49ee3ed`::moving from state preparing -> state finished
>Thread-1618::DEBUG::2014-04-10 17:08:38,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1618::DEBUG::2014-04-10 17:08:38,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1618::DEBUG::2014-04-10 17:08:38,355::task::974::TaskManager.Task::(_decref) Task=`4261d0ac-5c99-4dc1-963a-3bacf49ee3ed`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:39,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:39,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333176 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:39,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:39,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250829 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:41,458::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:41,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000371828 s, 990 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:41,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:41,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468778 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1622::DEBUG::2014-04-10 17:08:46,926::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1622::DEBUG::2014-04-10 17:08:46,935::task::579::TaskManager.Task::(_updateState) Task=`654b5438-0c2b-47cc-bd03-7b028cf31f6b`::moving from state init -> state preparing
>Thread-1622::INFO::2014-04-10 17:08:46,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1622::INFO::2014-04-10 17:08:46,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1622::DEBUG::2014-04-10 17:08:46,936::task::1168::TaskManager.Task::(prepare) Task=`654b5438-0c2b-47cc-bd03-7b028cf31f6b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1622::DEBUG::2014-04-10 17:08:46,936::task::579::TaskManager.Task::(_updateState) Task=`654b5438-0c2b-47cc-bd03-7b028cf31f6b`::moving from state preparing -> state finished
>Thread-1622::DEBUG::2014-04-10 17:08:46,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1622::DEBUG::2014-04-10 17:08:46,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1622::DEBUG::2014-04-10 17:08:46,937::task::974::TaskManager.Task::(_decref) Task=`654b5438-0c2b-47cc-bd03-7b028cf31f6b`::ref 0 aborting False
>Thread-1623::DEBUG::2014-04-10 17:08:46,944::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-1623::DEBUG::2014-04-10 17:08:46,945::task::579::TaskManager.Task::(_updateState) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::moving from state init -> state preparing
>Thread-1623::INFO::2014-04-10 17:08:46,945::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1623::DEBUG::2014-04-10 17:08:46,945::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf99d7b4-9327-4dd1-9b1e-a7fdaf9eb505`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1623::DEBUG::2014-04-10 17:08:46,945::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1623::DEBUG::2014-04-10 17:08:46,946::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1623::DEBUG::2014-04-10 17:08:46,946::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf99d7b4-9327-4dd1-9b1e-a7fdaf9eb505`::Granted request
>Thread-1623::DEBUG::2014-04-10 17:08:46,947::task::811::TaskManager.Task::(resourceAcquired) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1623::DEBUG::2014-04-10 17:08:46,948::task::974::TaskManager.Task::(_decref) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::ref 1 aborting False
>Thread-1623::INFO::2014-04-10 17:08:46,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1623::DEBUG::2014-04-10 17:08:46,950::task::1168::TaskManager.Task::(prepare) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1623::DEBUG::2014-04-10 17:08:46,950::task::579::TaskManager.Task::(_updateState) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::moving from state preparing -> state finished
>Thread-1623::DEBUG::2014-04-10 17:08:46,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1623::DEBUG::2014-04-10 17:08:46,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1623::DEBUG::2014-04-10 17:08:46,951::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1623::DEBUG::2014-04-10 17:08:46,951::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1623::DEBUG::2014-04-10 17:08:46,952::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1623::DEBUG::2014-04-10 17:08:46,952::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1623::DEBUG::2014-04-10 17:08:46,952::task::974::TaskManager.Task::(_decref) Task=`c7d8fad8-b8b7-48ec-899b-30160c618691`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:49,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:49,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297559 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:49,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:49,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295149 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:08:51,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:08:51,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000514403 s, 715 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:08:51,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:08:51,570::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000545347 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1626::DEBUG::2014-04-10 17:08:53,522::task::579::TaskManager.Task::(_updateState) Task=`2e94c772-ea94-4493-ab33-2d0557e00238`::moving from state init -> state preparing
>Thread-1626::INFO::2014-04-10 17:08:53,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1626::INFO::2014-04-10 17:08:53,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545347', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297559', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295149', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514403', 'lastCheck': '2.0', 'valid': True}}
>Thread-1626::DEBUG::2014-04-10 17:08:53,522::task::1168::TaskManager.Task::(prepare) Task=`2e94c772-ea94-4493-ab33-2d0557e00238`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545347', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297559', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295149', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514403', 'lastCheck': '2.0', 'valid': True}}
>Thread-1626::DEBUG::2014-04-10 17:08:53,523::task::579::TaskManager.Task::(_updateState) Task=`2e94c772-ea94-4493-ab33-2d0557e00238`::moving from state preparing -> state finished
>Thread-1626::DEBUG::2014-04-10 17:08:53,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1626::DEBUG::2014-04-10 17:08:53,523::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1626::DEBUG::2014-04-10 17:08:53,523::task::974::TaskManager.Task::(_decref) Task=`2e94c772-ea94-4493-ab33-2d0557e00238`::ref 0 aborting False
>Thread-1629::DEBUG::2014-04-10 17:08:57,039::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-1629::DEBUG::2014-04-10 17:08:57,039::task::579::TaskManager.Task::(_updateState) Task=`152ad2a3-ef9c-49c8-91a8-4f633e0ebf08`::moving from state init -> state preparing
>Thread-1629::INFO::2014-04-10 17:08:57,040::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1629::INFO::2014-04-10 17:08:57,040::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1629::DEBUG::2014-04-10 17:08:57,040::task::1168::TaskManager.Task::(prepare) Task=`152ad2a3-ef9c-49c8-91a8-4f633e0ebf08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1629::DEBUG::2014-04-10 17:08:57,040::task::579::TaskManager.Task::(_updateState) Task=`152ad2a3-ef9c-49c8-91a8-4f633e0ebf08`::moving from state preparing -> state finished
>Thread-1629::DEBUG::2014-04-10 17:08:57,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1629::DEBUG::2014-04-10 17:08:57,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1629::DEBUG::2014-04-10 17:08:57,041::task::974::TaskManager.Task::(_decref) Task=`152ad2a3-ef9c-49c8-91a8-4f633e0ebf08`::ref 0 aborting False
>Thread-1630::DEBUG::2014-04-10 17:08:57,047::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-1630::DEBUG::2014-04-10 17:08:57,048::task::579::TaskManager.Task::(_updateState) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::moving from state init -> state preparing
>Thread-1630::INFO::2014-04-10 17:08:57,048::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1630::DEBUG::2014-04-10 17:08:57,048::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`041a16d0-9320-4df4-ba0b-34770cf2d00a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1630::DEBUG::2014-04-10 17:08:57,049::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1630::DEBUG::2014-04-10 17:08:57,049::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1630::DEBUG::2014-04-10 17:08:57,049::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`041a16d0-9320-4df4-ba0b-34770cf2d00a`::Granted request
>Thread-1630::DEBUG::2014-04-10 17:08:57,049::task::811::TaskManager.Task::(resourceAcquired) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1630::DEBUG::2014-04-10 17:08:57,049::task::974::TaskManager.Task::(_decref) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::ref 1 aborting False
>Thread-1630::INFO::2014-04-10 17:08:57,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::task::1168::TaskManager.Task::(prepare) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::task::579::TaskManager.Task::(_updateState) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::moving from state preparing -> state finished
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1630::DEBUG::2014-04-10 17:08:57,052::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1630::DEBUG::2014-04-10 17:08:57,053::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1630::DEBUG::2014-04-10 17:08:57,053::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1630::DEBUG::2014-04-10 17:08:57,053::task::974::TaskManager.Task::(_decref) Task=`9b1b5323-e1d0-4eff-a15b-5782c9744df2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:08:59,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:08:59,936::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345378 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:08:59,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:08:59,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303258 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:01,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:01,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456531 s, 806 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:01,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:01,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000562393 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1634::DEBUG::2014-04-10 17:09:07,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1634::DEBUG::2014-04-10 17:09:07,131::task::579::TaskManager.Task::(_updateState) Task=`d4010686-a9c7-40c0-869e-f18c9a997af4`::moving from state init -> state preparing
>Thread-1634::INFO::2014-04-10 17:09:07,131::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1634::INFO::2014-04-10 17:09:07,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1634::DEBUG::2014-04-10 17:09:07,132::task::1168::TaskManager.Task::(prepare) Task=`d4010686-a9c7-40c0-869e-f18c9a997af4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1634::DEBUG::2014-04-10 17:09:07,132::task::579::TaskManager.Task::(_updateState) Task=`d4010686-a9c7-40c0-869e-f18c9a997af4`::moving from state preparing -> state finished
>Thread-1634::DEBUG::2014-04-10 17:09:07,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1634::DEBUG::2014-04-10 17:09:07,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1634::DEBUG::2014-04-10 17:09:07,132::task::974::TaskManager.Task::(_decref) Task=`d4010686-a9c7-40c0-869e-f18c9a997af4`::ref 0 aborting False
>Thread-1635::DEBUG::2014-04-10 17:09:07,138::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1635::DEBUG::2014-04-10 17:09:07,139::task::579::TaskManager.Task::(_updateState) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::moving from state init -> state preparing
>Thread-1635::INFO::2014-04-10 17:09:07,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1635::DEBUG::2014-04-10 17:09:07,139::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3ae358b-50dc-444a-a08e-ae43ad2a2da1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1635::DEBUG::2014-04-10 17:09:07,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1635::DEBUG::2014-04-10 17:09:07,140::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1635::DEBUG::2014-04-10 17:09:07,140::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3ae358b-50dc-444a-a08e-ae43ad2a2da1`::Granted request
>Thread-1635::DEBUG::2014-04-10 17:09:07,140::task::811::TaskManager.Task::(resourceAcquired) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1635::DEBUG::2014-04-10 17:09:07,140::task::974::TaskManager.Task::(_decref) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::ref 1 aborting False
>Thread-1635::INFO::2014-04-10 17:09:07,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::task::1168::TaskManager.Task::(prepare) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::task::579::TaskManager.Task::(_updateState) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::moving from state preparing -> state finished
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1635::DEBUG::2014-04-10 17:09:07,143::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1635::DEBUG::2014-04-10 17:09:07,144::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1635::DEBUG::2014-04-10 17:09:07,144::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1635::DEBUG::2014-04-10 17:09:07,144::task::974::TaskManager.Task::(_decref) Task=`b236f126-4aa3-44f5-9fa7-8f4321ee54f2`::ref 0 aborting False
>Thread-1636::DEBUG::2014-04-10 17:09:08,675::task::579::TaskManager.Task::(_updateState) Task=`e9e777b9-534b-4014-b046-d64f33144e87`::moving from state init -> state preparing
>Thread-1636::INFO::2014-04-10 17:09:08,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1636::INFO::2014-04-10 17:09:08,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562393', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345378', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303258', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456531', 'lastCheck': '7.2', 'valid': True}}
>Thread-1636::DEBUG::2014-04-10 17:09:08,675::task::1168::TaskManager.Task::(prepare) Task=`e9e777b9-534b-4014-b046-d64f33144e87`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562393', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345378', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303258', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456531', 'lastCheck': '7.2', 'valid': True}}
>Thread-1636::DEBUG::2014-04-10 17:09:08,675::task::579::TaskManager.Task::(_updateState) Task=`e9e777b9-534b-4014-b046-d64f33144e87`::moving from state preparing -> state finished
>Thread-1636::DEBUG::2014-04-10 17:09:08,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1636::DEBUG::2014-04-10 17:09:08,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1636::DEBUG::2014-04-10 17:09:08,676::task::974::TaskManager.Task::(_decref) Task=`e9e777b9-534b-4014-b046-d64f33144e87`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:09:09,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:09:09,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242476 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:09:09,976::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:09:09,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000258094 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:11,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:11,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000434195 s, 848 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:11,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:11,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000503644 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1640::DEBUG::2014-04-10 17:09:17,231::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1640::DEBUG::2014-04-10 17:09:17,232::task::579::TaskManager.Task::(_updateState) Task=`d1f05f5f-1930-4f84-8943-3b942a26af32`::moving from state init -> state preparing
>Thread-1640::INFO::2014-04-10 17:09:17,232::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1640::INFO::2014-04-10 17:09:17,232::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1640::DEBUG::2014-04-10 17:09:17,232::task::1168::TaskManager.Task::(prepare) Task=`d1f05f5f-1930-4f84-8943-3b942a26af32`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1640::DEBUG::2014-04-10 17:09:17,233::task::579::TaskManager.Task::(_updateState) Task=`d1f05f5f-1930-4f84-8943-3b942a26af32`::moving from state preparing -> state finished
>Thread-1640::DEBUG::2014-04-10 17:09:17,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1640::DEBUG::2014-04-10 17:09:17,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1640::DEBUG::2014-04-10 17:09:17,233::task::974::TaskManager.Task::(_decref) Task=`d1f05f5f-1930-4f84-8943-3b942a26af32`::ref 0 aborting False
>Thread-1641::DEBUG::2014-04-10 17:09:17,240::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1641::DEBUG::2014-04-10 17:09:17,240::task::579::TaskManager.Task::(_updateState) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::moving from state init -> state preparing
>Thread-1641::INFO::2014-04-10 17:09:17,241::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1641::DEBUG::2014-04-10 17:09:17,241::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`129ff84a-e91b-4cd0-b599-ea28ff3231c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1641::DEBUG::2014-04-10 17:09:17,241::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1641::DEBUG::2014-04-10 17:09:17,242::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1641::DEBUG::2014-04-10 17:09:17,242::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`129ff84a-e91b-4cd0-b599-ea28ff3231c3`::Granted request
>Thread-1641::DEBUG::2014-04-10 17:09:17,242::task::811::TaskManager.Task::(resourceAcquired) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1641::DEBUG::2014-04-10 17:09:17,242::task::974::TaskManager.Task::(_decref) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::ref 1 aborting False
>Thread-1641::INFO::2014-04-10 17:09:17,245::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1641::DEBUG::2014-04-10 17:09:17,245::task::1168::TaskManager.Task::(prepare) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1641::DEBUG::2014-04-10 17:09:17,245::task::579::TaskManager.Task::(_updateState) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::moving from state preparing -> state finished
>Thread-1641::DEBUG::2014-04-10 17:09:17,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1641::DEBUG::2014-04-10 17:09:17,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1641::DEBUG::2014-04-10 17:09:17,246::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1641::DEBUG::2014-04-10 17:09:17,246::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1641::DEBUG::2014-04-10 17:09:17,246::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1641::DEBUG::2014-04-10 17:09:17,246::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1641::DEBUG::2014-04-10 17:09:17,246::task::974::TaskManager.Task::(_decref) Task=`a7240ba7-734d-49f3-9d0c-fe394d4d544d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:09:19,977::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:09:19,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026897 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:09:20,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:09:20,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00023785 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:21,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:21,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444433 s, 828 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:21,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:21,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000447679 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1644::DEBUG::2014-04-10 17:09:23,827::task::579::TaskManager.Task::(_updateState) Task=`137fcc66-4511-4871-9046-2891aa26b12b`::moving from state init -> state preparing
>Thread-1644::INFO::2014-04-10 17:09:23,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1644::INFO::2014-04-10 17:09:23,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447679', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026897', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023785', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444433', 'lastCheck': '2.3', 'valid': True}}
>Thread-1644::DEBUG::2014-04-10 17:09:23,828::task::1168::TaskManager.Task::(prepare) Task=`137fcc66-4511-4871-9046-2891aa26b12b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447679', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026897', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023785', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444433', 'lastCheck': '2.3', 'valid': True}}
>Thread-1644::DEBUG::2014-04-10 17:09:23,828::task::579::TaskManager.Task::(_updateState) Task=`137fcc66-4511-4871-9046-2891aa26b12b`::moving from state preparing -> state finished
>Thread-1644::DEBUG::2014-04-10 17:09:23,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1644::DEBUG::2014-04-10 17:09:23,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1644::DEBUG::2014-04-10 17:09:23,829::task::974::TaskManager.Task::(_decref) Task=`137fcc66-4511-4871-9046-2891aa26b12b`::ref 0 aborting False
>Thread-1647::DEBUG::2014-04-10 17:09:27,328::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1647::DEBUG::2014-04-10 17:09:27,328::task::579::TaskManager.Task::(_updateState) Task=`6bafb5aa-e494-4360-bcc5-eb3e0ecd8f68`::moving from state init -> state preparing
>Thread-1647::INFO::2014-04-10 17:09:27,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1647::INFO::2014-04-10 17:09:27,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1647::DEBUG::2014-04-10 17:09:27,329::task::1168::TaskManager.Task::(prepare) Task=`6bafb5aa-e494-4360-bcc5-eb3e0ecd8f68`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1647::DEBUG::2014-04-10 17:09:27,329::task::579::TaskManager.Task::(_updateState) Task=`6bafb5aa-e494-4360-bcc5-eb3e0ecd8f68`::moving from state preparing -> state finished
>Thread-1647::DEBUG::2014-04-10 17:09:27,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1647::DEBUG::2014-04-10 17:09:27,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1647::DEBUG::2014-04-10 17:09:27,330::task::974::TaskManager.Task::(_decref) Task=`6bafb5aa-e494-4360-bcc5-eb3e0ecd8f68`::ref 0 aborting False
>Thread-1648::DEBUG::2014-04-10 17:09:27,336::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1648::DEBUG::2014-04-10 17:09:27,336::task::579::TaskManager.Task::(_updateState) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::moving from state init -> state preparing
>Thread-1648::INFO::2014-04-10 17:09:27,337::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1648::DEBUG::2014-04-10 17:09:27,337::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`118128b1-b2ba-479b-aad6-e11765c144e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1648::DEBUG::2014-04-10 17:09:27,337::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1648::DEBUG::2014-04-10 17:09:27,338::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1648::DEBUG::2014-04-10 17:09:27,338::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`118128b1-b2ba-479b-aad6-e11765c144e3`::Granted request
>Thread-1648::DEBUG::2014-04-10 17:09:27,339::task::811::TaskManager.Task::(resourceAcquired) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1648::DEBUG::2014-04-10 17:09:27,339::task::974::TaskManager.Task::(_decref) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::ref 1 aborting False
>Thread-1648::INFO::2014-04-10 17:09:27,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1648::DEBUG::2014-04-10 17:09:27,341::task::1168::TaskManager.Task::(prepare) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::task::579::TaskManager.Task::(_updateState) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::moving from state preparing -> state finished
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1648::DEBUG::2014-04-10 17:09:27,342::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1648::DEBUG::2014-04-10 17:09:27,343::task::974::TaskManager.Task::(_decref) Task=`31a26274-eb0d-402d-8a53-722b9e4f9aa3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:09:30,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:09:30,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259107 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:09:30,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:09:30,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240354 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:31,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:31,586::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000372787 s, 987 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:31,623::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:31,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475811 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1652::DEBUG::2014-04-10 17:09:37,435::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1652::DEBUG::2014-04-10 17:09:37,436::task::579::TaskManager.Task::(_updateState) Task=`ff4c7366-ff2d-4e35-b707-4b3114a28754`::moving from state init -> state preparing
>Thread-1652::INFO::2014-04-10 17:09:37,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1652::INFO::2014-04-10 17:09:37,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1652::DEBUG::2014-04-10 17:09:37,436::task::1168::TaskManager.Task::(prepare) Task=`ff4c7366-ff2d-4e35-b707-4b3114a28754`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1652::DEBUG::2014-04-10 17:09:37,437::task::579::TaskManager.Task::(_updateState) Task=`ff4c7366-ff2d-4e35-b707-4b3114a28754`::moving from state preparing -> state finished
>Thread-1652::DEBUG::2014-04-10 17:09:37,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1652::DEBUG::2014-04-10 17:09:37,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1652::DEBUG::2014-04-10 17:09:37,437::task::974::TaskManager.Task::(_decref) Task=`ff4c7366-ff2d-4e35-b707-4b3114a28754`::ref 0 aborting False
>Thread-1653::DEBUG::2014-04-10 17:09:37,444::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1653::DEBUG::2014-04-10 17:09:37,444::task::579::TaskManager.Task::(_updateState) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::moving from state init -> state preparing
>Thread-1653::INFO::2014-04-10 17:09:37,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1653::DEBUG::2014-04-10 17:09:37,444::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8ba245d4-b7f6-4f8f-8867-d7123984c3dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1653::DEBUG::2014-04-10 17:09:37,445::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1653::DEBUG::2014-04-10 17:09:37,445::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1653::DEBUG::2014-04-10 17:09:37,445::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8ba245d4-b7f6-4f8f-8867-d7123984c3dc`::Granted request
>Thread-1653::DEBUG::2014-04-10 17:09:37,445::task::811::TaskManager.Task::(resourceAcquired) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1653::DEBUG::2014-04-10 17:09:37,446::task::974::TaskManager.Task::(_decref) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::ref 1 aborting False
>Thread-1653::INFO::2014-04-10 17:09:37,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::task::1168::TaskManager.Task::(prepare) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::task::579::TaskManager.Task::(_updateState) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::moving from state preparing -> state finished
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1653::DEBUG::2014-04-10 17:09:37,448::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1653::DEBUG::2014-04-10 17:09:37,449::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1653::DEBUG::2014-04-10 17:09:37,449::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1653::DEBUG::2014-04-10 17:09:37,449::task::974::TaskManager.Task::(_decref) Task=`1ca67249-8e9a-41a9-9720-e7c14d3da94c`::ref 0 aborting False
>Thread-1654::DEBUG::2014-04-10 17:09:38,996::task::579::TaskManager.Task::(_updateState) Task=`8e6d1286-a89b-45b7-beda-4b7829970cea`::moving from state init -> state preparing
>Thread-1654::INFO::2014-04-10 17:09:38,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1654::INFO::2014-04-10 17:09:38,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475811', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259107', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240354', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372787', 'lastCheck': '7.4', 'valid': True}}
>Thread-1654::DEBUG::2014-04-10 17:09:38,997::task::1168::TaskManager.Task::(prepare) Task=`8e6d1286-a89b-45b7-beda-4b7829970cea`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475811', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259107', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240354', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372787', 'lastCheck': '7.4', 'valid': True}}
>Thread-1654::DEBUG::2014-04-10 17:09:38,997::task::579::TaskManager.Task::(_updateState) Task=`8e6d1286-a89b-45b7-beda-4b7829970cea`::moving from state preparing -> state finished
>Thread-1654::DEBUG::2014-04-10 17:09:38,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1654::DEBUG::2014-04-10 17:09:38,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1654::DEBUG::2014-04-10 17:09:38,998::task::974::TaskManager.Task::(_decref) Task=`8e6d1286-a89b-45b7-beda-4b7829970cea`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:09:40,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:09:40,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302869 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:09:40,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:09:40,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239253 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:41,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:41,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000362558 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:41,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:41,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475608 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1658::DEBUG::2014-04-10 17:09:47,542::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1658::DEBUG::2014-04-10 17:09:47,543::task::579::TaskManager.Task::(_updateState) Task=`14651777-ceac-4ace-a067-47dbbed043bd`::moving from state init -> state preparing
>Thread-1658::INFO::2014-04-10 17:09:47,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1658::INFO::2014-04-10 17:09:47,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1658::DEBUG::2014-04-10 17:09:47,544::task::1168::TaskManager.Task::(prepare) Task=`14651777-ceac-4ace-a067-47dbbed043bd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1658::DEBUG::2014-04-10 17:09:47,544::task::579::TaskManager.Task::(_updateState) Task=`14651777-ceac-4ace-a067-47dbbed043bd`::moving from state preparing -> state finished
>Thread-1658::DEBUG::2014-04-10 17:09:47,544::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1658::DEBUG::2014-04-10 17:09:47,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1658::DEBUG::2014-04-10 17:09:47,545::task::974::TaskManager.Task::(_decref) Task=`14651777-ceac-4ace-a067-47dbbed043bd`::ref 0 aborting False
>Thread-1659::DEBUG::2014-04-10 17:09:47,552::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-1659::DEBUG::2014-04-10 17:09:47,552::task::579::TaskManager.Task::(_updateState) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::moving from state init -> state preparing
>Thread-1659::INFO::2014-04-10 17:09:47,552::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1659::DEBUG::2014-04-10 17:09:47,553::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`467be123-d204-49a4-b56b-60e00bc95cc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1659::DEBUG::2014-04-10 17:09:47,553::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1659::DEBUG::2014-04-10 17:09:47,553::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1659::DEBUG::2014-04-10 17:09:47,554::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`467be123-d204-49a4-b56b-60e00bc95cc1`::Granted request
>Thread-1659::DEBUG::2014-04-10 17:09:47,554::task::811::TaskManager.Task::(resourceAcquired) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1659::DEBUG::2014-04-10 17:09:47,554::task::974::TaskManager.Task::(_decref) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::ref 1 aborting False
>Thread-1659::INFO::2014-04-10 17:09:47,556::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1659::DEBUG::2014-04-10 17:09:47,557::task::1168::TaskManager.Task::(prepare) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1659::DEBUG::2014-04-10 17:09:47,557::task::579::TaskManager.Task::(_updateState) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::moving from state preparing -> state finished
>Thread-1659::DEBUG::2014-04-10 17:09:47,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1659::DEBUG::2014-04-10 17:09:47,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1659::DEBUG::2014-04-10 17:09:47,557::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1659::DEBUG::2014-04-10 17:09:47,558::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1659::DEBUG::2014-04-10 17:09:47,558::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1659::DEBUG::2014-04-10 17:09:47,558::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1659::DEBUG::2014-04-10 17:09:47,558::task::974::TaskManager.Task::(_decref) Task=`f8827ad2-08ee-4ca3-95b2-f7b0631b8aff`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:09:50,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:09:50,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035834 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:09:50,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:09:50,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034099 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:09:51,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:09:51,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000624236 s, 590 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:09:51,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:09:51,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000551468 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1662::DEBUG::2014-04-10 17:09:54,154::task::579::TaskManager.Task::(_updateState) Task=`3829c2d7-9478-4887-8413-d72cf964f70d`::moving from state init -> state preparing
>Thread-1662::INFO::2014-04-10 17:09:54,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1662::INFO::2014-04-10 17:09:54,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551468', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035834', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034099', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624236', 'lastCheck': '2.5', 'valid': True}}
>Thread-1662::DEBUG::2014-04-10 17:09:54,154::task::1168::TaskManager.Task::(prepare) Task=`3829c2d7-9478-4887-8413-d72cf964f70d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551468', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035834', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034099', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624236', 'lastCheck': '2.5', 'valid': True}}
>Thread-1662::DEBUG::2014-04-10 17:09:54,155::task::579::TaskManager.Task::(_updateState) Task=`3829c2d7-9478-4887-8413-d72cf964f70d`::moving from state preparing -> state finished
>Thread-1662::DEBUG::2014-04-10 17:09:54,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1662::DEBUG::2014-04-10 17:09:54,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1662::DEBUG::2014-04-10 17:09:54,155::task::974::TaskManager.Task::(_decref) Task=`3829c2d7-9478-4887-8413-d72cf964f70d`::ref 0 aborting False
>Thread-1665::DEBUG::2014-04-10 17:09:57,648::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1665::DEBUG::2014-04-10 17:09:57,648::task::579::TaskManager.Task::(_updateState) Task=`cead02af-20a4-41bb-a4d5-3dc78a6cf9f1`::moving from state init -> state preparing
>Thread-1665::INFO::2014-04-10 17:09:57,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1665::INFO::2014-04-10 17:09:57,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1665::DEBUG::2014-04-10 17:09:57,649::task::1168::TaskManager.Task::(prepare) Task=`cead02af-20a4-41bb-a4d5-3dc78a6cf9f1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1665::DEBUG::2014-04-10 17:09:57,649::task::579::TaskManager.Task::(_updateState) Task=`cead02af-20a4-41bb-a4d5-3dc78a6cf9f1`::moving from state preparing -> state finished
>Thread-1665::DEBUG::2014-04-10 17:09:57,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1665::DEBUG::2014-04-10 17:09:57,650::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1665::DEBUG::2014-04-10 17:09:57,650::task::974::TaskManager.Task::(_decref) Task=`cead02af-20a4-41bb-a4d5-3dc78a6cf9f1`::ref 0 aborting False
>Thread-1666::DEBUG::2014-04-10 17:09:57,656::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1666::DEBUG::2014-04-10 17:09:57,657::task::579::TaskManager.Task::(_updateState) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::moving from state init -> state preparing
>Thread-1666::INFO::2014-04-10 17:09:57,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1666::DEBUG::2014-04-10 17:09:57,658::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`324fb987-e949-478d-966f-5e9c90fe074e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1666::DEBUG::2014-04-10 17:09:57,658::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1666::DEBUG::2014-04-10 17:09:57,658::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1666::DEBUG::2014-04-10 17:09:57,658::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`324fb987-e949-478d-966f-5e9c90fe074e`::Granted request
>Thread-1666::DEBUG::2014-04-10 17:09:57,658::task::811::TaskManager.Task::(resourceAcquired) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1666::DEBUG::2014-04-10 17:09:57,659::task::974::TaskManager.Task::(_decref) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::ref 1 aborting False
>Thread-1666::INFO::2014-04-10 17:09:57,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1666::DEBUG::2014-04-10 17:09:57,661::task::1168::TaskManager.Task::(prepare) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1666::DEBUG::2014-04-10 17:09:57,661::task::579::TaskManager.Task::(_updateState) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::moving from state preparing -> state finished
>Thread-1666::DEBUG::2014-04-10 17:09:57,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1666::DEBUG::2014-04-10 17:09:57,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1666::DEBUG::2014-04-10 17:09:57,661::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1666::DEBUG::2014-04-10 17:09:57,662::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1666::DEBUG::2014-04-10 17:09:57,662::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1666::DEBUG::2014-04-10 17:09:57,662::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1666::DEBUG::2014-04-10 17:09:57,662::task::974::TaskManager.Task::(_decref) Task=`ed66a5bf-324b-488f-bdcb-fbb39ae0c48c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:00,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:10:00,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310346 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:00,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:00,138::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029384 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:01,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:01,657::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000411224 s, 895 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:01,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:01,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000454405 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1670::DEBUG::2014-04-10 17:10:07,815::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1670::DEBUG::2014-04-10 17:10:07,815::task::579::TaskManager.Task::(_updateState) Task=`380812c9-167e-4d2c-9b3b-874bda70c2bf`::moving from state init -> state preparing
>Thread-1670::INFO::2014-04-10 17:10:07,816::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1670::INFO::2014-04-10 17:10:07,816::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1670::DEBUG::2014-04-10 17:10:07,816::task::1168::TaskManager.Task::(prepare) Task=`380812c9-167e-4d2c-9b3b-874bda70c2bf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1670::DEBUG::2014-04-10 17:10:07,816::task::579::TaskManager.Task::(_updateState) Task=`380812c9-167e-4d2c-9b3b-874bda70c2bf`::moving from state preparing -> state finished
>Thread-1670::DEBUG::2014-04-10 17:10:07,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1670::DEBUG::2014-04-10 17:10:07,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1670::DEBUG::2014-04-10 17:10:07,817::task::974::TaskManager.Task::(_decref) Task=`380812c9-167e-4d2c-9b3b-874bda70c2bf`::ref 0 aborting False
>Thread-1671::DEBUG::2014-04-10 17:10:07,823::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1671::DEBUG::2014-04-10 17:10:07,824::task::579::TaskManager.Task::(_updateState) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::moving from state init -> state preparing
>Thread-1671::INFO::2014-04-10 17:10:07,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1671::DEBUG::2014-04-10 17:10:07,825::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8882a707-f8f0-4695-b844-eed386f2db42`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1671::DEBUG::2014-04-10 17:10:07,825::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1671::DEBUG::2014-04-10 17:10:07,826::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1671::DEBUG::2014-04-10 17:10:07,826::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8882a707-f8f0-4695-b844-eed386f2db42`::Granted request
>Thread-1671::DEBUG::2014-04-10 17:10:07,827::task::811::TaskManager.Task::(resourceAcquired) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1671::DEBUG::2014-04-10 17:10:07,827::task::974::TaskManager.Task::(_decref) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::ref 1 aborting False
>Thread-1671::INFO::2014-04-10 17:10:07,829::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1671::DEBUG::2014-04-10 17:10:07,829::task::1168::TaskManager.Task::(prepare) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1671::DEBUG::2014-04-10 17:10:07,829::task::579::TaskManager.Task::(_updateState) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::moving from state preparing -> state finished
>Thread-1671::DEBUG::2014-04-10 17:10:07,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1671::DEBUG::2014-04-10 17:10:07,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1671::DEBUG::2014-04-10 17:10:07,830::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1671::DEBUG::2014-04-10 17:10:07,830::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1671::DEBUG::2014-04-10 17:10:07,830::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1671::DEBUG::2014-04-10 17:10:07,830::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1671::DEBUG::2014-04-10 17:10:07,830::task::974::TaskManager.Task::(_decref) Task=`a3f90965-5a49-41bb-a7b2-40547b9cc0ee`::ref 0 aborting False
>Thread-1672::DEBUG::2014-04-10 17:10:09,406::task::579::TaskManager.Task::(_updateState) Task=`d4606711-30c8-4b38-a102-c812baa83979`::moving from state init -> state preparing
>Thread-1672::INFO::2014-04-10 17:10:09,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1672::INFO::2014-04-10 17:10:09,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454405', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310346', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029384', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411224', 'lastCheck': '7.7', 'valid': True}}
>Thread-1672::DEBUG::2014-04-10 17:10:09,407::task::1168::TaskManager.Task::(prepare) Task=`d4606711-30c8-4b38-a102-c812baa83979`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454405', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310346', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029384', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411224', 'lastCheck': '7.7', 'valid': True}}
>Thread-1672::DEBUG::2014-04-10 17:10:09,407::task::579::TaskManager.Task::(_updateState) Task=`d4606711-30c8-4b38-a102-c812baa83979`::moving from state preparing -> state finished
>Thread-1672::DEBUG::2014-04-10 17:10:09,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1672::DEBUG::2014-04-10 17:10:09,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1672::DEBUG::2014-04-10 17:10:09,408::task::974::TaskManager.Task::(_decref) Task=`d4606711-30c8-4b38-a102-c812baa83979`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:10,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:10:10,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033807 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:10,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:10,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349212 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:11,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:11,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0005061 s, 727 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:11,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:11,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496541 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1676::DEBUG::2014-04-10 17:10:18,132::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1676::DEBUG::2014-04-10 17:10:18,133::task::579::TaskManager.Task::(_updateState) Task=`39b1477a-db34-407f-903a-728e8d0fae1b`::moving from state init -> state preparing
>Thread-1676::INFO::2014-04-10 17:10:18,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1676::INFO::2014-04-10 17:10:18,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1676::DEBUG::2014-04-10 17:10:18,134::task::1168::TaskManager.Task::(prepare) Task=`39b1477a-db34-407f-903a-728e8d0fae1b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1676::DEBUG::2014-04-10 17:10:18,134::task::579::TaskManager.Task::(_updateState) Task=`39b1477a-db34-407f-903a-728e8d0fae1b`::moving from state preparing -> state finished
>Thread-1676::DEBUG::2014-04-10 17:10:18,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1676::DEBUG::2014-04-10 17:10:18,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1676::DEBUG::2014-04-10 17:10:18,134::task::974::TaskManager.Task::(_decref) Task=`39b1477a-db34-407f-903a-728e8d0fae1b`::ref 0 aborting False
>Thread-1677::DEBUG::2014-04-10 17:10:18,141::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1677::DEBUG::2014-04-10 17:10:18,141::task::579::TaskManager.Task::(_updateState) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::moving from state init -> state preparing
>Thread-1677::INFO::2014-04-10 17:10:18,141::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1677::DEBUG::2014-04-10 17:10:18,141::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4acadcec-48f4-452a-a057-0ea091c0aace`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1677::DEBUG::2014-04-10 17:10:18,142::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1677::DEBUG::2014-04-10 17:10:18,142::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1677::DEBUG::2014-04-10 17:10:18,142::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4acadcec-48f4-452a-a057-0ea091c0aace`::Granted request
>Thread-1677::DEBUG::2014-04-10 17:10:18,142::task::811::TaskManager.Task::(resourceAcquired) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1677::DEBUG::2014-04-10 17:10:18,142::task::974::TaskManager.Task::(_decref) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::ref 1 aborting False
>Thread-1677::INFO::2014-04-10 17:10:18,144::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::task::1168::TaskManager.Task::(prepare) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::task::579::TaskManager.Task::(_updateState) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::moving from state preparing -> state finished
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1677::DEBUG::2014-04-10 17:10:18,145::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1677::DEBUG::2014-04-10 17:10:18,146::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1677::DEBUG::2014-04-10 17:10:18,146::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1677::DEBUG::2014-04-10 17:10:18,146::task::974::TaskManager.Task::(_decref) Task=`1bda058f-004b-4cdc-b019-b3c9826b54b3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:20,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:10:20,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000351429 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:20,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:20,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003393 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:21,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:21,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000402934 s, 913 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:21,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:21,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000462684 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1680::DEBUG::2014-04-10 17:10:24,576::task::579::TaskManager.Task::(_updateState) Task=`400d78be-e0ea-43b3-b60f-9f6ca7d0ccf4`::moving from state init -> state preparing
>Thread-1680::INFO::2014-04-10 17:10:24,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1680::INFO::2014-04-10 17:10:24,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462684', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351429', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003393', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402934', 'lastCheck': '2.8', 'valid': True}}
>Thread-1680::DEBUG::2014-04-10 17:10:24,577::task::1168::TaskManager.Task::(prepare) Task=`400d78be-e0ea-43b3-b60f-9f6ca7d0ccf4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462684', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351429', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003393', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402934', 'lastCheck': '2.8', 'valid': True}}
>Thread-1680::DEBUG::2014-04-10 17:10:24,577::task::579::TaskManager.Task::(_updateState) Task=`400d78be-e0ea-43b3-b60f-9f6ca7d0ccf4`::moving from state preparing -> state finished
>Thread-1680::DEBUG::2014-04-10 17:10:24,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1680::DEBUG::2014-04-10 17:10:24,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1680::DEBUG::2014-04-10 17:10:24,577::task::974::TaskManager.Task::(_decref) Task=`400d78be-e0ea-43b3-b60f-9f6ca7d0ccf4`::ref 0 aborting False
>Thread-1683::DEBUG::2014-04-10 17:10:28,219::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1683::DEBUG::2014-04-10 17:10:28,219::task::579::TaskManager.Task::(_updateState) Task=`6a7dd2b1-253f-4afd-af88-3d3e536dba27`::moving from state init -> state preparing
>Thread-1683::INFO::2014-04-10 17:10:28,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1683::INFO::2014-04-10 17:10:28,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1683::DEBUG::2014-04-10 17:10:28,220::task::1168::TaskManager.Task::(prepare) Task=`6a7dd2b1-253f-4afd-af88-3d3e536dba27`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1683::DEBUG::2014-04-10 17:10:28,220::task::579::TaskManager.Task::(_updateState) Task=`6a7dd2b1-253f-4afd-af88-3d3e536dba27`::moving from state preparing -> state finished
>Thread-1683::DEBUG::2014-04-10 17:10:28,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1683::DEBUG::2014-04-10 17:10:28,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1683::DEBUG::2014-04-10 17:10:28,221::task::974::TaskManager.Task::(_decref) Task=`6a7dd2b1-253f-4afd-af88-3d3e536dba27`::ref 0 aborting False
>Thread-1684::DEBUG::2014-04-10 17:10:28,227::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1684::DEBUG::2014-04-10 17:10:28,228::task::579::TaskManager.Task::(_updateState) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::moving from state init -> state preparing
>Thread-1684::INFO::2014-04-10 17:10:28,228::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1684::DEBUG::2014-04-10 17:10:28,229::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2cf9faff-4a47-4b24-ae8f-877632fe3f5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1684::DEBUG::2014-04-10 17:10:28,229::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1684::DEBUG::2014-04-10 17:10:28,229::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1684::DEBUG::2014-04-10 17:10:28,229::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2cf9faff-4a47-4b24-ae8f-877632fe3f5e`::Granted request
>Thread-1684::DEBUG::2014-04-10 17:10:28,230::task::811::TaskManager.Task::(resourceAcquired) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1684::DEBUG::2014-04-10 17:10:28,230::task::974::TaskManager.Task::(_decref) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::ref 1 aborting False
>Thread-1684::INFO::2014-04-10 17:10:28,232::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1684::DEBUG::2014-04-10 17:10:28,232::task::1168::TaskManager.Task::(prepare) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1684::DEBUG::2014-04-10 17:10:28,232::task::579::TaskManager.Task::(_updateState) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::moving from state preparing -> state finished
>Thread-1684::DEBUG::2014-04-10 17:10:28,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1684::DEBUG::2014-04-10 17:10:28,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1684::DEBUG::2014-04-10 17:10:28,233::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1684::DEBUG::2014-04-10 17:10:28,233::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1684::DEBUG::2014-04-10 17:10:28,233::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1684::DEBUG::2014-04-10 17:10:28,233::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1684::DEBUG::2014-04-10 17:10:28,233::task::974::TaskManager.Task::(_decref) Task=`b1e9cc60-2fe1-49fa-bdb3-f808ff01b5a0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:30,193::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:10:30,198::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:10:30,199::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:10:30,202::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:10:30,203::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:10:30,208::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:10:30,210::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-468::DEBUG::2014-04-10 17:10:30,210::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::INFO::2014-04-10 17:10:30,210::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:10:30,212::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:10:30,218::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 17:10:30,220::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:30,220::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:10:30,225::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:10:30,225::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:10:30,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287027 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:30,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:30,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309877 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:31,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:31,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000585485 s, 629 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:31,767::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:31,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000457533 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1696::DEBUG::2014-04-10 17:10:38,359::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1696::DEBUG::2014-04-10 17:10:38,360::task::579::TaskManager.Task::(_updateState) Task=`fbf28022-ac85-49e6-839d-f8e017655168`::moving from state init -> state preparing
>Thread-1696::INFO::2014-04-10 17:10:38,360::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1696::INFO::2014-04-10 17:10:38,360::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1696::DEBUG::2014-04-10 17:10:38,360::task::1168::TaskManager.Task::(prepare) Task=`fbf28022-ac85-49e6-839d-f8e017655168`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1696::DEBUG::2014-04-10 17:10:38,361::task::579::TaskManager.Task::(_updateState) Task=`fbf28022-ac85-49e6-839d-f8e017655168`::moving from state preparing -> state finished
>Thread-1696::DEBUG::2014-04-10 17:10:38,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1696::DEBUG::2014-04-10 17:10:38,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1696::DEBUG::2014-04-10 17:10:38,361::task::974::TaskManager.Task::(_decref) Task=`fbf28022-ac85-49e6-839d-f8e017655168`::ref 0 aborting False
>Thread-1697::DEBUG::2014-04-10 17:10:38,368::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1697::DEBUG::2014-04-10 17:10:38,369::task::579::TaskManager.Task::(_updateState) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::moving from state init -> state preparing
>Thread-1697::INFO::2014-04-10 17:10:38,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1697::DEBUG::2014-04-10 17:10:38,369::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6d9024e-8957-42ed-8afe-28c42eaa2dae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1697::DEBUG::2014-04-10 17:10:38,369::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1697::DEBUG::2014-04-10 17:10:38,370::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1697::DEBUG::2014-04-10 17:10:38,370::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6d9024e-8957-42ed-8afe-28c42eaa2dae`::Granted request
>Thread-1697::DEBUG::2014-04-10 17:10:38,370::task::811::TaskManager.Task::(resourceAcquired) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1697::DEBUG::2014-04-10 17:10:38,370::task::974::TaskManager.Task::(_decref) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::ref 1 aborting False
>Thread-1697::INFO::2014-04-10 17:10:38,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1697::DEBUG::2014-04-10 17:10:38,373::task::1168::TaskManager.Task::(prepare) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1697::DEBUG::2014-04-10 17:10:38,373::task::579::TaskManager.Task::(_updateState) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::moving from state preparing -> state finished
>Thread-1697::DEBUG::2014-04-10 17:10:38,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1697::DEBUG::2014-04-10 17:10:38,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1697::DEBUG::2014-04-10 17:10:38,374::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1697::DEBUG::2014-04-10 17:10:38,374::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1697::DEBUG::2014-04-10 17:10:38,374::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1697::DEBUG::2014-04-10 17:10:38,374::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1697::DEBUG::2014-04-10 17:10:38,375::task::974::TaskManager.Task::(_decref) Task=`44b52641-d0b4-43c8-bc7d-a0496aacccdd`::ref 0 aborting False
>Thread-1698::DEBUG::2014-04-10 17:10:39,731::task::579::TaskManager.Task::(_updateState) Task=`b7feee5a-42c8-40fc-b6f0-30599e4c0ae2`::moving from state init -> state preparing
>Thread-1698::INFO::2014-04-10 17:10:39,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1698::INFO::2014-04-10 17:10:39,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457533', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287027', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309877', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585485', 'lastCheck': '8.0', 'valid': True}}
>Thread-1698::DEBUG::2014-04-10 17:10:39,732::task::1168::TaskManager.Task::(prepare) Task=`b7feee5a-42c8-40fc-b6f0-30599e4c0ae2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457533', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287027', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309877', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585485', 'lastCheck': '8.0', 'valid': True}}
>Thread-1698::DEBUG::2014-04-10 17:10:39,732::task::579::TaskManager.Task::(_updateState) Task=`b7feee5a-42c8-40fc-b6f0-30599e4c0ae2`::moving from state preparing -> state finished
>Thread-1698::DEBUG::2014-04-10 17:10:39,733::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1698::DEBUG::2014-04-10 17:10:39,733::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1698::DEBUG::2014-04-10 17:10:39,733::task::974::TaskManager.Task::(_decref) Task=`b7feee5a-42c8-40fc-b6f0-30599e4c0ae2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:40,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:10:40,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319425 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:40,280::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:40,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337509 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:41,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:41,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000527087 s, 698 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:41,791::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:41,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000515337 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1702::DEBUG::2014-04-10 17:10:48,450::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1702::DEBUG::2014-04-10 17:10:48,451::task::579::TaskManager.Task::(_updateState) Task=`b7b468e6-c408-4b3a-85b0-b9eee60ec999`::moving from state init -> state preparing
>Thread-1702::INFO::2014-04-10 17:10:48,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1702::INFO::2014-04-10 17:10:48,452::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1702::DEBUG::2014-04-10 17:10:48,452::task::1168::TaskManager.Task::(prepare) Task=`b7b468e6-c408-4b3a-85b0-b9eee60ec999`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1702::DEBUG::2014-04-10 17:10:48,452::task::579::TaskManager.Task::(_updateState) Task=`b7b468e6-c408-4b3a-85b0-b9eee60ec999`::moving from state preparing -> state finished
>Thread-1702::DEBUG::2014-04-10 17:10:48,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1702::DEBUG::2014-04-10 17:10:48,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1702::DEBUG::2014-04-10 17:10:48,452::task::974::TaskManager.Task::(_decref) Task=`b7b468e6-c408-4b3a-85b0-b9eee60ec999`::ref 0 aborting False
>Thread-1703::DEBUG::2014-04-10 17:10:48,459::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1703::DEBUG::2014-04-10 17:10:48,459::task::579::TaskManager.Task::(_updateState) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::moving from state init -> state preparing
>Thread-1703::INFO::2014-04-10 17:10:48,459::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1703::DEBUG::2014-04-10 17:10:48,460::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`83d40b9b-ad85-4ed1-95ca-560b4011ee77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1703::DEBUG::2014-04-10 17:10:48,460::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1703::DEBUG::2014-04-10 17:10:48,460::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1703::DEBUG::2014-04-10 17:10:48,460::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`83d40b9b-ad85-4ed1-95ca-560b4011ee77`::Granted request
>Thread-1703::DEBUG::2014-04-10 17:10:48,462::task::811::TaskManager.Task::(resourceAcquired) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1703::DEBUG::2014-04-10 17:10:48,462::task::974::TaskManager.Task::(_decref) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::ref 1 aborting False
>Thread-1703::INFO::2014-04-10 17:10:48,464::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1703::DEBUG::2014-04-10 17:10:48,464::task::1168::TaskManager.Task::(prepare) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1703::DEBUG::2014-04-10 17:10:48,464::task::579::TaskManager.Task::(_updateState) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::moving from state preparing -> state finished
>Thread-1703::DEBUG::2014-04-10 17:10:48,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1703::DEBUG::2014-04-10 17:10:48,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1703::DEBUG::2014-04-10 17:10:48,465::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1703::DEBUG::2014-04-10 17:10:48,465::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1703::DEBUG::2014-04-10 17:10:48,465::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1703::DEBUG::2014-04-10 17:10:48,465::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1703::DEBUG::2014-04-10 17:10:48,465::task::974::TaskManager.Task::(_decref) Task=`65e20e24-460b-41b7-a667-2c643d84051c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:10:50,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:10:50,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325616 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:10:50,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:10:50,316::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326627 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:10:51,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:10:51,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502847 s, 732 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:10:51,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:10:51,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000502794 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1706::DEBUG::2014-04-10 17:10:54,893::task::579::TaskManager.Task::(_updateState) Task=`ffc9c99f-127d-4989-bcaa-f9788034bd85`::moving from state init -> state preparing
>Thread-1706::INFO::2014-04-10 17:10:54,893::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1706::INFO::2014-04-10 17:10:54,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502794', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325616', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326627', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502847', 'lastCheck': '3.1', 'valid': True}}
>Thread-1706::DEBUG::2014-04-10 17:10:54,894::task::1168::TaskManager.Task::(prepare) Task=`ffc9c99f-127d-4989-bcaa-f9788034bd85`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502794', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325616', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326627', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502847', 'lastCheck': '3.1', 'valid': True}}
>Thread-1706::DEBUG::2014-04-10 17:10:54,894::task::579::TaskManager.Task::(_updateState) Task=`ffc9c99f-127d-4989-bcaa-f9788034bd85`::moving from state preparing -> state finished
>Thread-1706::DEBUG::2014-04-10 17:10:54,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1706::DEBUG::2014-04-10 17:10:54,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1706::DEBUG::2014-04-10 17:10:54,895::task::974::TaskManager.Task::(_decref) Task=`ffc9c99f-127d-4989-bcaa-f9788034bd85`::ref 0 aborting False
>Thread-1709::DEBUG::2014-04-10 17:10:58,540::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-1709::DEBUG::2014-04-10 17:10:58,541::task::579::TaskManager.Task::(_updateState) Task=`96da3e98-7736-4232-a016-eef61a7d0dd5`::moving from state init -> state preparing
>Thread-1709::INFO::2014-04-10 17:10:58,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1709::INFO::2014-04-10 17:10:58,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1709::DEBUG::2014-04-10 17:10:58,541::task::1168::TaskManager.Task::(prepare) Task=`96da3e98-7736-4232-a016-eef61a7d0dd5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1709::DEBUG::2014-04-10 17:10:58,542::task::579::TaskManager.Task::(_updateState) Task=`96da3e98-7736-4232-a016-eef61a7d0dd5`::moving from state preparing -> state finished
>Thread-1709::DEBUG::2014-04-10 17:10:58,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1709::DEBUG::2014-04-10 17:10:58,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1709::DEBUG::2014-04-10 17:10:58,542::task::974::TaskManager.Task::(_decref) Task=`96da3e98-7736-4232-a016-eef61a7d0dd5`::ref 0 aborting False
>Thread-1710::DEBUG::2014-04-10 17:10:58,549::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-1710::DEBUG::2014-04-10 17:10:58,549::task::579::TaskManager.Task::(_updateState) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::moving from state init -> state preparing
>Thread-1710::INFO::2014-04-10 17:10:58,550::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1710::DEBUG::2014-04-10 17:10:58,550::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`971ba6aa-61a0-4e5c-97cb-f51a709ff8aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1710::DEBUG::2014-04-10 17:10:58,550::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1710::DEBUG::2014-04-10 17:10:58,550::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1710::DEBUG::2014-04-10 17:10:58,551::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`971ba6aa-61a0-4e5c-97cb-f51a709ff8aa`::Granted request
>Thread-1710::DEBUG::2014-04-10 17:10:58,551::task::811::TaskManager.Task::(resourceAcquired) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1710::DEBUG::2014-04-10 17:10:58,551::task::974::TaskManager.Task::(_decref) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::ref 1 aborting False
>Thread-1710::INFO::2014-04-10 17:10:58,553::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1710::DEBUG::2014-04-10 17:10:58,553::task::1168::TaskManager.Task::(prepare) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1710::DEBUG::2014-04-10 17:10:58,553::task::579::TaskManager.Task::(_updateState) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::moving from state preparing -> state finished
>Thread-1710::DEBUG::2014-04-10 17:10:58,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1710::DEBUG::2014-04-10 17:10:58,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1710::DEBUG::2014-04-10 17:10:58,554::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1710::DEBUG::2014-04-10 17:10:58,554::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1710::DEBUG::2014-04-10 17:10:58,554::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1710::DEBUG::2014-04-10 17:10:58,554::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1710::DEBUG::2014-04-10 17:10:58,555::task::974::TaskManager.Task::(_decref) Task=`8a15b413-951f-43c5-aecc-564e8e460397`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:00,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:11:00,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032212 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:00,341::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:00,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342656 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:01,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:01,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000471558 s, 780 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:11:01,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:11:01,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470136 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1714::DEBUG::2014-04-10 17:11:08,647::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1714::DEBUG::2014-04-10 17:11:08,648::task::579::TaskManager.Task::(_updateState) Task=`1ea503c0-1adc-4200-8d72-e5c0c85208bc`::moving from state init -> state preparing
>Thread-1714::INFO::2014-04-10 17:11:08,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1714::INFO::2014-04-10 17:11:08,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1714::DEBUG::2014-04-10 17:11:08,649::task::1168::TaskManager.Task::(prepare) Task=`1ea503c0-1adc-4200-8d72-e5c0c85208bc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1714::DEBUG::2014-04-10 17:11:08,649::task::579::TaskManager.Task::(_updateState) Task=`1ea503c0-1adc-4200-8d72-e5c0c85208bc`::moving from state preparing -> state finished
>Thread-1714::DEBUG::2014-04-10 17:11:08,649::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1714::DEBUG::2014-04-10 17:11:08,649::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1714::DEBUG::2014-04-10 17:11:08,650::task::974::TaskManager.Task::(_decref) Task=`1ea503c0-1adc-4200-8d72-e5c0c85208bc`::ref 0 aborting False
>Thread-1715::DEBUG::2014-04-10 17:11:08,657::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1715::DEBUG::2014-04-10 17:11:08,657::task::579::TaskManager.Task::(_updateState) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::moving from state init -> state preparing
>Thread-1715::INFO::2014-04-10 17:11:08,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1715::DEBUG::2014-04-10 17:11:08,658::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97d35815-4927-4ea4-8f82-5a056bdb5e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1715::DEBUG::2014-04-10 17:11:08,658::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1715::DEBUG::2014-04-10 17:11:08,658::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1715::DEBUG::2014-04-10 17:11:08,658::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97d35815-4927-4ea4-8f82-5a056bdb5e1b`::Granted request
>Thread-1715::DEBUG::2014-04-10 17:11:08,659::task::811::TaskManager.Task::(resourceAcquired) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1715::DEBUG::2014-04-10 17:11:08,659::task::974::TaskManager.Task::(_decref) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::ref 1 aborting False
>Thread-1715::INFO::2014-04-10 17:11:08,661::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1715::DEBUG::2014-04-10 17:11:08,661::task::1168::TaskManager.Task::(prepare) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1715::DEBUG::2014-04-10 17:11:08,662::task::579::TaskManager.Task::(_updateState) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::moving from state preparing -> state finished
>Thread-1715::DEBUG::2014-04-10 17:11:08,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1715::DEBUG::2014-04-10 17:11:08,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1715::DEBUG::2014-04-10 17:11:08,662::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1715::DEBUG::2014-04-10 17:11:08,662::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1715::DEBUG::2014-04-10 17:11:08,663::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1715::DEBUG::2014-04-10 17:11:08,663::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1715::DEBUG::2014-04-10 17:11:08,663::task::974::TaskManager.Task::(_decref) Task=`d8401558-7ace-4d9a-91e6-05e240fe8fde`::ref 0 aborting False
>Thread-1716::DEBUG::2014-04-10 17:11:10,059::task::579::TaskManager.Task::(_updateState) Task=`4ab73930-036c-497c-a9ba-086de913e46d`::moving from state init -> state preparing
>Thread-1716::INFO::2014-04-10 17:11:10,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1716::INFO::2014-04-10 17:11:10,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470136', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032212', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342656', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471558', 'lastCheck': '8.2', 'valid': True}}
>Thread-1716::DEBUG::2014-04-10 17:11:10,060::task::1168::TaskManager.Task::(prepare) Task=`4ab73930-036c-497c-a9ba-086de913e46d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470136', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032212', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342656', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471558', 'lastCheck': '8.2', 'valid': True}}
>Thread-1716::DEBUG::2014-04-10 17:11:10,060::task::579::TaskManager.Task::(_updateState) Task=`4ab73930-036c-497c-a9ba-086de913e46d`::moving from state preparing -> state finished
>Thread-1716::DEBUG::2014-04-10 17:11:10,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1716::DEBUG::2014-04-10 17:11:10,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1716::DEBUG::2014-04-10 17:11:10,060::task::974::TaskManager.Task::(_decref) Task=`4ab73930-036c-497c-a9ba-086de913e46d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:10,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:11:10,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334358 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:10,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:10,375::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337056 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:11,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:11,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000519747 s, 708 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:11:11,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:11:11,862::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000499989 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1720::DEBUG::2014-04-10 17:11:19,219::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1720::DEBUG::2014-04-10 17:11:19,220::task::579::TaskManager.Task::(_updateState) Task=`96eaf3fc-bb9b-47ac-9fbf-07c84cef0657`::moving from state init -> state preparing
>Thread-1720::INFO::2014-04-10 17:11:19,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1720::INFO::2014-04-10 17:11:19,222::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1720::DEBUG::2014-04-10 17:11:19,222::task::1168::TaskManager.Task::(prepare) Task=`96eaf3fc-bb9b-47ac-9fbf-07c84cef0657`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1720::DEBUG::2014-04-10 17:11:19,222::task::579::TaskManager.Task::(_updateState) Task=`96eaf3fc-bb9b-47ac-9fbf-07c84cef0657`::moving from state preparing -> state finished
>Thread-1720::DEBUG::2014-04-10 17:11:19,222::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1720::DEBUG::2014-04-10 17:11:19,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1720::DEBUG::2014-04-10 17:11:19,223::task::974::TaskManager.Task::(_decref) Task=`96eaf3fc-bb9b-47ac-9fbf-07c84cef0657`::ref 0 aborting False
>Thread-1722::DEBUG::2014-04-10 17:11:19,229::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-1722::DEBUG::2014-04-10 17:11:19,229::task::579::TaskManager.Task::(_updateState) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::moving from state init -> state preparing
>Thread-1722::INFO::2014-04-10 17:11:19,229::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1722::DEBUG::2014-04-10 17:11:19,230::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e05269bb-78a9-4c86-86d3-c5cbd3ac0dfd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1722::DEBUG::2014-04-10 17:11:19,230::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1722::DEBUG::2014-04-10 17:11:19,230::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1722::DEBUG::2014-04-10 17:11:19,230::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e05269bb-78a9-4c86-86d3-c5cbd3ac0dfd`::Granted request
>Thread-1722::DEBUG::2014-04-10 17:11:19,231::task::811::TaskManager.Task::(resourceAcquired) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1722::DEBUG::2014-04-10 17:11:19,231::task::974::TaskManager.Task::(_decref) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::ref 1 aborting False
>Thread-1722::INFO::2014-04-10 17:11:19,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1722::DEBUG::2014-04-10 17:11:19,233::task::1168::TaskManager.Task::(prepare) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1722::DEBUG::2014-04-10 17:11:19,233::task::579::TaskManager.Task::(_updateState) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::moving from state preparing -> state finished
>Thread-1722::DEBUG::2014-04-10 17:11:19,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1722::DEBUG::2014-04-10 17:11:19,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1722::DEBUG::2014-04-10 17:11:19,234::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1722::DEBUG::2014-04-10 17:11:19,234::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1722::DEBUG::2014-04-10 17:11:19,234::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1722::DEBUG::2014-04-10 17:11:19,234::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1722::DEBUG::2014-04-10 17:11:19,234::task::974::TaskManager.Task::(_decref) Task=`05f2dffc-b397-4c7c-974f-27d0e5d7613b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:20,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:11:20,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294196 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:20,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:20,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344277 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:21,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:21,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000530101 s, 694 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:11:21,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:11:21,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000471794 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1724::DEBUG::2014-04-10 17:11:25,262::task::579::TaskManager.Task::(_updateState) Task=`13c8c78e-f93b-40cb-81bb-36202f1056c9`::moving from state init -> state preparing
>Thread-1724::INFO::2014-04-10 17:11:25,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1724::INFO::2014-04-10 17:11:25,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471794', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294196', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344277', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530101', 'lastCheck': '3.4', 'valid': True}}
>Thread-1724::DEBUG::2014-04-10 17:11:25,263::task::1168::TaskManager.Task::(prepare) Task=`13c8c78e-f93b-40cb-81bb-36202f1056c9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471794', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294196', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344277', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530101', 'lastCheck': '3.4', 'valid': True}}
>Thread-1724::DEBUG::2014-04-10 17:11:25,263::task::579::TaskManager.Task::(_updateState) Task=`13c8c78e-f93b-40cb-81bb-36202f1056c9`::moving from state preparing -> state finished
>Thread-1724::DEBUG::2014-04-10 17:11:25,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1724::DEBUG::2014-04-10 17:11:25,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1724::DEBUG::2014-04-10 17:11:25,263::task::974::TaskManager.Task::(_decref) Task=`13c8c78e-f93b-40cb-81bb-36202f1056c9`::ref 0 aborting False
>Thread-1727::DEBUG::2014-04-10 17:11:29,309::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1727::DEBUG::2014-04-10 17:11:29,311::task::579::TaskManager.Task::(_updateState) Task=`b50ff220-2a94-420f-b736-658e5cae0e43`::moving from state init -> state preparing
>Thread-1727::INFO::2014-04-10 17:11:29,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1727::INFO::2014-04-10 17:11:29,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1727::DEBUG::2014-04-10 17:11:29,312::task::1168::TaskManager.Task::(prepare) Task=`b50ff220-2a94-420f-b736-658e5cae0e43`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1727::DEBUG::2014-04-10 17:11:29,312::task::579::TaskManager.Task::(_updateState) Task=`b50ff220-2a94-420f-b736-658e5cae0e43`::moving from state preparing -> state finished
>Thread-1727::DEBUG::2014-04-10 17:11:29,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1727::DEBUG::2014-04-10 17:11:29,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1727::DEBUG::2014-04-10 17:11:29,312::task::974::TaskManager.Task::(_decref) Task=`b50ff220-2a94-420f-b736-658e5cae0e43`::ref 0 aborting False
>Thread-1728::DEBUG::2014-04-10 17:11:29,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-1728::DEBUG::2014-04-10 17:11:29,319::task::579::TaskManager.Task::(_updateState) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::moving from state init -> state preparing
>Thread-1728::INFO::2014-04-10 17:11:29,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1728::DEBUG::2014-04-10 17:11:29,320::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28eab1aa-d7c9-48af-afc3-bfe9052aace0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1728::DEBUG::2014-04-10 17:11:29,320::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1728::DEBUG::2014-04-10 17:11:29,321::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1728::DEBUG::2014-04-10 17:11:29,321::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28eab1aa-d7c9-48af-afc3-bfe9052aace0`::Granted request
>Thread-1728::DEBUG::2014-04-10 17:11:29,321::task::811::TaskManager.Task::(resourceAcquired) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1728::DEBUG::2014-04-10 17:11:29,321::task::974::TaskManager.Task::(_decref) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::ref 1 aborting False
>Thread-1728::INFO::2014-04-10 17:11:29,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1728::DEBUG::2014-04-10 17:11:29,323::task::1168::TaskManager.Task::(prepare) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1728::DEBUG::2014-04-10 17:11:29,324::task::579::TaskManager.Task::(_updateState) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::moving from state preparing -> state finished
>Thread-1728::DEBUG::2014-04-10 17:11:29,324::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1728::DEBUG::2014-04-10 17:11:29,324::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1728::DEBUG::2014-04-10 17:11:29,324::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1728::DEBUG::2014-04-10 17:11:29,324::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1728::DEBUG::2014-04-10 17:11:29,325::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1728::DEBUG::2014-04-10 17:11:29,325::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1728::DEBUG::2014-04-10 17:11:29,325::task::974::TaskManager.Task::(_decref) Task=`afcb1798-4fb8-4ddd-a71e-96f1e5881296`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:30,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:11:30,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387615 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:30,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:30,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335211 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:31,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:31,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000471247 s, 781 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:11:31,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:11:31,895::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000534769 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1732::DEBUG::2014-04-10 17:11:39,416::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1732::DEBUG::2014-04-10 17:11:39,417::task::579::TaskManager.Task::(_updateState) Task=`eab373e4-f0a8-4f32-99c2-27ed19495179`::moving from state init -> state preparing
>Thread-1732::INFO::2014-04-10 17:11:39,417::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1732::INFO::2014-04-10 17:11:39,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1732::DEBUG::2014-04-10 17:11:39,417::task::1168::TaskManager.Task::(prepare) Task=`eab373e4-f0a8-4f32-99c2-27ed19495179`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1732::DEBUG::2014-04-10 17:11:39,418::task::579::TaskManager.Task::(_updateState) Task=`eab373e4-f0a8-4f32-99c2-27ed19495179`::moving from state preparing -> state finished
>Thread-1732::DEBUG::2014-04-10 17:11:39,418::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1732::DEBUG::2014-04-10 17:11:39,418::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1732::DEBUG::2014-04-10 17:11:39,418::task::974::TaskManager.Task::(_decref) Task=`eab373e4-f0a8-4f32-99c2-27ed19495179`::ref 0 aborting False
>Thread-1733::DEBUG::2014-04-10 17:11:39,425::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1733::DEBUG::2014-04-10 17:11:39,426::task::579::TaskManager.Task::(_updateState) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::moving from state init -> state preparing
>Thread-1733::INFO::2014-04-10 17:11:39,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1733::DEBUG::2014-04-10 17:11:39,426::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e9c39cc-e9bc-4375-89c7-9a03118f1b1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1733::DEBUG::2014-04-10 17:11:39,427::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1733::DEBUG::2014-04-10 17:11:39,427::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1733::DEBUG::2014-04-10 17:11:39,427::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e9c39cc-e9bc-4375-89c7-9a03118f1b1b`::Granted request
>Thread-1733::DEBUG::2014-04-10 17:11:39,427::task::811::TaskManager.Task::(resourceAcquired) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1733::DEBUG::2014-04-10 17:11:39,427::task::974::TaskManager.Task::(_decref) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::ref 1 aborting False
>Thread-1733::INFO::2014-04-10 17:11:39,429::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1733::DEBUG::2014-04-10 17:11:39,429::task::1168::TaskManager.Task::(prepare) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::task::579::TaskManager.Task::(_updateState) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::moving from state preparing -> state finished
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1733::DEBUG::2014-04-10 17:11:39,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1733::DEBUG::2014-04-10 17:11:39,431::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1733::DEBUG::2014-04-10 17:11:39,431::task::974::TaskManager.Task::(_decref) Task=`ac1201f7-873d-4785-bcf9-26fb0e59eac3`::ref 0 aborting False
>Thread-1734::DEBUG::2014-04-10 17:11:40,439::task::579::TaskManager.Task::(_updateState) Task=`1876ccb8-8ee3-4fd1-93f4-3fbcea4b6618`::moving from state init -> state preparing
>Thread-1734::INFO::2014-04-10 17:11:40,440::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-466::DEBUG::2014-04-10 17:11:40,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1734::INFO::2014-04-10 17:11:40,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534769', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387615', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335211', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471247', 'lastCheck': '8.6', 'valid': True}}
>Thread-1734::DEBUG::2014-04-10 17:11:40,447::task::1168::TaskManager.Task::(prepare) Task=`1876ccb8-8ee3-4fd1-93f4-3fbcea4b6618`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534769', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387615', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335211', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471247', 'lastCheck': '8.6', 'valid': True}}
>Thread-1734::DEBUG::2014-04-10 17:11:40,451::task::579::TaskManager.Task::(_updateState) Task=`1876ccb8-8ee3-4fd1-93f4-3fbcea4b6618`::moving from state preparing -> state finished
>Thread-1734::DEBUG::2014-04-10 17:11:40,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1734::DEBUG::2014-04-10 17:11:40,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1734::DEBUG::2014-04-10 17:11:40,461::task::974::TaskManager.Task::(_decref) Task=`1876ccb8-8ee3-4fd1-93f4-3fbcea4b6618`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:40,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003272 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:40,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:40,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032296 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:41,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:41,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000538288 s, 684 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:11:41,905::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:11:41,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00052573 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1738::DEBUG::2014-04-10 17:11:49,516::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1738::DEBUG::2014-04-10 17:11:49,516::task::579::TaskManager.Task::(_updateState) Task=`7035b042-546c-4e18-bc5a-528ba186ab96`::moving from state init -> state preparing
>Thread-1738::INFO::2014-04-10 17:11:49,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1738::INFO::2014-04-10 17:11:49,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1738::DEBUG::2014-04-10 17:11:49,517::task::1168::TaskManager.Task::(prepare) Task=`7035b042-546c-4e18-bc5a-528ba186ab96`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1738::DEBUG::2014-04-10 17:11:49,517::task::579::TaskManager.Task::(_updateState) Task=`7035b042-546c-4e18-bc5a-528ba186ab96`::moving from state preparing -> state finished
>Thread-1738::DEBUG::2014-04-10 17:11:49,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1738::DEBUG::2014-04-10 17:11:49,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1738::DEBUG::2014-04-10 17:11:49,518::task::974::TaskManager.Task::(_decref) Task=`7035b042-546c-4e18-bc5a-528ba186ab96`::ref 0 aborting False
>Thread-1739::DEBUG::2014-04-10 17:11:49,524::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1739::DEBUG::2014-04-10 17:11:49,524::task::579::TaskManager.Task::(_updateState) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::moving from state init -> state preparing
>Thread-1739::INFO::2014-04-10 17:11:49,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1739::DEBUG::2014-04-10 17:11:49,525::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`22ef53fb-76cc-4cdd-bd42-09ef654a765b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1739::DEBUG::2014-04-10 17:11:49,525::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1739::DEBUG::2014-04-10 17:11:49,525::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1739::DEBUG::2014-04-10 17:11:49,525::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`22ef53fb-76cc-4cdd-bd42-09ef654a765b`::Granted request
>Thread-1739::DEBUG::2014-04-10 17:11:49,526::task::811::TaskManager.Task::(resourceAcquired) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1739::DEBUG::2014-04-10 17:11:49,526::task::974::TaskManager.Task::(_decref) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::ref 1 aborting False
>Thread-1739::INFO::2014-04-10 17:11:49,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1739::DEBUG::2014-04-10 17:11:49,528::task::1168::TaskManager.Task::(prepare) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1739::DEBUG::2014-04-10 17:11:49,528::task::579::TaskManager.Task::(_updateState) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::moving from state preparing -> state finished
>Thread-1739::DEBUG::2014-04-10 17:11:49,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1739::DEBUG::2014-04-10 17:11:49,529::task::974::TaskManager.Task::(_decref) Task=`c6de7a28-eaf7-4d5d-a790-714ab86e9985`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:11:50,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:11:50,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000407472 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:11:50,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:11:50,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359979 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:51,899::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:11:51,928::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:11:51,932::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:11:51,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:51,945::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-467::DEBUG::2014-04-10 17:11:51,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000425406 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:11:51,953::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:11:51,954::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:11:51,955::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:11:51,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:11:51,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004551 s, 809 kB/s\n'; <rc> = 0
>Thread-1746::DEBUG::2014-04-10 17:11:55,679::task::579::TaskManager.Task::(_updateState) Task=`6a941a0c-37bf-41b4-aa23-c61f8143ac57`::moving from state init -> state preparing
>Thread-1746::INFO::2014-04-10 17:11:55,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1746::INFO::2014-04-10 17:11:55,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425406', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407472', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359979', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004551', 'lastCheck': '3.7', 'valid': True}}
>Thread-1746::DEBUG::2014-04-10 17:11:55,680::task::1168::TaskManager.Task::(prepare) Task=`6a941a0c-37bf-41b4-aa23-c61f8143ac57`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425406', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407472', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359979', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004551', 'lastCheck': '3.7', 'valid': True}}
>Thread-1746::DEBUG::2014-04-10 17:11:55,680::task::579::TaskManager.Task::(_updateState) Task=`6a941a0c-37bf-41b4-aa23-c61f8143ac57`::moving from state preparing -> state finished
>Thread-1746::DEBUG::2014-04-10 17:11:55,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1746::DEBUG::2014-04-10 17:11:55,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1746::DEBUG::2014-04-10 17:11:55,680::task::974::TaskManager.Task::(_decref) Task=`6a941a0c-37bf-41b4-aa23-c61f8143ac57`::ref 0 aborting False
>Thread-1749::DEBUG::2014-04-10 17:11:59,649::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1749::DEBUG::2014-04-10 17:11:59,650::task::579::TaskManager.Task::(_updateState) Task=`dedd43b7-7ed1-4b2d-999d-5c96ab522993`::moving from state init -> state preparing
>Thread-1749::INFO::2014-04-10 17:11:59,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1749::INFO::2014-04-10 17:11:59,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1749::DEBUG::2014-04-10 17:11:59,651::task::1168::TaskManager.Task::(prepare) Task=`dedd43b7-7ed1-4b2d-999d-5c96ab522993`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1749::DEBUG::2014-04-10 17:11:59,651::task::579::TaskManager.Task::(_updateState) Task=`dedd43b7-7ed1-4b2d-999d-5c96ab522993`::moving from state preparing -> state finished
>Thread-1749::DEBUG::2014-04-10 17:11:59,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1749::DEBUG::2014-04-10 17:11:59,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1749::DEBUG::2014-04-10 17:11:59,651::task::974::TaskManager.Task::(_decref) Task=`dedd43b7-7ed1-4b2d-999d-5c96ab522993`::ref 0 aborting False
>Thread-1750::DEBUG::2014-04-10 17:11:59,658::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1750::DEBUG::2014-04-10 17:11:59,658::task::579::TaskManager.Task::(_updateState) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::moving from state init -> state preparing
>Thread-1750::INFO::2014-04-10 17:11:59,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1750::DEBUG::2014-04-10 17:11:59,659::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9e2eee4-84e2-4cc1-b000-7eb13723d0ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1750::DEBUG::2014-04-10 17:11:59,659::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1750::DEBUG::2014-04-10 17:11:59,659::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1750::DEBUG::2014-04-10 17:11:59,659::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9e2eee4-84e2-4cc1-b000-7eb13723d0ad`::Granted request
>Thread-1750::DEBUG::2014-04-10 17:11:59,660::task::811::TaskManager.Task::(resourceAcquired) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1750::DEBUG::2014-04-10 17:11:59,660::task::974::TaskManager.Task::(_decref) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::ref 1 aborting False
>Thread-1750::INFO::2014-04-10 17:11:59,662::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1750::DEBUG::2014-04-10 17:11:59,662::task::1168::TaskManager.Task::(prepare) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1750::DEBUG::2014-04-10 17:11:59,662::task::579::TaskManager.Task::(_updateState) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::moving from state preparing -> state finished
>Thread-1750::DEBUG::2014-04-10 17:11:59,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1750::DEBUG::2014-04-10 17:11:59,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1750::DEBUG::2014-04-10 17:11:59,663::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1750::DEBUG::2014-04-10 17:11:59,663::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1750::DEBUG::2014-04-10 17:11:59,663::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1750::DEBUG::2014-04-10 17:11:59,663::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1750::DEBUG::2014-04-10 17:11:59,663::task::974::TaskManager.Task::(_decref) Task=`8d7effed-29d2-4066-88cf-d43943f76890`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:00,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:00,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389004 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:00,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:00,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294628 s, 2.3 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:12:01,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:01,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480845 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:02,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:02,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00050211 s, 733 kB/s\n'; <rc> = 0
>Thread-1754::DEBUG::2014-04-10 17:12:09,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-1754::DEBUG::2014-04-10 17:12:09,756::task::579::TaskManager.Task::(_updateState) Task=`ccb79015-a38b-4c9d-a4f1-d08a24ef721e`::moving from state init -> state preparing
>Thread-1754::INFO::2014-04-10 17:12:09,756::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1754::INFO::2014-04-10 17:12:09,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1754::DEBUG::2014-04-10 17:12:09,757::task::1168::TaskManager.Task::(prepare) Task=`ccb79015-a38b-4c9d-a4f1-d08a24ef721e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1754::DEBUG::2014-04-10 17:12:09,757::task::579::TaskManager.Task::(_updateState) Task=`ccb79015-a38b-4c9d-a4f1-d08a24ef721e`::moving from state preparing -> state finished
>Thread-1754::DEBUG::2014-04-10 17:12:09,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1754::DEBUG::2014-04-10 17:12:09,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1754::DEBUG::2014-04-10 17:12:09,757::task::974::TaskManager.Task::(_decref) Task=`ccb79015-a38b-4c9d-a4f1-d08a24ef721e`::ref 0 aborting False
>Thread-1755::DEBUG::2014-04-10 17:12:09,764::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-1755::DEBUG::2014-04-10 17:12:09,764::task::579::TaskManager.Task::(_updateState) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::moving from state init -> state preparing
>Thread-1755::INFO::2014-04-10 17:12:09,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1755::DEBUG::2014-04-10 17:12:09,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c89cd49-6047-43c8-9cf2-2ef0d5dc2b43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1755::DEBUG::2014-04-10 17:12:09,766::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1755::DEBUG::2014-04-10 17:12:09,766::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1755::DEBUG::2014-04-10 17:12:09,767::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c89cd49-6047-43c8-9cf2-2ef0d5dc2b43`::Granted request
>Thread-1755::DEBUG::2014-04-10 17:12:09,767::task::811::TaskManager.Task::(resourceAcquired) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1755::DEBUG::2014-04-10 17:12:09,767::task::974::TaskManager.Task::(_decref) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::ref 1 aborting False
>Thread-1755::INFO::2014-04-10 17:12:09,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1755::DEBUG::2014-04-10 17:12:09,769::task::1168::TaskManager.Task::(prepare) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1755::DEBUG::2014-04-10 17:12:09,769::task::579::TaskManager.Task::(_updateState) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::moving from state preparing -> state finished
>Thread-1755::DEBUG::2014-04-10 17:12:09,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1755::DEBUG::2014-04-10 17:12:09,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1755::DEBUG::2014-04-10 17:12:09,770::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1755::DEBUG::2014-04-10 17:12:09,771::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1755::DEBUG::2014-04-10 17:12:09,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1755::DEBUG::2014-04-10 17:12:09,771::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1755::DEBUG::2014-04-10 17:12:09,771::task::974::TaskManager.Task::(_decref) Task=`57a3df0e-40f3-401d-8a8e-e62dd4ae36c0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:10,544::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:10,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367047 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:10,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:10,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289671 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1756::DEBUG::2014-04-10 17:12:10,838::task::579::TaskManager.Task::(_updateState) Task=`7c30573c-3fa1-4b66-a447-5034129e04ec`::moving from state init -> state preparing
>Thread-1756::INFO::2014-04-10 17:12:10,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1756::INFO::2014-04-10 17:12:10,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480845', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367047', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289671', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050211', 'lastCheck': '8.8', 'valid': True}}
>Thread-1756::DEBUG::2014-04-10 17:12:10,839::task::1168::TaskManager.Task::(prepare) Task=`7c30573c-3fa1-4b66-a447-5034129e04ec`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480845', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367047', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289671', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050211', 'lastCheck': '8.8', 'valid': True}}
>Thread-1756::DEBUG::2014-04-10 17:12:10,839::task::579::TaskManager.Task::(_updateState) Task=`7c30573c-3fa1-4b66-a447-5034129e04ec`::moving from state preparing -> state finished
>Thread-1756::DEBUG::2014-04-10 17:12:10,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1756::DEBUG::2014-04-10 17:12:10,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1756::DEBUG::2014-04-10 17:12:10,840::task::974::TaskManager.Task::(_decref) Task=`7c30573c-3fa1-4b66-a447-5034129e04ec`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:12:12,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:12,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000456127 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:12,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:12,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000443037 s, 831 kB/s\n'; <rc> = 0
>Thread-1760::DEBUG::2014-04-10 17:12:19,863::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-1760::DEBUG::2014-04-10 17:12:19,864::task::579::TaskManager.Task::(_updateState) Task=`ae6ee5ac-5b5b-4370-b8db-44c9b274f7fd`::moving from state init -> state preparing
>Thread-1760::INFO::2014-04-10 17:12:19,864::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1760::INFO::2014-04-10 17:12:19,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1760::DEBUG::2014-04-10 17:12:19,865::task::1168::TaskManager.Task::(prepare) Task=`ae6ee5ac-5b5b-4370-b8db-44c9b274f7fd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1760::DEBUG::2014-04-10 17:12:19,865::task::579::TaskManager.Task::(_updateState) Task=`ae6ee5ac-5b5b-4370-b8db-44c9b274f7fd`::moving from state preparing -> state finished
>Thread-1760::DEBUG::2014-04-10 17:12:19,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1760::DEBUG::2014-04-10 17:12:19,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1760::DEBUG::2014-04-10 17:12:19,866::task::974::TaskManager.Task::(_decref) Task=`ae6ee5ac-5b5b-4370-b8db-44c9b274f7fd`::ref 0 aborting False
>Thread-1761::DEBUG::2014-04-10 17:12:19,873::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-1761::DEBUG::2014-04-10 17:12:19,873::task::579::TaskManager.Task::(_updateState) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::moving from state init -> state preparing
>Thread-1761::INFO::2014-04-10 17:12:19,873::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1761::DEBUG::2014-04-10 17:12:19,874::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3bbcb1b3-7483-43d7-bb93-cf871bfe8dd2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1761::DEBUG::2014-04-10 17:12:19,874::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1761::DEBUG::2014-04-10 17:12:19,874::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1761::DEBUG::2014-04-10 17:12:19,874::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3bbcb1b3-7483-43d7-bb93-cf871bfe8dd2`::Granted request
>Thread-1761::DEBUG::2014-04-10 17:12:19,874::task::811::TaskManager.Task::(resourceAcquired) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1761::DEBUG::2014-04-10 17:12:19,875::task::974::TaskManager.Task::(_decref) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::ref 1 aborting False
>Thread-1761::INFO::2014-04-10 17:12:19,876::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::task::1168::TaskManager.Task::(prepare) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::task::579::TaskManager.Task::(_updateState) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::moving from state preparing -> state finished
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1761::DEBUG::2014-04-10 17:12:19,877::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1761::DEBUG::2014-04-10 17:12:19,878::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1761::DEBUG::2014-04-10 17:12:19,878::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1761::DEBUG::2014-04-10 17:12:19,878::task::974::TaskManager.Task::(_decref) Task=`db3a50ea-6890-472c-9b35-3b90ed68692c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:20,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:20,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343472 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:20,578::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:20,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035696 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:12:22,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:22,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000500426 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:22,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:22,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000468514 s, 785 kB/s\n'; <rc> = 0
>Thread-1764::DEBUG::2014-04-10 17:12:26,009::task::579::TaskManager.Task::(_updateState) Task=`05301ad0-17f1-4ab5-9064-b2895439d82b`::moving from state init -> state preparing
>Thread-1764::INFO::2014-04-10 17:12:26,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1764::INFO::2014-04-10 17:12:26,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500426', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343472', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035696', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468514', 'lastCheck': '3.9', 'valid': True}}
>Thread-1764::DEBUG::2014-04-10 17:12:26,010::task::1168::TaskManager.Task::(prepare) Task=`05301ad0-17f1-4ab5-9064-b2895439d82b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500426', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343472', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035696', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468514', 'lastCheck': '3.9', 'valid': True}}
>Thread-1764::DEBUG::2014-04-10 17:12:26,010::task::579::TaskManager.Task::(_updateState) Task=`05301ad0-17f1-4ab5-9064-b2895439d82b`::moving from state preparing -> state finished
>Thread-1764::DEBUG::2014-04-10 17:12:26,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1764::DEBUG::2014-04-10 17:12:26,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1764::DEBUG::2014-04-10 17:12:26,011::task::974::TaskManager.Task::(_decref) Task=`05301ad0-17f1-4ab5-9064-b2895439d82b`::ref 0 aborting False
>Thread-1767::DEBUG::2014-04-10 17:12:29,970::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1767::DEBUG::2014-04-10 17:12:29,970::task::579::TaskManager.Task::(_updateState) Task=`33fca3a4-55ac-4100-91a9-26d254f6e016`::moving from state init -> state preparing
>Thread-1767::INFO::2014-04-10 17:12:29,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1767::INFO::2014-04-10 17:12:29,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1767::DEBUG::2014-04-10 17:12:29,971::task::1168::TaskManager.Task::(prepare) Task=`33fca3a4-55ac-4100-91a9-26d254f6e016`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1767::DEBUG::2014-04-10 17:12:29,971::task::579::TaskManager.Task::(_updateState) Task=`33fca3a4-55ac-4100-91a9-26d254f6e016`::moving from state preparing -> state finished
>Thread-1767::DEBUG::2014-04-10 17:12:29,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1767::DEBUG::2014-04-10 17:12:29,971::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1767::DEBUG::2014-04-10 17:12:29,972::task::974::TaskManager.Task::(_decref) Task=`33fca3a4-55ac-4100-91a9-26d254f6e016`::ref 0 aborting False
>Thread-1768::DEBUG::2014-04-10 17:12:29,978::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1768::DEBUG::2014-04-10 17:12:29,979::task::579::TaskManager.Task::(_updateState) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::moving from state init -> state preparing
>Thread-1768::INFO::2014-04-10 17:12:29,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1768::DEBUG::2014-04-10 17:12:29,979::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c379df84-f685-46da-93aa-16ea05b7ed84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1768::DEBUG::2014-04-10 17:12:29,979::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1768::DEBUG::2014-04-10 17:12:29,980::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1768::DEBUG::2014-04-10 17:12:29,980::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c379df84-f685-46da-93aa-16ea05b7ed84`::Granted request
>Thread-1768::DEBUG::2014-04-10 17:12:29,980::task::811::TaskManager.Task::(resourceAcquired) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1768::DEBUG::2014-04-10 17:12:29,980::task::974::TaskManager.Task::(_decref) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::ref 1 aborting False
>Thread-1768::INFO::2014-04-10 17:12:29,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1768::DEBUG::2014-04-10 17:12:29,982::task::1168::TaskManager.Task::(prepare) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::task::579::TaskManager.Task::(_updateState) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::moving from state preparing -> state finished
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1768::DEBUG::2014-04-10 17:12:29,983::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1768::DEBUG::2014-04-10 17:12:29,984::task::974::TaskManager.Task::(_decref) Task=`5ddfd315-3c81-4a91-9055-e444c5a5f1b7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:30,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:30,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337816 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:30,593::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:30,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254474 s, 2.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:12:32,068::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:32,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00043892 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:32,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:32,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000865612 s, 425 kB/s\n'; <rc> = 0
>Thread-1772::DEBUG::2014-04-10 17:12:40,068::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1772::DEBUG::2014-04-10 17:12:40,069::task::579::TaskManager.Task::(_updateState) Task=`e230e653-45dc-4a6d-8410-b902ac95dd65`::moving from state init -> state preparing
>Thread-1772::INFO::2014-04-10 17:12:40,069::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1772::INFO::2014-04-10 17:12:40,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1772::DEBUG::2014-04-10 17:12:40,070::task::1168::TaskManager.Task::(prepare) Task=`e230e653-45dc-4a6d-8410-b902ac95dd65`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1772::DEBUG::2014-04-10 17:12:40,070::task::579::TaskManager.Task::(_updateState) Task=`e230e653-45dc-4a6d-8410-b902ac95dd65`::moving from state preparing -> state finished
>Thread-1772::DEBUG::2014-04-10 17:12:40,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1772::DEBUG::2014-04-10 17:12:40,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1772::DEBUG::2014-04-10 17:12:40,071::task::974::TaskManager.Task::(_decref) Task=`e230e653-45dc-4a6d-8410-b902ac95dd65`::ref 0 aborting False
>Thread-1773::DEBUG::2014-04-10 17:12:40,077::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1773::DEBUG::2014-04-10 17:12:40,077::task::579::TaskManager.Task::(_updateState) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::moving from state init -> state preparing
>Thread-1773::INFO::2014-04-10 17:12:40,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1773::DEBUG::2014-04-10 17:12:40,078::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4270fee2-32ce-40b9-9286-a03f4e18f9fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1773::DEBUG::2014-04-10 17:12:40,078::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1773::DEBUG::2014-04-10 17:12:40,078::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1773::DEBUG::2014-04-10 17:12:40,078::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4270fee2-32ce-40b9-9286-a03f4e18f9fb`::Granted request
>Thread-1773::DEBUG::2014-04-10 17:12:40,079::task::811::TaskManager.Task::(resourceAcquired) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1773::DEBUG::2014-04-10 17:12:40,079::task::974::TaskManager.Task::(_decref) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::ref 1 aborting False
>Thread-1773::INFO::2014-04-10 17:12:40,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1773::DEBUG::2014-04-10 17:12:40,081::task::1168::TaskManager.Task::(prepare) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1773::DEBUG::2014-04-10 17:12:40,081::task::579::TaskManager.Task::(_updateState) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::moving from state preparing -> state finished
>Thread-1773::DEBUG::2014-04-10 17:12:40,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1773::DEBUG::2014-04-10 17:12:40,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1773::DEBUG::2014-04-10 17:12:40,082::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1773::DEBUG::2014-04-10 17:12:40,082::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1773::DEBUG::2014-04-10 17:12:40,082::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1773::DEBUG::2014-04-10 17:12:40,082::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1773::DEBUG::2014-04-10 17:12:40,082::task::974::TaskManager.Task::(_decref) Task=`8cd6c08c-ce64-4c90-b14a-06a474919d43`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:40,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:40,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278554 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:40,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:40,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033554 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1774::DEBUG::2014-04-10 17:12:41,172::task::579::TaskManager.Task::(_updateState) Task=`7fd8206c-e04e-46b2-a41a-36c090324f8e`::moving from state init -> state preparing
>Thread-1774::INFO::2014-04-10 17:12:41,172::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1774::INFO::2014-04-10 17:12:41,172::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043892', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278554', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033554', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865612', 'lastCheck': '9.1', 'valid': True}}
>Thread-1774::DEBUG::2014-04-10 17:12:41,172::task::1168::TaskManager.Task::(prepare) Task=`7fd8206c-e04e-46b2-a41a-36c090324f8e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043892', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278554', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033554', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865612', 'lastCheck': '9.1', 'valid': True}}
>Thread-1774::DEBUG::2014-04-10 17:12:41,173::task::579::TaskManager.Task::(_updateState) Task=`7fd8206c-e04e-46b2-a41a-36c090324f8e`::moving from state preparing -> state finished
>Thread-1774::DEBUG::2014-04-10 17:12:41,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1774::DEBUG::2014-04-10 17:12:41,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1774::DEBUG::2014-04-10 17:12:41,173::task::974::TaskManager.Task::(_decref) Task=`7fd8206c-e04e-46b2-a41a-36c090324f8e`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:12:42,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:42,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00049961 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:42,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:42,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000425322 s, 865 kB/s\n'; <rc> = 0
>Thread-1778::DEBUG::2014-04-10 17:12:50,159::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1778::DEBUG::2014-04-10 17:12:50,159::task::579::TaskManager.Task::(_updateState) Task=`48696516-1359-4f5e-aeed-9cbb4b23b3a4`::moving from state init -> state preparing
>Thread-1778::INFO::2014-04-10 17:12:50,159::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1778::INFO::2014-04-10 17:12:50,160::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1778::DEBUG::2014-04-10 17:12:50,160::task::1168::TaskManager.Task::(prepare) Task=`48696516-1359-4f5e-aeed-9cbb4b23b3a4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1778::DEBUG::2014-04-10 17:12:50,160::task::579::TaskManager.Task::(_updateState) Task=`48696516-1359-4f5e-aeed-9cbb4b23b3a4`::moving from state preparing -> state finished
>Thread-1778::DEBUG::2014-04-10 17:12:50,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1778::DEBUG::2014-04-10 17:12:50,160::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1778::DEBUG::2014-04-10 17:12:50,161::task::974::TaskManager.Task::(_decref) Task=`48696516-1359-4f5e-aeed-9cbb4b23b3a4`::ref 0 aborting False
>Thread-1779::DEBUG::2014-04-10 17:12:50,167::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1779::DEBUG::2014-04-10 17:12:50,167::task::579::TaskManager.Task::(_updateState) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::moving from state init -> state preparing
>Thread-1779::INFO::2014-04-10 17:12:50,168::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1779::DEBUG::2014-04-10 17:12:50,168::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`961cbd81-0402-4bd6-bd9e-2c6eba4220b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1779::DEBUG::2014-04-10 17:12:50,168::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1779::DEBUG::2014-04-10 17:12:50,169::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1779::DEBUG::2014-04-10 17:12:50,169::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`961cbd81-0402-4bd6-bd9e-2c6eba4220b4`::Granted request
>Thread-1779::DEBUG::2014-04-10 17:12:50,170::task::811::TaskManager.Task::(resourceAcquired) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1779::DEBUG::2014-04-10 17:12:50,170::task::974::TaskManager.Task::(_decref) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::ref 1 aborting False
>Thread-1779::INFO::2014-04-10 17:12:50,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1779::DEBUG::2014-04-10 17:12:50,172::task::1168::TaskManager.Task::(prepare) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::task::579::TaskManager.Task::(_updateState) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::moving from state preparing -> state finished
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1779::DEBUG::2014-04-10 17:12:50,173::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1779::DEBUG::2014-04-10 17:12:50,174::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1779::DEBUG::2014-04-10 17:12:50,174::task::974::TaskManager.Task::(_decref) Task=`c5b3fc29-3821-407c-bf13-d447bce152a1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:12:50,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:12:50,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313066 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:12:50,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:12:50,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000293224 s, 2.3 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:12:52,127::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:12:52,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000411958 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:12:52,154::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:12:52,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000461625 s, 797 kB/s\n'; <rc> = 0
>Thread-1782::DEBUG::2014-04-10 17:12:56,340::task::579::TaskManager.Task::(_updateState) Task=`908bd6eb-1bcf-4162-bee8-867bcfbda8eb`::moving from state init -> state preparing
>Thread-1782::INFO::2014-04-10 17:12:56,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1782::INFO::2014-04-10 17:12:56,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411958', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313066', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293224', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461625', 'lastCheck': '4.2', 'valid': True}}
>Thread-1782::DEBUG::2014-04-10 17:12:56,341::task::1168::TaskManager.Task::(prepare) Task=`908bd6eb-1bcf-4162-bee8-867bcfbda8eb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411958', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313066', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293224', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461625', 'lastCheck': '4.2', 'valid': True}}
>Thread-1782::DEBUG::2014-04-10 17:12:56,341::task::579::TaskManager.Task::(_updateState) Task=`908bd6eb-1bcf-4162-bee8-867bcfbda8eb`::moving from state preparing -> state finished
>Thread-1782::DEBUG::2014-04-10 17:12:56,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1782::DEBUG::2014-04-10 17:12:56,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1782::DEBUG::2014-04-10 17:12:56,342::task::974::TaskManager.Task::(_decref) Task=`908bd6eb-1bcf-4162-bee8-867bcfbda8eb`::ref 0 aborting False
>Thread-1785::DEBUG::2014-04-10 17:13:00,260::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1785::DEBUG::2014-04-10 17:13:00,261::task::579::TaskManager.Task::(_updateState) Task=`165c288e-4597-4b00-a6bd-a97a3d697211`::moving from state init -> state preparing
>Thread-1785::INFO::2014-04-10 17:13:00,261::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1785::INFO::2014-04-10 17:13:00,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1785::DEBUG::2014-04-10 17:13:00,261::task::1168::TaskManager.Task::(prepare) Task=`165c288e-4597-4b00-a6bd-a97a3d697211`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1785::DEBUG::2014-04-10 17:13:00,262::task::579::TaskManager.Task::(_updateState) Task=`165c288e-4597-4b00-a6bd-a97a3d697211`::moving from state preparing -> state finished
>Thread-1785::DEBUG::2014-04-10 17:13:00,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1785::DEBUG::2014-04-10 17:13:00,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1785::DEBUG::2014-04-10 17:13:00,262::task::974::TaskManager.Task::(_decref) Task=`165c288e-4597-4b00-a6bd-a97a3d697211`::ref 0 aborting False
>Thread-1786::DEBUG::2014-04-10 17:13:00,269::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1786::DEBUG::2014-04-10 17:13:00,269::task::579::TaskManager.Task::(_updateState) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::moving from state init -> state preparing
>Thread-1786::INFO::2014-04-10 17:13:00,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1786::DEBUG::2014-04-10 17:13:00,270::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29bd034a-a8c4-461e-80d9-6608a9c7dcb0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1786::DEBUG::2014-04-10 17:13:00,270::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1786::DEBUG::2014-04-10 17:13:00,270::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1786::DEBUG::2014-04-10 17:13:00,270::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29bd034a-a8c4-461e-80d9-6608a9c7dcb0`::Granted request
>Thread-1786::DEBUG::2014-04-10 17:13:00,270::task::811::TaskManager.Task::(resourceAcquired) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1786::DEBUG::2014-04-10 17:13:00,271::task::974::TaskManager.Task::(_decref) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::ref 1 aborting False
>Thread-1786::INFO::2014-04-10 17:13:00,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1786::DEBUG::2014-04-10 17:13:00,273::task::1168::TaskManager.Task::(prepare) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1786::DEBUG::2014-04-10 17:13:00,273::task::579::TaskManager.Task::(_updateState) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::moving from state preparing -> state finished
>Thread-1786::DEBUG::2014-04-10 17:13:00,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1786::DEBUG::2014-04-10 17:13:00,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1786::DEBUG::2014-04-10 17:13:00,273::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1786::DEBUG::2014-04-10 17:13:00,274::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1786::DEBUG::2014-04-10 17:13:00,274::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1786::DEBUG::2014-04-10 17:13:00,274::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1786::DEBUG::2014-04-10 17:13:00,274::task::974::TaskManager.Task::(_decref) Task=`e0efd035-82f9-4a4e-b00c-b57010c20184`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:00,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:00,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000285389 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:00,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:00,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024375 s, 2.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:02,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:02,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000393405 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:13:02,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:13:02,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000404187 s, 910 kB/s\n'; <rc> = 0
>Thread-1790::DEBUG::2014-04-10 17:13:10,380::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-1790::DEBUG::2014-04-10 17:13:10,381::task::579::TaskManager.Task::(_updateState) Task=`207ae3ea-87b8-4532-a729-09c21fde5847`::moving from state init -> state preparing
>Thread-1790::INFO::2014-04-10 17:13:10,381::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1790::INFO::2014-04-10 17:13:10,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1790::DEBUG::2014-04-10 17:13:10,381::task::1168::TaskManager.Task::(prepare) Task=`207ae3ea-87b8-4532-a729-09c21fde5847`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1790::DEBUG::2014-04-10 17:13:10,382::task::579::TaskManager.Task::(_updateState) Task=`207ae3ea-87b8-4532-a729-09c21fde5847`::moving from state preparing -> state finished
>Thread-1790::DEBUG::2014-04-10 17:13:10,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1790::DEBUG::2014-04-10 17:13:10,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1790::DEBUG::2014-04-10 17:13:10,382::task::974::TaskManager.Task::(_decref) Task=`207ae3ea-87b8-4532-a729-09c21fde5847`::ref 0 aborting False
>Thread-1791::DEBUG::2014-04-10 17:13:10,388::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-1791::DEBUG::2014-04-10 17:13:10,389::task::579::TaskManager.Task::(_updateState) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::moving from state init -> state preparing
>Thread-1791::INFO::2014-04-10 17:13:10,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1791::DEBUG::2014-04-10 17:13:10,389::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ce3793c0-72ac-445a-9880-06bfaf859a66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1791::DEBUG::2014-04-10 17:13:10,390::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1791::DEBUG::2014-04-10 17:13:10,390::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1791::DEBUG::2014-04-10 17:13:10,390::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ce3793c0-72ac-445a-9880-06bfaf859a66`::Granted request
>Thread-1791::DEBUG::2014-04-10 17:13:10,390::task::811::TaskManager.Task::(resourceAcquired) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1791::DEBUG::2014-04-10 17:13:10,390::task::974::TaskManager.Task::(_decref) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::ref 1 aborting False
>Thread-1791::INFO::2014-04-10 17:13:10,392::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1791::DEBUG::2014-04-10 17:13:10,392::task::1168::TaskManager.Task::(prepare) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1791::DEBUG::2014-04-10 17:13:10,393::task::579::TaskManager.Task::(_updateState) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::moving from state preparing -> state finished
>Thread-1791::DEBUG::2014-04-10 17:13:10,393::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1791::DEBUG::2014-04-10 17:13:10,393::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1791::DEBUG::2014-04-10 17:13:10,393::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1791::DEBUG::2014-04-10 17:13:10,393::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1791::DEBUG::2014-04-10 17:13:10,394::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1791::DEBUG::2014-04-10 17:13:10,394::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1791::DEBUG::2014-04-10 17:13:10,394::task::974::TaskManager.Task::(_decref) Task=`0ed47533-bb44-465a-8a6e-5b7ab2f1db0e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:10,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:10,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332517 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:10,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:10,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025427 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1792::DEBUG::2014-04-10 17:13:11,499::task::579::TaskManager.Task::(_updateState) Task=`9c8877d2-3d1f-41a3-9bf3-030f840dff95`::moving from state init -> state preparing
>Thread-1792::INFO::2014-04-10 17:13:11,499::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1792::INFO::2014-04-10 17:13:11,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393405', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332517', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025427', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404187', 'lastCheck': '9.3', 'valid': True}}
>Thread-1792::DEBUG::2014-04-10 17:13:11,500::task::1168::TaskManager.Task::(prepare) Task=`9c8877d2-3d1f-41a3-9bf3-030f840dff95`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393405', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332517', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025427', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404187', 'lastCheck': '9.3', 'valid': True}}
>Thread-1792::DEBUG::2014-04-10 17:13:11,500::task::579::TaskManager.Task::(_updateState) Task=`9c8877d2-3d1f-41a3-9bf3-030f840dff95`::moving from state preparing -> state finished
>Thread-1792::DEBUG::2014-04-10 17:13:11,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1792::DEBUG::2014-04-10 17:13:11,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1792::DEBUG::2014-04-10 17:13:11,500::task::974::TaskManager.Task::(_decref) Task=`9c8877d2-3d1f-41a3-9bf3-030f840dff95`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:13:12,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:12,219::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000418792 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:13:12,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:13:12,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000332441 s, 1.1 MB/s\n'; <rc> = 0
>Thread-1796::DEBUG::2014-04-10 17:13:20,479::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1796::DEBUG::2014-04-10 17:13:20,479::task::579::TaskManager.Task::(_updateState) Task=`6d83d8ef-f729-4b76-99f5-c43fdf4e66fd`::moving from state init -> state preparing
>Thread-1796::INFO::2014-04-10 17:13:20,479::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1796::INFO::2014-04-10 17:13:20,480::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1796::DEBUG::2014-04-10 17:13:20,480::task::1168::TaskManager.Task::(prepare) Task=`6d83d8ef-f729-4b76-99f5-c43fdf4e66fd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1796::DEBUG::2014-04-10 17:13:20,480::task::579::TaskManager.Task::(_updateState) Task=`6d83d8ef-f729-4b76-99f5-c43fdf4e66fd`::moving from state preparing -> state finished
>Thread-1796::DEBUG::2014-04-10 17:13:20,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1796::DEBUG::2014-04-10 17:13:20,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1796::DEBUG::2014-04-10 17:13:20,481::task::974::TaskManager.Task::(_decref) Task=`6d83d8ef-f729-4b76-99f5-c43fdf4e66fd`::ref 0 aborting False
>Thread-1797::DEBUG::2014-04-10 17:13:20,487::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1797::DEBUG::2014-04-10 17:13:20,487::task::579::TaskManager.Task::(_updateState) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::moving from state init -> state preparing
>Thread-1797::INFO::2014-04-10 17:13:20,488::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1797::DEBUG::2014-04-10 17:13:20,488::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15254430-6bd9-429f-abd6-20d3015507f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1797::DEBUG::2014-04-10 17:13:20,488::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1797::DEBUG::2014-04-10 17:13:20,488::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1797::DEBUG::2014-04-10 17:13:20,489::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15254430-6bd9-429f-abd6-20d3015507f4`::Granted request
>Thread-1797::DEBUG::2014-04-10 17:13:20,489::task::811::TaskManager.Task::(resourceAcquired) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1797::DEBUG::2014-04-10 17:13:20,489::task::974::TaskManager.Task::(_decref) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::ref 1 aborting False
>Thread-1797::INFO::2014-04-10 17:13:20,491::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1797::DEBUG::2014-04-10 17:13:20,491::task::1168::TaskManager.Task::(prepare) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1797::DEBUG::2014-04-10 17:13:20,491::task::579::TaskManager.Task::(_updateState) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::moving from state preparing -> state finished
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1797::DEBUG::2014-04-10 17:13:20,492::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1797::DEBUG::2014-04-10 17:13:20,493::task::974::TaskManager.Task::(_decref) Task=`4b2667b8-83e6-4e9f-b4a5-a0aa107df9e8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:20,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:20,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003411 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:20,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:20,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348749 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:22,229::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:13:22,258::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:13:22,260::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:13:22,265::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:22,274::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-469::DEBUG::2014-04-10 17:13:22,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000324045 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:22,283::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:13:22,283::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:13:22,284::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:13:22,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:22,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000346328 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1804::DEBUG::2014-04-10 17:13:26,666::task::579::TaskManager.Task::(_updateState) Task=`cc3fd392-a22d-4125-9b5e-474e23561b77`::moving from state init -> state preparing
>Thread-1804::INFO::2014-04-10 17:13:26,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1804::INFO::2014-04-10 17:13:26,666::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346328', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003411', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348749', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324045', 'lastCheck': '4.4', 'valid': True}}
>Thread-1804::DEBUG::2014-04-10 17:13:26,667::task::1168::TaskManager.Task::(prepare) Task=`cc3fd392-a22d-4125-9b5e-474e23561b77`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346328', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003411', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348749', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324045', 'lastCheck': '4.4', 'valid': True}}
>Thread-1804::DEBUG::2014-04-10 17:13:26,667::task::579::TaskManager.Task::(_updateState) Task=`cc3fd392-a22d-4125-9b5e-474e23561b77`::moving from state preparing -> state finished
>Thread-1804::DEBUG::2014-04-10 17:13:26,667::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1804::DEBUG::2014-04-10 17:13:26,667::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1804::DEBUG::2014-04-10 17:13:26,667::task::974::TaskManager.Task::(_decref) Task=`cc3fd392-a22d-4125-9b5e-474e23561b77`::ref 0 aborting False
>Thread-1807::DEBUG::2014-04-10 17:13:30,569::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1807::DEBUG::2014-04-10 17:13:30,569::task::579::TaskManager.Task::(_updateState) Task=`db1fb557-1351-4dd0-9444-09ae726f34af`::moving from state init -> state preparing
>Thread-1807::INFO::2014-04-10 17:13:30,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1807::INFO::2014-04-10 17:13:30,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1807::DEBUG::2014-04-10 17:13:30,570::task::1168::TaskManager.Task::(prepare) Task=`db1fb557-1351-4dd0-9444-09ae726f34af`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1807::DEBUG::2014-04-10 17:13:30,570::task::579::TaskManager.Task::(_updateState) Task=`db1fb557-1351-4dd0-9444-09ae726f34af`::moving from state preparing -> state finished
>Thread-1807::DEBUG::2014-04-10 17:13:30,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1807::DEBUG::2014-04-10 17:13:30,571::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1807::DEBUG::2014-04-10 17:13:30,571::task::974::TaskManager.Task::(_decref) Task=`db1fb557-1351-4dd0-9444-09ae726f34af`::ref 0 aborting False
>Thread-1808::DEBUG::2014-04-10 17:13:30,577::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1808::DEBUG::2014-04-10 17:13:30,578::task::579::TaskManager.Task::(_updateState) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::moving from state init -> state preparing
>Thread-1808::INFO::2014-04-10 17:13:30,578::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1808::DEBUG::2014-04-10 17:13:30,578::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7d7694d8-0c8b-4886-8531-ace706e966fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1808::DEBUG::2014-04-10 17:13:30,578::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1808::DEBUG::2014-04-10 17:13:30,579::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1808::DEBUG::2014-04-10 17:13:30,579::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7d7694d8-0c8b-4886-8531-ace706e966fb`::Granted request
>Thread-1808::DEBUG::2014-04-10 17:13:30,579::task::811::TaskManager.Task::(resourceAcquired) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1808::DEBUG::2014-04-10 17:13:30,579::task::974::TaskManager.Task::(_decref) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::ref 1 aborting False
>Thread-1808::INFO::2014-04-10 17:13:30,581::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1808::DEBUG::2014-04-10 17:13:30,581::task::1168::TaskManager.Task::(prepare) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::task::579::TaskManager.Task::(_updateState) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::moving from state preparing -> state finished
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1808::DEBUG::2014-04-10 17:13:30,582::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1808::DEBUG::2014-04-10 17:13:30,583::task::974::TaskManager.Task::(_decref) Task=`2862635d-6a28-4687-b65b-80bef5c8d963`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:30,703::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:30,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307812 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:30,737::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:30,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313078 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:13:32,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:13:32,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000454696 s, 809 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:32,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:32,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000383722 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1812::DEBUG::2014-04-10 17:13:40,666::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1812::DEBUG::2014-04-10 17:13:40,667::task::579::TaskManager.Task::(_updateState) Task=`b2d1bf93-549f-4ab4-9913-61b7ad621c77`::moving from state init -> state preparing
>Thread-1812::INFO::2014-04-10 17:13:40,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1812::INFO::2014-04-10 17:13:40,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1812::DEBUG::2014-04-10 17:13:40,668::task::1168::TaskManager.Task::(prepare) Task=`b2d1bf93-549f-4ab4-9913-61b7ad621c77`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1812::DEBUG::2014-04-10 17:13:40,668::task::579::TaskManager.Task::(_updateState) Task=`b2d1bf93-549f-4ab4-9913-61b7ad621c77`::moving from state preparing -> state finished
>Thread-1812::DEBUG::2014-04-10 17:13:40,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1812::DEBUG::2014-04-10 17:13:40,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1812::DEBUG::2014-04-10 17:13:40,668::task::974::TaskManager.Task::(_decref) Task=`b2d1bf93-549f-4ab4-9913-61b7ad621c77`::ref 0 aborting False
>Thread-1813::DEBUG::2014-04-10 17:13:40,674::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1813::DEBUG::2014-04-10 17:13:40,675::task::579::TaskManager.Task::(_updateState) Task=`21443984-7628-40ea-be2f-05e2259844f9`::moving from state init -> state preparing
>Thread-1813::INFO::2014-04-10 17:13:40,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1813::DEBUG::2014-04-10 17:13:40,675::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dc1f1d39-7935-4b7f-b818-7c32d1022a75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1813::DEBUG::2014-04-10 17:13:40,675::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1813::DEBUG::2014-04-10 17:13:40,676::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1813::DEBUG::2014-04-10 17:13:40,676::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dc1f1d39-7935-4b7f-b818-7c32d1022a75`::Granted request
>Thread-1813::DEBUG::2014-04-10 17:13:40,676::task::811::TaskManager.Task::(resourceAcquired) Task=`21443984-7628-40ea-be2f-05e2259844f9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1813::DEBUG::2014-04-10 17:13:40,676::task::974::TaskManager.Task::(_decref) Task=`21443984-7628-40ea-be2f-05e2259844f9`::ref 1 aborting False
>Thread-1813::INFO::2014-04-10 17:13:40,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1813::DEBUG::2014-04-10 17:13:40,678::task::1168::TaskManager.Task::(prepare) Task=`21443984-7628-40ea-be2f-05e2259844f9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::task::579::TaskManager.Task::(_updateState) Task=`21443984-7628-40ea-be2f-05e2259844f9`::moving from state preparing -> state finished
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1813::DEBUG::2014-04-10 17:13:40,679::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1813::DEBUG::2014-04-10 17:13:40,680::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1813::DEBUG::2014-04-10 17:13:40,680::task::974::TaskManager.Task::(_decref) Task=`21443984-7628-40ea-be2f-05e2259844f9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:40,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:40,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283331 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:40,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:40,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000489564 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1814::DEBUG::2014-04-10 17:13:41,823::task::579::TaskManager.Task::(_updateState) Task=`8a3c1464-1701-492d-a9a2-05be25b437e7`::moving from state init -> state preparing
>Thread-1814::INFO::2014-04-10 17:13:41,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1814::INFO::2014-04-10 17:13:41,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383722', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283331', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489564', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454696', 'lastCheck': '9.5', 'valid': True}}
>Thread-1814::DEBUG::2014-04-10 17:13:41,824::task::1168::TaskManager.Task::(prepare) Task=`8a3c1464-1701-492d-a9a2-05be25b437e7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383722', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283331', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489564', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454696', 'lastCheck': '9.5', 'valid': True}}
>Thread-1814::DEBUG::2014-04-10 17:13:41,825::task::579::TaskManager.Task::(_updateState) Task=`8a3c1464-1701-492d-a9a2-05be25b437e7`::moving from state preparing -> state finished
>Thread-1814::DEBUG::2014-04-10 17:13:41,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1814::DEBUG::2014-04-10 17:13:41,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1814::DEBUG::2014-04-10 17:13:41,825::task::974::TaskManager.Task::(_decref) Task=`8a3c1464-1701-492d-a9a2-05be25b437e7`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:13:42,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:13:42,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000436912 s, 842 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:42,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:42,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00043078 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1818::DEBUG::2014-04-10 17:13:50,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1818::DEBUG::2014-04-10 17:13:50,759::task::579::TaskManager.Task::(_updateState) Task=`b80c9d0c-1c22-4d87-955e-c1feff7ca35e`::moving from state init -> state preparing
>Thread-1818::INFO::2014-04-10 17:13:50,759::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1818::INFO::2014-04-10 17:13:50,759::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1818::DEBUG::2014-04-10 17:13:50,760::task::1168::TaskManager.Task::(prepare) Task=`b80c9d0c-1c22-4d87-955e-c1feff7ca35e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1818::DEBUG::2014-04-10 17:13:50,760::task::579::TaskManager.Task::(_updateState) Task=`b80c9d0c-1c22-4d87-955e-c1feff7ca35e`::moving from state preparing -> state finished
>Thread-1818::DEBUG::2014-04-10 17:13:50,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1818::DEBUG::2014-04-10 17:13:50,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1818::DEBUG::2014-04-10 17:13:50,760::task::974::TaskManager.Task::(_decref) Task=`b80c9d0c-1c22-4d87-955e-c1feff7ca35e`::ref 0 aborting False
>Thread-1819::DEBUG::2014-04-10 17:13:50,766::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-1819::DEBUG::2014-04-10 17:13:50,767::task::579::TaskManager.Task::(_updateState) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::moving from state init -> state preparing
>Thread-1819::INFO::2014-04-10 17:13:50,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1819::DEBUG::2014-04-10 17:13:50,767::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47e5824d-1f96-4dc0-a274-c61538fa074b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1819::DEBUG::2014-04-10 17:13:50,768::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1819::DEBUG::2014-04-10 17:13:50,768::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1819::DEBUG::2014-04-10 17:13:50,768::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47e5824d-1f96-4dc0-a274-c61538fa074b`::Granted request
>Thread-1819::DEBUG::2014-04-10 17:13:50,768::task::811::TaskManager.Task::(resourceAcquired) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1819::DEBUG::2014-04-10 17:13:50,768::task::974::TaskManager.Task::(_decref) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::ref 1 aborting False
>Thread-1819::INFO::2014-04-10 17:13:50,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1819::DEBUG::2014-04-10 17:13:50,770::task::1168::TaskManager.Task::(prepare) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1819::DEBUG::2014-04-10 17:13:50,771::task::579::TaskManager.Task::(_updateState) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::moving from state preparing -> state finished
>Thread-1819::DEBUG::2014-04-10 17:13:50,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1819::DEBUG::2014-04-10 17:13:50,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1819::DEBUG::2014-04-10 17:13:50,771::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1819::DEBUG::2014-04-10 17:13:50,771::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1819::DEBUG::2014-04-10 17:13:50,772::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1819::DEBUG::2014-04-10 17:13:50,772::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1819::DEBUG::2014-04-10 17:13:50,772::task::974::TaskManager.Task::(_decref) Task=`a714c9be-6d05-4236-87cf-0e749c036324`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:13:50,779::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:13:50,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000231008 s, 2.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:13:50,815::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:13:50,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304793 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:13:52,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:13:52,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457149 s, 805 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:13:52,348::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:13:52,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406163 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1822::DEBUG::2014-04-10 17:13:56,995::task::579::TaskManager.Task::(_updateState) Task=`28acbef7-074c-4265-b2d4-858e262f944c`::moving from state init -> state preparing
>Thread-1822::INFO::2014-04-10 17:13:56,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1822::INFO::2014-04-10 17:13:56,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406163', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231008', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304793', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457149', 'lastCheck': '4.7', 'valid': True}}
>Thread-1822::DEBUG::2014-04-10 17:13:56,996::task::1168::TaskManager.Task::(prepare) Task=`28acbef7-074c-4265-b2d4-858e262f944c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406163', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231008', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304793', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457149', 'lastCheck': '4.7', 'valid': True}}
>Thread-1822::DEBUG::2014-04-10 17:13:56,997::task::579::TaskManager.Task::(_updateState) Task=`28acbef7-074c-4265-b2d4-858e262f944c`::moving from state preparing -> state finished
>Thread-1822::DEBUG::2014-04-10 17:13:56,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1822::DEBUG::2014-04-10 17:13:56,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1822::DEBUG::2014-04-10 17:13:56,997::task::974::TaskManager.Task::(_decref) Task=`28acbef7-074c-4265-b2d4-858e262f944c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:14:00,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:00,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389276 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:00,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1825::DEBUG::2014-04-10 17:14:00,862::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1825::DEBUG::2014-04-10 17:14:00,866::task::579::TaskManager.Task::(_updateState) Task=`c482af36-c6ba-4cc4-aec2-8c8d8a5ae16b`::moving from state init -> state preparing
>Thread-1825::INFO::2014-04-10 17:14:00,868::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1825::INFO::2014-04-10 17:14:00,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1825::DEBUG::2014-04-10 17:14:00,873::task::1168::TaskManager.Task::(prepare) Task=`c482af36-c6ba-4cc4-aec2-8c8d8a5ae16b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1825::DEBUG::2014-04-10 17:14:00,875::task::579::TaskManager.Task::(_updateState) Task=`c482af36-c6ba-4cc4-aec2-8c8d8a5ae16b`::moving from state preparing -> state finished
>Thread-1825::DEBUG::2014-04-10 17:14:00,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-468::DEBUG::2014-04-10 17:14:00,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320635 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1825::DEBUG::2014-04-10 17:14:00,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1825::DEBUG::2014-04-10 17:14:00,881::task::974::TaskManager.Task::(_decref) Task=`c482af36-c6ba-4cc4-aec2-8c8d8a5ae16b`::ref 0 aborting False
>Thread-1826::DEBUG::2014-04-10 17:14:00,892::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1826::DEBUG::2014-04-10 17:14:00,892::task::579::TaskManager.Task::(_updateState) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::moving from state init -> state preparing
>Thread-1826::INFO::2014-04-10 17:14:00,893::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1826::DEBUG::2014-04-10 17:14:00,893::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2170113-105d-4028-b322-dce322d8e244`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1826::DEBUG::2014-04-10 17:14:00,893::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1826::DEBUG::2014-04-10 17:14:00,894::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1826::DEBUG::2014-04-10 17:14:00,894::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2170113-105d-4028-b322-dce322d8e244`::Granted request
>Thread-1826::DEBUG::2014-04-10 17:14:00,894::task::811::TaskManager.Task::(resourceAcquired) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1826::DEBUG::2014-04-10 17:14:00,894::task::974::TaskManager.Task::(_decref) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::ref 1 aborting False
>Thread-1826::INFO::2014-04-10 17:14:00,897::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1826::DEBUG::2014-04-10 17:14:00,897::task::1168::TaskManager.Task::(prepare) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1826::DEBUG::2014-04-10 17:14:00,897::task::579::TaskManager.Task::(_updateState) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::moving from state preparing -> state finished
>Thread-1826::DEBUG::2014-04-10 17:14:00,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1826::DEBUG::2014-04-10 17:14:00,898::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1826::DEBUG::2014-04-10 17:14:00,898::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1826::DEBUG::2014-04-10 17:14:00,898::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1826::DEBUG::2014-04-10 17:14:00,898::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1826::DEBUG::2014-04-10 17:14:00,898::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1826::DEBUG::2014-04-10 17:14:00,899::task::974::TaskManager.Task::(_decref) Task=`cbe0bef9-e9dc-4bc3-a737-d6dce3115b99`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:02,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:02,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000337126 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:02,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:02,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000401013 s, 1.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:14:10,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:10,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292965 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:10,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:14:10,899::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339905 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1830::DEBUG::2014-04-10 17:14:10,981::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1830::DEBUG::2014-04-10 17:14:10,982::task::579::TaskManager.Task::(_updateState) Task=`9e21a14e-d877-485d-bcc2-de65f8acd365`::moving from state init -> state preparing
>Thread-1830::INFO::2014-04-10 17:14:10,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1830::INFO::2014-04-10 17:14:10,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1830::DEBUG::2014-04-10 17:14:10,983::task::1168::TaskManager.Task::(prepare) Task=`9e21a14e-d877-485d-bcc2-de65f8acd365`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1830::DEBUG::2014-04-10 17:14:10,983::task::579::TaskManager.Task::(_updateState) Task=`9e21a14e-d877-485d-bcc2-de65f8acd365`::moving from state preparing -> state finished
>Thread-1830::DEBUG::2014-04-10 17:14:10,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1830::DEBUG::2014-04-10 17:14:10,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1830::DEBUG::2014-04-10 17:14:10,984::task::974::TaskManager.Task::(_decref) Task=`9e21a14e-d877-485d-bcc2-de65f8acd365`::ref 0 aborting False
>Thread-1831::DEBUG::2014-04-10 17:14:10,991::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1831::DEBUG::2014-04-10 17:14:10,992::task::579::TaskManager.Task::(_updateState) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::moving from state init -> state preparing
>Thread-1831::INFO::2014-04-10 17:14:10,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1831::DEBUG::2014-04-10 17:14:10,993::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`969962f4-3289-4eba-b81b-317f65465249`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1831::DEBUG::2014-04-10 17:14:10,994::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1831::DEBUG::2014-04-10 17:14:10,994::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1831::DEBUG::2014-04-10 17:14:10,994::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`969962f4-3289-4eba-b81b-317f65465249`::Granted request
>Thread-1831::DEBUG::2014-04-10 17:14:10,994::task::811::TaskManager.Task::(resourceAcquired) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1831::DEBUG::2014-04-10 17:14:10,995::task::974::TaskManager.Task::(_decref) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::ref 1 aborting False
>Thread-1831::INFO::2014-04-10 17:14:10,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1831::DEBUG::2014-04-10 17:14:10,997::task::1168::TaskManager.Task::(prepare) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1831::DEBUG::2014-04-10 17:14:10,997::task::579::TaskManager.Task::(_updateState) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::moving from state preparing -> state finished
>Thread-1831::DEBUG::2014-04-10 17:14:10,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1831::DEBUG::2014-04-10 17:14:10,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1831::DEBUG::2014-04-10 17:14:10,998::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1831::DEBUG::2014-04-10 17:14:10,998::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1831::DEBUG::2014-04-10 17:14:10,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1831::DEBUG::2014-04-10 17:14:10,998::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1831::DEBUG::2014-04-10 17:14:10,998::task::974::TaskManager.Task::(_decref) Task=`ce1fe120-9b83-4e94-9f48-1348d5032e0f`::ref 0 aborting False
>Thread-1832::DEBUG::2014-04-10 17:14:12,169::task::579::TaskManager.Task::(_updateState) Task=`696dc3d4-ce98-4445-b063-3947e50bc464`::moving from state init -> state preparing
>Thread-1832::INFO::2014-04-10 17:14:12,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1832::INFO::2014-04-10 17:14:12,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401013', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292965', 'lastCheck': '1.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339905', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337126', 'lastCheck': '9.8', 'valid': True}}
>Thread-1832::DEBUG::2014-04-10 17:14:12,170::task::1168::TaskManager.Task::(prepare) Task=`696dc3d4-ce98-4445-b063-3947e50bc464`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401013', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292965', 'lastCheck': '1.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339905', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337126', 'lastCheck': '9.8', 'valid': True}}
>Thread-1832::DEBUG::2014-04-10 17:14:12,170::task::579::TaskManager.Task::(_updateState) Task=`696dc3d4-ce98-4445-b063-3947e50bc464`::moving from state preparing -> state finished
>Thread-1832::DEBUG::2014-04-10 17:14:12,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1832::DEBUG::2014-04-10 17:14:12,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1832::DEBUG::2014-04-10 17:14:12,171::task::974::TaskManager.Task::(_decref) Task=`696dc3d4-ce98-4445-b063-3947e50bc464`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:12,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:12,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000409871 s, 898 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:12,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:12,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000319369 s, 2.1 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:14:20,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:20,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278572 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:20,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:14:20,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026495 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1836::DEBUG::2014-04-10 17:14:21,079::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1836::DEBUG::2014-04-10 17:14:21,080::task::579::TaskManager.Task::(_updateState) Task=`0f9d9847-31c3-4dcd-a345-febcb83a1042`::moving from state init -> state preparing
>Thread-1836::INFO::2014-04-10 17:14:21,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1836::INFO::2014-04-10 17:14:21,080::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1836::DEBUG::2014-04-10 17:14:21,080::task::1168::TaskManager.Task::(prepare) Task=`0f9d9847-31c3-4dcd-a345-febcb83a1042`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1836::DEBUG::2014-04-10 17:14:21,081::task::579::TaskManager.Task::(_updateState) Task=`0f9d9847-31c3-4dcd-a345-febcb83a1042`::moving from state preparing -> state finished
>Thread-1836::DEBUG::2014-04-10 17:14:21,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1836::DEBUG::2014-04-10 17:14:21,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1836::DEBUG::2014-04-10 17:14:21,081::task::974::TaskManager.Task::(_decref) Task=`0f9d9847-31c3-4dcd-a345-febcb83a1042`::ref 0 aborting False
>Thread-1837::DEBUG::2014-04-10 17:14:21,088::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1837::DEBUG::2014-04-10 17:14:21,088::task::579::TaskManager.Task::(_updateState) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::moving from state init -> state preparing
>Thread-1837::INFO::2014-04-10 17:14:21,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1837::DEBUG::2014-04-10 17:14:21,089::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6a0cdace-0a24-4362-96a2-1253e1382846`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1837::DEBUG::2014-04-10 17:14:21,089::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1837::DEBUG::2014-04-10 17:14:21,089::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1837::DEBUG::2014-04-10 17:14:21,089::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6a0cdace-0a24-4362-96a2-1253e1382846`::Granted request
>Thread-1837::DEBUG::2014-04-10 17:14:21,090::task::811::TaskManager.Task::(resourceAcquired) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1837::DEBUG::2014-04-10 17:14:21,090::task::974::TaskManager.Task::(_decref) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::ref 1 aborting False
>Thread-1837::INFO::2014-04-10 17:14:21,092::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1837::DEBUG::2014-04-10 17:14:21,092::task::1168::TaskManager.Task::(prepare) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1837::DEBUG::2014-04-10 17:14:21,092::task::579::TaskManager.Task::(_updateState) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::moving from state preparing -> state finished
>Thread-1837::DEBUG::2014-04-10 17:14:21,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1837::DEBUG::2014-04-10 17:14:21,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1837::DEBUG::2014-04-10 17:14:21,093::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1837::DEBUG::2014-04-10 17:14:21,093::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1837::DEBUG::2014-04-10 17:14:21,093::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1837::DEBUG::2014-04-10 17:14:21,093::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1837::DEBUG::2014-04-10 17:14:21,093::task::974::TaskManager.Task::(_decref) Task=`e65fc320-d0d0-49a4-9045-b6613e27b6ed`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:22,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:22,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00046641 s, 789 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:22,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:22,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000390543 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1840::DEBUG::2014-04-10 17:14:27,341::task::579::TaskManager.Task::(_updateState) Task=`5701da0e-99ea-4253-8b1b-7bdcdbd6200a`::moving from state init -> state preparing
>Thread-1840::INFO::2014-04-10 17:14:27,342::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1840::INFO::2014-04-10 17:14:27,342::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390543', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278572', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026495', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046641', 'lastCheck': '4.9', 'valid': True}}
>Thread-1840::DEBUG::2014-04-10 17:14:27,342::task::1168::TaskManager.Task::(prepare) Task=`5701da0e-99ea-4253-8b1b-7bdcdbd6200a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390543', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278572', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026495', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046641', 'lastCheck': '4.9', 'valid': True}}
>Thread-1840::DEBUG::2014-04-10 17:14:27,342::task::579::TaskManager.Task::(_updateState) Task=`5701da0e-99ea-4253-8b1b-7bdcdbd6200a`::moving from state preparing -> state finished
>Thread-1840::DEBUG::2014-04-10 17:14:27,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1840::DEBUG::2014-04-10 17:14:27,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1840::DEBUG::2014-04-10 17:14:27,343::task::974::TaskManager.Task::(_decref) Task=`5701da0e-99ea-4253-8b1b-7bdcdbd6200a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:14:30,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:30,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0002911 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:30,922::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:14:30,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375801 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1843::DEBUG::2014-04-10 17:14:31,180::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-1843::DEBUG::2014-04-10 17:14:31,183::task::579::TaskManager.Task::(_updateState) Task=`fce404f6-19f9-4119-bd0d-75cf1c1588d0`::moving from state init -> state preparing
>Thread-1843::INFO::2014-04-10 17:14:31,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1843::INFO::2014-04-10 17:14:31,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1843::DEBUG::2014-04-10 17:14:31,189::task::1168::TaskManager.Task::(prepare) Task=`fce404f6-19f9-4119-bd0d-75cf1c1588d0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1843::DEBUG::2014-04-10 17:14:31,190::task::579::TaskManager.Task::(_updateState) Task=`fce404f6-19f9-4119-bd0d-75cf1c1588d0`::moving from state preparing -> state finished
>Thread-1843::DEBUG::2014-04-10 17:14:31,192::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1843::DEBUG::2014-04-10 17:14:31,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1843::DEBUG::2014-04-10 17:14:31,195::task::974::TaskManager.Task::(_decref) Task=`fce404f6-19f9-4119-bd0d-75cf1c1588d0`::ref 0 aborting False
>Thread-1844::DEBUG::2014-04-10 17:14:31,203::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-1844::DEBUG::2014-04-10 17:14:31,203::task::579::TaskManager.Task::(_updateState) Task=`4b613653-860b-48e6-8138-126801f74a2d`::moving from state init -> state preparing
>Thread-1844::INFO::2014-04-10 17:14:31,204::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1844::DEBUG::2014-04-10 17:14:31,204::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`de53b1f2-3ba8-4a83-be49-7068aeae3738`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1844::DEBUG::2014-04-10 17:14:31,204::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1844::DEBUG::2014-04-10 17:14:31,205::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1844::DEBUG::2014-04-10 17:14:31,205::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`de53b1f2-3ba8-4a83-be49-7068aeae3738`::Granted request
>Thread-1844::DEBUG::2014-04-10 17:14:31,205::task::811::TaskManager.Task::(resourceAcquired) Task=`4b613653-860b-48e6-8138-126801f74a2d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1844::DEBUG::2014-04-10 17:14:31,205::task::974::TaskManager.Task::(_decref) Task=`4b613653-860b-48e6-8138-126801f74a2d`::ref 1 aborting False
>Thread-1844::INFO::2014-04-10 17:14:31,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1844::DEBUG::2014-04-10 17:14:31,208::task::1168::TaskManager.Task::(prepare) Task=`4b613653-860b-48e6-8138-126801f74a2d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1844::DEBUG::2014-04-10 17:14:31,208::task::579::TaskManager.Task::(_updateState) Task=`4b613653-860b-48e6-8138-126801f74a2d`::moving from state preparing -> state finished
>Thread-1844::DEBUG::2014-04-10 17:14:31,208::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1844::DEBUG::2014-04-10 17:14:31,208::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1844::DEBUG::2014-04-10 17:14:31,208::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1844::DEBUG::2014-04-10 17:14:31,209::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1844::DEBUG::2014-04-10 17:14:31,209::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1844::DEBUG::2014-04-10 17:14:31,209::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1844::DEBUG::2014-04-10 17:14:31,209::task::974::TaskManager.Task::(_decref) Task=`4b613653-860b-48e6-8138-126801f74a2d`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:32,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:32,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000342318 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:32,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:32,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000451132 s, 1.5 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:14:40,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:40,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347713 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:40,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:14:40,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365801 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1848::DEBUG::2014-04-10 17:14:41,324::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1848::DEBUG::2014-04-10 17:14:41,325::task::579::TaskManager.Task::(_updateState) Task=`cb3e07d4-3ad3-4eb3-a2b3-3fd530698771`::moving from state init -> state preparing
>Thread-1848::INFO::2014-04-10 17:14:41,325::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1848::INFO::2014-04-10 17:14:41,326::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1848::DEBUG::2014-04-10 17:14:41,326::task::1168::TaskManager.Task::(prepare) Task=`cb3e07d4-3ad3-4eb3-a2b3-3fd530698771`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1848::DEBUG::2014-04-10 17:14:41,326::task::579::TaskManager.Task::(_updateState) Task=`cb3e07d4-3ad3-4eb3-a2b3-3fd530698771`::moving from state preparing -> state finished
>Thread-1848::DEBUG::2014-04-10 17:14:41,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1848::DEBUG::2014-04-10 17:14:41,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1848::DEBUG::2014-04-10 17:14:41,326::task::974::TaskManager.Task::(_decref) Task=`cb3e07d4-3ad3-4eb3-a2b3-3fd530698771`::ref 0 aborting False
>Thread-1849::DEBUG::2014-04-10 17:14:41,333::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1849::DEBUG::2014-04-10 17:14:41,333::task::579::TaskManager.Task::(_updateState) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::moving from state init -> state preparing
>Thread-1849::INFO::2014-04-10 17:14:41,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1849::DEBUG::2014-04-10 17:14:41,334::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`883082e1-e40c-4b7e-beac-f4401fe2b36f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1849::DEBUG::2014-04-10 17:14:41,334::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1849::DEBUG::2014-04-10 17:14:41,335::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1849::DEBUG::2014-04-10 17:14:41,335::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`883082e1-e40c-4b7e-beac-f4401fe2b36f`::Granted request
>Thread-1849::DEBUG::2014-04-10 17:14:41,335::task::811::TaskManager.Task::(resourceAcquired) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1849::DEBUG::2014-04-10 17:14:41,335::task::974::TaskManager.Task::(_decref) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::ref 1 aborting False
>Thread-1849::INFO::2014-04-10 17:14:41,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1849::DEBUG::2014-04-10 17:14:41,338::task::1168::TaskManager.Task::(prepare) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1849::DEBUG::2014-04-10 17:14:41,338::task::579::TaskManager.Task::(_updateState) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::moving from state preparing -> state finished
>Thread-1849::DEBUG::2014-04-10 17:14:41,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1849::DEBUG::2014-04-10 17:14:41,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1849::DEBUG::2014-04-10 17:14:41,338::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1849::DEBUG::2014-04-10 17:14:41,339::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1849::DEBUG::2014-04-10 17:14:41,339::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1849::DEBUG::2014-04-10 17:14:41,339::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1849::DEBUG::2014-04-10 17:14:41,339::task::974::TaskManager.Task::(_decref) Task=`4a00c047-d508-4fe1-b306-17d3cc00b2c8`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:42,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:42,438::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000417739 s, 881 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:42,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:42,458::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00037845 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1850::DEBUG::2014-04-10 17:14:42,503::task::579::TaskManager.Task::(_updateState) Task=`3e93c42b-8c86-49cb-ab1f-99a804758763`::moving from state init -> state preparing
>Thread-1850::INFO::2014-04-10 17:14:42,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1850::INFO::2014-04-10 17:14:42,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037845', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347713', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365801', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417739', 'lastCheck': '0.1', 'valid': True}}
>Thread-1850::DEBUG::2014-04-10 17:14:42,504::task::1168::TaskManager.Task::(prepare) Task=`3e93c42b-8c86-49cb-ab1f-99a804758763`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037845', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347713', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365801', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417739', 'lastCheck': '0.1', 'valid': True}}
>Thread-1850::DEBUG::2014-04-10 17:14:42,504::task::579::TaskManager.Task::(_updateState) Task=`3e93c42b-8c86-49cb-ab1f-99a804758763`::moving from state preparing -> state finished
>Thread-1850::DEBUG::2014-04-10 17:14:42,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1850::DEBUG::2014-04-10 17:14:42,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1850::DEBUG::2014-04-10 17:14:42,505::task::974::TaskManager.Task::(_decref) Task=`3e93c42b-8c86-49cb-ab1f-99a804758763`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:14:50,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:14:50,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389622 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:14:50,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:14:50,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250556 s, 2.7 MB/s\n'; <rc> = 0
>Thread-1854::DEBUG::2014-04-10 17:14:51,417::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1854::DEBUG::2014-04-10 17:14:51,417::task::579::TaskManager.Task::(_updateState) Task=`f6e05458-7fab-49ff-9566-536f6d24ed57`::moving from state init -> state preparing
>Thread-1854::INFO::2014-04-10 17:14:51,417::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1854::INFO::2014-04-10 17:14:51,418::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1854::DEBUG::2014-04-10 17:14:51,418::task::1168::TaskManager.Task::(prepare) Task=`f6e05458-7fab-49ff-9566-536f6d24ed57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1854::DEBUG::2014-04-10 17:14:51,418::task::579::TaskManager.Task::(_updateState) Task=`f6e05458-7fab-49ff-9566-536f6d24ed57`::moving from state preparing -> state finished
>Thread-1854::DEBUG::2014-04-10 17:14:51,418::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1854::DEBUG::2014-04-10 17:14:51,418::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1854::DEBUG::2014-04-10 17:14:51,419::task::974::TaskManager.Task::(_decref) Task=`f6e05458-7fab-49ff-9566-536f6d24ed57`::ref 0 aborting False
>Thread-1855::DEBUG::2014-04-10 17:14:51,425::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1855::DEBUG::2014-04-10 17:14:51,425::task::579::TaskManager.Task::(_updateState) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::moving from state init -> state preparing
>Thread-1855::INFO::2014-04-10 17:14:51,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1855::DEBUG::2014-04-10 17:14:51,426::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad5f8b5-b9eb-40c8-aa0c-7fdb9d767e16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1855::DEBUG::2014-04-10 17:14:51,426::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1855::DEBUG::2014-04-10 17:14:51,426::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1855::DEBUG::2014-04-10 17:14:51,426::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad5f8b5-b9eb-40c8-aa0c-7fdb9d767e16`::Granted request
>Thread-1855::DEBUG::2014-04-10 17:14:51,427::task::811::TaskManager.Task::(resourceAcquired) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1855::DEBUG::2014-04-10 17:14:51,427::task::974::TaskManager.Task::(_decref) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::ref 1 aborting False
>Thread-1855::INFO::2014-04-10 17:14:51,429::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1855::DEBUG::2014-04-10 17:14:51,429::task::1168::TaskManager.Task::(prepare) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1855::DEBUG::2014-04-10 17:14:51,429::task::579::TaskManager.Task::(_updateState) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::moving from state preparing -> state finished
>Thread-1855::DEBUG::2014-04-10 17:14:51,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1855::DEBUG::2014-04-10 17:14:51,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1855::DEBUG::2014-04-10 17:14:51,430::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1855::DEBUG::2014-04-10 17:14:51,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1855::DEBUG::2014-04-10 17:14:51,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1855::DEBUG::2014-04-10 17:14:51,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1855::DEBUG::2014-04-10 17:14:51,430::task::974::TaskManager.Task::(_decref) Task=`35150212-1c55-4a5f-b71c-d2e66c9961d5`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:14:52,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:14:52,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437882 s, 840 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:14:52,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:14:52,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000434314 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1858::DEBUG::2014-04-10 17:14:57,935::task::579::TaskManager.Task::(_updateState) Task=`0c23bcf6-147d-45b4-922e-1d692d7d8abb`::moving from state init -> state preparing
>Thread-1858::INFO::2014-04-10 17:14:57,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1858::INFO::2014-04-10 17:14:57,936::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434314', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389622', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250556', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437882', 'lastCheck': '5.5', 'valid': True}}
>Thread-1858::DEBUG::2014-04-10 17:14:57,936::task::1168::TaskManager.Task::(prepare) Task=`0c23bcf6-147d-45b4-922e-1d692d7d8abb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434314', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389622', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250556', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437882', 'lastCheck': '5.5', 'valid': True}}
>Thread-1858::DEBUG::2014-04-10 17:14:57,936::task::579::TaskManager.Task::(_updateState) Task=`0c23bcf6-147d-45b4-922e-1d692d7d8abb`::moving from state preparing -> state finished
>Thread-1858::DEBUG::2014-04-10 17:14:57,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1858::DEBUG::2014-04-10 17:14:57,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1858::DEBUG::2014-04-10 17:14:57,937::task::974::TaskManager.Task::(_decref) Task=`0c23bcf6-147d-45b4-922e-1d692d7d8abb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:00,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:15:00,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329197 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:00,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:00,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316814 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1861::DEBUG::2014-04-10 17:15:01,514::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1861::DEBUG::2014-04-10 17:15:01,515::task::579::TaskManager.Task::(_updateState) Task=`e4a5b2b0-c5ba-4f6f-bb8f-c63e79a12fc9`::moving from state init -> state preparing
>Thread-1861::INFO::2014-04-10 17:15:01,515::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1861::INFO::2014-04-10 17:15:01,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1861::DEBUG::2014-04-10 17:15:01,515::task::1168::TaskManager.Task::(prepare) Task=`e4a5b2b0-c5ba-4f6f-bb8f-c63e79a12fc9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1861::DEBUG::2014-04-10 17:15:01,515::task::579::TaskManager.Task::(_updateState) Task=`e4a5b2b0-c5ba-4f6f-bb8f-c63e79a12fc9`::moving from state preparing -> state finished
>Thread-1861::DEBUG::2014-04-10 17:15:01,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1861::DEBUG::2014-04-10 17:15:01,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1861::DEBUG::2014-04-10 17:15:01,516::task::974::TaskManager.Task::(_decref) Task=`e4a5b2b0-c5ba-4f6f-bb8f-c63e79a12fc9`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:15:02,478::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:02,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000423464 s, 869 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:02,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:02,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00035387 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1862::DEBUG::2014-04-10 17:15:02,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1862::DEBUG::2014-04-10 17:15:02,523::task::579::TaskManager.Task::(_updateState) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::moving from state init -> state preparing
>Thread-1862::INFO::2014-04-10 17:15:02,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1862::DEBUG::2014-04-10 17:15:02,524::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf36f876-dca8-41b7-a7c1-cea6942badb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1862::DEBUG::2014-04-10 17:15:02,524::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1862::DEBUG::2014-04-10 17:15:02,525::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1862::DEBUG::2014-04-10 17:15:02,525::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf36f876-dca8-41b7-a7c1-cea6942badb9`::Granted request
>Thread-1862::DEBUG::2014-04-10 17:15:02,525::task::811::TaskManager.Task::(resourceAcquired) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1862::DEBUG::2014-04-10 17:15:02,525::task::974::TaskManager.Task::(_decref) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::ref 1 aborting False
>Thread-1862::INFO::2014-04-10 17:15:02,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1862::DEBUG::2014-04-10 17:15:02,528::task::1168::TaskManager.Task::(prepare) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1862::DEBUG::2014-04-10 17:15:02,528::task::579::TaskManager.Task::(_updateState) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::moving from state preparing -> state finished
>Thread-1862::DEBUG::2014-04-10 17:15:02,528::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1862::DEBUG::2014-04-10 17:15:02,528::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1862::DEBUG::2014-04-10 17:15:02,529::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1862::DEBUG::2014-04-10 17:15:02,529::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1862::DEBUG::2014-04-10 17:15:02,529::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1862::DEBUG::2014-04-10 17:15:02,529::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1862::DEBUG::2014-04-10 17:15:02,529::task::974::TaskManager.Task::(_decref) Task=`c0fe5f41-1abe-444e-b996-380e342e8bf6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:10,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:15:10,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421091 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:10,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:10,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000222353 s, 3.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:15:12,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:12,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000385893 s, 954 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:12,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:12,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000373675 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1866::DEBUG::2014-04-10 17:15:12,670::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-1866::DEBUG::2014-04-10 17:15:12,670::task::579::TaskManager.Task::(_updateState) Task=`f72d3228-125f-495e-876b-60aaae69dd97`::moving from state init -> state preparing
>Thread-1866::INFO::2014-04-10 17:15:12,671::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1866::INFO::2014-04-10 17:15:12,671::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1866::DEBUG::2014-04-10 17:15:12,671::task::1168::TaskManager.Task::(prepare) Task=`f72d3228-125f-495e-876b-60aaae69dd97`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1866::DEBUG::2014-04-10 17:15:12,671::task::579::TaskManager.Task::(_updateState) Task=`f72d3228-125f-495e-876b-60aaae69dd97`::moving from state preparing -> state finished
>Thread-1866::DEBUG::2014-04-10 17:15:12,672::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1866::DEBUG::2014-04-10 17:15:12,672::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1866::DEBUG::2014-04-10 17:15:12,672::task::974::TaskManager.Task::(_decref) Task=`f72d3228-125f-495e-876b-60aaae69dd97`::ref 0 aborting False
>Thread-1867::DEBUG::2014-04-10 17:15:12,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-1867::DEBUG::2014-04-10 17:15:12,679::task::579::TaskManager.Task::(_updateState) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::moving from state init -> state preparing
>Thread-1867::INFO::2014-04-10 17:15:12,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1867::DEBUG::2014-04-10 17:15:12,680::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4069168d-a3e8-49e7-908f-d53fd1a06136`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1867::DEBUG::2014-04-10 17:15:12,680::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1867::DEBUG::2014-04-10 17:15:12,681::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1867::DEBUG::2014-04-10 17:15:12,681::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4069168d-a3e8-49e7-908f-d53fd1a06136`::Granted request
>Thread-1867::DEBUG::2014-04-10 17:15:12,681::task::811::TaskManager.Task::(resourceAcquired) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1867::DEBUG::2014-04-10 17:15:12,681::task::974::TaskManager.Task::(_decref) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::ref 1 aborting False
>Thread-1867::INFO::2014-04-10 17:15:12,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948827136', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948827136', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1867::DEBUG::2014-04-10 17:15:12,684::task::1168::TaskManager.Task::(prepare) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948827136', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910948827136', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1867::DEBUG::2014-04-10 17:15:12,684::task::579::TaskManager.Task::(_updateState) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::moving from state preparing -> state finished
>Thread-1867::DEBUG::2014-04-10 17:15:12,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1867::DEBUG::2014-04-10 17:15:12,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1867::DEBUG::2014-04-10 17:15:12,685::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1867::DEBUG::2014-04-10 17:15:12,685::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1867::DEBUG::2014-04-10 17:15:12,685::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1867::DEBUG::2014-04-10 17:15:12,685::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1867::DEBUG::2014-04-10 17:15:12,685::task::974::TaskManager.Task::(_decref) Task=`8e25a939-9bf7-4b1f-b598-21057907a00c`::ref 0 aborting False
>Thread-1868::DEBUG::2014-04-10 17:15:13,135::task::579::TaskManager.Task::(_updateState) Task=`a4afd50d-6bc2-4b18-9b95-5c80cbc10215`::moving from state init -> state preparing
>Thread-1868::INFO::2014-04-10 17:15:13,135::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1868::INFO::2014-04-10 17:15:13,135::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373675', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421091', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222353', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385893', 'lastCheck': '0.6', 'valid': True}}
>Thread-1868::DEBUG::2014-04-10 17:15:13,135::task::1168::TaskManager.Task::(prepare) Task=`a4afd50d-6bc2-4b18-9b95-5c80cbc10215`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373675', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421091', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222353', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385893', 'lastCheck': '0.6', 'valid': True}}
>Thread-1868::DEBUG::2014-04-10 17:15:13,136::task::579::TaskManager.Task::(_updateState) Task=`a4afd50d-6bc2-4b18-9b95-5c80cbc10215`::moving from state preparing -> state finished
>Thread-1868::DEBUG::2014-04-10 17:15:13,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1868::DEBUG::2014-04-10 17:15:13,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1868::DEBUG::2014-04-10 17:15:13,136::task::974::TaskManager.Task::(_decref) Task=`a4afd50d-6bc2-4b18-9b95-5c80cbc10215`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:20,975::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:15:20,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000412721 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:20,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:21,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353052 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:15:22,544::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:22,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000362689 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:22,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:22,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000378115 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1873::DEBUG::2014-04-10 17:15:22,803::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-1873::DEBUG::2014-04-10 17:15:22,804::task::579::TaskManager.Task::(_updateState) Task=`5e247984-c331-40a5-a706-a4ebd04d3739`::moving from state init -> state preparing
>Thread-1873::INFO::2014-04-10 17:15:22,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1873::INFO::2014-04-10 17:15:22,805::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1873::DEBUG::2014-04-10 17:15:22,805::task::1168::TaskManager.Task::(prepare) Task=`5e247984-c331-40a5-a706-a4ebd04d3739`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1873::DEBUG::2014-04-10 17:15:22,805::task::579::TaskManager.Task::(_updateState) Task=`5e247984-c331-40a5-a706-a4ebd04d3739`::moving from state preparing -> state finished
>Thread-1873::DEBUG::2014-04-10 17:15:22,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1873::DEBUG::2014-04-10 17:15:22,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1873::DEBUG::2014-04-10 17:15:22,806::task::974::TaskManager.Task::(_decref) Task=`5e247984-c331-40a5-a706-a4ebd04d3739`::ref 0 aborting False
>Thread-1874::DEBUG::2014-04-10 17:15:22,812::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-1874::DEBUG::2014-04-10 17:15:22,813::task::579::TaskManager.Task::(_updateState) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::moving from state init -> state preparing
>Thread-1874::INFO::2014-04-10 17:15:22,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1874::DEBUG::2014-04-10 17:15:22,814::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3d864041-3d1f-40f6-aa62-759f5da8870b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1874::DEBUG::2014-04-10 17:15:22,814::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1874::DEBUG::2014-04-10 17:15:22,814::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1874::DEBUG::2014-04-10 17:15:22,814::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3d864041-3d1f-40f6-aa62-759f5da8870b`::Granted request
>Thread-1874::DEBUG::2014-04-10 17:15:22,815::task::811::TaskManager.Task::(resourceAcquired) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1874::DEBUG::2014-04-10 17:15:22,815::task::974::TaskManager.Task::(_decref) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::ref 1 aborting False
>Thread-1874::INFO::2014-04-10 17:15:22,817::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1874::DEBUG::2014-04-10 17:15:22,817::task::1168::TaskManager.Task::(prepare) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1874::DEBUG::2014-04-10 17:15:22,817::task::579::TaskManager.Task::(_updateState) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::moving from state preparing -> state finished
>Thread-1874::DEBUG::2014-04-10 17:15:22,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1874::DEBUG::2014-04-10 17:15:22,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1874::DEBUG::2014-04-10 17:15:22,818::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1874::DEBUG::2014-04-10 17:15:22,818::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1874::DEBUG::2014-04-10 17:15:22,818::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1874::DEBUG::2014-04-10 17:15:22,818::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1874::DEBUG::2014-04-10 17:15:22,819::task::974::TaskManager.Task::(_decref) Task=`7ebc5689-d799-4a05-af88-e758e154d824`::ref 0 aborting False
>Thread-1876::DEBUG::2014-04-10 17:15:28,594::task::579::TaskManager.Task::(_updateState) Task=`4a61de28-ebd3-49b3-af68-712e1d1be414`::moving from state init -> state preparing
>Thread-1876::INFO::2014-04-10 17:15:28,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1876::INFO::2014-04-10 17:15:28,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378115', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412721', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353052', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362689', 'lastCheck': '6.0', 'valid': True}}
>Thread-1876::DEBUG::2014-04-10 17:15:28,595::task::1168::TaskManager.Task::(prepare) Task=`4a61de28-ebd3-49b3-af68-712e1d1be414`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378115', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412721', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353052', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362689', 'lastCheck': '6.0', 'valid': True}}
>Thread-1876::DEBUG::2014-04-10 17:15:28,595::task::579::TaskManager.Task::(_updateState) Task=`4a61de28-ebd3-49b3-af68-712e1d1be414`::moving from state preparing -> state finished
>Thread-1876::DEBUG::2014-04-10 17:15:28,595::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1876::DEBUG::2014-04-10 17:15:28,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1876::DEBUG::2014-04-10 17:15:28,595::task::974::TaskManager.Task::(_decref) Task=`4a61de28-ebd3-49b3-af68-712e1d1be414`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:30,985::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:15:30,991::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:15:30,995::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:15:31,000::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:15:31,001::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:15:31,001::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:15:31,001::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:15:31,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:31,006::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:15:31,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274001 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:31,045::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:15:31,048::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:15:31,054::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:15:31,056::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:15:31,056::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:15:31,056::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:15:31,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:31,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286655 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:15:32,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:32,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000393696 s, 935 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:32,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:32,617::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000413555 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1887::DEBUG::2014-04-10 17:15:32,910::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-1887::DEBUG::2014-04-10 17:15:32,912::task::579::TaskManager.Task::(_updateState) Task=`4544df30-cc82-4d1f-b678-8a7883749ad4`::moving from state init -> state preparing
>Thread-1887::INFO::2014-04-10 17:15:32,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1887::INFO::2014-04-10 17:15:32,912::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1887::DEBUG::2014-04-10 17:15:32,912::task::1168::TaskManager.Task::(prepare) Task=`4544df30-cc82-4d1f-b678-8a7883749ad4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1887::DEBUG::2014-04-10 17:15:32,913::task::579::TaskManager.Task::(_updateState) Task=`4544df30-cc82-4d1f-b678-8a7883749ad4`::moving from state preparing -> state finished
>Thread-1887::DEBUG::2014-04-10 17:15:32,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1887::DEBUG::2014-04-10 17:15:32,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1887::DEBUG::2014-04-10 17:15:32,913::task::974::TaskManager.Task::(_decref) Task=`4544df30-cc82-4d1f-b678-8a7883749ad4`::ref 0 aborting False
>Thread-1888::DEBUG::2014-04-10 17:15:32,920::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-1888::DEBUG::2014-04-10 17:15:32,921::task::579::TaskManager.Task::(_updateState) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::moving from state init -> state preparing
>Thread-1888::INFO::2014-04-10 17:15:32,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1888::DEBUG::2014-04-10 17:15:32,922::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9322688-a242-4bc4-a209-cf32cdb0ee18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1888::DEBUG::2014-04-10 17:15:32,922::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1888::DEBUG::2014-04-10 17:15:32,922::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1888::DEBUG::2014-04-10 17:15:32,922::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9322688-a242-4bc4-a209-cf32cdb0ee18`::Granted request
>Thread-1888::DEBUG::2014-04-10 17:15:32,923::task::811::TaskManager.Task::(resourceAcquired) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1888::DEBUG::2014-04-10 17:15:32,923::task::974::TaskManager.Task::(_decref) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::ref 1 aborting False
>Thread-1888::INFO::2014-04-10 17:15:32,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1888::DEBUG::2014-04-10 17:15:32,925::task::1168::TaskManager.Task::(prepare) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1888::DEBUG::2014-04-10 17:15:32,925::task::579::TaskManager.Task::(_updateState) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::moving from state preparing -> state finished
>Thread-1888::DEBUG::2014-04-10 17:15:32,925::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1888::DEBUG::2014-04-10 17:15:32,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1888::DEBUG::2014-04-10 17:15:32,926::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1888::DEBUG::2014-04-10 17:15:32,926::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1888::DEBUG::2014-04-10 17:15:32,926::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1888::DEBUG::2014-04-10 17:15:32,926::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1888::DEBUG::2014-04-10 17:15:32,927::task::974::TaskManager.Task::(_decref) Task=`23fda095-2c86-4aeb-9e97-2ce95dd42fa3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:41,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:15:41,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414355 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:41,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:41,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381248 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:15:42,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:42,640::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366048 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:42,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:42,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00036918 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1892::DEBUG::2014-04-10 17:15:43,017::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1892::DEBUG::2014-04-10 17:15:43,027::task::579::TaskManager.Task::(_updateState) Task=`56486b31-6fff-44de-9cac-244610fcd264`::moving from state init -> state preparing
>Thread-1892::INFO::2014-04-10 17:15:43,027::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1892::INFO::2014-04-10 17:15:43,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1892::DEBUG::2014-04-10 17:15:43,028::task::1168::TaskManager.Task::(prepare) Task=`56486b31-6fff-44de-9cac-244610fcd264`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1892::DEBUG::2014-04-10 17:15:43,028::task::579::TaskManager.Task::(_updateState) Task=`56486b31-6fff-44de-9cac-244610fcd264`::moving from state preparing -> state finished
>Thread-1892::DEBUG::2014-04-10 17:15:43,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1892::DEBUG::2014-04-10 17:15:43,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1892::DEBUG::2014-04-10 17:15:43,028::task::974::TaskManager.Task::(_decref) Task=`56486b31-6fff-44de-9cac-244610fcd264`::ref 0 aborting False
>Thread-1893::DEBUG::2014-04-10 17:15:43,036::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1893::DEBUG::2014-04-10 17:15:43,036::task::579::TaskManager.Task::(_updateState) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::moving from state init -> state preparing
>Thread-1893::INFO::2014-04-10 17:15:43,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1893::DEBUG::2014-04-10 17:15:43,037::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1ea01605-d3a6-489a-9fb8-6a761fca2477`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1893::DEBUG::2014-04-10 17:15:43,037::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1893::DEBUG::2014-04-10 17:15:43,037::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1893::DEBUG::2014-04-10 17:15:43,037::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1ea01605-d3a6-489a-9fb8-6a761fca2477`::Granted request
>Thread-1893::DEBUG::2014-04-10 17:15:43,038::task::811::TaskManager.Task::(resourceAcquired) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1893::DEBUG::2014-04-10 17:15:43,038::task::974::TaskManager.Task::(_decref) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::ref 1 aborting False
>Thread-1893::INFO::2014-04-10 17:15:43,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1893::DEBUG::2014-04-10 17:15:43,040::task::1168::TaskManager.Task::(prepare) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1893::DEBUG::2014-04-10 17:15:43,041::task::579::TaskManager.Task::(_updateState) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::moving from state preparing -> state finished
>Thread-1893::DEBUG::2014-04-10 17:15:43,041::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1893::DEBUG::2014-04-10 17:15:43,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1893::DEBUG::2014-04-10 17:15:43,041::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1893::DEBUG::2014-04-10 17:15:43,041::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1893::DEBUG::2014-04-10 17:15:43,042::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1893::DEBUG::2014-04-10 17:15:43,042::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1893::DEBUG::2014-04-10 17:15:43,042::task::974::TaskManager.Task::(_decref) Task=`11c47898-9e81-4a3b-9716-6727b4d5d43e`::ref 0 aborting False
>Thread-1894::DEBUG::2014-04-10 17:15:43,762::task::579::TaskManager.Task::(_updateState) Task=`b7d9b260-3852-4614-b1f2-9a95c1cae8b9`::moving from state init -> state preparing
>Thread-1894::INFO::2014-04-10 17:15:43,762::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1894::INFO::2014-04-10 17:15:43,762::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036918', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414355', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381248', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366048', 'lastCheck': '1.1', 'valid': True}}
>Thread-1894::DEBUG::2014-04-10 17:15:43,762::task::1168::TaskManager.Task::(prepare) Task=`b7d9b260-3852-4614-b1f2-9a95c1cae8b9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036918', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414355', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381248', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366048', 'lastCheck': '1.1', 'valid': True}}
>Thread-1894::DEBUG::2014-04-10 17:15:43,763::task::579::TaskManager.Task::(_updateState) Task=`b7d9b260-3852-4614-b1f2-9a95c1cae8b9`::moving from state preparing -> state finished
>Thread-1894::DEBUG::2014-04-10 17:15:43,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1894::DEBUG::2014-04-10 17:15:43,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1894::DEBUG::2014-04-10 17:15:43,763::task::974::TaskManager.Task::(_decref) Task=`b7d9b260-3852-4614-b1f2-9a95c1cae8b9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:15:51,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:15:51,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000399119 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:15:51,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:15:51,096::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357838 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:15:52,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:15:52,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000388885 s, 946 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:15:52,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:15:52,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000416332 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1899::DEBUG::2014-04-10 17:15:53,121::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1899::DEBUG::2014-04-10 17:15:53,122::task::579::TaskManager.Task::(_updateState) Task=`7d13660d-02a7-489c-adf7-19613a2917fa`::moving from state init -> state preparing
>Thread-1899::INFO::2014-04-10 17:15:53,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1899::INFO::2014-04-10 17:15:53,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1899::DEBUG::2014-04-10 17:15:53,123::task::1168::TaskManager.Task::(prepare) Task=`7d13660d-02a7-489c-adf7-19613a2917fa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1899::DEBUG::2014-04-10 17:15:53,123::task::579::TaskManager.Task::(_updateState) Task=`7d13660d-02a7-489c-adf7-19613a2917fa`::moving from state preparing -> state finished
>Thread-1899::DEBUG::2014-04-10 17:15:53,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1899::DEBUG::2014-04-10 17:15:53,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1899::DEBUG::2014-04-10 17:15:53,123::task::974::TaskManager.Task::(_decref) Task=`7d13660d-02a7-489c-adf7-19613a2917fa`::ref 0 aborting False
>Thread-1900::DEBUG::2014-04-10 17:15:53,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1900::DEBUG::2014-04-10 17:15:53,131::task::579::TaskManager.Task::(_updateState) Task=`25072b63-1f3e-461b-9614-4076cae84276`::moving from state init -> state preparing
>Thread-1900::INFO::2014-04-10 17:15:53,131::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1900::DEBUG::2014-04-10 17:15:53,131::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0431026e-aac4-472b-a72d-2d83025fb534`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1900::DEBUG::2014-04-10 17:15:53,132::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1900::DEBUG::2014-04-10 17:15:53,132::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1900::DEBUG::2014-04-10 17:15:53,132::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0431026e-aac4-472b-a72d-2d83025fb534`::Granted request
>Thread-1900::DEBUG::2014-04-10 17:15:53,132::task::811::TaskManager.Task::(resourceAcquired) Task=`25072b63-1f3e-461b-9614-4076cae84276`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1900::DEBUG::2014-04-10 17:15:53,133::task::974::TaskManager.Task::(_decref) Task=`25072b63-1f3e-461b-9614-4076cae84276`::ref 1 aborting False
>Thread-1900::INFO::2014-04-10 17:15:53,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1900::DEBUG::2014-04-10 17:15:53,135::task::1168::TaskManager.Task::(prepare) Task=`25072b63-1f3e-461b-9614-4076cae84276`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1900::DEBUG::2014-04-10 17:15:53,135::task::579::TaskManager.Task::(_updateState) Task=`25072b63-1f3e-461b-9614-4076cae84276`::moving from state preparing -> state finished
>Thread-1900::DEBUG::2014-04-10 17:15:53,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1900::DEBUG::2014-04-10 17:15:53,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1900::DEBUG::2014-04-10 17:15:53,136::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1900::DEBUG::2014-04-10 17:15:53,136::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1900::DEBUG::2014-04-10 17:15:53,136::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1900::DEBUG::2014-04-10 17:15:53,136::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1900::DEBUG::2014-04-10 17:15:53,137::task::974::TaskManager.Task::(_decref) Task=`25072b63-1f3e-461b-9614-4076cae84276`::ref 0 aborting False
>Thread-1902::DEBUG::2014-04-10 17:15:58,939::task::579::TaskManager.Task::(_updateState) Task=`5465fefa-4671-4e26-8c8d-f19cf72f6f1b`::moving from state init -> state preparing
>Thread-1902::INFO::2014-04-10 17:15:58,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1902::INFO::2014-04-10 17:15:58,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416332', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399119', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357838', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388885', 'lastCheck': '6.3', 'valid': True}}
>Thread-1902::DEBUG::2014-04-10 17:15:58,939::task::1168::TaskManager.Task::(prepare) Task=`5465fefa-4671-4e26-8c8d-f19cf72f6f1b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416332', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399119', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357838', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388885', 'lastCheck': '6.3', 'valid': True}}
>Thread-1902::DEBUG::2014-04-10 17:15:58,940::task::579::TaskManager.Task::(_updateState) Task=`5465fefa-4671-4e26-8c8d-f19cf72f6f1b`::moving from state preparing -> state finished
>Thread-1902::DEBUG::2014-04-10 17:15:58,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1902::DEBUG::2014-04-10 17:15:58,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1902::DEBUG::2014-04-10 17:15:58,940::task::974::TaskManager.Task::(_decref) Task=`5465fefa-4671-4e26-8c8d-f19cf72f6f1b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:01,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:01,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000503057 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:01,104::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:01,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326816 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:02,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:02,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000421657 s, 873 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:16:02,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:16:02,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00034654 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1905::DEBUG::2014-04-10 17:16:03,214::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-1905::DEBUG::2014-04-10 17:16:03,214::task::579::TaskManager.Task::(_updateState) Task=`40732d04-8234-45dc-81c7-3295f5235f7b`::moving from state init -> state preparing
>Thread-1905::INFO::2014-04-10 17:16:03,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1905::INFO::2014-04-10 17:16:03,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1905::DEBUG::2014-04-10 17:16:03,215::task::1168::TaskManager.Task::(prepare) Task=`40732d04-8234-45dc-81c7-3295f5235f7b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1905::DEBUG::2014-04-10 17:16:03,215::task::579::TaskManager.Task::(_updateState) Task=`40732d04-8234-45dc-81c7-3295f5235f7b`::moving from state preparing -> state finished
>Thread-1905::DEBUG::2014-04-10 17:16:03,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1905::DEBUG::2014-04-10 17:16:03,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1905::DEBUG::2014-04-10 17:16:03,216::task::974::TaskManager.Task::(_decref) Task=`40732d04-8234-45dc-81c7-3295f5235f7b`::ref 0 aborting False
>Thread-1906::DEBUG::2014-04-10 17:16:03,222::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-1906::DEBUG::2014-04-10 17:16:03,223::task::579::TaskManager.Task::(_updateState) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::moving from state init -> state preparing
>Thread-1906::INFO::2014-04-10 17:16:03,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1906::DEBUG::2014-04-10 17:16:03,223::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47f1c2f0-d794-4da9-bea4-4f06c694a88b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1906::DEBUG::2014-04-10 17:16:03,223::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1906::DEBUG::2014-04-10 17:16:03,224::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1906::DEBUG::2014-04-10 17:16:03,224::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`47f1c2f0-d794-4da9-bea4-4f06c694a88b`::Granted request
>Thread-1906::DEBUG::2014-04-10 17:16:03,224::task::811::TaskManager.Task::(resourceAcquired) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1906::DEBUG::2014-04-10 17:16:03,224::task::974::TaskManager.Task::(_decref) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::ref 1 aborting False
>Thread-1906::INFO::2014-04-10 17:16:03,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1906::DEBUG::2014-04-10 17:16:03,226::task::1168::TaskManager.Task::(prepare) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1906::DEBUG::2014-04-10 17:16:03,226::task::579::TaskManager.Task::(_updateState) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::moving from state preparing -> state finished
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1906::DEBUG::2014-04-10 17:16:03,227::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1906::DEBUG::2014-04-10 17:16:03,228::task::974::TaskManager.Task::(_decref) Task=`6e2b036b-c849-4e2a-a0fe-186b5c0d1564`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:11,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:11,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387115 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:11,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:11,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000429842 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:12,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:12,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004268 s, 862 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:16:12,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:16:12,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000360474 s, 1.8 MB/s\n'; <rc> = 0
>Thread-1910::DEBUG::2014-04-10 17:16:13,362::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-1910::DEBUG::2014-04-10 17:16:13,364::task::579::TaskManager.Task::(_updateState) Task=`3c9cd9fe-f8a3-40c6-8c6b-84d9eb6e271e`::moving from state init -> state preparing
>Thread-1910::INFO::2014-04-10 17:16:13,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1910::INFO::2014-04-10 17:16:13,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1910::DEBUG::2014-04-10 17:16:13,365::task::1168::TaskManager.Task::(prepare) Task=`3c9cd9fe-f8a3-40c6-8c6b-84d9eb6e271e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1910::DEBUG::2014-04-10 17:16:13,365::task::579::TaskManager.Task::(_updateState) Task=`3c9cd9fe-f8a3-40c6-8c6b-84d9eb6e271e`::moving from state preparing -> state finished
>Thread-1910::DEBUG::2014-04-10 17:16:13,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1910::DEBUG::2014-04-10 17:16:13,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1910::DEBUG::2014-04-10 17:16:13,365::task::974::TaskManager.Task::(_decref) Task=`3c9cd9fe-f8a3-40c6-8c6b-84d9eb6e271e`::ref 0 aborting False
>Thread-1911::DEBUG::2014-04-10 17:16:13,372::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-1911::DEBUG::2014-04-10 17:16:13,373::task::579::TaskManager.Task::(_updateState) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::moving from state init -> state preparing
>Thread-1911::INFO::2014-04-10 17:16:13,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1911::DEBUG::2014-04-10 17:16:13,374::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2ec58123-2dd9-4eaa-a16b-a6083297f761`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1911::DEBUG::2014-04-10 17:16:13,374::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1911::DEBUG::2014-04-10 17:16:13,374::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1911::DEBUG::2014-04-10 17:16:13,374::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2ec58123-2dd9-4eaa-a16b-a6083297f761`::Granted request
>Thread-1911::DEBUG::2014-04-10 17:16:13,375::task::811::TaskManager.Task::(resourceAcquired) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1911::DEBUG::2014-04-10 17:16:13,375::task::974::TaskManager.Task::(_decref) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::ref 1 aborting False
>Thread-1911::INFO::2014-04-10 17:16:13,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1911::DEBUG::2014-04-10 17:16:13,377::task::1168::TaskManager.Task::(prepare) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1911::DEBUG::2014-04-10 17:16:13,377::task::579::TaskManager.Task::(_updateState) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::moving from state preparing -> state finished
>Thread-1911::DEBUG::2014-04-10 17:16:13,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1911::DEBUG::2014-04-10 17:16:13,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1911::DEBUG::2014-04-10 17:16:13,378::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1911::DEBUG::2014-04-10 17:16:13,378::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1911::DEBUG::2014-04-10 17:16:13,378::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1911::DEBUG::2014-04-10 17:16:13,378::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1911::DEBUG::2014-04-10 17:16:13,379::task::974::TaskManager.Task::(_decref) Task=`2199ba3d-fe0e-4fd1-95bd-54030fa790fb`::ref 0 aborting False
>Thread-1912::DEBUG::2014-04-10 17:16:14,091::task::579::TaskManager.Task::(_updateState) Task=`9a654bdc-09c1-4772-b2ce-2746b90f3846`::moving from state init -> state preparing
>Thread-1912::INFO::2014-04-10 17:16:14,091::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1912::INFO::2014-04-10 17:16:14,091::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360474', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387115', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429842', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004268', 'lastCheck': '1.3', 'valid': True}}
>Thread-1912::DEBUG::2014-04-10 17:16:14,091::task::1168::TaskManager.Task::(prepare) Task=`9a654bdc-09c1-4772-b2ce-2746b90f3846`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360474', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387115', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429842', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004268', 'lastCheck': '1.3', 'valid': True}}
>Thread-1912::DEBUG::2014-04-10 17:16:14,092::task::579::TaskManager.Task::(_updateState) Task=`9a654bdc-09c1-4772-b2ce-2746b90f3846`::moving from state preparing -> state finished
>Thread-1912::DEBUG::2014-04-10 17:16:14,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1912::DEBUG::2014-04-10 17:16:14,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1912::DEBUG::2014-04-10 17:16:14,092::task::974::TaskManager.Task::(_decref) Task=`9a654bdc-09c1-4772-b2ce-2746b90f3846`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:21,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:21,127::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398505 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:21,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:21,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390239 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:22,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:22,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000417537 s, 881 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:16:22,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:16:22,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000409731 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1917::DEBUG::2014-04-10 17:16:23,711::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-1917::DEBUG::2014-04-10 17:16:23,712::task::579::TaskManager.Task::(_updateState) Task=`6d77b9b1-a325-4963-8eee-29c5c2287336`::moving from state init -> state preparing
>Thread-1917::INFO::2014-04-10 17:16:23,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1917::INFO::2014-04-10 17:16:23,713::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1917::DEBUG::2014-04-10 17:16:23,713::task::1168::TaskManager.Task::(prepare) Task=`6d77b9b1-a325-4963-8eee-29c5c2287336`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1917::DEBUG::2014-04-10 17:16:23,713::task::579::TaskManager.Task::(_updateState) Task=`6d77b9b1-a325-4963-8eee-29c5c2287336`::moving from state preparing -> state finished
>Thread-1917::DEBUG::2014-04-10 17:16:23,713::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1917::DEBUG::2014-04-10 17:16:23,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1917::DEBUG::2014-04-10 17:16:23,713::task::974::TaskManager.Task::(_decref) Task=`6d77b9b1-a325-4963-8eee-29c5c2287336`::ref 0 aborting False
>Thread-1918::DEBUG::2014-04-10 17:16:23,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-1918::DEBUG::2014-04-10 17:16:23,721::task::579::TaskManager.Task::(_updateState) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::moving from state init -> state preparing
>Thread-1918::INFO::2014-04-10 17:16:23,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1918::DEBUG::2014-04-10 17:16:23,722::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59e5da27-3efe-4113-afc1-f676a6a2a014`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1918::DEBUG::2014-04-10 17:16:23,722::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1918::DEBUG::2014-04-10 17:16:23,722::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1918::DEBUG::2014-04-10 17:16:23,722::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59e5da27-3efe-4113-afc1-f676a6a2a014`::Granted request
>Thread-1918::DEBUG::2014-04-10 17:16:23,723::task::811::TaskManager.Task::(resourceAcquired) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1918::DEBUG::2014-04-10 17:16:23,723::task::974::TaskManager.Task::(_decref) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::ref 1 aborting False
>Thread-1918::INFO::2014-04-10 17:16:23,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1918::DEBUG::2014-04-10 17:16:23,725::task::1168::TaskManager.Task::(prepare) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1918::DEBUG::2014-04-10 17:16:23,725::task::579::TaskManager.Task::(_updateState) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::moving from state preparing -> state finished
>Thread-1918::DEBUG::2014-04-10 17:16:23,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1918::DEBUG::2014-04-10 17:16:23,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1918::DEBUG::2014-04-10 17:16:23,726::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1918::DEBUG::2014-04-10 17:16:23,726::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1918::DEBUG::2014-04-10 17:16:23,726::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1918::DEBUG::2014-04-10 17:16:23,727::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1918::DEBUG::2014-04-10 17:16:23,727::task::974::TaskManager.Task::(_decref) Task=`dbdd17ab-c483-4f90-8eee-f6dc7c2b5c7a`::ref 0 aborting False
>Thread-1920::DEBUG::2014-04-10 17:16:29,752::task::579::TaskManager.Task::(_updateState) Task=`1e0c8cf7-14e6-4228-a99e-1e0ae1892f04`::moving from state init -> state preparing
>Thread-1920::INFO::2014-04-10 17:16:29,752::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1920::INFO::2014-04-10 17:16:29,753::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409731', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398505', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390239', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417537', 'lastCheck': '7.0', 'valid': True}}
>Thread-1920::DEBUG::2014-04-10 17:16:29,753::task::1168::TaskManager.Task::(prepare) Task=`1e0c8cf7-14e6-4228-a99e-1e0ae1892f04`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409731', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398505', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390239', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417537', 'lastCheck': '7.0', 'valid': True}}
>Thread-1920::DEBUG::2014-04-10 17:16:29,753::task::579::TaskManager.Task::(_updateState) Task=`1e0c8cf7-14e6-4228-a99e-1e0ae1892f04`::moving from state preparing -> state finished
>Thread-1920::DEBUG::2014-04-10 17:16:29,753::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1920::DEBUG::2014-04-10 17:16:29,753::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1920::DEBUG::2014-04-10 17:16:29,754::task::974::TaskManager.Task::(_decref) Task=`1e0c8cf7-14e6-4228-a99e-1e0ae1892f04`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:31,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:31,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368983 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:31,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:31,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366535 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:32,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:32,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000386981 s, 951 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:16:32,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:16:32,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000390905 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1923::DEBUG::2014-04-10 17:16:33,800::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-1923::DEBUG::2014-04-10 17:16:33,801::task::579::TaskManager.Task::(_updateState) Task=`9d5c51b4-a7b8-474d-81a8-dcf3147994e7`::moving from state init -> state preparing
>Thread-1923::INFO::2014-04-10 17:16:33,801::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1923::INFO::2014-04-10 17:16:33,801::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1923::DEBUG::2014-04-10 17:16:33,801::task::1168::TaskManager.Task::(prepare) Task=`9d5c51b4-a7b8-474d-81a8-dcf3147994e7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1923::DEBUG::2014-04-10 17:16:33,801::task::579::TaskManager.Task::(_updateState) Task=`9d5c51b4-a7b8-474d-81a8-dcf3147994e7`::moving from state preparing -> state finished
>Thread-1923::DEBUG::2014-04-10 17:16:33,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1923::DEBUG::2014-04-10 17:16:33,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1923::DEBUG::2014-04-10 17:16:33,802::task::974::TaskManager.Task::(_decref) Task=`9d5c51b4-a7b8-474d-81a8-dcf3147994e7`::ref 0 aborting False
>Thread-1924::DEBUG::2014-04-10 17:16:33,808::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-1924::DEBUG::2014-04-10 17:16:33,809::task::579::TaskManager.Task::(_updateState) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::moving from state init -> state preparing
>Thread-1924::INFO::2014-04-10 17:16:33,809::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1924::DEBUG::2014-04-10 17:16:33,809::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f664073-c2ca-40bc-a60c-0dd711dd046b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1924::DEBUG::2014-04-10 17:16:33,809::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1924::DEBUG::2014-04-10 17:16:33,810::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1924::DEBUG::2014-04-10 17:16:33,810::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f664073-c2ca-40bc-a60c-0dd711dd046b`::Granted request
>Thread-1924::DEBUG::2014-04-10 17:16:33,810::task::811::TaskManager.Task::(resourceAcquired) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1924::DEBUG::2014-04-10 17:16:33,810::task::974::TaskManager.Task::(_decref) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::ref 1 aborting False
>Thread-1924::INFO::2014-04-10 17:16:33,812::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1924::DEBUG::2014-04-10 17:16:33,812::task::1168::TaskManager.Task::(prepare) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1924::DEBUG::2014-04-10 17:16:33,812::task::579::TaskManager.Task::(_updateState) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::moving from state preparing -> state finished
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1924::DEBUG::2014-04-10 17:16:33,813::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1924::DEBUG::2014-04-10 17:16:33,814::task::974::TaskManager.Task::(_decref) Task=`934a9c99-ddfe-4f30-866b-426786bae2d5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:41,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:41,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000526269 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:41,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:41,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355052 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:42,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:42,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517838 s, 711 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:16:42,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:16:42,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480255 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1928::DEBUG::2014-04-10 17:16:43,924::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-1928::DEBUG::2014-04-10 17:16:43,930::task::579::TaskManager.Task::(_updateState) Task=`706c4a44-e003-48ef-83cd-87edddb4af06`::moving from state init -> state preparing
>Thread-1928::INFO::2014-04-10 17:16:43,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1928::INFO::2014-04-10 17:16:43,931::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1928::DEBUG::2014-04-10 17:16:43,931::task::1168::TaskManager.Task::(prepare) Task=`706c4a44-e003-48ef-83cd-87edddb4af06`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1928::DEBUG::2014-04-10 17:16:43,931::task::579::TaskManager.Task::(_updateState) Task=`706c4a44-e003-48ef-83cd-87edddb4af06`::moving from state preparing -> state finished
>Thread-1928::DEBUG::2014-04-10 17:16:43,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1928::DEBUG::2014-04-10 17:16:43,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1928::DEBUG::2014-04-10 17:16:43,932::task::974::TaskManager.Task::(_decref) Task=`706c4a44-e003-48ef-83cd-87edddb4af06`::ref 0 aborting False
>Thread-1929::DEBUG::2014-04-10 17:16:43,938::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-1929::DEBUG::2014-04-10 17:16:43,939::task::579::TaskManager.Task::(_updateState) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::moving from state init -> state preparing
>Thread-1929::INFO::2014-04-10 17:16:43,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1929::DEBUG::2014-04-10 17:16:43,940::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`425c2417-a29b-4d20-a859-ca60f21e01c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1929::DEBUG::2014-04-10 17:16:43,940::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1929::DEBUG::2014-04-10 17:16:43,940::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1929::DEBUG::2014-04-10 17:16:43,940::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`425c2417-a29b-4d20-a859-ca60f21e01c7`::Granted request
>Thread-1929::DEBUG::2014-04-10 17:16:43,941::task::811::TaskManager.Task::(resourceAcquired) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1929::DEBUG::2014-04-10 17:16:43,941::task::974::TaskManager.Task::(_decref) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::ref 1 aborting False
>Thread-1929::INFO::2014-04-10 17:16:43,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1929::DEBUG::2014-04-10 17:16:43,943::task::1168::TaskManager.Task::(prepare) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1929::DEBUG::2014-04-10 17:16:43,943::task::579::TaskManager.Task::(_updateState) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::moving from state preparing -> state finished
>Thread-1929::DEBUG::2014-04-10 17:16:43,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1929::DEBUG::2014-04-10 17:16:43,944::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1929::DEBUG::2014-04-10 17:16:43,944::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1929::DEBUG::2014-04-10 17:16:43,944::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1929::DEBUG::2014-04-10 17:16:43,944::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1929::DEBUG::2014-04-10 17:16:43,944::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1929::DEBUG::2014-04-10 17:16:43,945::task::974::TaskManager.Task::(_decref) Task=`a97cb851-f758-4f94-b0c2-8a5ceda4d2dd`::ref 0 aborting False
>Thread-1930::DEBUG::2014-04-10 17:16:44,926::task::579::TaskManager.Task::(_updateState) Task=`2b78f3db-93b2-47a6-88d3-98b52fa78c59`::moving from state init -> state preparing
>Thread-1930::INFO::2014-04-10 17:16:44,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1930::INFO::2014-04-10 17:16:44,927::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480255', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526269', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355052', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517838', 'lastCheck': '2.1', 'valid': True}}
>Thread-1930::DEBUG::2014-04-10 17:16:44,927::task::1168::TaskManager.Task::(prepare) Task=`2b78f3db-93b2-47a6-88d3-98b52fa78c59`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480255', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526269', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355052', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517838', 'lastCheck': '2.1', 'valid': True}}
>Thread-1930::DEBUG::2014-04-10 17:16:44,927::task::579::TaskManager.Task::(_updateState) Task=`2b78f3db-93b2-47a6-88d3-98b52fa78c59`::moving from state preparing -> state finished
>Thread-1930::DEBUG::2014-04-10 17:16:44,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1930::DEBUG::2014-04-10 17:16:44,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1930::DEBUG::2014-04-10 17:16:44,928::task::974::TaskManager.Task::(_decref) Task=`2b78f3db-93b2-47a6-88d3-98b52fa78c59`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:16:51,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:16:51,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044873 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:16:51,195::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:16:51,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316083 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:52,843::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:16:52,869::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:16:52,873::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:16:52,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:52,884::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-467::DEBUG::2014-04-10 17:16:52,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000431091 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:16:52,891::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:16:52,892::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:16:52,892::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:16:52,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:16:52,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000446897 s, 823 kB/s\n'; <rc> = 0
>Thread-1938::DEBUG::2014-04-10 17:16:54,024::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1938::DEBUG::2014-04-10 17:16:54,024::task::579::TaskManager.Task::(_updateState) Task=`795c61f7-d9a4-4ce2-9d4a-82593bad743e`::moving from state init -> state preparing
>Thread-1938::INFO::2014-04-10 17:16:54,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1938::INFO::2014-04-10 17:16:54,025::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1938::DEBUG::2014-04-10 17:16:54,025::task::1168::TaskManager.Task::(prepare) Task=`795c61f7-d9a4-4ce2-9d4a-82593bad743e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1938::DEBUG::2014-04-10 17:16:54,025::task::579::TaskManager.Task::(_updateState) Task=`795c61f7-d9a4-4ce2-9d4a-82593bad743e`::moving from state preparing -> state finished
>Thread-1938::DEBUG::2014-04-10 17:16:54,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1938::DEBUG::2014-04-10 17:16:54,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1938::DEBUG::2014-04-10 17:16:54,026::task::974::TaskManager.Task::(_decref) Task=`795c61f7-d9a4-4ce2-9d4a-82593bad743e`::ref 0 aborting False
>Thread-1939::DEBUG::2014-04-10 17:16:54,036::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1939::DEBUG::2014-04-10 17:16:54,036::task::579::TaskManager.Task::(_updateState) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::moving from state init -> state preparing
>Thread-1939::INFO::2014-04-10 17:16:54,038::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1939::DEBUG::2014-04-10 17:16:54,043::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acb11b12-3341-4aca-89a4-70b09a17701b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1939::DEBUG::2014-04-10 17:16:54,044::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1939::DEBUG::2014-04-10 17:16:54,046::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1939::DEBUG::2014-04-10 17:16:54,046::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acb11b12-3341-4aca-89a4-70b09a17701b`::Granted request
>Thread-1939::DEBUG::2014-04-10 17:16:54,047::task::811::TaskManager.Task::(resourceAcquired) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1939::DEBUG::2014-04-10 17:16:54,047::task::974::TaskManager.Task::(_decref) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::ref 1 aborting False
>Thread-1939::INFO::2014-04-10 17:16:54,049::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1939::DEBUG::2014-04-10 17:16:54,049::task::1168::TaskManager.Task::(prepare) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1939::DEBUG::2014-04-10 17:16:54,049::task::579::TaskManager.Task::(_updateState) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::moving from state preparing -> state finished
>Thread-1939::DEBUG::2014-04-10 17:16:54,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1939::DEBUG::2014-04-10 17:16:54,050::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1939::DEBUG::2014-04-10 17:16:54,050::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1939::DEBUG::2014-04-10 17:16:54,050::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1939::DEBUG::2014-04-10 17:16:54,050::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1939::DEBUG::2014-04-10 17:16:54,050::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1939::DEBUG::2014-04-10 17:16:54,051::task::974::TaskManager.Task::(_decref) Task=`6efce4a0-7440-4b06-b2bb-d5b753ab4102`::ref 0 aborting False
>Thread-1942::DEBUG::2014-04-10 17:17:00,085::task::579::TaskManager.Task::(_updateState) Task=`a6f087e1-a263-4fdb-90eb-7a9ea5a6bb1d`::moving from state init -> state preparing
>Thread-1942::INFO::2014-04-10 17:17:00,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1942::INFO::2014-04-10 17:17:00,086::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431091', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044873', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316083', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446897', 'lastCheck': '7.2', 'valid': True}}
>Thread-1942::DEBUG::2014-04-10 17:17:00,086::task::1168::TaskManager.Task::(prepare) Task=`a6f087e1-a263-4fdb-90eb-7a9ea5a6bb1d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431091', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044873', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316083', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446897', 'lastCheck': '7.2', 'valid': True}}
>Thread-1942::DEBUG::2014-04-10 17:17:00,087::task::579::TaskManager.Task::(_updateState) Task=`a6f087e1-a263-4fdb-90eb-7a9ea5a6bb1d`::moving from state preparing -> state finished
>Thread-1942::DEBUG::2014-04-10 17:17:00,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1942::DEBUG::2014-04-10 17:17:00,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1942::DEBUG::2014-04-10 17:17:00,087::task::974::TaskManager.Task::(_decref) Task=`a6f087e1-a263-4fdb-90eb-7a9ea5a6bb1d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:01,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:01,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037056 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:01,227::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:01,233::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000351831 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:02,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:02,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459865 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:02,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:02,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451396 s, 815 kB/s\n'; <rc> = 0
>Thread-1945::DEBUG::2014-04-10 17:17:04,128::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1945::DEBUG::2014-04-10 17:17:04,129::task::579::TaskManager.Task::(_updateState) Task=`f8034ac6-469f-49bc-8885-fd56c305f28c`::moving from state init -> state preparing
>Thread-1945::INFO::2014-04-10 17:17:04,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1945::INFO::2014-04-10 17:17:04,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1945::DEBUG::2014-04-10 17:17:04,130::task::1168::TaskManager.Task::(prepare) Task=`f8034ac6-469f-49bc-8885-fd56c305f28c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1945::DEBUG::2014-04-10 17:17:04,130::task::579::TaskManager.Task::(_updateState) Task=`f8034ac6-469f-49bc-8885-fd56c305f28c`::moving from state preparing -> state finished
>Thread-1945::DEBUG::2014-04-10 17:17:04,130::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1945::DEBUG::2014-04-10 17:17:04,130::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1945::DEBUG::2014-04-10 17:17:04,130::task::974::TaskManager.Task::(_decref) Task=`f8034ac6-469f-49bc-8885-fd56c305f28c`::ref 0 aborting False
>Thread-1946::DEBUG::2014-04-10 17:17:04,137::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1946::DEBUG::2014-04-10 17:17:04,137::task::579::TaskManager.Task::(_updateState) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::moving from state init -> state preparing
>Thread-1946::INFO::2014-04-10 17:17:04,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1946::DEBUG::2014-04-10 17:17:04,138::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c59c7576-d19a-4561-ada5-5b129060479a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1946::DEBUG::2014-04-10 17:17:04,138::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1946::DEBUG::2014-04-10 17:17:04,138::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1946::DEBUG::2014-04-10 17:17:04,139::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c59c7576-d19a-4561-ada5-5b129060479a`::Granted request
>Thread-1946::DEBUG::2014-04-10 17:17:04,139::task::811::TaskManager.Task::(resourceAcquired) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1946::DEBUG::2014-04-10 17:17:04,139::task::974::TaskManager.Task::(_decref) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::ref 1 aborting False
>Thread-1946::INFO::2014-04-10 17:17:04,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1946::DEBUG::2014-04-10 17:17:04,141::task::1168::TaskManager.Task::(prepare) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1946::DEBUG::2014-04-10 17:17:04,141::task::579::TaskManager.Task::(_updateState) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::moving from state preparing -> state finished
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1946::DEBUG::2014-04-10 17:17:04,142::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1946::DEBUG::2014-04-10 17:17:04,143::task::974::TaskManager.Task::(_decref) Task=`495835af-8862-485c-958e-9bd73ac09b0d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:11,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:11,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386715 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:11,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:11,265::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339325 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:12,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:12,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446935 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:12,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:12,976::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000454101 s, 810 kB/s\n'; <rc> = 0
>Thread-1950::DEBUG::2014-04-10 17:17:14,220::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1950::DEBUG::2014-04-10 17:17:14,229::task::579::TaskManager.Task::(_updateState) Task=`b289d082-daf3-4360-b4cb-3cc7c4b3e1c6`::moving from state init -> state preparing
>Thread-1950::INFO::2014-04-10 17:17:14,230::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1950::INFO::2014-04-10 17:17:14,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1950::DEBUG::2014-04-10 17:17:14,230::task::1168::TaskManager.Task::(prepare) Task=`b289d082-daf3-4360-b4cb-3cc7c4b3e1c6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1950::DEBUG::2014-04-10 17:17:14,230::task::579::TaskManager.Task::(_updateState) Task=`b289d082-daf3-4360-b4cb-3cc7c4b3e1c6`::moving from state preparing -> state finished
>Thread-1950::DEBUG::2014-04-10 17:17:14,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1950::DEBUG::2014-04-10 17:17:14,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1950::DEBUG::2014-04-10 17:17:14,231::task::974::TaskManager.Task::(_decref) Task=`b289d082-daf3-4360-b4cb-3cc7c4b3e1c6`::ref 0 aborting False
>Thread-1951::DEBUG::2014-04-10 17:17:14,238::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1951::DEBUG::2014-04-10 17:17:14,238::task::579::TaskManager.Task::(_updateState) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::moving from state init -> state preparing
>Thread-1951::INFO::2014-04-10 17:17:14,238::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1951::DEBUG::2014-04-10 17:17:14,239::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8a213183-d70a-41bf-8935-7323deb9e084`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1951::DEBUG::2014-04-10 17:17:14,239::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1951::DEBUG::2014-04-10 17:17:14,239::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1951::DEBUG::2014-04-10 17:17:14,239::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8a213183-d70a-41bf-8935-7323deb9e084`::Granted request
>Thread-1951::DEBUG::2014-04-10 17:17:14,240::task::811::TaskManager.Task::(resourceAcquired) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1951::DEBUG::2014-04-10 17:17:14,240::task::974::TaskManager.Task::(_decref) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::ref 1 aborting False
>Thread-1951::INFO::2014-04-10 17:17:14,242::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1951::DEBUG::2014-04-10 17:17:14,242::task::1168::TaskManager.Task::(prepare) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1951::DEBUG::2014-04-10 17:17:14,242::task::579::TaskManager.Task::(_updateState) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::moving from state preparing -> state finished
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1951::DEBUG::2014-04-10 17:17:14,243::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1951::DEBUG::2014-04-10 17:17:14,244::task::974::TaskManager.Task::(_decref) Task=`3572bdad-7806-4c77-b92a-b4147bd3873b`::ref 0 aborting False
>Thread-1952::DEBUG::2014-04-10 17:17:15,253::task::579::TaskManager.Task::(_updateState) Task=`79d4658b-7644-494a-83cd-005f6da11ea8`::moving from state init -> state preparing
>Thread-1952::INFO::2014-04-10 17:17:15,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1952::INFO::2014-04-10 17:17:15,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446935', 'lastCheck': '2.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386715', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339325', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454101', 'lastCheck': '2.3', 'valid': True}}
>Thread-1952::DEBUG::2014-04-10 17:17:15,253::task::1168::TaskManager.Task::(prepare) Task=`79d4658b-7644-494a-83cd-005f6da11ea8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446935', 'lastCheck': '2.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386715', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339325', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454101', 'lastCheck': '2.3', 'valid': True}}
>Thread-1952::DEBUG::2014-04-10 17:17:15,254::task::579::TaskManager.Task::(_updateState) Task=`79d4658b-7644-494a-83cd-005f6da11ea8`::moving from state preparing -> state finished
>Thread-1952::DEBUG::2014-04-10 17:17:15,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1952::DEBUG::2014-04-10 17:17:15,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1952::DEBUG::2014-04-10 17:17:15,254::task::974::TaskManager.Task::(_decref) Task=`79d4658b-7644-494a-83cd-005f6da11ea8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:21,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:21,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373609 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:21,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:21,295::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371103 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:22,976::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:22,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448457 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:23,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:23,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448512 s, 820 kB/s\n'; <rc> = 0
>Thread-1956::DEBUG::2014-04-10 17:17:24,327::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1956::DEBUG::2014-04-10 17:17:24,327::task::579::TaskManager.Task::(_updateState) Task=`b60e98e1-1fe0-4e8d-bdb8-2bc8f1950115`::moving from state init -> state preparing
>Thread-1956::INFO::2014-04-10 17:17:24,328::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1956::INFO::2014-04-10 17:17:24,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1956::DEBUG::2014-04-10 17:17:24,328::task::1168::TaskManager.Task::(prepare) Task=`b60e98e1-1fe0-4e8d-bdb8-2bc8f1950115`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1956::DEBUG::2014-04-10 17:17:24,328::task::579::TaskManager.Task::(_updateState) Task=`b60e98e1-1fe0-4e8d-bdb8-2bc8f1950115`::moving from state preparing -> state finished
>Thread-1956::DEBUG::2014-04-10 17:17:24,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1956::DEBUG::2014-04-10 17:17:24,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1956::DEBUG::2014-04-10 17:17:24,329::task::974::TaskManager.Task::(_decref) Task=`b60e98e1-1fe0-4e8d-bdb8-2bc8f1950115`::ref 0 aborting False
>Thread-1957::DEBUG::2014-04-10 17:17:24,335::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1957::DEBUG::2014-04-10 17:17:24,335::task::579::TaskManager.Task::(_updateState) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::moving from state init -> state preparing
>Thread-1957::INFO::2014-04-10 17:17:24,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1957::DEBUG::2014-04-10 17:17:24,336::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b3b15208-10a1-4873-b445-8f95081824c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1957::DEBUG::2014-04-10 17:17:24,336::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1957::DEBUG::2014-04-10 17:17:24,336::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1957::DEBUG::2014-04-10 17:17:24,336::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b3b15208-10a1-4873-b445-8f95081824c9`::Granted request
>Thread-1957::DEBUG::2014-04-10 17:17:24,337::task::811::TaskManager.Task::(resourceAcquired) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1957::DEBUG::2014-04-10 17:17:24,337::task::974::TaskManager.Task::(_decref) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::ref 1 aborting False
>Thread-1957::INFO::2014-04-10 17:17:24,339::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1957::DEBUG::2014-04-10 17:17:24,339::task::1168::TaskManager.Task::(prepare) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1957::DEBUG::2014-04-10 17:17:24,339::task::579::TaskManager.Task::(_updateState) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::moving from state preparing -> state finished
>Thread-1957::DEBUG::2014-04-10 17:17:24,339::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1957::DEBUG::2014-04-10 17:17:24,339::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1957::DEBUG::2014-04-10 17:17:24,340::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1957::DEBUG::2014-04-10 17:17:24,340::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1957::DEBUG::2014-04-10 17:17:24,340::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1957::DEBUG::2014-04-10 17:17:24,340::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1957::DEBUG::2014-04-10 17:17:24,340::task::974::TaskManager.Task::(_decref) Task=`2f04a3ca-9fa3-4b16-9558-459f61830bd3`::ref 0 aborting False
>Thread-1960::DEBUG::2014-04-10 17:17:30,439::task::579::TaskManager.Task::(_updateState) Task=`58f649a2-28a6-40a4-998e-20bec7ea6f33`::moving from state init -> state preparing
>Thread-1960::INFO::2014-04-10 17:17:30,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1960::INFO::2014-04-10 17:17:30,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448457', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373609', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371103', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448512', 'lastCheck': '7.4', 'valid': True}}
>Thread-1960::DEBUG::2014-04-10 17:17:30,440::task::1168::TaskManager.Task::(prepare) Task=`58f649a2-28a6-40a4-998e-20bec7ea6f33`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448457', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373609', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371103', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448512', 'lastCheck': '7.4', 'valid': True}}
>Thread-1960::DEBUG::2014-04-10 17:17:30,440::task::579::TaskManager.Task::(_updateState) Task=`58f649a2-28a6-40a4-998e-20bec7ea6f33`::moving from state preparing -> state finished
>Thread-1960::DEBUG::2014-04-10 17:17:30,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1960::DEBUG::2014-04-10 17:17:30,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1960::DEBUG::2014-04-10 17:17:30,441::task::974::TaskManager.Task::(_decref) Task=`58f649a2-28a6-40a4-998e-20bec7ea6f33`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:31,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:31,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000427935 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:31,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:31,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333123 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:33,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:33,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000435502 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:33,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:33,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000495451 s, 743 kB/s\n'; <rc> = 0
>Thread-1963::DEBUG::2014-04-10 17:17:34,425::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1963::DEBUG::2014-04-10 17:17:34,427::task::579::TaskManager.Task::(_updateState) Task=`a9bb6328-350e-4ab7-a10b-51bf9e987209`::moving from state init -> state preparing
>Thread-1963::INFO::2014-04-10 17:17:34,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1963::INFO::2014-04-10 17:17:34,427::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1963::DEBUG::2014-04-10 17:17:34,427::task::1168::TaskManager.Task::(prepare) Task=`a9bb6328-350e-4ab7-a10b-51bf9e987209`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1963::DEBUG::2014-04-10 17:17:34,428::task::579::TaskManager.Task::(_updateState) Task=`a9bb6328-350e-4ab7-a10b-51bf9e987209`::moving from state preparing -> state finished
>Thread-1963::DEBUG::2014-04-10 17:17:34,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1963::DEBUG::2014-04-10 17:17:34,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1963::DEBUG::2014-04-10 17:17:34,428::task::974::TaskManager.Task::(_decref) Task=`a9bb6328-350e-4ab7-a10b-51bf9e987209`::ref 0 aborting False
>Thread-1964::DEBUG::2014-04-10 17:17:34,435::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1964::DEBUG::2014-04-10 17:17:34,435::task::579::TaskManager.Task::(_updateState) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::moving from state init -> state preparing
>Thread-1964::INFO::2014-04-10 17:17:34,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1964::DEBUG::2014-04-10 17:17:34,436::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`494a960e-55df-4459-b5b9-6fddd581a7ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1964::DEBUG::2014-04-10 17:17:34,436::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1964::DEBUG::2014-04-10 17:17:34,436::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1964::DEBUG::2014-04-10 17:17:34,436::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`494a960e-55df-4459-b5b9-6fddd581a7ec`::Granted request
>Thread-1964::DEBUG::2014-04-10 17:17:34,436::task::811::TaskManager.Task::(resourceAcquired) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1964::DEBUG::2014-04-10 17:17:34,437::task::974::TaskManager.Task::(_decref) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::ref 1 aborting False
>Thread-1964::INFO::2014-04-10 17:17:34,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1964::DEBUG::2014-04-10 17:17:34,439::task::1168::TaskManager.Task::(prepare) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1964::DEBUG::2014-04-10 17:17:34,439::task::579::TaskManager.Task::(_updateState) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::moving from state preparing -> state finished
>Thread-1964::DEBUG::2014-04-10 17:17:34,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1964::DEBUG::2014-04-10 17:17:34,439::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1964::DEBUG::2014-04-10 17:17:34,439::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1964::DEBUG::2014-04-10 17:17:34,440::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1964::DEBUG::2014-04-10 17:17:34,440::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1964::DEBUG::2014-04-10 17:17:34,440::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1964::DEBUG::2014-04-10 17:17:34,440::task::974::TaskManager.Task::(_decref) Task=`f0db40c4-4860-4eee-a298-6607746e7fd8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:41,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:41,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000429033 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:41,359::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:41,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000400181 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:43,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:43,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000503555 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:43,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:43,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474862 s, 775 kB/s\n'; <rc> = 0
>Thread-1966::DEBUG::2014-04-10 17:17:44,566::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-1966::DEBUG::2014-04-10 17:17:44,566::task::579::TaskManager.Task::(_updateState) Task=`3db8718e-c5ea-4da4-a770-23e50fdfe608`::moving from state init -> state preparing
>Thread-1966::INFO::2014-04-10 17:17:44,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1966::INFO::2014-04-10 17:17:44,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1966::DEBUG::2014-04-10 17:17:44,567::task::1168::TaskManager.Task::(prepare) Task=`3db8718e-c5ea-4da4-a770-23e50fdfe608`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1966::DEBUG::2014-04-10 17:17:44,567::task::579::TaskManager.Task::(_updateState) Task=`3db8718e-c5ea-4da4-a770-23e50fdfe608`::moving from state preparing -> state finished
>Thread-1966::DEBUG::2014-04-10 17:17:44,567::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1966::DEBUG::2014-04-10 17:17:44,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1966::DEBUG::2014-04-10 17:17:44,568::task::974::TaskManager.Task::(_decref) Task=`3db8718e-c5ea-4da4-a770-23e50fdfe608`::ref 0 aborting False
>Thread-1967::DEBUG::2014-04-10 17:17:44,574::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-1967::DEBUG::2014-04-10 17:17:44,574::task::579::TaskManager.Task::(_updateState) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::moving from state init -> state preparing
>Thread-1967::INFO::2014-04-10 17:17:44,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1967::DEBUG::2014-04-10 17:17:44,575::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4ed8f8b3-c7de-4371-9a4b-4bad038818b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1967::DEBUG::2014-04-10 17:17:44,575::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1967::DEBUG::2014-04-10 17:17:44,576::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1967::DEBUG::2014-04-10 17:17:44,576::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4ed8f8b3-c7de-4371-9a4b-4bad038818b0`::Granted request
>Thread-1967::DEBUG::2014-04-10 17:17:44,576::task::811::TaskManager.Task::(resourceAcquired) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1967::DEBUG::2014-04-10 17:17:44,576::task::974::TaskManager.Task::(_decref) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::ref 1 aborting False
>Thread-1967::INFO::2014-04-10 17:17:44,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1967::DEBUG::2014-04-10 17:17:44,579::task::1168::TaskManager.Task::(prepare) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1967::DEBUG::2014-04-10 17:17:44,579::task::579::TaskManager.Task::(_updateState) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::moving from state preparing -> state finished
>Thread-1967::DEBUG::2014-04-10 17:17:44,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1967::DEBUG::2014-04-10 17:17:44,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1967::DEBUG::2014-04-10 17:17:44,579::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1967::DEBUG::2014-04-10 17:17:44,580::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1967::DEBUG::2014-04-10 17:17:44,580::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1967::DEBUG::2014-04-10 17:17:44,580::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1967::DEBUG::2014-04-10 17:17:44,580::task::974::TaskManager.Task::(_decref) Task=`bc4f5ce0-4e61-457a-b20d-2e90293fe923`::ref 0 aborting False
>Thread-1970::DEBUG::2014-04-10 17:17:50,864::task::579::TaskManager.Task::(_updateState) Task=`7777e3e9-cd10-4fe1-9b53-69637220c019`::moving from state init -> state preparing
>Thread-1970::INFO::2014-04-10 17:17:50,864::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1970::INFO::2014-04-10 17:17:50,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503555', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429033', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400181', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474862', 'lastCheck': '7.8', 'valid': True}}
>Thread-1970::DEBUG::2014-04-10 17:17:50,865::task::1168::TaskManager.Task::(prepare) Task=`7777e3e9-cd10-4fe1-9b53-69637220c019`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503555', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429033', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400181', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474862', 'lastCheck': '7.8', 'valid': True}}
>Thread-1970::DEBUG::2014-04-10 17:17:50,865::task::579::TaskManager.Task::(_updateState) Task=`7777e3e9-cd10-4fe1-9b53-69637220c019`::moving from state preparing -> state finished
>Thread-1970::DEBUG::2014-04-10 17:17:50,865::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1970::DEBUG::2014-04-10 17:17:50,865::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1970::DEBUG::2014-04-10 17:17:50,865::task::974::TaskManager.Task::(_decref) Task=`7777e3e9-cd10-4fe1-9b53-69637220c019`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:17:51,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:17:51,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000418072 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:17:51,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:17:51,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366758 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:17:53,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:17:53,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000517042 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:17:53,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:17:53,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476318 s, 773 kB/s\n'; <rc> = 0
>Thread-1973::DEBUG::2014-04-10 17:17:54,656::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-1973::DEBUG::2014-04-10 17:17:54,657::task::579::TaskManager.Task::(_updateState) Task=`4d4da8a1-de05-43cf-8500-9ccb91173eb9`::moving from state init -> state preparing
>Thread-1973::INFO::2014-04-10 17:17:54,657::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1973::INFO::2014-04-10 17:17:54,657::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1973::DEBUG::2014-04-10 17:17:54,657::task::1168::TaskManager.Task::(prepare) Task=`4d4da8a1-de05-43cf-8500-9ccb91173eb9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1973::DEBUG::2014-04-10 17:17:54,658::task::579::TaskManager.Task::(_updateState) Task=`4d4da8a1-de05-43cf-8500-9ccb91173eb9`::moving from state preparing -> state finished
>Thread-1973::DEBUG::2014-04-10 17:17:54,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1973::DEBUG::2014-04-10 17:17:54,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1973::DEBUG::2014-04-10 17:17:54,658::task::974::TaskManager.Task::(_decref) Task=`4d4da8a1-de05-43cf-8500-9ccb91173eb9`::ref 0 aborting False
>Thread-1974::DEBUG::2014-04-10 17:17:54,665::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-1974::DEBUG::2014-04-10 17:17:54,665::task::579::TaskManager.Task::(_updateState) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::moving from state init -> state preparing
>Thread-1974::INFO::2014-04-10 17:17:54,665::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1974::DEBUG::2014-04-10 17:17:54,666::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28ebf229-be7a-4f6c-9631-ce9d85776beb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1974::DEBUG::2014-04-10 17:17:54,666::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1974::DEBUG::2014-04-10 17:17:54,666::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1974::DEBUG::2014-04-10 17:17:54,666::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28ebf229-be7a-4f6c-9631-ce9d85776beb`::Granted request
>Thread-1974::DEBUG::2014-04-10 17:17:54,667::task::811::TaskManager.Task::(resourceAcquired) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1974::DEBUG::2014-04-10 17:17:54,667::task::974::TaskManager.Task::(_decref) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::ref 1 aborting False
>Thread-1974::INFO::2014-04-10 17:17:54,669::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1974::DEBUG::2014-04-10 17:17:54,669::task::1168::TaskManager.Task::(prepare) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1974::DEBUG::2014-04-10 17:17:54,669::task::579::TaskManager.Task::(_updateState) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::moving from state preparing -> state finished
>Thread-1974::DEBUG::2014-04-10 17:17:54,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1974::DEBUG::2014-04-10 17:17:54,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1974::DEBUG::2014-04-10 17:17:54,670::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1974::DEBUG::2014-04-10 17:17:54,670::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1974::DEBUG::2014-04-10 17:17:54,670::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1974::DEBUG::2014-04-10 17:17:54,670::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1974::DEBUG::2014-04-10 17:17:54,670::task::974::TaskManager.Task::(_decref) Task=`6bccf81a-4efd-4030-b79b-eed526abb67a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:01,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:01,407::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000432061 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:01,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:01,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034868 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:03,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:03,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00050738 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:18:03,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:18:03,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000458287 s, 803 kB/s\n'; <rc> = 0
>Thread-1978::DEBUG::2014-04-10 17:18:04,746::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1978::DEBUG::2014-04-10 17:18:04,747::task::579::TaskManager.Task::(_updateState) Task=`9d1fc4cf-d736-496e-99c7-5b8e3a8489d2`::moving from state init -> state preparing
>Thread-1978::INFO::2014-04-10 17:18:04,747::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1978::INFO::2014-04-10 17:18:04,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1978::DEBUG::2014-04-10 17:18:04,747::task::1168::TaskManager.Task::(prepare) Task=`9d1fc4cf-d736-496e-99c7-5b8e3a8489d2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1978::DEBUG::2014-04-10 17:18:04,748::task::579::TaskManager.Task::(_updateState) Task=`9d1fc4cf-d736-496e-99c7-5b8e3a8489d2`::moving from state preparing -> state finished
>Thread-1978::DEBUG::2014-04-10 17:18:04,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1978::DEBUG::2014-04-10 17:18:04,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1978::DEBUG::2014-04-10 17:18:04,748::task::974::TaskManager.Task::(_decref) Task=`9d1fc4cf-d736-496e-99c7-5b8e3a8489d2`::ref 0 aborting False
>Thread-1979::DEBUG::2014-04-10 17:18:04,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1979::DEBUG::2014-04-10 17:18:04,755::task::579::TaskManager.Task::(_updateState) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::moving from state init -> state preparing
>Thread-1979::INFO::2014-04-10 17:18:04,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1979::DEBUG::2014-04-10 17:18:04,756::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3b088405-21a0-4e73-9d99-f6c3656ded4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1979::DEBUG::2014-04-10 17:18:04,756::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1979::DEBUG::2014-04-10 17:18:04,756::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1979::DEBUG::2014-04-10 17:18:04,756::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3b088405-21a0-4e73-9d99-f6c3656ded4b`::Granted request
>Thread-1979::DEBUG::2014-04-10 17:18:04,757::task::811::TaskManager.Task::(resourceAcquired) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1979::DEBUG::2014-04-10 17:18:04,757::task::974::TaskManager.Task::(_decref) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::ref 1 aborting False
>Thread-1979::INFO::2014-04-10 17:18:04,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1979::DEBUG::2014-04-10 17:18:04,759::task::1168::TaskManager.Task::(prepare) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1979::DEBUG::2014-04-10 17:18:04,759::task::579::TaskManager.Task::(_updateState) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::moving from state preparing -> state finished
>Thread-1979::DEBUG::2014-04-10 17:18:04,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1979::DEBUG::2014-04-10 17:18:04,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1979::DEBUG::2014-04-10 17:18:04,760::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1979::DEBUG::2014-04-10 17:18:04,760::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1979::DEBUG::2014-04-10 17:18:04,760::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1979::DEBUG::2014-04-10 17:18:04,760::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1979::DEBUG::2014-04-10 17:18:04,760::task::974::TaskManager.Task::(_decref) Task=`53fcf2bd-90e7-4d5f-a947-72d5593d76c4`::ref 0 aborting False
>Thread-1980::DEBUG::2014-04-10 17:18:06,041::task::579::TaskManager.Task::(_updateState) Task=`1052eebe-b07e-422d-ae03-92ca8e01a085`::moving from state init -> state preparing
>Thread-1980::INFO::2014-04-10 17:18:06,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1980::INFO::2014-04-10 17:18:06,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050738', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432061', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034868', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458287', 'lastCheck': '2.9', 'valid': True}}
>Thread-1980::DEBUG::2014-04-10 17:18:06,042::task::1168::TaskManager.Task::(prepare) Task=`1052eebe-b07e-422d-ae03-92ca8e01a085`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050738', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432061', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034868', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458287', 'lastCheck': '2.9', 'valid': True}}
>Thread-1980::DEBUG::2014-04-10 17:18:06,042::task::579::TaskManager.Task::(_updateState) Task=`1052eebe-b07e-422d-ae03-92ca8e01a085`::moving from state preparing -> state finished
>Thread-1980::DEBUG::2014-04-10 17:18:06,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1980::DEBUG::2014-04-10 17:18:06,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1980::DEBUG::2014-04-10 17:18:06,042::task::974::TaskManager.Task::(_decref) Task=`1052eebe-b07e-422d-ae03-92ca8e01a085`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:11,423::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:11,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340226 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:11,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:11,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328948 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:13,157::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:13,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000411022 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:18:13,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:18:13,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00041737 s, 882 kB/s\n'; <rc> = 0
>Thread-1984::DEBUG::2014-04-10 17:18:14,836::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1984::DEBUG::2014-04-10 17:18:14,837::task::579::TaskManager.Task::(_updateState) Task=`4bce1b2d-3c6c-498a-93e4-c49753e0b603`::moving from state init -> state preparing
>Thread-1984::INFO::2014-04-10 17:18:14,837::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1984::INFO::2014-04-10 17:18:14,838::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1984::DEBUG::2014-04-10 17:18:14,838::task::1168::TaskManager.Task::(prepare) Task=`4bce1b2d-3c6c-498a-93e4-c49753e0b603`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1984::DEBUG::2014-04-10 17:18:14,838::task::579::TaskManager.Task::(_updateState) Task=`4bce1b2d-3c6c-498a-93e4-c49753e0b603`::moving from state preparing -> state finished
>Thread-1984::DEBUG::2014-04-10 17:18:14,838::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1984::DEBUG::2014-04-10 17:18:14,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1984::DEBUG::2014-04-10 17:18:14,838::task::974::TaskManager.Task::(_decref) Task=`4bce1b2d-3c6c-498a-93e4-c49753e0b603`::ref 0 aborting False
>Thread-1985::DEBUG::2014-04-10 17:18:14,846::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1985::DEBUG::2014-04-10 17:18:14,846::task::579::TaskManager.Task::(_updateState) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::moving from state init -> state preparing
>Thread-1985::INFO::2014-04-10 17:18:14,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1985::DEBUG::2014-04-10 17:18:14,847::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e230121-e0d2-4388-8c1c-c9afe46600d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1985::DEBUG::2014-04-10 17:18:14,848::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1985::DEBUG::2014-04-10 17:18:14,848::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1985::DEBUG::2014-04-10 17:18:14,849::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e230121-e0d2-4388-8c1c-c9afe46600d5`::Granted request
>Thread-1985::DEBUG::2014-04-10 17:18:14,849::task::811::TaskManager.Task::(resourceAcquired) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1985::DEBUG::2014-04-10 17:18:14,849::task::974::TaskManager.Task::(_decref) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::ref 1 aborting False
>Thread-1985::INFO::2014-04-10 17:18:14,851::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1985::DEBUG::2014-04-10 17:18:14,851::task::1168::TaskManager.Task::(prepare) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1985::DEBUG::2014-04-10 17:18:14,852::task::579::TaskManager.Task::(_updateState) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::moving from state preparing -> state finished
>Thread-1985::DEBUG::2014-04-10 17:18:14,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1985::DEBUG::2014-04-10 17:18:14,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1985::DEBUG::2014-04-10 17:18:14,852::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1985::DEBUG::2014-04-10 17:18:14,852::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1985::DEBUG::2014-04-10 17:18:14,853::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1985::DEBUG::2014-04-10 17:18:14,853::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1985::DEBUG::2014-04-10 17:18:14,853::task::974::TaskManager.Task::(_decref) Task=`e7f4d379-e11e-42cc-a07a-7ad82c49e625`::ref 0 aborting False
>Thread-1988::DEBUG::2014-04-10 17:18:21,205::task::579::TaskManager.Task::(_updateState) Task=`b285ba8a-58e0-46e7-b6c2-83dc182ab0bc`::moving from state init -> state preparing
>Thread-1988::INFO::2014-04-10 17:18:21,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1988::INFO::2014-04-10 17:18:21,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411022', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340226', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328948', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041737', 'lastCheck': '8.0', 'valid': True}}
>Thread-1988::DEBUG::2014-04-10 17:18:21,206::task::1168::TaskManager.Task::(prepare) Task=`b285ba8a-58e0-46e7-b6c2-83dc182ab0bc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411022', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340226', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328948', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041737', 'lastCheck': '8.0', 'valid': True}}
>Thread-1988::DEBUG::2014-04-10 17:18:21,206::task::579::TaskManager.Task::(_updateState) Task=`b285ba8a-58e0-46e7-b6c2-83dc182ab0bc`::moving from state preparing -> state finished
>Thread-1988::DEBUG::2014-04-10 17:18:21,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1988::DEBUG::2014-04-10 17:18:21,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1988::DEBUG::2014-04-10 17:18:21,206::task::974::TaskManager.Task::(_decref) Task=`b285ba8a-58e0-46e7-b6c2-83dc182ab0bc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:21,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:21,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331293 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:21,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:21,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343675 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:23,195::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:18:23,221::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:18:23,223::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:18:23,228::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:23,244::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-469::DEBUG::2014-04-10 17:18:23,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000311182 s, 1.2 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:23,251::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:18:23,252::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:18:23,252::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:18:23,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:23,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000380862 s, 1.7 MB/s\n'; <rc> = 0
>Thread-1995::DEBUG::2014-04-10 17:18:24,935::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1995::DEBUG::2014-04-10 17:18:24,936::task::579::TaskManager.Task::(_updateState) Task=`e1614b6e-13f7-4f4c-8318-eac5d56f29d5`::moving from state init -> state preparing
>Thread-1995::INFO::2014-04-10 17:18:24,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1995::INFO::2014-04-10 17:18:24,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1995::DEBUG::2014-04-10 17:18:24,936::task::1168::TaskManager.Task::(prepare) Task=`e1614b6e-13f7-4f4c-8318-eac5d56f29d5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1995::DEBUG::2014-04-10 17:18:24,936::task::579::TaskManager.Task::(_updateState) Task=`e1614b6e-13f7-4f4c-8318-eac5d56f29d5`::moving from state preparing -> state finished
>Thread-1995::DEBUG::2014-04-10 17:18:24,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1995::DEBUG::2014-04-10 17:18:24,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1995::DEBUG::2014-04-10 17:18:24,937::task::974::TaskManager.Task::(_decref) Task=`e1614b6e-13f7-4f4c-8318-eac5d56f29d5`::ref 0 aborting False
>Thread-1996::DEBUG::2014-04-10 17:18:24,944::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1996::DEBUG::2014-04-10 17:18:24,944::task::579::TaskManager.Task::(_updateState) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::moving from state init -> state preparing
>Thread-1996::INFO::2014-04-10 17:18:24,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1996::DEBUG::2014-04-10 17:18:24,945::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3bf41b42-e5f0-4001-9769-560314732671`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1996::DEBUG::2014-04-10 17:18:24,945::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1996::DEBUG::2014-04-10 17:18:24,945::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1996::DEBUG::2014-04-10 17:18:24,945::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3bf41b42-e5f0-4001-9769-560314732671`::Granted request
>Thread-1996::DEBUG::2014-04-10 17:18:24,945::task::811::TaskManager.Task::(resourceAcquired) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1996::DEBUG::2014-04-10 17:18:24,946::task::974::TaskManager.Task::(_decref) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::ref 1 aborting False
>Thread-1996::INFO::2014-04-10 17:18:24,947::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1996::DEBUG::2014-04-10 17:18:24,948::task::1168::TaskManager.Task::(prepare) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1996::DEBUG::2014-04-10 17:18:24,948::task::579::TaskManager.Task::(_updateState) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::moving from state preparing -> state finished
>Thread-1996::DEBUG::2014-04-10 17:18:24,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1996::DEBUG::2014-04-10 17:18:24,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1996::DEBUG::2014-04-10 17:18:24,948::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1996::DEBUG::2014-04-10 17:18:24,949::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1996::DEBUG::2014-04-10 17:18:24,949::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1996::DEBUG::2014-04-10 17:18:24,949::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1996::DEBUG::2014-04-10 17:18:24,949::task::974::TaskManager.Task::(_decref) Task=`0a82dab9-bfef-4ee0-8242-ba7ef29729c2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:31,483::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:31,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000429968 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:31,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:31,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355007 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:18:33,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:18:33,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484088 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:33,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:33,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000426144 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2000::DEBUG::2014-04-10 17:18:35,025::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2000::DEBUG::2014-04-10 17:18:35,026::task::579::TaskManager.Task::(_updateState) Task=`15401c89-d207-4d23-b9b3-b9b3148782e5`::moving from state init -> state preparing
>Thread-2000::INFO::2014-04-10 17:18:35,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2000::INFO::2014-04-10 17:18:35,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2000::DEBUG::2014-04-10 17:18:35,026::task::1168::TaskManager.Task::(prepare) Task=`15401c89-d207-4d23-b9b3-b9b3148782e5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2000::DEBUG::2014-04-10 17:18:35,027::task::579::TaskManager.Task::(_updateState) Task=`15401c89-d207-4d23-b9b3-b9b3148782e5`::moving from state preparing -> state finished
>Thread-2000::DEBUG::2014-04-10 17:18:35,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2000::DEBUG::2014-04-10 17:18:35,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2000::DEBUG::2014-04-10 17:18:35,027::task::974::TaskManager.Task::(_decref) Task=`15401c89-d207-4d23-b9b3-b9b3148782e5`::ref 0 aborting False
>Thread-2001::DEBUG::2014-04-10 17:18:35,034::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2001::DEBUG::2014-04-10 17:18:35,035::task::579::TaskManager.Task::(_updateState) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::moving from state init -> state preparing
>Thread-2001::INFO::2014-04-10 17:18:35,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2001::DEBUG::2014-04-10 17:18:35,035::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06aec7b5-6f6c-4599-9a3a-36b43fe85ceb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2001::DEBUG::2014-04-10 17:18:35,036::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2001::DEBUG::2014-04-10 17:18:35,036::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2001::DEBUG::2014-04-10 17:18:35,036::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06aec7b5-6f6c-4599-9a3a-36b43fe85ceb`::Granted request
>Thread-2001::DEBUG::2014-04-10 17:18:35,036::task::811::TaskManager.Task::(resourceAcquired) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2001::DEBUG::2014-04-10 17:18:35,037::task::974::TaskManager.Task::(_decref) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::ref 1 aborting False
>Thread-2001::INFO::2014-04-10 17:18:35,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2001::DEBUG::2014-04-10 17:18:35,039::task::1168::TaskManager.Task::(prepare) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2001::DEBUG::2014-04-10 17:18:35,039::task::579::TaskManager.Task::(_updateState) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::moving from state preparing -> state finished
>Thread-2001::DEBUG::2014-04-10 17:18:35,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2001::DEBUG::2014-04-10 17:18:35,040::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2001::DEBUG::2014-04-10 17:18:35,040::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2001::DEBUG::2014-04-10 17:18:35,040::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2001::DEBUG::2014-04-10 17:18:35,040::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2001::DEBUG::2014-04-10 17:18:35,040::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2001::DEBUG::2014-04-10 17:18:35,041::task::974::TaskManager.Task::(_decref) Task=`5a705a7a-bf33-4972-88ae-161c5ee61d61`::ref 0 aborting False
>Thread-2002::DEBUG::2014-04-10 17:18:36,359::task::579::TaskManager.Task::(_updateState) Task=`bf3926bc-3283-4670-ae7b-a99fe2d2e4b8`::moving from state init -> state preparing
>Thread-2002::INFO::2014-04-10 17:18:36,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2002::INFO::2014-04-10 17:18:36,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426144', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429968', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355007', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484088', 'lastCheck': '3.1', 'valid': True}}
>Thread-2002::DEBUG::2014-04-10 17:18:36,359::task::1168::TaskManager.Task::(prepare) Task=`bf3926bc-3283-4670-ae7b-a99fe2d2e4b8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426144', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429968', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355007', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484088', 'lastCheck': '3.1', 'valid': True}}
>Thread-2002::DEBUG::2014-04-10 17:18:36,360::task::579::TaskManager.Task::(_updateState) Task=`bf3926bc-3283-4670-ae7b-a99fe2d2e4b8`::moving from state preparing -> state finished
>Thread-2002::DEBUG::2014-04-10 17:18:36,360::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2002::DEBUG::2014-04-10 17:18:36,360::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2002::DEBUG::2014-04-10 17:18:36,360::task::974::TaskManager.Task::(_decref) Task=`bf3926bc-3283-4670-ae7b-a99fe2d2e4b8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:41,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:41,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00187297 s, 358 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:41,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:41,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377594 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:18:43,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:18:43,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000461832 s, 797 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:43,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:43,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000504217 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2006::DEBUG::2014-04-10 17:18:45,299::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2006::DEBUG::2014-04-10 17:18:45,300::task::579::TaskManager.Task::(_updateState) Task=`b554b7ac-6631-41f0-b0cd-4d815c1af5f5`::moving from state init -> state preparing
>Thread-2006::INFO::2014-04-10 17:18:45,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2006::INFO::2014-04-10 17:18:45,301::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2006::DEBUG::2014-04-10 17:18:45,301::task::1168::TaskManager.Task::(prepare) Task=`b554b7ac-6631-41f0-b0cd-4d815c1af5f5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2006::DEBUG::2014-04-10 17:18:45,301::task::579::TaskManager.Task::(_updateState) Task=`b554b7ac-6631-41f0-b0cd-4d815c1af5f5`::moving from state preparing -> state finished
>Thread-2006::DEBUG::2014-04-10 17:18:45,301::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2006::DEBUG::2014-04-10 17:18:45,301::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2006::DEBUG::2014-04-10 17:18:45,302::task::974::TaskManager.Task::(_decref) Task=`b554b7ac-6631-41f0-b0cd-4d815c1af5f5`::ref 0 aborting False
>Thread-2007::DEBUG::2014-04-10 17:18:45,308::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2007::DEBUG::2014-04-10 17:18:45,309::task::579::TaskManager.Task::(_updateState) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::moving from state init -> state preparing
>Thread-2007::INFO::2014-04-10 17:18:45,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2007::DEBUG::2014-04-10 17:18:45,309::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20dd24cb-0670-46a5-b0d5-88ac1852514e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2007::DEBUG::2014-04-10 17:18:45,310::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2007::DEBUG::2014-04-10 17:18:45,310::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2007::DEBUG::2014-04-10 17:18:45,310::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20dd24cb-0670-46a5-b0d5-88ac1852514e`::Granted request
>Thread-2007::DEBUG::2014-04-10 17:18:45,310::task::811::TaskManager.Task::(resourceAcquired) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2007::DEBUG::2014-04-10 17:18:45,310::task::974::TaskManager.Task::(_decref) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::ref 1 aborting False
>Thread-2007::INFO::2014-04-10 17:18:45,312::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::task::1168::TaskManager.Task::(prepare) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::task::579::TaskManager.Task::(_updateState) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::moving from state preparing -> state finished
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2007::DEBUG::2014-04-10 17:18:45,313::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2007::DEBUG::2014-04-10 17:18:45,314::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2007::DEBUG::2014-04-10 17:18:45,314::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2007::DEBUG::2014-04-10 17:18:45,314::task::974::TaskManager.Task::(_decref) Task=`ebb180d2-dfe1-4e13-9322-3bc772b1a752`::ref 0 aborting False
>Thread-2010::DEBUG::2014-04-10 17:18:51,549::task::579::TaskManager.Task::(_updateState) Task=`fbaf7154-3fa5-40d2-a12f-c6fd6205f83f`::moving from state init -> state preparing
>Thread-2010::INFO::2014-04-10 17:18:51,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2010::INFO::2014-04-10 17:18:51,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504217', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187297', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377594', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461832', 'lastCheck': '8.3', 'valid': True}}
>Thread-2010::DEBUG::2014-04-10 17:18:51,550::task::1168::TaskManager.Task::(prepare) Task=`fbaf7154-3fa5-40d2-a12f-c6fd6205f83f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504217', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187297', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377594', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461832', 'lastCheck': '8.3', 'valid': True}}
>Thread-2010::DEBUG::2014-04-10 17:18:51,550::task::579::TaskManager.Task::(_updateState) Task=`fbaf7154-3fa5-40d2-a12f-c6fd6205f83f`::moving from state preparing -> state finished
>Thread-2010::DEBUG::2014-04-10 17:18:51,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2010::DEBUG::2014-04-10 17:18:51,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2010::DEBUG::2014-04-10 17:18:51,551::task::974::TaskManager.Task::(_decref) Task=`fbaf7154-3fa5-40d2-a12f-c6fd6205f83f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:18:51,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:18:51,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00180968 s, 371 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:18:51,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:18:51,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256574 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:18:53,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:18:53,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533168 s, 690 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:18:53,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:18:53,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455131 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2013::DEBUG::2014-04-10 17:18:55,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2013::DEBUG::2014-04-10 17:18:55,416::task::579::TaskManager.Task::(_updateState) Task=`e43f7200-a5f2-4473-8f2d-673ac55dbcaf`::moving from state init -> state preparing
>Thread-2013::INFO::2014-04-10 17:18:55,416::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2013::INFO::2014-04-10 17:18:55,416::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2013::DEBUG::2014-04-10 17:18:55,416::task::1168::TaskManager.Task::(prepare) Task=`e43f7200-a5f2-4473-8f2d-673ac55dbcaf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2013::DEBUG::2014-04-10 17:18:55,417::task::579::TaskManager.Task::(_updateState) Task=`e43f7200-a5f2-4473-8f2d-673ac55dbcaf`::moving from state preparing -> state finished
>Thread-2013::DEBUG::2014-04-10 17:18:55,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2013::DEBUG::2014-04-10 17:18:55,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2013::DEBUG::2014-04-10 17:18:55,417::task::974::TaskManager.Task::(_decref) Task=`e43f7200-a5f2-4473-8f2d-673ac55dbcaf`::ref 0 aborting False
>Thread-2014::DEBUG::2014-04-10 17:18:55,424::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2014::DEBUG::2014-04-10 17:18:55,424::task::579::TaskManager.Task::(_updateState) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::moving from state init -> state preparing
>Thread-2014::INFO::2014-04-10 17:18:55,424::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2014::DEBUG::2014-04-10 17:18:55,425::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2402b818-0e80-4e94-9689-1ead64331bed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2014::DEBUG::2014-04-10 17:18:55,425::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2014::DEBUG::2014-04-10 17:18:55,425::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2014::DEBUG::2014-04-10 17:18:55,425::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2402b818-0e80-4e94-9689-1ead64331bed`::Granted request
>Thread-2014::DEBUG::2014-04-10 17:18:55,426::task::811::TaskManager.Task::(resourceAcquired) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2014::DEBUG::2014-04-10 17:18:55,427::task::974::TaskManager.Task::(_decref) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::ref 1 aborting False
>Thread-2014::INFO::2014-04-10 17:18:55,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2014::DEBUG::2014-04-10 17:18:55,429::task::1168::TaskManager.Task::(prepare) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2014::DEBUG::2014-04-10 17:18:55,429::task::579::TaskManager.Task::(_updateState) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::moving from state preparing -> state finished
>Thread-2014::DEBUG::2014-04-10 17:18:55,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2014::DEBUG::2014-04-10 17:18:55,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2014::DEBUG::2014-04-10 17:18:55,429::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2014::DEBUG::2014-04-10 17:18:55,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2014::DEBUG::2014-04-10 17:18:55,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2014::DEBUG::2014-04-10 17:18:55,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2014::DEBUG::2014-04-10 17:18:55,430::task::974::TaskManager.Task::(_decref) Task=`ad5c22f5-c14b-4d65-9b66-ddeb1a2efbe6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:01,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:01,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304945 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:01,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:01,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341471 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:19:03,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:03,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448115 s, 821 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:03,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:03,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455666 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2018::DEBUG::2014-04-10 17:19:05,503::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2018::DEBUG::2014-04-10 17:19:05,504::task::579::TaskManager.Task::(_updateState) Task=`b43a0566-240f-45fb-a65b-df9addb61264`::moving from state init -> state preparing
>Thread-2018::INFO::2014-04-10 17:19:05,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2018::INFO::2014-04-10 17:19:05,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2018::DEBUG::2014-04-10 17:19:05,505::task::1168::TaskManager.Task::(prepare) Task=`b43a0566-240f-45fb-a65b-df9addb61264`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2018::DEBUG::2014-04-10 17:19:05,505::task::579::TaskManager.Task::(_updateState) Task=`b43a0566-240f-45fb-a65b-df9addb61264`::moving from state preparing -> state finished
>Thread-2018::DEBUG::2014-04-10 17:19:05,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2018::DEBUG::2014-04-10 17:19:05,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2018::DEBUG::2014-04-10 17:19:05,506::task::974::TaskManager.Task::(_decref) Task=`b43a0566-240f-45fb-a65b-df9addb61264`::ref 0 aborting False
>Thread-2019::DEBUG::2014-04-10 17:19:05,512::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2019::DEBUG::2014-04-10 17:19:05,513::task::579::TaskManager.Task::(_updateState) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::moving from state init -> state preparing
>Thread-2019::INFO::2014-04-10 17:19:05,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2019::DEBUG::2014-04-10 17:19:05,514::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e94629c3-8d37-4674-9cee-3c78ef90e308`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2019::DEBUG::2014-04-10 17:19:05,514::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2019::DEBUG::2014-04-10 17:19:05,514::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2019::DEBUG::2014-04-10 17:19:05,514::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e94629c3-8d37-4674-9cee-3c78ef90e308`::Granted request
>Thread-2019::DEBUG::2014-04-10 17:19:05,515::task::811::TaskManager.Task::(resourceAcquired) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2019::DEBUG::2014-04-10 17:19:05,515::task::974::TaskManager.Task::(_decref) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::ref 1 aborting False
>Thread-2019::INFO::2014-04-10 17:19:05,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2019::DEBUG::2014-04-10 17:19:05,517::task::1168::TaskManager.Task::(prepare) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::task::579::TaskManager.Task::(_updateState) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::moving from state preparing -> state finished
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2019::DEBUG::2014-04-10 17:19:05,518::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2019::DEBUG::2014-04-10 17:19:05,519::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2019::DEBUG::2014-04-10 17:19:05,519::task::974::TaskManager.Task::(_decref) Task=`7c4a696a-3949-4b89-87ab-27db2458e76d`::ref 0 aborting False
>Thread-2020::DEBUG::2014-04-10 17:19:06,720::task::579::TaskManager.Task::(_updateState) Task=`785f396e-ab64-488b-b825-c94fef0c945d`::moving from state init -> state preparing
>Thread-2020::INFO::2014-04-10 17:19:06,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2020::INFO::2014-04-10 17:19:06,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455666', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304945', 'lastCheck': '5.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341471', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448115', 'lastCheck': '3.4', 'valid': True}}
>Thread-2020::DEBUG::2014-04-10 17:19:06,721::task::1168::TaskManager.Task::(prepare) Task=`785f396e-ab64-488b-b825-c94fef0c945d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455666', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304945', 'lastCheck': '5.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341471', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448115', 'lastCheck': '3.4', 'valid': True}}
>Thread-2020::DEBUG::2014-04-10 17:19:06,721::task::579::TaskManager.Task::(_updateState) Task=`785f396e-ab64-488b-b825-c94fef0c945d`::moving from state preparing -> state finished
>Thread-2020::DEBUG::2014-04-10 17:19:06,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2020::DEBUG::2014-04-10 17:19:06,721::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2020::DEBUG::2014-04-10 17:19:06,721::task::974::TaskManager.Task::(_decref) Task=`785f396e-ab64-488b-b825-c94fef0c945d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:11,631::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:11,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357707 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:11,660::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:11,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361434 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:19:13,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:13,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466435 s, 789 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:13,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:13,345::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000424922 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2024::DEBUG::2014-04-10 17:19:15,601::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2024::DEBUG::2014-04-10 17:19:15,602::task::579::TaskManager.Task::(_updateState) Task=`1a0d5a3b-e76c-4f24-979d-e75a1d599b20`::moving from state init -> state preparing
>Thread-2024::INFO::2014-04-10 17:19:15,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2024::INFO::2014-04-10 17:19:15,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2024::DEBUG::2014-04-10 17:19:15,603::task::1168::TaskManager.Task::(prepare) Task=`1a0d5a3b-e76c-4f24-979d-e75a1d599b20`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2024::DEBUG::2014-04-10 17:19:15,603::task::579::TaskManager.Task::(_updateState) Task=`1a0d5a3b-e76c-4f24-979d-e75a1d599b20`::moving from state preparing -> state finished
>Thread-2024::DEBUG::2014-04-10 17:19:15,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2024::DEBUG::2014-04-10 17:19:15,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2024::DEBUG::2014-04-10 17:19:15,603::task::974::TaskManager.Task::(_decref) Task=`1a0d5a3b-e76c-4f24-979d-e75a1d599b20`::ref 0 aborting False
>Thread-2025::DEBUG::2014-04-10 17:19:15,609::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2025::DEBUG::2014-04-10 17:19:15,610::task::579::TaskManager.Task::(_updateState) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::moving from state init -> state preparing
>Thread-2025::INFO::2014-04-10 17:19:15,610::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2025::DEBUG::2014-04-10 17:19:15,610::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`91c3d49c-0cf2-49dd-be14-ec4b706bd168`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2025::DEBUG::2014-04-10 17:19:15,611::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2025::DEBUG::2014-04-10 17:19:15,611::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2025::DEBUG::2014-04-10 17:19:15,611::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`91c3d49c-0cf2-49dd-be14-ec4b706bd168`::Granted request
>Thread-2025::DEBUG::2014-04-10 17:19:15,611::task::811::TaskManager.Task::(resourceAcquired) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2025::DEBUG::2014-04-10 17:19:15,611::task::974::TaskManager.Task::(_decref) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::ref 1 aborting False
>Thread-2025::INFO::2014-04-10 17:19:15,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2025::DEBUG::2014-04-10 17:19:15,613::task::1168::TaskManager.Task::(prepare) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::task::579::TaskManager.Task::(_updateState) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::moving from state preparing -> state finished
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2025::DEBUG::2014-04-10 17:19:15,614::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2025::DEBUG::2014-04-10 17:19:15,615::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2025::DEBUG::2014-04-10 17:19:15,615::task::974::TaskManager.Task::(_decref) Task=`b857fcfc-4ac2-4088-83ef-7096b7878d5c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:21,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:21,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332908 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:21,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:21,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033798 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2028::DEBUG::2014-04-10 17:19:21,879::task::579::TaskManager.Task::(_updateState) Task=`afb17dfe-151d-40b5-8803-6bff1c1be45b`::moving from state init -> state preparing
>Thread-2028::INFO::2014-04-10 17:19:21,880::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2028::INFO::2014-04-10 17:19:21,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424922', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332908', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033798', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466435', 'lastCheck': '8.5', 'valid': True}}
>Thread-2028::DEBUG::2014-04-10 17:19:21,880::task::1168::TaskManager.Task::(prepare) Task=`afb17dfe-151d-40b5-8803-6bff1c1be45b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424922', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332908', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033798', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466435', 'lastCheck': '8.5', 'valid': True}}
>Thread-2028::DEBUG::2014-04-10 17:19:21,880::task::579::TaskManager.Task::(_updateState) Task=`afb17dfe-151d-40b5-8803-6bff1c1be45b`::moving from state preparing -> state finished
>Thread-2028::DEBUG::2014-04-10 17:19:21,881::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2028::DEBUG::2014-04-10 17:19:21,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2028::DEBUG::2014-04-10 17:19:21,881::task::974::TaskManager.Task::(_decref) Task=`afb17dfe-151d-40b5-8803-6bff1c1be45b`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:19:23,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:23,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447118 s, 823 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:23,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:23,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000437228 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2031::DEBUG::2014-04-10 17:19:25,683::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2031::DEBUG::2014-04-10 17:19:25,684::task::579::TaskManager.Task::(_updateState) Task=`c864e760-1046-48e8-8ae1-b655fcce62f0`::moving from state init -> state preparing
>Thread-2031::INFO::2014-04-10 17:19:25,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2031::INFO::2014-04-10 17:19:25,684::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2031::DEBUG::2014-04-10 17:19:25,685::task::1168::TaskManager.Task::(prepare) Task=`c864e760-1046-48e8-8ae1-b655fcce62f0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2031::DEBUG::2014-04-10 17:19:25,685::task::579::TaskManager.Task::(_updateState) Task=`c864e760-1046-48e8-8ae1-b655fcce62f0`::moving from state preparing -> state finished
>Thread-2031::DEBUG::2014-04-10 17:19:25,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2031::DEBUG::2014-04-10 17:19:25,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2031::DEBUG::2014-04-10 17:19:25,685::task::974::TaskManager.Task::(_decref) Task=`c864e760-1046-48e8-8ae1-b655fcce62f0`::ref 0 aborting False
>Thread-2032::DEBUG::2014-04-10 17:19:25,692::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2032::DEBUG::2014-04-10 17:19:25,692::task::579::TaskManager.Task::(_updateState) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::moving from state init -> state preparing
>Thread-2032::INFO::2014-04-10 17:19:25,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2032::DEBUG::2014-04-10 17:19:25,693::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9ed252e7-a810-45f4-8e50-cf9fad511976`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2032::DEBUG::2014-04-10 17:19:25,693::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2032::DEBUG::2014-04-10 17:19:25,693::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2032::DEBUG::2014-04-10 17:19:25,694::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9ed252e7-a810-45f4-8e50-cf9fad511976`::Granted request
>Thread-2032::DEBUG::2014-04-10 17:19:25,694::task::811::TaskManager.Task::(resourceAcquired) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2032::DEBUG::2014-04-10 17:19:25,694::task::974::TaskManager.Task::(_decref) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::ref 1 aborting False
>Thread-2032::INFO::2014-04-10 17:19:25,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2032::DEBUG::2014-04-10 17:19:25,696::task::1168::TaskManager.Task::(prepare) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2032::DEBUG::2014-04-10 17:19:25,696::task::579::TaskManager.Task::(_updateState) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::moving from state preparing -> state finished
>Thread-2032::DEBUG::2014-04-10 17:19:25,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2032::DEBUG::2014-04-10 17:19:25,697::task::974::TaskManager.Task::(_decref) Task=`14e55075-a67d-457f-846e-d9ee61988b7e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:31,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:31,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356698 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:31,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:31,727::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337154 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:19:33,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:33,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000482974 s, 762 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:33,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:33,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000461428 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2036::DEBUG::2014-04-10 17:19:35,782::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-2036::DEBUG::2014-04-10 17:19:35,783::task::579::TaskManager.Task::(_updateState) Task=`373c4407-6716-4326-bb21-9c70340accc9`::moving from state init -> state preparing
>Thread-2036::INFO::2014-04-10 17:19:35,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2036::INFO::2014-04-10 17:19:35,783::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2036::DEBUG::2014-04-10 17:19:35,783::task::1168::TaskManager.Task::(prepare) Task=`373c4407-6716-4326-bb21-9c70340accc9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2036::DEBUG::2014-04-10 17:19:35,784::task::579::TaskManager.Task::(_updateState) Task=`373c4407-6716-4326-bb21-9c70340accc9`::moving from state preparing -> state finished
>Thread-2036::DEBUG::2014-04-10 17:19:35,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2036::DEBUG::2014-04-10 17:19:35,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2036::DEBUG::2014-04-10 17:19:35,784::task::974::TaskManager.Task::(_decref) Task=`373c4407-6716-4326-bb21-9c70340accc9`::ref 0 aborting False
>Thread-2037::DEBUG::2014-04-10 17:19:35,791::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-2037::DEBUG::2014-04-10 17:19:35,791::task::579::TaskManager.Task::(_updateState) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::moving from state init -> state preparing
>Thread-2037::INFO::2014-04-10 17:19:35,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2037::DEBUG::2014-04-10 17:19:35,792::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2635a82-137b-4fa2-bc31-e4dc885313d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2037::DEBUG::2014-04-10 17:19:35,792::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2037::DEBUG::2014-04-10 17:19:35,792::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2037::DEBUG::2014-04-10 17:19:35,792::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2635a82-137b-4fa2-bc31-e4dc885313d8`::Granted request
>Thread-2037::DEBUG::2014-04-10 17:19:35,820::task::811::TaskManager.Task::(resourceAcquired) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2037::DEBUG::2014-04-10 17:19:35,821::task::974::TaskManager.Task::(_decref) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::ref 1 aborting False
>Thread-2037::INFO::2014-04-10 17:19:35,823::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2037::DEBUG::2014-04-10 17:19:35,823::task::1168::TaskManager.Task::(prepare) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2037::DEBUG::2014-04-10 17:19:35,823::task::579::TaskManager.Task::(_updateState) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::moving from state preparing -> state finished
>Thread-2037::DEBUG::2014-04-10 17:19:35,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2037::DEBUG::2014-04-10 17:19:35,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2037::DEBUG::2014-04-10 17:19:35,824::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2037::DEBUG::2014-04-10 17:19:35,824::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2037::DEBUG::2014-04-10 17:19:35,824::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2037::DEBUG::2014-04-10 17:19:35,824::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2037::DEBUG::2014-04-10 17:19:35,825::task::974::TaskManager.Task::(_decref) Task=`1a62f93a-96f8-4a2f-ac0b-8bbe7a0be9fd`::ref 0 aborting False
>Thread-2038::DEBUG::2014-04-10 17:19:37,070::task::579::TaskManager.Task::(_updateState) Task=`4f0ddeb1-401a-49f2-a9e0-6d04644d8677`::moving from state init -> state preparing
>Thread-2038::INFO::2014-04-10 17:19:37,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2038::INFO::2014-04-10 17:19:37,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461428', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356698', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337154', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482974', 'lastCheck': '3.7', 'valid': True}}
>Thread-2038::DEBUG::2014-04-10 17:19:37,070::task::1168::TaskManager.Task::(prepare) Task=`4f0ddeb1-401a-49f2-a9e0-6d04644d8677`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461428', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356698', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337154', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482974', 'lastCheck': '3.7', 'valid': True}}
>Thread-2038::DEBUG::2014-04-10 17:19:37,071::task::579::TaskManager.Task::(_updateState) Task=`4f0ddeb1-401a-49f2-a9e0-6d04644d8677`::moving from state preparing -> state finished
>Thread-2038::DEBUG::2014-04-10 17:19:37,071::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2038::DEBUG::2014-04-10 17:19:37,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2038::DEBUG::2014-04-10 17:19:37,071::task::974::TaskManager.Task::(_decref) Task=`4f0ddeb1-401a-49f2-a9e0-6d04644d8677`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:41,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:41,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281311 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:41,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:41,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334067 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:19:43,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:43,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477103 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:43,389::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:43,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429712 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2042::DEBUG::2014-04-10 17:19:45,915::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2042::DEBUG::2014-04-10 17:19:45,915::task::579::TaskManager.Task::(_updateState) Task=`3b8f437e-0faa-4a46-b551-a880f2a81e41`::moving from state init -> state preparing
>Thread-2042::INFO::2014-04-10 17:19:45,916::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2042::INFO::2014-04-10 17:19:45,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2042::DEBUG::2014-04-10 17:19:45,916::task::1168::TaskManager.Task::(prepare) Task=`3b8f437e-0faa-4a46-b551-a880f2a81e41`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2042::DEBUG::2014-04-10 17:19:45,916::task::579::TaskManager.Task::(_updateState) Task=`3b8f437e-0faa-4a46-b551-a880f2a81e41`::moving from state preparing -> state finished
>Thread-2042::DEBUG::2014-04-10 17:19:45,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2042::DEBUG::2014-04-10 17:19:45,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2042::DEBUG::2014-04-10 17:19:45,917::task::974::TaskManager.Task::(_decref) Task=`3b8f437e-0faa-4a46-b551-a880f2a81e41`::ref 0 aborting False
>Thread-2043::DEBUG::2014-04-10 17:19:45,923::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2043::DEBUG::2014-04-10 17:19:45,923::task::579::TaskManager.Task::(_updateState) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::moving from state init -> state preparing
>Thread-2043::INFO::2014-04-10 17:19:45,924::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2043::DEBUG::2014-04-10 17:19:45,924::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`126e0908-7b95-4114-a550-f4efff052c1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2043::DEBUG::2014-04-10 17:19:45,924::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2043::DEBUG::2014-04-10 17:19:45,924::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2043::DEBUG::2014-04-10 17:19:45,925::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`126e0908-7b95-4114-a550-f4efff052c1e`::Granted request
>Thread-2043::DEBUG::2014-04-10 17:19:45,925::task::811::TaskManager.Task::(resourceAcquired) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2043::DEBUG::2014-04-10 17:19:45,925::task::974::TaskManager.Task::(_decref) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::ref 1 aborting False
>Thread-2043::INFO::2014-04-10 17:19:45,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2043::DEBUG::2014-04-10 17:19:45,927::task::1168::TaskManager.Task::(prepare) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2043::DEBUG::2014-04-10 17:19:45,927::task::579::TaskManager.Task::(_updateState) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::moving from state preparing -> state finished
>Thread-2043::DEBUG::2014-04-10 17:19:45,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2043::DEBUG::2014-04-10 17:19:45,928::task::974::TaskManager.Task::(_decref) Task=`890292e5-b8e7-4656-932a-3ee973fb5b04`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:19:51,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:19:51,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296751 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:19:51,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:19:51,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334492 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2046::DEBUG::2014-04-10 17:19:52,266::task::579::TaskManager.Task::(_updateState) Task=`3098a139-e20a-4af1-bafb-241891ad346e`::moving from state init -> state preparing
>Thread-2046::INFO::2014-04-10 17:19:52,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2046::INFO::2014-04-10 17:19:52,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429712', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296751', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334492', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477103', 'lastCheck': '8.9', 'valid': True}}
>Thread-2046::DEBUG::2014-04-10 17:19:52,267::task::1168::TaskManager.Task::(prepare) Task=`3098a139-e20a-4af1-bafb-241891ad346e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429712', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296751', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334492', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477103', 'lastCheck': '8.9', 'valid': True}}
>Thread-2046::DEBUG::2014-04-10 17:19:52,267::task::579::TaskManager.Task::(_updateState) Task=`3098a139-e20a-4af1-bafb-241891ad346e`::moving from state preparing -> state finished
>Thread-2046::DEBUG::2014-04-10 17:19:52,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2046::DEBUG::2014-04-10 17:19:52,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2046::DEBUG::2014-04-10 17:19:52,268::task::974::TaskManager.Task::(_decref) Task=`3098a139-e20a-4af1-bafb-241891ad346e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:19:53,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:19:53,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000472397 s, 779 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:19:53,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:19:53,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470862 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2049::DEBUG::2014-04-10 17:19:56,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2049::DEBUG::2014-04-10 17:19:56,013::task::579::TaskManager.Task::(_updateState) Task=`c7a96b35-ce87-4bef-8eca-589e572ae4b6`::moving from state init -> state preparing
>Thread-2049::INFO::2014-04-10 17:19:56,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2049::INFO::2014-04-10 17:19:56,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2049::DEBUG::2014-04-10 17:19:56,014::task::1168::TaskManager.Task::(prepare) Task=`c7a96b35-ce87-4bef-8eca-589e572ae4b6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2049::DEBUG::2014-04-10 17:19:56,014::task::579::TaskManager.Task::(_updateState) Task=`c7a96b35-ce87-4bef-8eca-589e572ae4b6`::moving from state preparing -> state finished
>Thread-2049::DEBUG::2014-04-10 17:19:56,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2049::DEBUG::2014-04-10 17:19:56,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2049::DEBUG::2014-04-10 17:19:56,015::task::974::TaskManager.Task::(_decref) Task=`c7a96b35-ce87-4bef-8eca-589e572ae4b6`::ref 0 aborting False
>Thread-2050::DEBUG::2014-04-10 17:19:56,021::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2050::DEBUG::2014-04-10 17:19:56,022::task::579::TaskManager.Task::(_updateState) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::moving from state init -> state preparing
>Thread-2050::INFO::2014-04-10 17:19:56,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2050::DEBUG::2014-04-10 17:19:56,022::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40a17990-eef9-4c5a-89f1-52a28289d54f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2050::DEBUG::2014-04-10 17:19:56,022::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2050::DEBUG::2014-04-10 17:19:56,023::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2050::DEBUG::2014-04-10 17:19:56,023::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40a17990-eef9-4c5a-89f1-52a28289d54f`::Granted request
>Thread-2050::DEBUG::2014-04-10 17:19:56,023::task::811::TaskManager.Task::(resourceAcquired) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2050::DEBUG::2014-04-10 17:19:56,023::task::974::TaskManager.Task::(_decref) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::ref 1 aborting False
>Thread-2050::INFO::2014-04-10 17:19:56,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2050::DEBUG::2014-04-10 17:19:56,025::task::1168::TaskManager.Task::(prepare) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2050::DEBUG::2014-04-10 17:19:56,025::task::579::TaskManager.Task::(_updateState) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::moving from state preparing -> state finished
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2050::DEBUG::2014-04-10 17:19:56,026::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2050::DEBUG::2014-04-10 17:19:56,027::task::974::TaskManager.Task::(_decref) Task=`3b883d60-7da2-4db7-a046-50ddfd293915`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:01,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:20:01,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272351 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:20:01,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:01,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334496 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:20:03,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:03,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000397947 s, 925 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:03,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:03,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000437955 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2054::DEBUG::2014-04-10 17:20:06,103::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-2054::DEBUG::2014-04-10 17:20:06,103::task::579::TaskManager.Task::(_updateState) Task=`077d2673-42ef-49f3-9615-2e5764179344`::moving from state init -> state preparing
>Thread-2054::INFO::2014-04-10 17:20:06,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2054::INFO::2014-04-10 17:20:06,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2054::DEBUG::2014-04-10 17:20:06,104::task::1168::TaskManager.Task::(prepare) Task=`077d2673-42ef-49f3-9615-2e5764179344`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2054::DEBUG::2014-04-10 17:20:06,104::task::579::TaskManager.Task::(_updateState) Task=`077d2673-42ef-49f3-9615-2e5764179344`::moving from state preparing -> state finished
>Thread-2054::DEBUG::2014-04-10 17:20:06,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2054::DEBUG::2014-04-10 17:20:06,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2054::DEBUG::2014-04-10 17:20:06,105::task::974::TaskManager.Task::(_decref) Task=`077d2673-42ef-49f3-9615-2e5764179344`::ref 0 aborting False
>Thread-2055::DEBUG::2014-04-10 17:20:06,112::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-2055::DEBUG::2014-04-10 17:20:06,112::task::579::TaskManager.Task::(_updateState) Task=`926f1175-5015-4481-9a46-4a421341e230`::moving from state init -> state preparing
>Thread-2055::INFO::2014-04-10 17:20:06,113::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2055::DEBUG::2014-04-10 17:20:06,113::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5c0a5cc-2031-4c2f-87c3-e68ccd5587b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2055::DEBUG::2014-04-10 17:20:06,113::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2055::DEBUG::2014-04-10 17:20:06,114::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2055::DEBUG::2014-04-10 17:20:06,114::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5c0a5cc-2031-4c2f-87c3-e68ccd5587b5`::Granted request
>Thread-2055::DEBUG::2014-04-10 17:20:06,114::task::811::TaskManager.Task::(resourceAcquired) Task=`926f1175-5015-4481-9a46-4a421341e230`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2055::DEBUG::2014-04-10 17:20:06,114::task::974::TaskManager.Task::(_decref) Task=`926f1175-5015-4481-9a46-4a421341e230`::ref 1 aborting False
>Thread-2055::INFO::2014-04-10 17:20:06,116::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2055::DEBUG::2014-04-10 17:20:06,117::task::1168::TaskManager.Task::(prepare) Task=`926f1175-5015-4481-9a46-4a421341e230`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2055::DEBUG::2014-04-10 17:20:06,117::task::579::TaskManager.Task::(_updateState) Task=`926f1175-5015-4481-9a46-4a421341e230`::moving from state preparing -> state finished
>Thread-2055::DEBUG::2014-04-10 17:20:06,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2055::DEBUG::2014-04-10 17:20:06,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2055::DEBUG::2014-04-10 17:20:06,117::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2055::DEBUG::2014-04-10 17:20:06,118::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2055::DEBUG::2014-04-10 17:20:06,118::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2055::DEBUG::2014-04-10 17:20:06,118::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2055::DEBUG::2014-04-10 17:20:06,118::task::974::TaskManager.Task::(_decref) Task=`926f1175-5015-4481-9a46-4a421341e230`::ref 0 aborting False
>Thread-2056::DEBUG::2014-04-10 17:20:07,515::task::579::TaskManager.Task::(_updateState) Task=`114093ce-823c-48aa-a4a7-879994b3699a`::moving from state init -> state preparing
>Thread-2056::INFO::2014-04-10 17:20:07,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2056::INFO::2014-04-10 17:20:07,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437955', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272351', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334496', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397947', 'lastCheck': '4.1', 'valid': True}}
>Thread-2056::DEBUG::2014-04-10 17:20:07,516::task::1168::TaskManager.Task::(prepare) Task=`114093ce-823c-48aa-a4a7-879994b3699a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437955', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272351', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334496', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397947', 'lastCheck': '4.1', 'valid': True}}
>Thread-2056::DEBUG::2014-04-10 17:20:07,516::task::579::TaskManager.Task::(_updateState) Task=`114093ce-823c-48aa-a4a7-879994b3699a`::moving from state preparing -> state finished
>Thread-2056::DEBUG::2014-04-10 17:20:07,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2056::DEBUG::2014-04-10 17:20:07,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2056::DEBUG::2014-04-10 17:20:07,516::task::974::TaskManager.Task::(_decref) Task=`114093ce-823c-48aa-a4a7-879994b3699a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:11,823::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:20:11,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297934 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:20:11,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:11,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314646 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:20:13,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:13,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00050752 s, 725 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:13,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:13,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000442078 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2060::DEBUG::2014-04-10 17:20:16,194::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2060::DEBUG::2014-04-10 17:20:16,194::task::579::TaskManager.Task::(_updateState) Task=`48b44ce5-104f-48ce-af86-7ba1f378cd6f`::moving from state init -> state preparing
>Thread-2060::INFO::2014-04-10 17:20:16,195::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2060::INFO::2014-04-10 17:20:16,195::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2060::DEBUG::2014-04-10 17:20:16,195::task::1168::TaskManager.Task::(prepare) Task=`48b44ce5-104f-48ce-af86-7ba1f378cd6f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2060::DEBUG::2014-04-10 17:20:16,195::task::579::TaskManager.Task::(_updateState) Task=`48b44ce5-104f-48ce-af86-7ba1f378cd6f`::moving from state preparing -> state finished
>Thread-2060::DEBUG::2014-04-10 17:20:16,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2060::DEBUG::2014-04-10 17:20:16,196::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2060::DEBUG::2014-04-10 17:20:16,196::task::974::TaskManager.Task::(_decref) Task=`48b44ce5-104f-48ce-af86-7ba1f378cd6f`::ref 0 aborting False
>Thread-2061::DEBUG::2014-04-10 17:20:16,202::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2061::DEBUG::2014-04-10 17:20:16,202::task::579::TaskManager.Task::(_updateState) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::moving from state init -> state preparing
>Thread-2061::INFO::2014-04-10 17:20:16,203::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2061::DEBUG::2014-04-10 17:20:16,203::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f333dd13-8fcf-4750-8b39-83be9d84cb38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2061::DEBUG::2014-04-10 17:20:16,203::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2061::DEBUG::2014-04-10 17:20:16,203::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2061::DEBUG::2014-04-10 17:20:16,204::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f333dd13-8fcf-4750-8b39-83be9d84cb38`::Granted request
>Thread-2061::DEBUG::2014-04-10 17:20:16,204::task::811::TaskManager.Task::(resourceAcquired) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2061::DEBUG::2014-04-10 17:20:16,204::task::974::TaskManager.Task::(_decref) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::ref 1 aborting False
>Thread-2061::INFO::2014-04-10 17:20:16,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2061::DEBUG::2014-04-10 17:20:16,206::task::1168::TaskManager.Task::(prepare) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2061::DEBUG::2014-04-10 17:20:16,206::task::579::TaskManager.Task::(_updateState) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::moving from state preparing -> state finished
>Thread-2061::DEBUG::2014-04-10 17:20:16,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2061::DEBUG::2014-04-10 17:20:16,207::task::974::TaskManager.Task::(_decref) Task=`18e7a8ac-d849-448d-9f0b-724ef7239674`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:21,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:20:21,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347329 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:20:21,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:21,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363446 s, 1.8 MB/s\n'; <rc> = 0
>Thread-2064::DEBUG::2014-04-10 17:20:22,711::task::579::TaskManager.Task::(_updateState) Task=`29186359-d992-4824-8435-a95499455773`::moving from state init -> state preparing
>Thread-2064::INFO::2014-04-10 17:20:22,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2064::INFO::2014-04-10 17:20:22,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442078', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347329', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363446', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050752', 'lastCheck': '9.3', 'valid': True}}
>Thread-2064::DEBUG::2014-04-10 17:20:22,712::task::1168::TaskManager.Task::(prepare) Task=`29186359-d992-4824-8435-a95499455773`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442078', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347329', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363446', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050752', 'lastCheck': '9.3', 'valid': True}}
>Thread-2064::DEBUG::2014-04-10 17:20:22,712::task::579::TaskManager.Task::(_updateState) Task=`29186359-d992-4824-8435-a95499455773`::moving from state preparing -> state finished
>Thread-2064::DEBUG::2014-04-10 17:20:22,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2064::DEBUG::2014-04-10 17:20:22,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2064::DEBUG::2014-04-10 17:20:22,713::task::974::TaskManager.Task::(_decref) Task=`29186359-d992-4824-8435-a95499455773`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:20:23,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:23,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000468526 s, 785 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:23,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:23,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000491813 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2067::DEBUG::2014-04-10 17:20:26,283::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2067::DEBUG::2014-04-10 17:20:26,284::task::579::TaskManager.Task::(_updateState) Task=`fcad0c3b-b3ab-4345-9902-c63350c3f9f8`::moving from state init -> state preparing
>Thread-2067::INFO::2014-04-10 17:20:26,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2067::INFO::2014-04-10 17:20:26,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2067::DEBUG::2014-04-10 17:20:26,284::task::1168::TaskManager.Task::(prepare) Task=`fcad0c3b-b3ab-4345-9902-c63350c3f9f8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2067::DEBUG::2014-04-10 17:20:26,285::task::579::TaskManager.Task::(_updateState) Task=`fcad0c3b-b3ab-4345-9902-c63350c3f9f8`::moving from state preparing -> state finished
>Thread-2067::DEBUG::2014-04-10 17:20:26,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2067::DEBUG::2014-04-10 17:20:26,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2067::DEBUG::2014-04-10 17:20:26,285::task::974::TaskManager.Task::(_decref) Task=`fcad0c3b-b3ab-4345-9902-c63350c3f9f8`::ref 0 aborting False
>Thread-2068::DEBUG::2014-04-10 17:20:26,292::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2068::DEBUG::2014-04-10 17:20:26,292::task::579::TaskManager.Task::(_updateState) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::moving from state init -> state preparing
>Thread-2068::INFO::2014-04-10 17:20:26,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2068::DEBUG::2014-04-10 17:20:26,293::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0fe1fcc6-fc7a-427a-8ea7-ab98cafd8275`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2068::DEBUG::2014-04-10 17:20:26,293::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2068::DEBUG::2014-04-10 17:20:26,293::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2068::DEBUG::2014-04-10 17:20:26,293::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0fe1fcc6-fc7a-427a-8ea7-ab98cafd8275`::Granted request
>Thread-2068::DEBUG::2014-04-10 17:20:26,293::task::811::TaskManager.Task::(resourceAcquired) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2068::DEBUG::2014-04-10 17:20:26,294::task::974::TaskManager.Task::(_decref) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::ref 1 aborting False
>Thread-2068::INFO::2014-04-10 17:20:26,295::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::task::1168::TaskManager.Task::(prepare) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::task::579::TaskManager.Task::(_updateState) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::moving from state preparing -> state finished
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2068::DEBUG::2014-04-10 17:20:26,296::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2068::DEBUG::2014-04-10 17:20:26,297::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2068::DEBUG::2014-04-10 17:20:26,297::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2068::DEBUG::2014-04-10 17:20:26,297::task::974::TaskManager.Task::(_decref) Task=`12d18787-93ee-4f43-b3bc-34a61bac3f09`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:31,881::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:20:31,887::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:20:31,888::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:20:31,891::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:20:31,892::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:20:31,895::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:20:31,896::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:20:31,897::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:20:31,898::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:20:31,900::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:20:31,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:31,910::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:20:31,916::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:20:31,917::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-466::DEBUG::2014-04-10 17:20:31,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000221398 s, 3.0 MB/s\n'; <rc> = 0
>Thread-468::INFO::2014-04-10 17:20:31,918::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:20:31,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:31,937::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000229703 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:20:33,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:33,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000535319 s, 687 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:33,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:33,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000561446 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2080::DEBUG::2014-04-10 17:20:36,540::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-2080::DEBUG::2014-04-10 17:20:36,541::task::579::TaskManager.Task::(_updateState) Task=`465d226a-c9fd-4c0f-811e-6cb05094e5d2`::moving from state init -> state preparing
>Thread-2080::INFO::2014-04-10 17:20:36,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2080::INFO::2014-04-10 17:20:36,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2080::DEBUG::2014-04-10 17:20:36,541::task::1168::TaskManager.Task::(prepare) Task=`465d226a-c9fd-4c0f-811e-6cb05094e5d2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2080::DEBUG::2014-04-10 17:20:36,541::task::579::TaskManager.Task::(_updateState) Task=`465d226a-c9fd-4c0f-811e-6cb05094e5d2`::moving from state preparing -> state finished
>Thread-2080::DEBUG::2014-04-10 17:20:36,542::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2080::DEBUG::2014-04-10 17:20:36,542::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2080::DEBUG::2014-04-10 17:20:36,542::task::974::TaskManager.Task::(_decref) Task=`465d226a-c9fd-4c0f-811e-6cb05094e5d2`::ref 0 aborting False
>Thread-2081::DEBUG::2014-04-10 17:20:36,547::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-2081::DEBUG::2014-04-10 17:20:36,547::task::579::TaskManager.Task::(_updateState) Task=`213293c8-8d45-4214-b61f-240b00abc193`::moving from state init -> state preparing
>Thread-2081::INFO::2014-04-10 17:20:36,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2081::DEBUG::2014-04-10 17:20:36,548::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4890e5a-898f-48c3-bccc-16254524dd7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2081::DEBUG::2014-04-10 17:20:36,548::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2081::DEBUG::2014-04-10 17:20:36,548::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2081::DEBUG::2014-04-10 17:20:36,548::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4890e5a-898f-48c3-bccc-16254524dd7c`::Granted request
>Thread-2081::DEBUG::2014-04-10 17:20:36,549::task::811::TaskManager.Task::(resourceAcquired) Task=`213293c8-8d45-4214-b61f-240b00abc193`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2081::DEBUG::2014-04-10 17:20:36,549::task::974::TaskManager.Task::(_decref) Task=`213293c8-8d45-4214-b61f-240b00abc193`::ref 1 aborting False
>Thread-2081::INFO::2014-04-10 17:20:36,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2081::DEBUG::2014-04-10 17:20:36,551::task::1168::TaskManager.Task::(prepare) Task=`213293c8-8d45-4214-b61f-240b00abc193`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2081::DEBUG::2014-04-10 17:20:36,551::task::579::TaskManager.Task::(_updateState) Task=`213293c8-8d45-4214-b61f-240b00abc193`::moving from state preparing -> state finished
>Thread-2081::DEBUG::2014-04-10 17:20:36,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2081::DEBUG::2014-04-10 17:20:36,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2081::DEBUG::2014-04-10 17:20:36,552::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2081::DEBUG::2014-04-10 17:20:36,552::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2081::DEBUG::2014-04-10 17:20:36,552::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2081::DEBUG::2014-04-10 17:20:36,552::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2081::DEBUG::2014-04-10 17:20:36,552::task::974::TaskManager.Task::(_decref) Task=`213293c8-8d45-4214-b61f-240b00abc193`::ref 0 aborting False
>Thread-2082::DEBUG::2014-04-10 17:20:37,890::task::579::TaskManager.Task::(_updateState) Task=`66da4d5c-f442-43c7-9a59-ff757df30b1a`::moving from state init -> state preparing
>Thread-2082::INFO::2014-04-10 17:20:37,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2082::INFO::2014-04-10 17:20:37,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561446', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221398', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229703', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535319', 'lastCheck': '4.4', 'valid': True}}
>Thread-2082::DEBUG::2014-04-10 17:20:37,891::task::1168::TaskManager.Task::(prepare) Task=`66da4d5c-f442-43c7-9a59-ff757df30b1a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561446', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221398', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000229703', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535319', 'lastCheck': '4.4', 'valid': True}}
>Thread-2082::DEBUG::2014-04-10 17:20:37,891::task::579::TaskManager.Task::(_updateState) Task=`66da4d5c-f442-43c7-9a59-ff757df30b1a`::moving from state preparing -> state finished
>Thread-2082::DEBUG::2014-04-10 17:20:37,891::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2082::DEBUG::2014-04-10 17:20:37,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2082::DEBUG::2014-04-10 17:20:37,891::task::974::TaskManager.Task::(_decref) Task=`66da4d5c-f442-43c7-9a59-ff757df30b1a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:41,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:20:41,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393301 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:20:41,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:41,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324423 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:20:43,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:43,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000472683 s, 779 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:43,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:43,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470541 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2086::DEBUG::2014-04-10 17:20:46,629::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-2086::DEBUG::2014-04-10 17:20:46,630::task::579::TaskManager.Task::(_updateState) Task=`0eefee17-afb4-4463-8454-7cbc51bc084e`::moving from state init -> state preparing
>Thread-2086::INFO::2014-04-10 17:20:46,630::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2086::INFO::2014-04-10 17:20:46,630::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2086::DEBUG::2014-04-10 17:20:46,631::task::1168::TaskManager.Task::(prepare) Task=`0eefee17-afb4-4463-8454-7cbc51bc084e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2086::DEBUG::2014-04-10 17:20:46,631::task::579::TaskManager.Task::(_updateState) Task=`0eefee17-afb4-4463-8454-7cbc51bc084e`::moving from state preparing -> state finished
>Thread-2086::DEBUG::2014-04-10 17:20:46,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2086::DEBUG::2014-04-10 17:20:46,631::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2086::DEBUG::2014-04-10 17:20:46,631::task::974::TaskManager.Task::(_decref) Task=`0eefee17-afb4-4463-8454-7cbc51bc084e`::ref 0 aborting False
>Thread-2087::DEBUG::2014-04-10 17:20:46,638::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-2087::DEBUG::2014-04-10 17:20:46,638::task::579::TaskManager.Task::(_updateState) Task=`b39db940-05df-4284-8854-42249eca4d30`::moving from state init -> state preparing
>Thread-2087::INFO::2014-04-10 17:20:46,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2087::DEBUG::2014-04-10 17:20:46,639::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`30689fd8-19bd-4a7d-b0e0-ebcc008a1304`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2087::DEBUG::2014-04-10 17:20:46,639::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2087::DEBUG::2014-04-10 17:20:46,639::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2087::DEBUG::2014-04-10 17:20:46,640::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`30689fd8-19bd-4a7d-b0e0-ebcc008a1304`::Granted request
>Thread-2087::DEBUG::2014-04-10 17:20:46,640::task::811::TaskManager.Task::(resourceAcquired) Task=`b39db940-05df-4284-8854-42249eca4d30`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2087::DEBUG::2014-04-10 17:20:46,640::task::974::TaskManager.Task::(_decref) Task=`b39db940-05df-4284-8854-42249eca4d30`::ref 1 aborting False
>Thread-2087::INFO::2014-04-10 17:20:46,642::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2087::DEBUG::2014-04-10 17:20:46,642::task::1168::TaskManager.Task::(prepare) Task=`b39db940-05df-4284-8854-42249eca4d30`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2087::DEBUG::2014-04-10 17:20:46,642::task::579::TaskManager.Task::(_updateState) Task=`b39db940-05df-4284-8854-42249eca4d30`::moving from state preparing -> state finished
>Thread-2087::DEBUG::2014-04-10 17:20:46,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2087::DEBUG::2014-04-10 17:20:46,643::task::974::TaskManager.Task::(_decref) Task=`b39db940-05df-4284-8854-42249eca4d30`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:20:51,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:20:51,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370866 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:20:51,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:20:51,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342517 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2090::DEBUG::2014-04-10 17:20:53,061::task::579::TaskManager.Task::(_updateState) Task=`75013988-da8d-4ce0-a850-6bcb9eee211b`::moving from state init -> state preparing
>Thread-2090::INFO::2014-04-10 17:20:53,062::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2090::INFO::2014-04-10 17:20:53,062::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470541', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370866', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342517', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472683', 'lastCheck': '9.6', 'valid': True}}
>Thread-2090::DEBUG::2014-04-10 17:20:53,062::task::1168::TaskManager.Task::(prepare) Task=`75013988-da8d-4ce0-a850-6bcb9eee211b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470541', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370866', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342517', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472683', 'lastCheck': '9.6', 'valid': True}}
>Thread-2090::DEBUG::2014-04-10 17:20:53,062::task::579::TaskManager.Task::(_updateState) Task=`75013988-da8d-4ce0-a850-6bcb9eee211b`::moving from state preparing -> state finished
>Thread-2090::DEBUG::2014-04-10 17:20:53,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2090::DEBUG::2014-04-10 17:20:53,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2090::DEBUG::2014-04-10 17:20:53,063::task::974::TaskManager.Task::(_decref) Task=`75013988-da8d-4ce0-a850-6bcb9eee211b`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:20:53,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:20:53,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431941 s, 852 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:20:53,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:20:53,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468457 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2093::DEBUG::2014-04-10 17:20:56,729::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2093::DEBUG::2014-04-10 17:20:56,729::task::579::TaskManager.Task::(_updateState) Task=`3dc81a41-98c9-4037-b804-ef6cc1e954cd`::moving from state init -> state preparing
>Thread-2093::INFO::2014-04-10 17:20:56,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2093::INFO::2014-04-10 17:20:56,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2093::DEBUG::2014-04-10 17:20:56,730::task::1168::TaskManager.Task::(prepare) Task=`3dc81a41-98c9-4037-b804-ef6cc1e954cd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2093::DEBUG::2014-04-10 17:20:56,730::task::579::TaskManager.Task::(_updateState) Task=`3dc81a41-98c9-4037-b804-ef6cc1e954cd`::moving from state preparing -> state finished
>Thread-2093::DEBUG::2014-04-10 17:20:56,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2093::DEBUG::2014-04-10 17:20:56,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2093::DEBUG::2014-04-10 17:20:56,731::task::974::TaskManager.Task::(_decref) Task=`3dc81a41-98c9-4037-b804-ef6cc1e954cd`::ref 0 aborting False
>Thread-2094::DEBUG::2014-04-10 17:20:56,737::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2094::DEBUG::2014-04-10 17:20:56,737::task::579::TaskManager.Task::(_updateState) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::moving from state init -> state preparing
>Thread-2094::INFO::2014-04-10 17:20:56,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2094::DEBUG::2014-04-10 17:20:56,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`592aecda-940a-40e0-9f97-a7c99c23f947`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2094::DEBUG::2014-04-10 17:20:56,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2094::DEBUG::2014-04-10 17:20:56,738::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2094::DEBUG::2014-04-10 17:20:56,738::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`592aecda-940a-40e0-9f97-a7c99c23f947`::Granted request
>Thread-2094::DEBUG::2014-04-10 17:20:56,739::task::811::TaskManager.Task::(resourceAcquired) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2094::DEBUG::2014-04-10 17:20:56,739::task::974::TaskManager.Task::(_decref) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::ref 1 aborting False
>Thread-2094::INFO::2014-04-10 17:20:56,741::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2094::DEBUG::2014-04-10 17:20:56,741::task::1168::TaskManager.Task::(prepare) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2094::DEBUG::2014-04-10 17:20:56,741::task::579::TaskManager.Task::(_updateState) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::moving from state preparing -> state finished
>Thread-2094::DEBUG::2014-04-10 17:20:56,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2094::DEBUG::2014-04-10 17:20:56,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2094::DEBUG::2014-04-10 17:20:56,742::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2094::DEBUG::2014-04-10 17:20:56,742::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2094::DEBUG::2014-04-10 17:20:56,742::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2094::DEBUG::2014-04-10 17:20:56,742::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2094::DEBUG::2014-04-10 17:20:56,742::task::974::TaskManager.Task::(_decref) Task=`a16c22db-9277-410a-a3f5-0f8f5175fe2a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:01,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:02,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338392 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:02,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:02,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000251457 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:03,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:03,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000516094 s, 713 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:21:03,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:03,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000454616 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2098::DEBUG::2014-04-10 17:21:06,977::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2098::DEBUG::2014-04-10 17:21:06,977::task::579::TaskManager.Task::(_updateState) Task=`9706caed-4a71-4edb-b74f-2240e42fc22c`::moving from state init -> state preparing
>Thread-2098::INFO::2014-04-10 17:21:06,977::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2098::INFO::2014-04-10 17:21:06,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2098::DEBUG::2014-04-10 17:21:06,978::task::1168::TaskManager.Task::(prepare) Task=`9706caed-4a71-4edb-b74f-2240e42fc22c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2098::DEBUG::2014-04-10 17:21:06,978::task::579::TaskManager.Task::(_updateState) Task=`9706caed-4a71-4edb-b74f-2240e42fc22c`::moving from state preparing -> state finished
>Thread-2098::DEBUG::2014-04-10 17:21:06,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2098::DEBUG::2014-04-10 17:21:06,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2098::DEBUG::2014-04-10 17:21:06,979::task::974::TaskManager.Task::(_decref) Task=`9706caed-4a71-4edb-b74f-2240e42fc22c`::ref 0 aborting False
>Thread-2099::DEBUG::2014-04-10 17:21:06,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2099::DEBUG::2014-04-10 17:21:06,985::task::579::TaskManager.Task::(_updateState) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::moving from state init -> state preparing
>Thread-2099::INFO::2014-04-10 17:21:06,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2099::DEBUG::2014-04-10 17:21:06,986::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a81c643d-f2aa-452f-b7cc-b737738cd36c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2099::DEBUG::2014-04-10 17:21:06,986::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2099::DEBUG::2014-04-10 17:21:06,986::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2099::DEBUG::2014-04-10 17:21:06,986::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a81c643d-f2aa-452f-b7cc-b737738cd36c`::Granted request
>Thread-2099::DEBUG::2014-04-10 17:21:06,987::task::811::TaskManager.Task::(resourceAcquired) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2099::DEBUG::2014-04-10 17:21:06,987::task::974::TaskManager.Task::(_decref) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::ref 1 aborting False
>Thread-2099::INFO::2014-04-10 17:21:06,989::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2099::DEBUG::2014-04-10 17:21:06,989::task::1168::TaskManager.Task::(prepare) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2099::DEBUG::2014-04-10 17:21:06,989::task::579::TaskManager.Task::(_updateState) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::moving from state preparing -> state finished
>Thread-2099::DEBUG::2014-04-10 17:21:06,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2099::DEBUG::2014-04-10 17:21:06,990::task::974::TaskManager.Task::(_decref) Task=`f853a775-6c27-4514-bfca-e98cb5243082`::ref 0 aborting False
>Thread-2100::DEBUG::2014-04-10 17:21:08,232::task::579::TaskManager.Task::(_updateState) Task=`8b1202fb-aa43-4b94-a377-1d62520e9dd9`::moving from state init -> state preparing
>Thread-2100::INFO::2014-04-10 17:21:08,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2100::INFO::2014-04-10 17:21:08,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454616', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338392', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251457', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516094', 'lastCheck': '4.7', 'valid': True}}
>Thread-2100::DEBUG::2014-04-10 17:21:08,233::task::1168::TaskManager.Task::(prepare) Task=`8b1202fb-aa43-4b94-a377-1d62520e9dd9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454616', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338392', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251457', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516094', 'lastCheck': '4.7', 'valid': True}}
>Thread-2100::DEBUG::2014-04-10 17:21:08,233::task::579::TaskManager.Task::(_updateState) Task=`8b1202fb-aa43-4b94-a377-1d62520e9dd9`::moving from state preparing -> state finished
>Thread-2100::DEBUG::2014-04-10 17:21:08,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2100::DEBUG::2014-04-10 17:21:08,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2100::DEBUG::2014-04-10 17:21:08,233::task::974::TaskManager.Task::(_decref) Task=`8b1202fb-aa43-4b94-a377-1d62520e9dd9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:12,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:12,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335222 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:12,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:12,074::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362982 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:13,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:13,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485338 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:21:13,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:13,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00047578 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2104::DEBUG::2014-04-10 17:21:17,067::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2104::DEBUG::2014-04-10 17:21:17,068::task::579::TaskManager.Task::(_updateState) Task=`a92df3d7-c570-479d-ab3f-68a79bf21f57`::moving from state init -> state preparing
>Thread-2104::INFO::2014-04-10 17:21:17,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2104::INFO::2014-04-10 17:21:17,069::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2104::DEBUG::2014-04-10 17:21:17,069::task::1168::TaskManager.Task::(prepare) Task=`a92df3d7-c570-479d-ab3f-68a79bf21f57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2104::DEBUG::2014-04-10 17:21:17,069::task::579::TaskManager.Task::(_updateState) Task=`a92df3d7-c570-479d-ab3f-68a79bf21f57`::moving from state preparing -> state finished
>Thread-2104::DEBUG::2014-04-10 17:21:17,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2104::DEBUG::2014-04-10 17:21:17,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2104::DEBUG::2014-04-10 17:21:17,069::task::974::TaskManager.Task::(_decref) Task=`a92df3d7-c570-479d-ab3f-68a79bf21f57`::ref 0 aborting False
>Thread-2105::DEBUG::2014-04-10 17:21:17,076::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2105::DEBUG::2014-04-10 17:21:17,076::task::579::TaskManager.Task::(_updateState) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::moving from state init -> state preparing
>Thread-2105::INFO::2014-04-10 17:21:17,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2105::DEBUG::2014-04-10 17:21:17,077::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`910b7ad3-f074-457e-8485-0764bda1d921`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2105::DEBUG::2014-04-10 17:21:17,077::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2105::DEBUG::2014-04-10 17:21:17,077::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2105::DEBUG::2014-04-10 17:21:17,078::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`910b7ad3-f074-457e-8485-0764bda1d921`::Granted request
>Thread-2105::DEBUG::2014-04-10 17:21:17,078::task::811::TaskManager.Task::(resourceAcquired) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2105::DEBUG::2014-04-10 17:21:17,078::task::974::TaskManager.Task::(_decref) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::ref 1 aborting False
>Thread-2105::INFO::2014-04-10 17:21:17,080::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2105::DEBUG::2014-04-10 17:21:17,080::task::1168::TaskManager.Task::(prepare) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2105::DEBUG::2014-04-10 17:21:17,080::task::579::TaskManager.Task::(_updateState) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::moving from state preparing -> state finished
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2105::DEBUG::2014-04-10 17:21:17,081::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2105::DEBUG::2014-04-10 17:21:17,082::task::974::TaskManager.Task::(_decref) Task=`96c02e3a-f75f-4b13-8a6c-945e1974a29c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:22,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:22,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306147 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:22,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:22,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391876 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:23,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:23,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000559189 s, 658 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:21:23,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:23,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477103 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2108::DEBUG::2014-04-10 17:21:23,571::task::579::TaskManager.Task::(_updateState) Task=`8bf6d82b-ee89-483e-be32-eb6ed5503c2d`::moving from state init -> state preparing
>Thread-2108::INFO::2014-04-10 17:21:23,572::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2108::INFO::2014-04-10 17:21:23,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477103', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306147', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391876', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559189', 'lastCheck': '0.0', 'valid': True}}
>Thread-2108::DEBUG::2014-04-10 17:21:23,572::task::1168::TaskManager.Task::(prepare) Task=`8bf6d82b-ee89-483e-be32-eb6ed5503c2d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477103', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306147', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391876', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559189', 'lastCheck': '0.0', 'valid': True}}
>Thread-2108::DEBUG::2014-04-10 17:21:23,572::task::579::TaskManager.Task::(_updateState) Task=`8bf6d82b-ee89-483e-be32-eb6ed5503c2d`::moving from state preparing -> state finished
>Thread-2108::DEBUG::2014-04-10 17:21:23,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2108::DEBUG::2014-04-10 17:21:23,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2108::DEBUG::2014-04-10 17:21:23,573::task::974::TaskManager.Task::(_decref) Task=`8bf6d82b-ee89-483e-be32-eb6ed5503c2d`::ref 0 aborting False
>Thread-2111::DEBUG::2014-04-10 17:21:27,641::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2111::DEBUG::2014-04-10 17:21:27,641::task::579::TaskManager.Task::(_updateState) Task=`8d06959c-0583-4075-b1fe-e117fb9e4e6a`::moving from state init -> state preparing
>Thread-2111::INFO::2014-04-10 17:21:27,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2111::INFO::2014-04-10 17:21:27,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2111::DEBUG::2014-04-10 17:21:27,642::task::1168::TaskManager.Task::(prepare) Task=`8d06959c-0583-4075-b1fe-e117fb9e4e6a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2111::DEBUG::2014-04-10 17:21:27,642::task::579::TaskManager.Task::(_updateState) Task=`8d06959c-0583-4075-b1fe-e117fb9e4e6a`::moving from state preparing -> state finished
>Thread-2111::DEBUG::2014-04-10 17:21:27,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2111::DEBUG::2014-04-10 17:21:27,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2111::DEBUG::2014-04-10 17:21:27,643::task::974::TaskManager.Task::(_decref) Task=`8d06959c-0583-4075-b1fe-e117fb9e4e6a`::ref 0 aborting False
>Thread-2112::DEBUG::2014-04-10 17:21:27,649::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2112::DEBUG::2014-04-10 17:21:27,650::task::579::TaskManager.Task::(_updateState) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::moving from state init -> state preparing
>Thread-2112::INFO::2014-04-10 17:21:27,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2112::DEBUG::2014-04-10 17:21:27,650::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3fb226f-77dc-44e1-9b38-94e96a837b7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2112::DEBUG::2014-04-10 17:21:27,650::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2112::DEBUG::2014-04-10 17:21:27,651::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2112::DEBUG::2014-04-10 17:21:27,651::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3fb226f-77dc-44e1-9b38-94e96a837b7a`::Granted request
>Thread-2112::DEBUG::2014-04-10 17:21:27,651::task::811::TaskManager.Task::(resourceAcquired) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2112::DEBUG::2014-04-10 17:21:27,651::task::974::TaskManager.Task::(_decref) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::ref 1 aborting False
>Thread-2112::INFO::2014-04-10 17:21:27,653::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2112::DEBUG::2014-04-10 17:21:27,653::task::1168::TaskManager.Task::(prepare) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::task::579::TaskManager.Task::(_updateState) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::moving from state preparing -> state finished
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2112::DEBUG::2014-04-10 17:21:27,654::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2112::DEBUG::2014-04-10 17:21:27,655::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2112::DEBUG::2014-04-10 17:21:27,655::task::974::TaskManager.Task::(_decref) Task=`afa9b9b4-6de0-45fa-b5ba-682f645e6058`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:32,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:32,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000378555 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:32,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:32,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314668 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:33,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:33,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442107 s, 832 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:21:33,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:33,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000525865 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2116::DEBUG::2014-04-10 17:21:37,739::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2116::DEBUG::2014-04-10 17:21:37,739::task::579::TaskManager.Task::(_updateState) Task=`43010020-4ffe-4255-a327-2ea72b5e959b`::moving from state init -> state preparing
>Thread-2116::INFO::2014-04-10 17:21:37,740::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2116::INFO::2014-04-10 17:21:37,740::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2116::DEBUG::2014-04-10 17:21:37,740::task::1168::TaskManager.Task::(prepare) Task=`43010020-4ffe-4255-a327-2ea72b5e959b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2116::DEBUG::2014-04-10 17:21:37,740::task::579::TaskManager.Task::(_updateState) Task=`43010020-4ffe-4255-a327-2ea72b5e959b`::moving from state preparing -> state finished
>Thread-2116::DEBUG::2014-04-10 17:21:37,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2116::DEBUG::2014-04-10 17:21:37,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2116::DEBUG::2014-04-10 17:21:37,741::task::974::TaskManager.Task::(_decref) Task=`43010020-4ffe-4255-a327-2ea72b5e959b`::ref 0 aborting False
>Thread-2117::DEBUG::2014-04-10 17:21:37,747::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2117::DEBUG::2014-04-10 17:21:37,748::task::579::TaskManager.Task::(_updateState) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::moving from state init -> state preparing
>Thread-2117::INFO::2014-04-10 17:21:37,748::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2117::DEBUG::2014-04-10 17:21:37,749::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5bea1e0d-47ef-43a9-8a56-8c22109151aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2117::DEBUG::2014-04-10 17:21:37,749::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2117::DEBUG::2014-04-10 17:21:37,749::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2117::DEBUG::2014-04-10 17:21:37,749::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5bea1e0d-47ef-43a9-8a56-8c22109151aa`::Granted request
>Thread-2117::DEBUG::2014-04-10 17:21:37,749::task::811::TaskManager.Task::(resourceAcquired) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2117::DEBUG::2014-04-10 17:21:37,750::task::974::TaskManager.Task::(_decref) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::ref 1 aborting False
>Thread-2117::INFO::2014-04-10 17:21:37,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2117::DEBUG::2014-04-10 17:21:37,752::task::1168::TaskManager.Task::(prepare) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2117::DEBUG::2014-04-10 17:21:37,752::task::579::TaskManager.Task::(_updateState) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::moving from state preparing -> state finished
>Thread-2117::DEBUG::2014-04-10 17:21:37,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2117::DEBUG::2014-04-10 17:21:37,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2117::DEBUG::2014-04-10 17:21:37,752::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2117::DEBUG::2014-04-10 17:21:37,753::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2117::DEBUG::2014-04-10 17:21:37,753::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2117::DEBUG::2014-04-10 17:21:37,753::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2117::DEBUG::2014-04-10 17:21:37,753::task::974::TaskManager.Task::(_decref) Task=`7673c157-8ff4-45c6-996b-529dc5a61990`::ref 0 aborting False
>Thread-2118::DEBUG::2014-04-10 17:21:38,731::task::579::TaskManager.Task::(_updateState) Task=`870df039-5d46-4a26-9e8d-d3367ac9b83f`::moving from state init -> state preparing
>Thread-2118::INFO::2014-04-10 17:21:38,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2118::INFO::2014-04-10 17:21:38,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525865', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378555', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314668', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442107', 'lastCheck': '5.2', 'valid': True}}
>Thread-2118::DEBUG::2014-04-10 17:21:38,731::task::1168::TaskManager.Task::(prepare) Task=`870df039-5d46-4a26-9e8d-d3367ac9b83f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525865', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378555', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314668', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442107', 'lastCheck': '5.2', 'valid': True}}
>Thread-2118::DEBUG::2014-04-10 17:21:38,731::task::579::TaskManager.Task::(_updateState) Task=`870df039-5d46-4a26-9e8d-d3367ac9b83f`::moving from state preparing -> state finished
>Thread-2118::DEBUG::2014-04-10 17:21:38,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2118::DEBUG::2014-04-10 17:21:38,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2118::DEBUG::2014-04-10 17:21:38,732::task::974::TaskManager.Task::(_decref) Task=`870df039-5d46-4a26-9e8d-d3367ac9b83f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:42,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:42,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000419313 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:42,177::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:42,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350528 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:43,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:43,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000557741 s, 660 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:21:43,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:43,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000483198 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2123::DEBUG::2014-04-10 17:21:47,857::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2123::DEBUG::2014-04-10 17:21:47,857::task::579::TaskManager.Task::(_updateState) Task=`8b2e36e0-dbd4-439b-aefd-35f02fd65eec`::moving from state init -> state preparing
>Thread-2123::INFO::2014-04-10 17:21:47,857::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2123::INFO::2014-04-10 17:21:47,858::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2123::DEBUG::2014-04-10 17:21:47,858::task::1168::TaskManager.Task::(prepare) Task=`8b2e36e0-dbd4-439b-aefd-35f02fd65eec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2123::DEBUG::2014-04-10 17:21:47,858::task::579::TaskManager.Task::(_updateState) Task=`8b2e36e0-dbd4-439b-aefd-35f02fd65eec`::moving from state preparing -> state finished
>Thread-2123::DEBUG::2014-04-10 17:21:47,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2123::DEBUG::2014-04-10 17:21:47,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2123::DEBUG::2014-04-10 17:21:47,859::task::974::TaskManager.Task::(_decref) Task=`8b2e36e0-dbd4-439b-aefd-35f02fd65eec`::ref 0 aborting False
>Thread-2124::DEBUG::2014-04-10 17:21:47,865::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2124::DEBUG::2014-04-10 17:21:47,865::task::579::TaskManager.Task::(_updateState) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::moving from state init -> state preparing
>Thread-2124::INFO::2014-04-10 17:21:47,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2124::DEBUG::2014-04-10 17:21:47,866::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c3966ec-3ac1-41f1-964a-27b3a1c01a15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2124::DEBUG::2014-04-10 17:21:47,866::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2124::DEBUG::2014-04-10 17:21:47,866::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2124::DEBUG::2014-04-10 17:21:47,867::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c3966ec-3ac1-41f1-964a-27b3a1c01a15`::Granted request
>Thread-2124::DEBUG::2014-04-10 17:21:47,867::task::811::TaskManager.Task::(resourceAcquired) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2124::DEBUG::2014-04-10 17:21:47,867::task::974::TaskManager.Task::(_decref) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::ref 1 aborting False
>Thread-2124::INFO::2014-04-10 17:21:47,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2124::DEBUG::2014-04-10 17:21:47,869::task::1168::TaskManager.Task::(prepare) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2124::DEBUG::2014-04-10 17:21:47,869::task::579::TaskManager.Task::(_updateState) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::moving from state preparing -> state finished
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2124::DEBUG::2014-04-10 17:21:47,870::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2124::DEBUG::2014-04-10 17:21:47,871::task::974::TaskManager.Task::(_decref) Task=`35f19afb-aab0-4042-be37-5330c85d0b6b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:21:52,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:21:52,195::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379018 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:21:52,211::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:21:52,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371926 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:53,562::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:21:53,577::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:21:53,578::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:21:53,584::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:21:53,592::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:21:53,594::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:21:53,595::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:21:53,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:21:53,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:21:53,641::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000491786 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:21:53,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000385696 s, 954 kB/s\n'; <rc> = 0
>Thread-2130::DEBUG::2014-04-10 17:21:53,895::task::579::TaskManager.Task::(_updateState) Task=`81cd3133-9e04-4e87-b4f2-ad998baaa559`::moving from state init -> state preparing
>Thread-2130::INFO::2014-04-10 17:21:53,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2130::INFO::2014-04-10 17:21:53,895::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491786', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379018', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371926', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385696', 'lastCheck': '0.2', 'valid': True}}
>Thread-2130::DEBUG::2014-04-10 17:21:53,895::task::1168::TaskManager.Task::(prepare) Task=`81cd3133-9e04-4e87-b4f2-ad998baaa559`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491786', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379018', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371926', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385696', 'lastCheck': '0.2', 'valid': True}}
>Thread-2130::DEBUG::2014-04-10 17:21:53,896::task::579::TaskManager.Task::(_updateState) Task=`81cd3133-9e04-4e87-b4f2-ad998baaa559`::moving from state preparing -> state finished
>Thread-2130::DEBUG::2014-04-10 17:21:53,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2130::DEBUG::2014-04-10 17:21:53,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2130::DEBUG::2014-04-10 17:21:53,896::task::974::TaskManager.Task::(_decref) Task=`81cd3133-9e04-4e87-b4f2-ad998baaa559`::ref 0 aborting False
>Thread-2133::DEBUG::2014-04-10 17:21:57,987::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2133::DEBUG::2014-04-10 17:21:57,988::task::579::TaskManager.Task::(_updateState) Task=`5f3293b9-2df8-4d50-a97a-c5ecee8041aa`::moving from state init -> state preparing
>Thread-2133::INFO::2014-04-10 17:21:57,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2133::INFO::2014-04-10 17:21:57,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2133::DEBUG::2014-04-10 17:21:57,988::task::1168::TaskManager.Task::(prepare) Task=`5f3293b9-2df8-4d50-a97a-c5ecee8041aa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2133::DEBUG::2014-04-10 17:21:57,988::task::579::TaskManager.Task::(_updateState) Task=`5f3293b9-2df8-4d50-a97a-c5ecee8041aa`::moving from state preparing -> state finished
>Thread-2133::DEBUG::2014-04-10 17:21:57,989::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2133::DEBUG::2014-04-10 17:21:57,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2133::DEBUG::2014-04-10 17:21:57,989::task::974::TaskManager.Task::(_decref) Task=`5f3293b9-2df8-4d50-a97a-c5ecee8041aa`::ref 0 aborting False
>Thread-2134::DEBUG::2014-04-10 17:21:57,995::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2134::DEBUG::2014-04-10 17:21:57,996::task::579::TaskManager.Task::(_updateState) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::moving from state init -> state preparing
>Thread-2134::INFO::2014-04-10 17:21:57,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2134::DEBUG::2014-04-10 17:21:57,996::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`df2f565f-f0bb-4156-95c7-6c5a7b05f9ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2134::DEBUG::2014-04-10 17:21:57,996::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2134::DEBUG::2014-04-10 17:21:57,997::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2134::DEBUG::2014-04-10 17:21:57,997::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`df2f565f-f0bb-4156-95c7-6c5a7b05f9ec`::Granted request
>Thread-2134::DEBUG::2014-04-10 17:21:57,997::task::811::TaskManager.Task::(resourceAcquired) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2134::DEBUG::2014-04-10 17:21:57,997::task::974::TaskManager.Task::(_decref) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::ref 1 aborting False
>Thread-2134::INFO::2014-04-10 17:21:57,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2134::DEBUG::2014-04-10 17:21:57,999::task::1168::TaskManager.Task::(prepare) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::task::579::TaskManager.Task::(_updateState) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::moving from state preparing -> state finished
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2134::DEBUG::2014-04-10 17:21:58,000::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2134::DEBUG::2014-04-10 17:21:58,001::task::974::TaskManager.Task::(_decref) Task=`0c612229-9915-4778-86ec-15346f52b0eb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:02,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:02,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348293 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:02,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:02,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398395 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:03,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:03,671::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:03,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000407426 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:03,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000436105 s, 844 kB/s\n'; <rc> = 0
>Thread-2138::DEBUG::2014-04-10 17:22:08,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2138::DEBUG::2014-04-10 17:22:08,235::task::579::TaskManager.Task::(_updateState) Task=`1b33872f-e4a1-42b0-b869-afa5115dfc1b`::moving from state init -> state preparing
>Thread-2138::INFO::2014-04-10 17:22:08,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2138::INFO::2014-04-10 17:22:08,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2138::DEBUG::2014-04-10 17:22:08,236::task::1168::TaskManager.Task::(prepare) Task=`1b33872f-e4a1-42b0-b869-afa5115dfc1b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2138::DEBUG::2014-04-10 17:22:08,236::task::579::TaskManager.Task::(_updateState) Task=`1b33872f-e4a1-42b0-b869-afa5115dfc1b`::moving from state preparing -> state finished
>Thread-2138::DEBUG::2014-04-10 17:22:08,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2138::DEBUG::2014-04-10 17:22:08,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2138::DEBUG::2014-04-10 17:22:08,236::task::974::TaskManager.Task::(_decref) Task=`1b33872f-e4a1-42b0-b869-afa5115dfc1b`::ref 0 aborting False
>Thread-2139::DEBUG::2014-04-10 17:22:08,243::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2139::DEBUG::2014-04-10 17:22:08,243::task::579::TaskManager.Task::(_updateState) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::moving from state init -> state preparing
>Thread-2139::INFO::2014-04-10 17:22:08,243::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2139::DEBUG::2014-04-10 17:22:08,243::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c8ba9a9-de25-468d-8abf-4f69b42e6e81`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2139::DEBUG::2014-04-10 17:22:08,244::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2139::DEBUG::2014-04-10 17:22:08,244::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2139::DEBUG::2014-04-10 17:22:08,244::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c8ba9a9-de25-468d-8abf-4f69b42e6e81`::Granted request
>Thread-2139::DEBUG::2014-04-10 17:22:08,244::task::811::TaskManager.Task::(resourceAcquired) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2139::DEBUG::2014-04-10 17:22:08,245::task::974::TaskManager.Task::(_decref) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::ref 1 aborting False
>Thread-2139::INFO::2014-04-10 17:22:08,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::task::1168::TaskManager.Task::(prepare) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::task::579::TaskManager.Task::(_updateState) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::moving from state preparing -> state finished
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2139::DEBUG::2014-04-10 17:22:08,247::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2139::DEBUG::2014-04-10 17:22:08,248::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2139::DEBUG::2014-04-10 17:22:08,248::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2139::DEBUG::2014-04-10 17:22:08,248::task::974::TaskManager.Task::(_decref) Task=`eef25a96-f626-408b-8e76-72064ecd3c53`::ref 0 aborting False
>Thread-2140::DEBUG::2014-04-10 17:22:09,050::task::579::TaskManager.Task::(_updateState) Task=`274b4fa4-f778-4d26-bdb3-93f1ed7becbc`::moving from state init -> state preparing
>Thread-2140::INFO::2014-04-10 17:22:09,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2140::INFO::2014-04-10 17:22:09,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407426', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348293', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398395', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436105', 'lastCheck': '5.4', 'valid': True}}
>Thread-2140::DEBUG::2014-04-10 17:22:09,050::task::1168::TaskManager.Task::(prepare) Task=`274b4fa4-f778-4d26-bdb3-93f1ed7becbc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407426', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348293', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398395', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436105', 'lastCheck': '5.4', 'valid': True}}
>Thread-2140::DEBUG::2014-04-10 17:22:09,050::task::579::TaskManager.Task::(_updateState) Task=`274b4fa4-f778-4d26-bdb3-93f1ed7becbc`::moving from state preparing -> state finished
>Thread-2140::DEBUG::2014-04-10 17:22:09,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2140::DEBUG::2014-04-10 17:22:09,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2140::DEBUG::2014-04-10 17:22:09,051::task::974::TaskManager.Task::(_decref) Task=`274b4fa4-f778-4d26-bdb3-93f1ed7becbc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:12,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:12,273::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277963 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:12,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:12,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345926 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:13,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:13,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:13,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000370641 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:13,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000426525 s, 863 kB/s\n'; <rc> = 0
>Thread-2145::DEBUG::2014-04-10 17:22:18,350::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2145::DEBUG::2014-04-10 17:22:18,350::task::579::TaskManager.Task::(_updateState) Task=`4f87d83b-d74e-4c82-b3a8-5bcda6095e7e`::moving from state init -> state preparing
>Thread-2145::INFO::2014-04-10 17:22:18,351::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2145::INFO::2014-04-10 17:22:18,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2145::DEBUG::2014-04-10 17:22:18,351::task::1168::TaskManager.Task::(prepare) Task=`4f87d83b-d74e-4c82-b3a8-5bcda6095e7e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2145::DEBUG::2014-04-10 17:22:18,351::task::579::TaskManager.Task::(_updateState) Task=`4f87d83b-d74e-4c82-b3a8-5bcda6095e7e`::moving from state preparing -> state finished
>Thread-2145::DEBUG::2014-04-10 17:22:18,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2145::DEBUG::2014-04-10 17:22:18,352::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2145::DEBUG::2014-04-10 17:22:18,352::task::974::TaskManager.Task::(_decref) Task=`4f87d83b-d74e-4c82-b3a8-5bcda6095e7e`::ref 0 aborting False
>Thread-2146::DEBUG::2014-04-10 17:22:18,358::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2146::DEBUG::2014-04-10 17:22:18,358::task::579::TaskManager.Task::(_updateState) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::moving from state init -> state preparing
>Thread-2146::INFO::2014-04-10 17:22:18,358::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2146::DEBUG::2014-04-10 17:22:18,359::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`43a7ccf5-96d8-47b0-92f0-afca641244e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2146::DEBUG::2014-04-10 17:22:18,359::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2146::DEBUG::2014-04-10 17:22:18,359::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2146::DEBUG::2014-04-10 17:22:18,359::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`43a7ccf5-96d8-47b0-92f0-afca641244e8`::Granted request
>Thread-2146::DEBUG::2014-04-10 17:22:18,360::task::811::TaskManager.Task::(resourceAcquired) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2146::DEBUG::2014-04-10 17:22:18,360::task::974::TaskManager.Task::(_decref) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::ref 1 aborting False
>Thread-2146::INFO::2014-04-10 17:22:18,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2146::DEBUG::2014-04-10 17:22:18,362::task::1168::TaskManager.Task::(prepare) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2146::DEBUG::2014-04-10 17:22:18,362::task::579::TaskManager.Task::(_updateState) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::moving from state preparing -> state finished
>Thread-2146::DEBUG::2014-04-10 17:22:18,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2146::DEBUG::2014-04-10 17:22:18,363::task::974::TaskManager.Task::(_decref) Task=`c41fa514-aa59-4602-b79d-6659a29822f3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:22,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:22,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282897 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:22,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:22,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381313 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:23,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:23,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:23,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043139 s, 853 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:23,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000418693 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2148::DEBUG::2014-04-10 17:22:24,245::task::579::TaskManager.Task::(_updateState) Task=`f5b85ecc-25eb-43a7-83a7-1d4e0e11e124`::moving from state init -> state preparing
>Thread-2148::INFO::2014-04-10 17:22:24,245::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2148::INFO::2014-04-10 17:22:24,246::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418693', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282897', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381313', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043139', 'lastCheck': '0.5', 'valid': True}}
>Thread-2148::DEBUG::2014-04-10 17:22:24,246::task::1168::TaskManager.Task::(prepare) Task=`f5b85ecc-25eb-43a7-83a7-1d4e0e11e124`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418693', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282897', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381313', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043139', 'lastCheck': '0.5', 'valid': True}}
>Thread-2148::DEBUG::2014-04-10 17:22:24,246::task::579::TaskManager.Task::(_updateState) Task=`f5b85ecc-25eb-43a7-83a7-1d4e0e11e124`::moving from state preparing -> state finished
>Thread-2148::DEBUG::2014-04-10 17:22:24,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2148::DEBUG::2014-04-10 17:22:24,246::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2148::DEBUG::2014-04-10 17:22:24,247::task::974::TaskManager.Task::(_decref) Task=`f5b85ecc-25eb-43a7-83a7-1d4e0e11e124`::ref 0 aborting False
>Thread-2151::DEBUG::2014-04-10 17:22:28,433::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2151::DEBUG::2014-04-10 17:22:28,433::task::579::TaskManager.Task::(_updateState) Task=`b26d88fc-ba6f-447f-b8e8-8a7ba3dd6643`::moving from state init -> state preparing
>Thread-2151::INFO::2014-04-10 17:22:28,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2151::INFO::2014-04-10 17:22:28,434::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2151::DEBUG::2014-04-10 17:22:28,434::task::1168::TaskManager.Task::(prepare) Task=`b26d88fc-ba6f-447f-b8e8-8a7ba3dd6643`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2151::DEBUG::2014-04-10 17:22:28,434::task::579::TaskManager.Task::(_updateState) Task=`b26d88fc-ba6f-447f-b8e8-8a7ba3dd6643`::moving from state preparing -> state finished
>Thread-2151::DEBUG::2014-04-10 17:22:28,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2151::DEBUG::2014-04-10 17:22:28,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2151::DEBUG::2014-04-10 17:22:28,435::task::974::TaskManager.Task::(_decref) Task=`b26d88fc-ba6f-447f-b8e8-8a7ba3dd6643`::ref 0 aborting False
>Thread-2152::DEBUG::2014-04-10 17:22:28,441::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2152::DEBUG::2014-04-10 17:22:28,442::task::579::TaskManager.Task::(_updateState) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::moving from state init -> state preparing
>Thread-2152::INFO::2014-04-10 17:22:28,442::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2152::DEBUG::2014-04-10 17:22:28,442::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d7a8aed-df83-46ab-99b2-4d05380ee282`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2152::DEBUG::2014-04-10 17:22:28,443::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2152::DEBUG::2014-04-10 17:22:28,443::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2152::DEBUG::2014-04-10 17:22:28,443::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d7a8aed-df83-46ab-99b2-4d05380ee282`::Granted request
>Thread-2152::DEBUG::2014-04-10 17:22:28,443::task::811::TaskManager.Task::(resourceAcquired) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2152::DEBUG::2014-04-10 17:22:28,443::task::974::TaskManager.Task::(_decref) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::ref 1 aborting False
>Thread-2152::INFO::2014-04-10 17:22:28,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::task::1168::TaskManager.Task::(prepare) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::task::579::TaskManager.Task::(_updateState) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::moving from state preparing -> state finished
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2152::DEBUG::2014-04-10 17:22:28,446::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2152::DEBUG::2014-04-10 17:22:28,447::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2152::DEBUG::2014-04-10 17:22:28,447::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2152::DEBUG::2014-04-10 17:22:28,447::task::974::TaskManager.Task::(_decref) Task=`1d2b261b-be98-4c66-8a8b-f9164bb2b3cf`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:32,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:32,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344052 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:32,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:32,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000452924 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:33,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:33,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:33,808::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000385768 s, 954 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:33,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000378121 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2156::DEBUG::2014-04-10 17:22:38,522::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2156::DEBUG::2014-04-10 17:22:38,522::task::579::TaskManager.Task::(_updateState) Task=`55be2ebe-2096-4a45-8e3e-598b8ea33e11`::moving from state init -> state preparing
>Thread-2156::INFO::2014-04-10 17:22:38,523::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2156::INFO::2014-04-10 17:22:38,523::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2156::DEBUG::2014-04-10 17:22:38,523::task::1168::TaskManager.Task::(prepare) Task=`55be2ebe-2096-4a45-8e3e-598b8ea33e11`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2156::DEBUG::2014-04-10 17:22:38,523::task::579::TaskManager.Task::(_updateState) Task=`55be2ebe-2096-4a45-8e3e-598b8ea33e11`::moving from state preparing -> state finished
>Thread-2156::DEBUG::2014-04-10 17:22:38,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2156::DEBUG::2014-04-10 17:22:38,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2156::DEBUG::2014-04-10 17:22:38,524::task::974::TaskManager.Task::(_decref) Task=`55be2ebe-2096-4a45-8e3e-598b8ea33e11`::ref 0 aborting False
>Thread-2157::DEBUG::2014-04-10 17:22:38,530::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2157::DEBUG::2014-04-10 17:22:38,530::task::579::TaskManager.Task::(_updateState) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::moving from state init -> state preparing
>Thread-2157::INFO::2014-04-10 17:22:38,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2157::DEBUG::2014-04-10 17:22:38,531::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f394d41-5b54-4e80-8460-9ab8eddd297a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2157::DEBUG::2014-04-10 17:22:38,531::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2157::DEBUG::2014-04-10 17:22:38,531::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2157::DEBUG::2014-04-10 17:22:38,531::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f394d41-5b54-4e80-8460-9ab8eddd297a`::Granted request
>Thread-2157::DEBUG::2014-04-10 17:22:38,532::task::811::TaskManager.Task::(resourceAcquired) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2157::DEBUG::2014-04-10 17:22:38,532::task::974::TaskManager.Task::(_decref) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::ref 1 aborting False
>Thread-2157::INFO::2014-04-10 17:22:38,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2157::DEBUG::2014-04-10 17:22:38,534::task::1168::TaskManager.Task::(prepare) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2157::DEBUG::2014-04-10 17:22:38,534::task::579::TaskManager.Task::(_updateState) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::moving from state preparing -> state finished
>Thread-2157::DEBUG::2014-04-10 17:22:38,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2157::DEBUG::2014-04-10 17:22:38,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2157::DEBUG::2014-04-10 17:22:38,535::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2157::DEBUG::2014-04-10 17:22:38,535::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2157::DEBUG::2014-04-10 17:22:38,535::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2157::DEBUG::2014-04-10 17:22:38,535::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2157::DEBUG::2014-04-10 17:22:38,535::task::974::TaskManager.Task::(_decref) Task=`44ff9bc9-8cc6-499a-b922-226aae2cdbcc`::ref 0 aborting False
>Thread-2158::DEBUG::2014-04-10 17:22:39,402::task::579::TaskManager.Task::(_updateState) Task=`97c6a41f-fb34-4d13-bc21-dddfb6c466d6`::moving from state init -> state preparing
>Thread-2158::INFO::2014-04-10 17:22:39,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2158::INFO::2014-04-10 17:22:39,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378121', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344052', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452924', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385768', 'lastCheck': '5.6', 'valid': True}}
>Thread-2158::DEBUG::2014-04-10 17:22:39,403::task::1168::TaskManager.Task::(prepare) Task=`97c6a41f-fb34-4d13-bc21-dddfb6c466d6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378121', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344052', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452924', 'lastCheck': '7.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385768', 'lastCheck': '5.6', 'valid': True}}
>Thread-2158::DEBUG::2014-04-10 17:22:39,403::task::579::TaskManager.Task::(_updateState) Task=`97c6a41f-fb34-4d13-bc21-dddfb6c466d6`::moving from state preparing -> state finished
>Thread-2158::DEBUG::2014-04-10 17:22:39,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2158::DEBUG::2014-04-10 17:22:39,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2158::DEBUG::2014-04-10 17:22:39,403::task::974::TaskManager.Task::(_decref) Task=`97c6a41f-fb34-4d13-bc21-dddfb6c466d6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:42,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:42,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390168 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:42,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:42,407::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366804 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:43,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:43,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000415965 s, 885 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:43,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:43,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000418926 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2163::DEBUG::2014-04-10 17:22:48,704::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-2163::DEBUG::2014-04-10 17:22:48,705::task::579::TaskManager.Task::(_updateState) Task=`491d9718-90c9-439d-bf09-7c7831e72b69`::moving from state init -> state preparing
>Thread-2163::INFO::2014-04-10 17:22:48,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2163::INFO::2014-04-10 17:22:48,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2163::DEBUG::2014-04-10 17:22:48,706::task::1168::TaskManager.Task::(prepare) Task=`491d9718-90c9-439d-bf09-7c7831e72b69`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2163::DEBUG::2014-04-10 17:22:48,706::task::579::TaskManager.Task::(_updateState) Task=`491d9718-90c9-439d-bf09-7c7831e72b69`::moving from state preparing -> state finished
>Thread-2163::DEBUG::2014-04-10 17:22:48,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2163::DEBUG::2014-04-10 17:22:48,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2163::DEBUG::2014-04-10 17:22:48,706::task::974::TaskManager.Task::(_decref) Task=`491d9718-90c9-439d-bf09-7c7831e72b69`::ref 0 aborting False
>Thread-2164::DEBUG::2014-04-10 17:22:48,713::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-2164::DEBUG::2014-04-10 17:22:48,713::task::579::TaskManager.Task::(_updateState) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::moving from state init -> state preparing
>Thread-2164::INFO::2014-04-10 17:22:48,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2164::DEBUG::2014-04-10 17:22:48,713::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f516a3e7-ea0a-4c04-b288-dd4ae16e0e5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2164::DEBUG::2014-04-10 17:22:48,714::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2164::DEBUG::2014-04-10 17:22:48,714::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2164::DEBUG::2014-04-10 17:22:48,714::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f516a3e7-ea0a-4c04-b288-dd4ae16e0e5e`::Granted request
>Thread-2164::DEBUG::2014-04-10 17:22:48,714::task::811::TaskManager.Task::(resourceAcquired) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2164::DEBUG::2014-04-10 17:22:48,715::task::974::TaskManager.Task::(_decref) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::ref 1 aborting False
>Thread-2164::INFO::2014-04-10 17:22:48,716::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2164::DEBUG::2014-04-10 17:22:48,717::task::1168::TaskManager.Task::(prepare) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2164::DEBUG::2014-04-10 17:22:48,717::task::579::TaskManager.Task::(_updateState) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::moving from state preparing -> state finished
>Thread-2164::DEBUG::2014-04-10 17:22:48,717::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2164::DEBUG::2014-04-10 17:22:48,717::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2164::DEBUG::2014-04-10 17:22:48,717::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2164::DEBUG::2014-04-10 17:22:48,718::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2164::DEBUG::2014-04-10 17:22:48,718::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2164::DEBUG::2014-04-10 17:22:48,718::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2164::DEBUG::2014-04-10 17:22:48,718::task::974::TaskManager.Task::(_decref) Task=`264ab1fc-0c7d-4d8d-89a3-d43a4acf7381`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:22:52,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:22:52,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389248 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:22:52,439::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:22:52,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342918 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:22:53,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:22:53,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000537657 s, 684 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:22:53,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:22:53,889::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000509775 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2166::DEBUG::2014-04-10 17:22:54,557::task::579::TaskManager.Task::(_updateState) Task=`df12abdd-6569-4312-8d63-4532cbae8ad9`::moving from state init -> state preparing
>Thread-2166::INFO::2014-04-10 17:22:54,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2166::INFO::2014-04-10 17:22:54,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509775', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389248', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342918', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537657', 'lastCheck': '0.7', 'valid': True}}
>Thread-2166::DEBUG::2014-04-10 17:22:54,558::task::1168::TaskManager.Task::(prepare) Task=`df12abdd-6569-4312-8d63-4532cbae8ad9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509775', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389248', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342918', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537657', 'lastCheck': '0.7', 'valid': True}}
>Thread-2166::DEBUG::2014-04-10 17:22:54,559::task::579::TaskManager.Task::(_updateState) Task=`df12abdd-6569-4312-8d63-4532cbae8ad9`::moving from state preparing -> state finished
>Thread-2166::DEBUG::2014-04-10 17:22:54,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2166::DEBUG::2014-04-10 17:22:54,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2166::DEBUG::2014-04-10 17:22:54,559::task::974::TaskManager.Task::(_decref) Task=`df12abdd-6569-4312-8d63-4532cbae8ad9`::ref 0 aborting False
>Thread-2169::DEBUG::2014-04-10 17:22:58,795::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-2169::DEBUG::2014-04-10 17:22:58,795::task::579::TaskManager.Task::(_updateState) Task=`ffcaec4d-ff2d-432a-80c8-cb2d3cabc182`::moving from state init -> state preparing
>Thread-2169::INFO::2014-04-10 17:22:58,796::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2169::INFO::2014-04-10 17:22:58,796::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2169::DEBUG::2014-04-10 17:22:58,796::task::1168::TaskManager.Task::(prepare) Task=`ffcaec4d-ff2d-432a-80c8-cb2d3cabc182`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2169::DEBUG::2014-04-10 17:22:58,796::task::579::TaskManager.Task::(_updateState) Task=`ffcaec4d-ff2d-432a-80c8-cb2d3cabc182`::moving from state preparing -> state finished
>Thread-2169::DEBUG::2014-04-10 17:22:58,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2169::DEBUG::2014-04-10 17:22:58,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2169::DEBUG::2014-04-10 17:22:58,797::task::974::TaskManager.Task::(_decref) Task=`ffcaec4d-ff2d-432a-80c8-cb2d3cabc182`::ref 0 aborting False
>Thread-2170::DEBUG::2014-04-10 17:22:58,803::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-2170::DEBUG::2014-04-10 17:22:58,803::task::579::TaskManager.Task::(_updateState) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::moving from state init -> state preparing
>Thread-2170::INFO::2014-04-10 17:22:58,804::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2170::DEBUG::2014-04-10 17:22:58,804::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`58a517c1-b67a-49e0-8a3d-a1d93ceea347`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2170::DEBUG::2014-04-10 17:22:58,804::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2170::DEBUG::2014-04-10 17:22:58,805::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2170::DEBUG::2014-04-10 17:22:58,805::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`58a517c1-b67a-49e0-8a3d-a1d93ceea347`::Granted request
>Thread-2170::DEBUG::2014-04-10 17:22:58,805::task::811::TaskManager.Task::(resourceAcquired) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2170::DEBUG::2014-04-10 17:22:58,805::task::974::TaskManager.Task::(_decref) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::ref 1 aborting False
>Thread-2170::INFO::2014-04-10 17:22:58,807::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2170::DEBUG::2014-04-10 17:22:58,807::task::1168::TaskManager.Task::(prepare) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2170::DEBUG::2014-04-10 17:22:58,807::task::579::TaskManager.Task::(_updateState) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::moving from state preparing -> state finished
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2170::DEBUG::2014-04-10 17:22:58,808::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2170::DEBUG::2014-04-10 17:22:58,809::task::974::TaskManager.Task::(_decref) Task=`4f9e866f-c0d6-4e87-becc-c176bbd6672b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:02,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:02,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290287 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:02,478::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:02,483::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345905 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:03,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:03,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000420161 s, 876 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:03,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:03,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000488453 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2174::DEBUG::2014-04-10 17:23:08,901::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-2174::DEBUG::2014-04-10 17:23:08,909::task::579::TaskManager.Task::(_updateState) Task=`a06fd7e4-dfaa-484c-ba30-f407e5751c75`::moving from state init -> state preparing
>Thread-2174::INFO::2014-04-10 17:23:08,910::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2174::INFO::2014-04-10 17:23:08,910::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2174::DEBUG::2014-04-10 17:23:08,910::task::1168::TaskManager.Task::(prepare) Task=`a06fd7e4-dfaa-484c-ba30-f407e5751c75`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2174::DEBUG::2014-04-10 17:23:08,910::task::579::TaskManager.Task::(_updateState) Task=`a06fd7e4-dfaa-484c-ba30-f407e5751c75`::moving from state preparing -> state finished
>Thread-2174::DEBUG::2014-04-10 17:23:08,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2174::DEBUG::2014-04-10 17:23:08,911::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2174::DEBUG::2014-04-10 17:23:08,911::task::974::TaskManager.Task::(_decref) Task=`a06fd7e4-dfaa-484c-ba30-f407e5751c75`::ref 0 aborting False
>Thread-2175::DEBUG::2014-04-10 17:23:08,917::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-2175::DEBUG::2014-04-10 17:23:08,917::task::579::TaskManager.Task::(_updateState) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::moving from state init -> state preparing
>Thread-2175::INFO::2014-04-10 17:23:08,917::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2175::DEBUG::2014-04-10 17:23:08,918::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ecc7e23-610d-453d-a994-79faae1a91a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2175::DEBUG::2014-04-10 17:23:08,918::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2175::DEBUG::2014-04-10 17:23:08,918::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2175::DEBUG::2014-04-10 17:23:08,918::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ecc7e23-610d-453d-a994-79faae1a91a0`::Granted request
>Thread-2175::DEBUG::2014-04-10 17:23:08,919::task::811::TaskManager.Task::(resourceAcquired) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2175::DEBUG::2014-04-10 17:23:08,919::task::974::TaskManager.Task::(_decref) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::ref 1 aborting False
>Thread-2175::INFO::2014-04-10 17:23:08,921::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2175::DEBUG::2014-04-10 17:23:08,921::task::1168::TaskManager.Task::(prepare) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2175::DEBUG::2014-04-10 17:23:08,921::task::579::TaskManager.Task::(_updateState) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::moving from state preparing -> state finished
>Thread-2175::DEBUG::2014-04-10 17:23:08,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2175::DEBUG::2014-04-10 17:23:08,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2175::DEBUG::2014-04-10 17:23:08,922::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2175::DEBUG::2014-04-10 17:23:08,922::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2175::DEBUG::2014-04-10 17:23:08,922::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2175::DEBUG::2014-04-10 17:23:08,922::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2175::DEBUG::2014-04-10 17:23:08,922::task::974::TaskManager.Task::(_decref) Task=`a0d821ab-1747-474b-bd39-ecc64df28fff`::ref 0 aborting False
>Thread-2176::DEBUG::2014-04-10 17:23:09,749::task::579::TaskManager.Task::(_updateState) Task=`227b7def-a3df-447e-82e5-74f529acdd7f`::moving from state init -> state preparing
>Thread-2176::INFO::2014-04-10 17:23:09,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2176::INFO::2014-04-10 17:23:09,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488453', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290287', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345905', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420161', 'lastCheck': '5.8', 'valid': True}}
>Thread-2176::DEBUG::2014-04-10 17:23:09,750::task::1168::TaskManager.Task::(prepare) Task=`227b7def-a3df-447e-82e5-74f529acdd7f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488453', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290287', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345905', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420161', 'lastCheck': '5.8', 'valid': True}}
>Thread-2176::DEBUG::2014-04-10 17:23:09,750::task::579::TaskManager.Task::(_updateState) Task=`227b7def-a3df-447e-82e5-74f529acdd7f`::moving from state preparing -> state finished
>Thread-2176::DEBUG::2014-04-10 17:23:09,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2176::DEBUG::2014-04-10 17:23:09,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2176::DEBUG::2014-04-10 17:23:09,751::task::974::TaskManager.Task::(_decref) Task=`227b7def-a3df-447e-82e5-74f529acdd7f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:12,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:12,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372658 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:12,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:12,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332589 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:13,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:13,916::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000560609 s, 656 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:13,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:13,936::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000344628 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2181::DEBUG::2014-04-10 17:23:19,015::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2181::DEBUG::2014-04-10 17:23:19,021::task::579::TaskManager.Task::(_updateState) Task=`9865f440-ee0d-426d-b672-a39e49b3adc6`::moving from state init -> state preparing
>Thread-2181::INFO::2014-04-10 17:23:19,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2181::INFO::2014-04-10 17:23:19,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2181::DEBUG::2014-04-10 17:23:19,022::task::1168::TaskManager.Task::(prepare) Task=`9865f440-ee0d-426d-b672-a39e49b3adc6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2181::DEBUG::2014-04-10 17:23:19,022::task::579::TaskManager.Task::(_updateState) Task=`9865f440-ee0d-426d-b672-a39e49b3adc6`::moving from state preparing -> state finished
>Thread-2181::DEBUG::2014-04-10 17:23:19,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2181::DEBUG::2014-04-10 17:23:19,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2181::DEBUG::2014-04-10 17:23:19,023::task::974::TaskManager.Task::(_decref) Task=`9865f440-ee0d-426d-b672-a39e49b3adc6`::ref 0 aborting False
>Thread-2182::DEBUG::2014-04-10 17:23:19,029::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2182::DEBUG::2014-04-10 17:23:19,030::task::579::TaskManager.Task::(_updateState) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::moving from state init -> state preparing
>Thread-2182::INFO::2014-04-10 17:23:19,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2182::DEBUG::2014-04-10 17:23:19,030::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dcff271b-e10f-4c8c-93fc-75c2045d1dab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2182::DEBUG::2014-04-10 17:23:19,030::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2182::DEBUG::2014-04-10 17:23:19,031::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2182::DEBUG::2014-04-10 17:23:19,031::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dcff271b-e10f-4c8c-93fc-75c2045d1dab`::Granted request
>Thread-2182::DEBUG::2014-04-10 17:23:19,031::task::811::TaskManager.Task::(resourceAcquired) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2182::DEBUG::2014-04-10 17:23:19,031::task::974::TaskManager.Task::(_decref) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::ref 1 aborting False
>Thread-2182::INFO::2014-04-10 17:23:19,033::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2182::DEBUG::2014-04-10 17:23:19,033::task::1168::TaskManager.Task::(prepare) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2182::DEBUG::2014-04-10 17:23:19,033::task::579::TaskManager.Task::(_updateState) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::moving from state preparing -> state finished
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2182::DEBUG::2014-04-10 17:23:19,034::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2182::DEBUG::2014-04-10 17:23:19,035::task::974::TaskManager.Task::(_decref) Task=`2bac7fea-4458-4e1f-a4aa-c1b85df1f38b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:22,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:22,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000411685 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:22,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:22,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336869 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:23,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:23,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000541559 s, 680 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:23,940::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:23:23,954::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:23:23,955::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:23:23,961::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:23:23,962::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:23:23,963::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:23:23,963::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:23:23,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:23,974::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446243 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2188::DEBUG::2014-04-10 17:23:24,906::task::579::TaskManager.Task::(_updateState) Task=`54082c65-5cd5-451b-9c45-9b50ba065cd3`::moving from state init -> state preparing
>Thread-2188::INFO::2014-04-10 17:23:24,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2188::INFO::2014-04-10 17:23:24,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446243', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411685', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000336869', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541559', 'lastCheck': '1.0', 'valid': True}}
>Thread-2188::DEBUG::2014-04-10 17:23:24,907::task::1168::TaskManager.Task::(prepare) Task=`54082c65-5cd5-451b-9c45-9b50ba065cd3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446243', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411685', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000336869', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541559', 'lastCheck': '1.0', 'valid': True}}
>Thread-2188::DEBUG::2014-04-10 17:23:24,907::task::579::TaskManager.Task::(_updateState) Task=`54082c65-5cd5-451b-9c45-9b50ba065cd3`::moving from state preparing -> state finished
>Thread-2188::DEBUG::2014-04-10 17:23:24,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2188::DEBUG::2014-04-10 17:23:24,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2188::DEBUG::2014-04-10 17:23:24,908::task::974::TaskManager.Task::(_decref) Task=`54082c65-5cd5-451b-9c45-9b50ba065cd3`::ref 0 aborting False
>Thread-2191::DEBUG::2014-04-10 17:23:29,106::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2191::DEBUG::2014-04-10 17:23:29,106::task::579::TaskManager.Task::(_updateState) Task=`34b3d473-3cf5-4e8e-a2b3-1d99f772a98c`::moving from state init -> state preparing
>Thread-2191::INFO::2014-04-10 17:23:29,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2191::INFO::2014-04-10 17:23:29,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2191::DEBUG::2014-04-10 17:23:29,107::task::1168::TaskManager.Task::(prepare) Task=`34b3d473-3cf5-4e8e-a2b3-1d99f772a98c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2191::DEBUG::2014-04-10 17:23:29,107::task::579::TaskManager.Task::(_updateState) Task=`34b3d473-3cf5-4e8e-a2b3-1d99f772a98c`::moving from state preparing -> state finished
>Thread-2191::DEBUG::2014-04-10 17:23:29,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2191::DEBUG::2014-04-10 17:23:29,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2191::DEBUG::2014-04-10 17:23:29,108::task::974::TaskManager.Task::(_decref) Task=`34b3d473-3cf5-4e8e-a2b3-1d99f772a98c`::ref 0 aborting False
>Thread-2192::DEBUG::2014-04-10 17:23:29,114::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2192::DEBUG::2014-04-10 17:23:29,114::task::579::TaskManager.Task::(_updateState) Task=`07451838-115b-442f-b890-5cab096bcfc9`::moving from state init -> state preparing
>Thread-2192::INFO::2014-04-10 17:23:29,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2192::DEBUG::2014-04-10 17:23:29,115::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7d91ff0c-a99f-4788-a3a8-0177cd35a685`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2192::DEBUG::2014-04-10 17:23:29,115::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2192::DEBUG::2014-04-10 17:23:29,115::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2192::DEBUG::2014-04-10 17:23:29,115::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7d91ff0c-a99f-4788-a3a8-0177cd35a685`::Granted request
>Thread-2192::DEBUG::2014-04-10 17:23:29,116::task::811::TaskManager.Task::(resourceAcquired) Task=`07451838-115b-442f-b890-5cab096bcfc9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2192::DEBUG::2014-04-10 17:23:29,116::task::974::TaskManager.Task::(_decref) Task=`07451838-115b-442f-b890-5cab096bcfc9`::ref 1 aborting False
>Thread-2192::INFO::2014-04-10 17:23:29,118::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2192::DEBUG::2014-04-10 17:23:29,118::task::1168::TaskManager.Task::(prepare) Task=`07451838-115b-442f-b890-5cab096bcfc9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2192::DEBUG::2014-04-10 17:23:29,118::task::579::TaskManager.Task::(_updateState) Task=`07451838-115b-442f-b890-5cab096bcfc9`::moving from state preparing -> state finished
>Thread-2192::DEBUG::2014-04-10 17:23:29,118::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2192::DEBUG::2014-04-10 17:23:29,118::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2192::DEBUG::2014-04-10 17:23:29,119::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2192::DEBUG::2014-04-10 17:23:29,119::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2192::DEBUG::2014-04-10 17:23:29,119::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2192::DEBUG::2014-04-10 17:23:29,119::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2192::DEBUG::2014-04-10 17:23:29,119::task::974::TaskManager.Task::(_decref) Task=`07451838-115b-442f-b890-5cab096bcfc9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:32,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:32,584::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339758 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:32,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:32,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333971 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:33,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:33,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0005587 s, 659 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:33,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:33,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494264 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2196::DEBUG::2014-04-10 17:23:39,197::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2196::DEBUG::2014-04-10 17:23:39,199::task::579::TaskManager.Task::(_updateState) Task=`49cdc6fa-d321-47e5-afb5-0303fceaa8be`::moving from state init -> state preparing
>Thread-2196::INFO::2014-04-10 17:23:39,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2196::INFO::2014-04-10 17:23:39,199::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2196::DEBUG::2014-04-10 17:23:39,199::task::1168::TaskManager.Task::(prepare) Task=`49cdc6fa-d321-47e5-afb5-0303fceaa8be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2196::DEBUG::2014-04-10 17:23:39,200::task::579::TaskManager.Task::(_updateState) Task=`49cdc6fa-d321-47e5-afb5-0303fceaa8be`::moving from state preparing -> state finished
>Thread-2196::DEBUG::2014-04-10 17:23:39,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2196::DEBUG::2014-04-10 17:23:39,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2196::DEBUG::2014-04-10 17:23:39,200::task::974::TaskManager.Task::(_decref) Task=`49cdc6fa-d321-47e5-afb5-0303fceaa8be`::ref 0 aborting False
>Thread-2197::DEBUG::2014-04-10 17:23:39,206::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2197::DEBUG::2014-04-10 17:23:39,207::task::579::TaskManager.Task::(_updateState) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::moving from state init -> state preparing
>Thread-2197::INFO::2014-04-10 17:23:39,207::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2197::DEBUG::2014-04-10 17:23:39,208::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c5a6e19d-9441-41e6-944d-5c428bda6d40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2197::DEBUG::2014-04-10 17:23:39,208::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2197::DEBUG::2014-04-10 17:23:39,208::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2197::DEBUG::2014-04-10 17:23:39,208::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c5a6e19d-9441-41e6-944d-5c428bda6d40`::Granted request
>Thread-2197::DEBUG::2014-04-10 17:23:39,208::task::811::TaskManager.Task::(resourceAcquired) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2197::DEBUG::2014-04-10 17:23:39,209::task::974::TaskManager.Task::(_decref) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::ref 1 aborting False
>Thread-2197::INFO::2014-04-10 17:23:39,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2197::DEBUG::2014-04-10 17:23:39,211::task::1168::TaskManager.Task::(prepare) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2197::DEBUG::2014-04-10 17:23:39,211::task::579::TaskManager.Task::(_updateState) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::moving from state preparing -> state finished
>Thread-2197::DEBUG::2014-04-10 17:23:39,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2197::DEBUG::2014-04-10 17:23:39,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2197::DEBUG::2014-04-10 17:23:39,211::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2197::DEBUG::2014-04-10 17:23:39,212::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2197::DEBUG::2014-04-10 17:23:39,212::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2197::DEBUG::2014-04-10 17:23:39,212::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2197::DEBUG::2014-04-10 17:23:39,212::task::974::TaskManager.Task::(_decref) Task=`21ed4fc2-54f7-4db3-b33f-5f215d100a57`::ref 0 aborting False
>Thread-2198::DEBUG::2014-04-10 17:23:40,071::task::579::TaskManager.Task::(_updateState) Task=`4c5f7163-4fca-4702-83e4-c194c9a63ddf`::moving from state init -> state preparing
>Thread-2198::INFO::2014-04-10 17:23:40,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2198::INFO::2014-04-10 17:23:40,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494264', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339758', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333971', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005587', 'lastCheck': '6.1', 'valid': True}}
>Thread-2198::DEBUG::2014-04-10 17:23:40,072::task::1168::TaskManager.Task::(prepare) Task=`4c5f7163-4fca-4702-83e4-c194c9a63ddf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494264', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339758', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333971', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005587', 'lastCheck': '6.1', 'valid': True}}
>Thread-2198::DEBUG::2014-04-10 17:23:40,072::task::579::TaskManager.Task::(_updateState) Task=`4c5f7163-4fca-4702-83e4-c194c9a63ddf`::moving from state preparing -> state finished
>Thread-2198::DEBUG::2014-04-10 17:23:40,072::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2198::DEBUG::2014-04-10 17:23:40,072::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2198::DEBUG::2014-04-10 17:23:40,072::task::974::TaskManager.Task::(_decref) Task=`4c5f7163-4fca-4702-83e4-c194c9a63ddf`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:42,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:42,624::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035694 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:42,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:42,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240057 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:43,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:43,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533888 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:43,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:44,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00038996 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2203::DEBUG::2014-04-10 17:23:49,302::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2203::DEBUG::2014-04-10 17:23:49,303::task::579::TaskManager.Task::(_updateState) Task=`6163bfef-8d8c-4b8d-8984-acf1eb09d227`::moving from state init -> state preparing
>Thread-2203::INFO::2014-04-10 17:23:49,303::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2203::INFO::2014-04-10 17:23:49,304::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2203::DEBUG::2014-04-10 17:23:49,304::task::1168::TaskManager.Task::(prepare) Task=`6163bfef-8d8c-4b8d-8984-acf1eb09d227`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2203::DEBUG::2014-04-10 17:23:49,304::task::579::TaskManager.Task::(_updateState) Task=`6163bfef-8d8c-4b8d-8984-acf1eb09d227`::moving from state preparing -> state finished
>Thread-2203::DEBUG::2014-04-10 17:23:49,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2203::DEBUG::2014-04-10 17:23:49,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2203::DEBUG::2014-04-10 17:23:49,304::task::974::TaskManager.Task::(_decref) Task=`6163bfef-8d8c-4b8d-8984-acf1eb09d227`::ref 0 aborting False
>Thread-2204::DEBUG::2014-04-10 17:23:49,311::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2204::DEBUG::2014-04-10 17:23:49,312::task::579::TaskManager.Task::(_updateState) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::moving from state init -> state preparing
>Thread-2204::INFO::2014-04-10 17:23:49,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2204::DEBUG::2014-04-10 17:23:49,312::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`38d8ed4b-1ee6-4c73-86c3-6cf3161f640b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2204::DEBUG::2014-04-10 17:23:49,313::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2204::DEBUG::2014-04-10 17:23:49,313::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2204::DEBUG::2014-04-10 17:23:49,313::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`38d8ed4b-1ee6-4c73-86c3-6cf3161f640b`::Granted request
>Thread-2204::DEBUG::2014-04-10 17:23:49,313::task::811::TaskManager.Task::(resourceAcquired) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2204::DEBUG::2014-04-10 17:23:49,313::task::974::TaskManager.Task::(_decref) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::ref 1 aborting False
>Thread-2204::INFO::2014-04-10 17:23:49,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::task::1168::TaskManager.Task::(prepare) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::task::579::TaskManager.Task::(_updateState) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::moving from state preparing -> state finished
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2204::DEBUG::2014-04-10 17:23:49,316::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2204::DEBUG::2014-04-10 17:23:49,317::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2204::DEBUG::2014-04-10 17:23:49,317::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2204::DEBUG::2014-04-10 17:23:49,317::task::974::TaskManager.Task::(_decref) Task=`3b22bce6-9a72-4dc5-b2d2-2c5e1ac7a773`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:23:52,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:23:52,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000444477 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:23:52,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:23:52,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366478 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:23:53,974::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:23:53,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000538529 s, 683 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:23:54,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:23:54,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000577077 s, 1.1 MB/s\n'; <rc> = 0
>Thread-2206::DEBUG::2014-04-10 17:23:55,226::task::579::TaskManager.Task::(_updateState) Task=`11e6e92c-5d00-45d5-b840-6d584c47f254`::moving from state init -> state preparing
>Thread-2206::INFO::2014-04-10 17:23:55,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2206::INFO::2014-04-10 17:23:55,227::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577077', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444477', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366478', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538529', 'lastCheck': '1.2', 'valid': True}}
>Thread-2206::DEBUG::2014-04-10 17:23:55,227::task::1168::TaskManager.Task::(prepare) Task=`11e6e92c-5d00-45d5-b840-6d584c47f254`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577077', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444477', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366478', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538529', 'lastCheck': '1.2', 'valid': True}}
>Thread-2206::DEBUG::2014-04-10 17:23:55,228::task::579::TaskManager.Task::(_updateState) Task=`11e6e92c-5d00-45d5-b840-6d584c47f254`::moving from state preparing -> state finished
>Thread-2206::DEBUG::2014-04-10 17:23:55,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2206::DEBUG::2014-04-10 17:23:55,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2206::DEBUG::2014-04-10 17:23:55,228::task::974::TaskManager.Task::(_decref) Task=`11e6e92c-5d00-45d5-b840-6d584c47f254`::ref 0 aborting False
>Thread-2209::DEBUG::2014-04-10 17:23:59,394::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2209::DEBUG::2014-04-10 17:23:59,394::task::579::TaskManager.Task::(_updateState) Task=`2caf5775-6da1-4f08-9db1-d9f35b87aa7f`::moving from state init -> state preparing
>Thread-2209::INFO::2014-04-10 17:23:59,395::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2209::INFO::2014-04-10 17:23:59,395::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2209::DEBUG::2014-04-10 17:23:59,395::task::1168::TaskManager.Task::(prepare) Task=`2caf5775-6da1-4f08-9db1-d9f35b87aa7f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2209::DEBUG::2014-04-10 17:23:59,395::task::579::TaskManager.Task::(_updateState) Task=`2caf5775-6da1-4f08-9db1-d9f35b87aa7f`::moving from state preparing -> state finished
>Thread-2209::DEBUG::2014-04-10 17:23:59,395::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2209::DEBUG::2014-04-10 17:23:59,396::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2209::DEBUG::2014-04-10 17:23:59,396::task::974::TaskManager.Task::(_decref) Task=`2caf5775-6da1-4f08-9db1-d9f35b87aa7f`::ref 0 aborting False
>Thread-2210::DEBUG::2014-04-10 17:23:59,402::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2210::DEBUG::2014-04-10 17:23:59,402::task::579::TaskManager.Task::(_updateState) Task=`958c2917-4513-44ee-87a8-e0068849a694`::moving from state init -> state preparing
>Thread-2210::INFO::2014-04-10 17:23:59,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2210::DEBUG::2014-04-10 17:23:59,403::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f9ae262-1efe-4882-9919-f2a5329da774`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2210::DEBUG::2014-04-10 17:23:59,403::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2210::DEBUG::2014-04-10 17:23:59,403::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2210::DEBUG::2014-04-10 17:23:59,403::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f9ae262-1efe-4882-9919-f2a5329da774`::Granted request
>Thread-2210::DEBUG::2014-04-10 17:23:59,404::task::811::TaskManager.Task::(resourceAcquired) Task=`958c2917-4513-44ee-87a8-e0068849a694`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2210::DEBUG::2014-04-10 17:23:59,404::task::974::TaskManager.Task::(_decref) Task=`958c2917-4513-44ee-87a8-e0068849a694`::ref 1 aborting False
>Thread-2210::INFO::2014-04-10 17:23:59,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2210::DEBUG::2014-04-10 17:23:59,406::task::1168::TaskManager.Task::(prepare) Task=`958c2917-4513-44ee-87a8-e0068849a694`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2210::DEBUG::2014-04-10 17:23:59,406::task::579::TaskManager.Task::(_updateState) Task=`958c2917-4513-44ee-87a8-e0068849a694`::moving from state preparing -> state finished
>Thread-2210::DEBUG::2014-04-10 17:23:59,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2210::DEBUG::2014-04-10 17:23:59,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2210::DEBUG::2014-04-10 17:23:59,407::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2210::DEBUG::2014-04-10 17:23:59,407::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2210::DEBUG::2014-04-10 17:23:59,407::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2210::DEBUG::2014-04-10 17:23:59,407::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2210::DEBUG::2014-04-10 17:23:59,407::task::974::TaskManager.Task::(_decref) Task=`958c2917-4513-44ee-87a8-e0068849a694`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:02,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:02,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369369 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:02,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:02,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337692 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:03,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:03,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509497 s, 722 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:04,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:04,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00049345 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2214::DEBUG::2014-04-10 17:24:09,533::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2214::DEBUG::2014-04-10 17:24:09,534::task::579::TaskManager.Task::(_updateState) Task=`749e15b0-ba10-4f4f-8488-eb2f976e7936`::moving from state init -> state preparing
>Thread-2214::INFO::2014-04-10 17:24:09,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2214::INFO::2014-04-10 17:24:09,535::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2214::DEBUG::2014-04-10 17:24:09,535::task::1168::TaskManager.Task::(prepare) Task=`749e15b0-ba10-4f4f-8488-eb2f976e7936`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2214::DEBUG::2014-04-10 17:24:09,535::task::579::TaskManager.Task::(_updateState) Task=`749e15b0-ba10-4f4f-8488-eb2f976e7936`::moving from state preparing -> state finished
>Thread-2214::DEBUG::2014-04-10 17:24:09,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2214::DEBUG::2014-04-10 17:24:09,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2214::DEBUG::2014-04-10 17:24:09,535::task::974::TaskManager.Task::(_decref) Task=`749e15b0-ba10-4f4f-8488-eb2f976e7936`::ref 0 aborting False
>Thread-2215::DEBUG::2014-04-10 17:24:09,542::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2215::DEBUG::2014-04-10 17:24:09,542::task::579::TaskManager.Task::(_updateState) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::moving from state init -> state preparing
>Thread-2215::INFO::2014-04-10 17:24:09,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2215::DEBUG::2014-04-10 17:24:09,543::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c659c45f-a229-4c0d-9b56-321ac0169e96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2215::DEBUG::2014-04-10 17:24:09,543::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2215::DEBUG::2014-04-10 17:24:09,543::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2215::DEBUG::2014-04-10 17:24:09,543::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c659c45f-a229-4c0d-9b56-321ac0169e96`::Granted request
>Thread-2215::DEBUG::2014-04-10 17:24:09,544::task::811::TaskManager.Task::(resourceAcquired) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2215::DEBUG::2014-04-10 17:24:09,544::task::974::TaskManager.Task::(_decref) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::ref 1 aborting False
>Thread-2215::INFO::2014-04-10 17:24:09,546::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2215::DEBUG::2014-04-10 17:24:09,546::task::1168::TaskManager.Task::(prepare) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2215::DEBUG::2014-04-10 17:24:09,546::task::579::TaskManager.Task::(_updateState) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::moving from state preparing -> state finished
>Thread-2215::DEBUG::2014-04-10 17:24:09,546::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2215::DEBUG::2014-04-10 17:24:09,546::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2215::DEBUG::2014-04-10 17:24:09,547::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2215::DEBUG::2014-04-10 17:24:09,547::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2215::DEBUG::2014-04-10 17:24:09,547::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2215::DEBUG::2014-04-10 17:24:09,547::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2215::DEBUG::2014-04-10 17:24:09,547::task::974::TaskManager.Task::(_decref) Task=`ea61f0a6-73f2-415c-869b-6cceba729337`::ref 0 aborting False
>Thread-2216::DEBUG::2014-04-10 17:24:10,404::task::579::TaskManager.Task::(_updateState) Task=`00faf44e-16b6-4329-8faa-ed0140f5bd57`::moving from state init -> state preparing
>Thread-2216::INFO::2014-04-10 17:24:10,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2216::INFO::2014-04-10 17:24:10,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049345', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369369', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337692', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509497', 'lastCheck': '6.4', 'valid': True}}
>Thread-2216::DEBUG::2014-04-10 17:24:10,405::task::1168::TaskManager.Task::(prepare) Task=`00faf44e-16b6-4329-8faa-ed0140f5bd57`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049345', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369369', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337692', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509497', 'lastCheck': '6.4', 'valid': True}}
>Thread-2216::DEBUG::2014-04-10 17:24:10,405::task::579::TaskManager.Task::(_updateState) Task=`00faf44e-16b6-4329-8faa-ed0140f5bd57`::moving from state preparing -> state finished
>Thread-2216::DEBUG::2014-04-10 17:24:10,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2216::DEBUG::2014-04-10 17:24:10,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2216::DEBUG::2014-04-10 17:24:10,405::task::974::TaskManager.Task::(_decref) Task=`00faf44e-16b6-4329-8faa-ed0140f5bd57`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:12,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:12,737::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000435413 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:12,748::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:12,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344504 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:14,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:14,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000490668 s, 750 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:14,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:14,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000435913 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2221::DEBUG::2014-04-10 17:24:19,624::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2221::DEBUG::2014-04-10 17:24:19,624::task::579::TaskManager.Task::(_updateState) Task=`9cad5ab6-9015-4526-8cf7-cd767cdbc33a`::moving from state init -> state preparing
>Thread-2221::INFO::2014-04-10 17:24:19,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2221::INFO::2014-04-10 17:24:19,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2221::DEBUG::2014-04-10 17:24:19,625::task::1168::TaskManager.Task::(prepare) Task=`9cad5ab6-9015-4526-8cf7-cd767cdbc33a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2221::DEBUG::2014-04-10 17:24:19,625::task::579::TaskManager.Task::(_updateState) Task=`9cad5ab6-9015-4526-8cf7-cd767cdbc33a`::moving from state preparing -> state finished
>Thread-2221::DEBUG::2014-04-10 17:24:19,625::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2221::DEBUG::2014-04-10 17:24:19,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2221::DEBUG::2014-04-10 17:24:19,626::task::974::TaskManager.Task::(_decref) Task=`9cad5ab6-9015-4526-8cf7-cd767cdbc33a`::ref 0 aborting False
>Thread-2222::DEBUG::2014-04-10 17:24:19,632::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2222::DEBUG::2014-04-10 17:24:19,632::task::579::TaskManager.Task::(_updateState) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::moving from state init -> state preparing
>Thread-2222::INFO::2014-04-10 17:24:19,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2222::DEBUG::2014-04-10 17:24:19,633::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5ad9fdde-e247-4f65-a4db-0ab47a52a109`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2222::DEBUG::2014-04-10 17:24:19,633::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2222::DEBUG::2014-04-10 17:24:19,635::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2222::DEBUG::2014-04-10 17:24:19,635::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5ad9fdde-e247-4f65-a4db-0ab47a52a109`::Granted request
>Thread-2222::DEBUG::2014-04-10 17:24:19,635::task::811::TaskManager.Task::(resourceAcquired) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2222::DEBUG::2014-04-10 17:24:19,635::task::974::TaskManager.Task::(_decref) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::ref 1 aborting False
>Thread-2222::INFO::2014-04-10 17:24:19,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2222::DEBUG::2014-04-10 17:24:19,637::task::1168::TaskManager.Task::(prepare) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::task::579::TaskManager.Task::(_updateState) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::moving from state preparing -> state finished
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2222::DEBUG::2014-04-10 17:24:19,638::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2222::DEBUG::2014-04-10 17:24:19,639::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2222::DEBUG::2014-04-10 17:24:19,639::task::974::TaskManager.Task::(_decref) Task=`6f927297-6e56-4877-b8dc-9daa9300a1c2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:22,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:22,779::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000412981 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:22,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:22,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337043 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:24,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:24,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048372 s, 761 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:24,058::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:24,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000528694 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2224::DEBUG::2014-04-10 17:24:25,560::task::579::TaskManager.Task::(_updateState) Task=`869bc04b-8de8-4f2a-8676-97fc550cc9bb`::moving from state init -> state preparing
>Thread-2224::INFO::2014-04-10 17:24:25,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2224::INFO::2014-04-10 17:24:25,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528694', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412981', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337043', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048372', 'lastCheck': '1.5', 'valid': True}}
>Thread-2224::DEBUG::2014-04-10 17:24:25,561::task::1168::TaskManager.Task::(prepare) Task=`869bc04b-8de8-4f2a-8676-97fc550cc9bb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528694', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412981', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337043', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048372', 'lastCheck': '1.5', 'valid': True}}
>Thread-2224::DEBUG::2014-04-10 17:24:25,561::task::579::TaskManager.Task::(_updateState) Task=`869bc04b-8de8-4f2a-8676-97fc550cc9bb`::moving from state preparing -> state finished
>Thread-2224::DEBUG::2014-04-10 17:24:25,561::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2224::DEBUG::2014-04-10 17:24:25,561::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2224::DEBUG::2014-04-10 17:24:25,562::task::974::TaskManager.Task::(_decref) Task=`869bc04b-8de8-4f2a-8676-97fc550cc9bb`::ref 0 aborting False
>Thread-2227::DEBUG::2014-04-10 17:24:29,714::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-2227::DEBUG::2014-04-10 17:24:29,715::task::579::TaskManager.Task::(_updateState) Task=`aa1c7d64-d0b0-4d01-9c27-bd0059959c56`::moving from state init -> state preparing
>Thread-2227::INFO::2014-04-10 17:24:29,715::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2227::INFO::2014-04-10 17:24:29,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2227::DEBUG::2014-04-10 17:24:29,715::task::1168::TaskManager.Task::(prepare) Task=`aa1c7d64-d0b0-4d01-9c27-bd0059959c56`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2227::DEBUG::2014-04-10 17:24:29,715::task::579::TaskManager.Task::(_updateState) Task=`aa1c7d64-d0b0-4d01-9c27-bd0059959c56`::moving from state preparing -> state finished
>Thread-2227::DEBUG::2014-04-10 17:24:29,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2227::DEBUG::2014-04-10 17:24:29,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2227::DEBUG::2014-04-10 17:24:29,716::task::974::TaskManager.Task::(_decref) Task=`aa1c7d64-d0b0-4d01-9c27-bd0059959c56`::ref 0 aborting False
>Thread-2228::DEBUG::2014-04-10 17:24:29,722::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-2228::DEBUG::2014-04-10 17:24:29,723::task::579::TaskManager.Task::(_updateState) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::moving from state init -> state preparing
>Thread-2228::INFO::2014-04-10 17:24:29,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2228::DEBUG::2014-04-10 17:24:29,723::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`034ede75-824e-4ed7-b172-2bdbd0127d48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2228::DEBUG::2014-04-10 17:24:29,724::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2228::DEBUG::2014-04-10 17:24:29,724::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2228::DEBUG::2014-04-10 17:24:29,724::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`034ede75-824e-4ed7-b172-2bdbd0127d48`::Granted request
>Thread-2228::DEBUG::2014-04-10 17:24:29,724::task::811::TaskManager.Task::(resourceAcquired) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2228::DEBUG::2014-04-10 17:24:29,724::task::974::TaskManager.Task::(_decref) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::ref 1 aborting False
>Thread-2228::INFO::2014-04-10 17:24:29,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2228::DEBUG::2014-04-10 17:24:29,726::task::1168::TaskManager.Task::(prepare) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2228::DEBUG::2014-04-10 17:24:29,727::task::579::TaskManager.Task::(_updateState) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::moving from state preparing -> state finished
>Thread-2228::DEBUG::2014-04-10 17:24:29,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2228::DEBUG::2014-04-10 17:24:29,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2228::DEBUG::2014-04-10 17:24:29,727::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2228::DEBUG::2014-04-10 17:24:29,727::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2228::DEBUG::2014-04-10 17:24:29,728::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2228::DEBUG::2014-04-10 17:24:29,728::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2228::DEBUG::2014-04-10 17:24:29,728::task::974::TaskManager.Task::(_decref) Task=`2393f3d9-6af4-4f90-8a71-87a1ef0d4a93`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:32,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:32,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312025 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:32,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:32,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341973 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:34,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:34,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000497837 s, 739 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:34,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:34,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000579335 s, 1.1 MB/s\n'; <rc> = 0
>Thread-2232::DEBUG::2014-04-10 17:24:39,943::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2232::DEBUG::2014-04-10 17:24:39,944::task::579::TaskManager.Task::(_updateState) Task=`65cec885-79a5-4e56-8596-ef418411de88`::moving from state init -> state preparing
>Thread-2232::INFO::2014-04-10 17:24:39,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2232::INFO::2014-04-10 17:24:39,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2232::DEBUG::2014-04-10 17:24:39,945::task::1168::TaskManager.Task::(prepare) Task=`65cec885-79a5-4e56-8596-ef418411de88`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2232::DEBUG::2014-04-10 17:24:39,945::task::579::TaskManager.Task::(_updateState) Task=`65cec885-79a5-4e56-8596-ef418411de88`::moving from state preparing -> state finished
>Thread-2232::DEBUG::2014-04-10 17:24:39,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2232::DEBUG::2014-04-10 17:24:39,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2232::DEBUG::2014-04-10 17:24:39,945::task::974::TaskManager.Task::(_decref) Task=`65cec885-79a5-4e56-8596-ef418411de88`::ref 0 aborting False
>Thread-2233::DEBUG::2014-04-10 17:24:39,952::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2233::DEBUG::2014-04-10 17:24:39,952::task::579::TaskManager.Task::(_updateState) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::moving from state init -> state preparing
>Thread-2233::INFO::2014-04-10 17:24:39,953::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2233::DEBUG::2014-04-10 17:24:39,953::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1c10eab-4bd2-4f81-8085-492a4c30a739`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2233::DEBUG::2014-04-10 17:24:39,953::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2233::DEBUG::2014-04-10 17:24:39,953::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2233::DEBUG::2014-04-10 17:24:39,954::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1c10eab-4bd2-4f81-8085-492a4c30a739`::Granted request
>Thread-2233::DEBUG::2014-04-10 17:24:39,954::task::811::TaskManager.Task::(resourceAcquired) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2233::DEBUG::2014-04-10 17:24:39,954::task::974::TaskManager.Task::(_decref) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::ref 1 aborting False
>Thread-2233::INFO::2014-04-10 17:24:39,956::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2233::DEBUG::2014-04-10 17:24:39,956::task::1168::TaskManager.Task::(prepare) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2233::DEBUG::2014-04-10 17:24:39,956::task::579::TaskManager.Task::(_updateState) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::moving from state preparing -> state finished
>Thread-2233::DEBUG::2014-04-10 17:24:39,956::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2233::DEBUG::2014-04-10 17:24:39,957::task::974::TaskManager.Task::(_decref) Task=`5c01aaf5-a6a8-41e0-a915-e609f6c10c31`::ref 0 aborting False
>Thread-2234::DEBUG::2014-04-10 17:24:40,722::task::579::TaskManager.Task::(_updateState) Task=`43cf777d-4c43-4870-9b21-d3ba124c5230`::moving from state init -> state preparing
>Thread-2234::INFO::2014-04-10 17:24:40,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2234::INFO::2014-04-10 17:24:40,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579335', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312025', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341973', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497837', 'lastCheck': '6.7', 'valid': True}}
>Thread-2234::DEBUG::2014-04-10 17:24:40,723::task::1168::TaskManager.Task::(prepare) Task=`43cf777d-4c43-4870-9b21-d3ba124c5230`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579335', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312025', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341973', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497837', 'lastCheck': '6.7', 'valid': True}}
>Thread-2234::DEBUG::2014-04-10 17:24:40,723::task::579::TaskManager.Task::(_updateState) Task=`43cf777d-4c43-4870-9b21-d3ba124c5230`::moving from state preparing -> state finished
>Thread-2234::DEBUG::2014-04-10 17:24:40,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2234::DEBUG::2014-04-10 17:24:40,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2234::DEBUG::2014-04-10 17:24:40,724::task::974::TaskManager.Task::(_decref) Task=`43cf777d-4c43-4870-9b21-d3ba124c5230`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:42,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:42,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000404977 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:42,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:42,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346743 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:44,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:44,050::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430197 s, 855 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:44,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:44,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000514652 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2239::DEBUG::2014-04-10 17:24:50,041::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-2239::DEBUG::2014-04-10 17:24:50,041::task::579::TaskManager.Task::(_updateState) Task=`0b69b382-05eb-45a0-9f3c-1dfd46a94b0c`::moving from state init -> state preparing
>Thread-2239::INFO::2014-04-10 17:24:50,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2239::INFO::2014-04-10 17:24:50,042::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2239::DEBUG::2014-04-10 17:24:50,042::task::1168::TaskManager.Task::(prepare) Task=`0b69b382-05eb-45a0-9f3c-1dfd46a94b0c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2239::DEBUG::2014-04-10 17:24:50,042::task::579::TaskManager.Task::(_updateState) Task=`0b69b382-05eb-45a0-9f3c-1dfd46a94b0c`::moving from state preparing -> state finished
>Thread-2239::DEBUG::2014-04-10 17:24:50,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2239::DEBUG::2014-04-10 17:24:50,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2239::DEBUG::2014-04-10 17:24:50,043::task::974::TaskManager.Task::(_decref) Task=`0b69b382-05eb-45a0-9f3c-1dfd46a94b0c`::ref 0 aborting False
>Thread-2240::DEBUG::2014-04-10 17:24:50,049::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-2240::DEBUG::2014-04-10 17:24:50,049::task::579::TaskManager.Task::(_updateState) Task=`e180f360-8a04-4242-9363-54e24e560f05`::moving from state init -> state preparing
>Thread-2240::INFO::2014-04-10 17:24:50,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2240::DEBUG::2014-04-10 17:24:50,050::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eede6f41-98de-4a40-bd75-984a4696ce77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2240::DEBUG::2014-04-10 17:24:50,050::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2240::DEBUG::2014-04-10 17:24:50,050::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2240::DEBUG::2014-04-10 17:24:50,050::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eede6f41-98de-4a40-bd75-984a4696ce77`::Granted request
>Thread-2240::DEBUG::2014-04-10 17:24:50,050::task::811::TaskManager.Task::(resourceAcquired) Task=`e180f360-8a04-4242-9363-54e24e560f05`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2240::DEBUG::2014-04-10 17:24:50,051::task::974::TaskManager.Task::(_decref) Task=`e180f360-8a04-4242-9363-54e24e560f05`::ref 1 aborting False
>Thread-2240::INFO::2014-04-10 17:24:50,053::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2240::DEBUG::2014-04-10 17:24:50,053::task::1168::TaskManager.Task::(prepare) Task=`e180f360-8a04-4242-9363-54e24e560f05`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2240::DEBUG::2014-04-10 17:24:50,053::task::579::TaskManager.Task::(_updateState) Task=`e180f360-8a04-4242-9363-54e24e560f05`::moving from state preparing -> state finished
>Thread-2240::DEBUG::2014-04-10 17:24:50,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2240::DEBUG::2014-04-10 17:24:50,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2240::DEBUG::2014-04-10 17:24:50,053::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2240::DEBUG::2014-04-10 17:24:50,054::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2240::DEBUG::2014-04-10 17:24:50,054::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2240::DEBUG::2014-04-10 17:24:50,054::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2240::DEBUG::2014-04-10 17:24:50,054::task::974::TaskManager.Task::(_decref) Task=`e180f360-8a04-4242-9363-54e24e560f05`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:24:52,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:24:52,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000447896 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:24:52,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:24:52,920::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363214 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:24:54,058::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:24:54,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000551638 s, 667 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:24:54,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:24:54,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000381859 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2242::DEBUG::2014-04-10 17:24:55,883::task::579::TaskManager.Task::(_updateState) Task=`fef7466d-829d-4131-aed5-b9b2a9e1c61f`::moving from state init -> state preparing
>Thread-2242::INFO::2014-04-10 17:24:55,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2242::INFO::2014-04-10 17:24:55,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381859', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447896', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363214', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551638', 'lastCheck': '1.8', 'valid': True}}
>Thread-2242::DEBUG::2014-04-10 17:24:55,884::task::1168::TaskManager.Task::(prepare) Task=`fef7466d-829d-4131-aed5-b9b2a9e1c61f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381859', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447896', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363214', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551638', 'lastCheck': '1.8', 'valid': True}}
>Thread-2242::DEBUG::2014-04-10 17:24:55,884::task::579::TaskManager.Task::(_updateState) Task=`fef7466d-829d-4131-aed5-b9b2a9e1c61f`::moving from state preparing -> state finished
>Thread-2242::DEBUG::2014-04-10 17:24:55,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2242::DEBUG::2014-04-10 17:24:55,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2242::DEBUG::2014-04-10 17:24:55,885::task::974::TaskManager.Task::(_decref) Task=`fef7466d-829d-4131-aed5-b9b2a9e1c61f`::ref 0 aborting False
>Thread-2245::DEBUG::2014-04-10 17:25:00,127::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-2245::DEBUG::2014-04-10 17:25:00,127::task::579::TaskManager.Task::(_updateState) Task=`68f5473d-dd2b-4d07-bc1f-5db7824fa53c`::moving from state init -> state preparing
>Thread-2245::INFO::2014-04-10 17:25:00,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2245::INFO::2014-04-10 17:25:00,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2245::DEBUG::2014-04-10 17:25:00,128::task::1168::TaskManager.Task::(prepare) Task=`68f5473d-dd2b-4d07-bc1f-5db7824fa53c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2245::DEBUG::2014-04-10 17:25:00,128::task::579::TaskManager.Task::(_updateState) Task=`68f5473d-dd2b-4d07-bc1f-5db7824fa53c`::moving from state preparing -> state finished
>Thread-2245::DEBUG::2014-04-10 17:25:00,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2245::DEBUG::2014-04-10 17:25:00,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2245::DEBUG::2014-04-10 17:25:00,128::task::974::TaskManager.Task::(_decref) Task=`68f5473d-dd2b-4d07-bc1f-5db7824fa53c`::ref 0 aborting False
>Thread-2246::DEBUG::2014-04-10 17:25:00,135::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-2246::DEBUG::2014-04-10 17:25:00,135::task::579::TaskManager.Task::(_updateState) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::moving from state init -> state preparing
>Thread-2246::INFO::2014-04-10 17:25:00,135::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2246::DEBUG::2014-04-10 17:25:00,136::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`235d9bd6-28bd-4a74-9773-c76f279301ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2246::DEBUG::2014-04-10 17:25:00,136::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2246::DEBUG::2014-04-10 17:25:00,136::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2246::DEBUG::2014-04-10 17:25:00,136::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`235d9bd6-28bd-4a74-9773-c76f279301ca`::Granted request
>Thread-2246::DEBUG::2014-04-10 17:25:00,138::task::811::TaskManager.Task::(resourceAcquired) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2246::DEBUG::2014-04-10 17:25:00,138::task::974::TaskManager.Task::(_decref) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::ref 1 aborting False
>Thread-2246::INFO::2014-04-10 17:25:00,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2246::DEBUG::2014-04-10 17:25:00,140::task::1168::TaskManager.Task::(prepare) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2246::DEBUG::2014-04-10 17:25:00,140::task::579::TaskManager.Task::(_updateState) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::moving from state preparing -> state finished
>Thread-2246::DEBUG::2014-04-10 17:25:00,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2246::DEBUG::2014-04-10 17:25:00,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2246::DEBUG::2014-04-10 17:25:00,141::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2246::DEBUG::2014-04-10 17:25:00,141::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2246::DEBUG::2014-04-10 17:25:00,141::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2246::DEBUG::2014-04-10 17:25:00,141::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2246::DEBUG::2014-04-10 17:25:00,141::task::974::TaskManager.Task::(_decref) Task=`eb067e22-2ba1-4b8d-81d6-9adb436427c2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:02,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:02,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000405718 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:02,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:02,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264036 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:04,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:04,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000372555 s, 988 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:04,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:04,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000374346 s, 1.8 MB/s\n'; <rc> = 0
>Thread-2250::DEBUG::2014-04-10 17:25:10,224::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2250::DEBUG::2014-04-10 17:25:10,225::task::579::TaskManager.Task::(_updateState) Task=`3b62eb8e-d2c5-4cd9-b791-2deb589608ca`::moving from state init -> state preparing
>Thread-2250::INFO::2014-04-10 17:25:10,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2250::INFO::2014-04-10 17:25:10,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2250::DEBUG::2014-04-10 17:25:10,226::task::1168::TaskManager.Task::(prepare) Task=`3b62eb8e-d2c5-4cd9-b791-2deb589608ca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2250::DEBUG::2014-04-10 17:25:10,226::task::579::TaskManager.Task::(_updateState) Task=`3b62eb8e-d2c5-4cd9-b791-2deb589608ca`::moving from state preparing -> state finished
>Thread-2250::DEBUG::2014-04-10 17:25:10,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2250::DEBUG::2014-04-10 17:25:10,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2250::DEBUG::2014-04-10 17:25:10,227::task::974::TaskManager.Task::(_decref) Task=`3b62eb8e-d2c5-4cd9-b791-2deb589608ca`::ref 0 aborting False
>Thread-2251::DEBUG::2014-04-10 17:25:10,233::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2251::DEBUG::2014-04-10 17:25:10,233::task::579::TaskManager.Task::(_updateState) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::moving from state init -> state preparing
>Thread-2251::INFO::2014-04-10 17:25:10,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2251::DEBUG::2014-04-10 17:25:10,234::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1e28172-484b-4bd4-830d-d95379648a1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2251::DEBUG::2014-04-10 17:25:10,234::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2251::DEBUG::2014-04-10 17:25:10,234::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2251::DEBUG::2014-04-10 17:25:10,234::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1e28172-484b-4bd4-830d-d95379648a1f`::Granted request
>Thread-2251::DEBUG::2014-04-10 17:25:10,235::task::811::TaskManager.Task::(resourceAcquired) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2251::DEBUG::2014-04-10 17:25:10,235::task::974::TaskManager.Task::(_decref) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::ref 1 aborting False
>Thread-2251::INFO::2014-04-10 17:25:10,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2251::DEBUG::2014-04-10 17:25:10,237::task::1168::TaskManager.Task::(prepare) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2251::DEBUG::2014-04-10 17:25:10,237::task::579::TaskManager.Task::(_updateState) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::moving from state preparing -> state finished
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2251::DEBUG::2014-04-10 17:25:10,238::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2251::DEBUG::2014-04-10 17:25:10,239::task::974::TaskManager.Task::(_decref) Task=`4281c72d-8e21-4bbf-88fc-7a47566ff8a0`::ref 0 aborting False
>Thread-2252::DEBUG::2014-04-10 17:25:11,074::task::579::TaskManager.Task::(_updateState) Task=`8defba50-77f3-450a-b2d8-f826bf842010`::moving from state init -> state preparing
>Thread-2252::INFO::2014-04-10 17:25:11,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2252::INFO::2014-04-10 17:25:11,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374346', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405718', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264036', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372555', 'lastCheck': '7.0', 'valid': True}}
>Thread-2252::DEBUG::2014-04-10 17:25:11,075::task::1168::TaskManager.Task::(prepare) Task=`8defba50-77f3-450a-b2d8-f826bf842010`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374346', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405718', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000264036', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372555', 'lastCheck': '7.0', 'valid': True}}
>Thread-2252::DEBUG::2014-04-10 17:25:11,075::task::579::TaskManager.Task::(_updateState) Task=`8defba50-77f3-450a-b2d8-f826bf842010`::moving from state preparing -> state finished
>Thread-2252::DEBUG::2014-04-10 17:25:11,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2252::DEBUG::2014-04-10 17:25:11,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2252::DEBUG::2014-04-10 17:25:11,076::task::974::TaskManager.Task::(_decref) Task=`8defba50-77f3-450a-b2d8-f826bf842010`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:12,966::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:12,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284728 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:12,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:12,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000251574 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:14,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:14,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000520779 s, 707 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:14,132::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:14,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398201 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2257::DEBUG::2014-04-10 17:25:20,323::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2257::DEBUG::2014-04-10 17:25:20,324::task::579::TaskManager.Task::(_updateState) Task=`acfb0b3d-ae01-4785-bf5b-b0173a3a5b34`::moving from state init -> state preparing
>Thread-2257::INFO::2014-04-10 17:25:20,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2257::INFO::2014-04-10 17:25:20,325::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2257::DEBUG::2014-04-10 17:25:20,325::task::1168::TaskManager.Task::(prepare) Task=`acfb0b3d-ae01-4785-bf5b-b0173a3a5b34`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2257::DEBUG::2014-04-10 17:25:20,325::task::579::TaskManager.Task::(_updateState) Task=`acfb0b3d-ae01-4785-bf5b-b0173a3a5b34`::moving from state preparing -> state finished
>Thread-2257::DEBUG::2014-04-10 17:25:20,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2257::DEBUG::2014-04-10 17:25:20,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2257::DEBUG::2014-04-10 17:25:20,325::task::974::TaskManager.Task::(_decref) Task=`acfb0b3d-ae01-4785-bf5b-b0173a3a5b34`::ref 0 aborting False
>Thread-2258::DEBUG::2014-04-10 17:25:20,333::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2258::DEBUG::2014-04-10 17:25:20,334::task::579::TaskManager.Task::(_updateState) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::moving from state init -> state preparing
>Thread-2258::INFO::2014-04-10 17:25:20,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2258::DEBUG::2014-04-10 17:25:20,334::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5c90bd9c-86b8-4360-867f-2ecf3855105a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2258::DEBUG::2014-04-10 17:25:20,335::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2258::DEBUG::2014-04-10 17:25:20,335::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2258::DEBUG::2014-04-10 17:25:20,335::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5c90bd9c-86b8-4360-867f-2ecf3855105a`::Granted request
>Thread-2258::DEBUG::2014-04-10 17:25:20,335::task::811::TaskManager.Task::(resourceAcquired) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2258::DEBUG::2014-04-10 17:25:20,335::task::974::TaskManager.Task::(_decref) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::ref 1 aborting False
>Thread-2258::INFO::2014-04-10 17:25:20,338::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2258::DEBUG::2014-04-10 17:25:20,338::task::1168::TaskManager.Task::(prepare) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2258::DEBUG::2014-04-10 17:25:20,338::task::579::TaskManager.Task::(_updateState) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::moving from state preparing -> state finished
>Thread-2258::DEBUG::2014-04-10 17:25:20,338::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2258::DEBUG::2014-04-10 17:25:20,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2258::DEBUG::2014-04-10 17:25:20,338::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2258::DEBUG::2014-04-10 17:25:20,339::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2258::DEBUG::2014-04-10 17:25:20,339::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2258::DEBUG::2014-04-10 17:25:20,339::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2258::DEBUG::2014-04-10 17:25:20,339::task::974::TaskManager.Task::(_decref) Task=`9cbe8953-84e5-495f-bcec-f146a2cde1b4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:23,005::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:23,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306108 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:23,037::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:23,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297967 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:24,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:24,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000443687 s, 829 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:24,147::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:24,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000436007 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2260::DEBUG::2014-04-10 17:25:26,227::task::579::TaskManager.Task::(_updateState) Task=`1f4a92d3-ae5a-48fe-b4a0-fa7405ebe564`::moving from state init -> state preparing
>Thread-2260::INFO::2014-04-10 17:25:26,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2260::INFO::2014-04-10 17:25:26,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436007', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306108', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297967', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443687', 'lastCheck': '2.1', 'valid': True}}
>Thread-2260::DEBUG::2014-04-10 17:25:26,228::task::1168::TaskManager.Task::(prepare) Task=`1f4a92d3-ae5a-48fe-b4a0-fa7405ebe564`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436007', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306108', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297967', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443687', 'lastCheck': '2.1', 'valid': True}}
>Thread-2260::DEBUG::2014-04-10 17:25:26,228::task::579::TaskManager.Task::(_updateState) Task=`1f4a92d3-ae5a-48fe-b4a0-fa7405ebe564`::moving from state preparing -> state finished
>Thread-2260::DEBUG::2014-04-10 17:25:26,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2260::DEBUG::2014-04-10 17:25:26,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2260::DEBUG::2014-04-10 17:25:26,229::task::974::TaskManager.Task::(_decref) Task=`1f4a92d3-ae5a-48fe-b4a0-fa7405ebe564`::ref 0 aborting False
>Thread-2263::DEBUG::2014-04-10 17:25:30,414::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2263::DEBUG::2014-04-10 17:25:30,415::task::579::TaskManager.Task::(_updateState) Task=`aea0e8d6-3cfc-4035-870c-bd511c20a5bc`::moving from state init -> state preparing
>Thread-2263::INFO::2014-04-10 17:25:30,415::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2263::INFO::2014-04-10 17:25:30,416::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2263::DEBUG::2014-04-10 17:25:30,416::task::1168::TaskManager.Task::(prepare) Task=`aea0e8d6-3cfc-4035-870c-bd511c20a5bc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2263::DEBUG::2014-04-10 17:25:30,416::task::579::TaskManager.Task::(_updateState) Task=`aea0e8d6-3cfc-4035-870c-bd511c20a5bc`::moving from state preparing -> state finished
>Thread-2263::DEBUG::2014-04-10 17:25:30,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2263::DEBUG::2014-04-10 17:25:30,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2263::DEBUG::2014-04-10 17:25:30,417::task::974::TaskManager.Task::(_decref) Task=`aea0e8d6-3cfc-4035-870c-bd511c20a5bc`::ref 0 aborting False
>Thread-2264::DEBUG::2014-04-10 17:25:30,424::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2264::DEBUG::2014-04-10 17:25:30,424::task::579::TaskManager.Task::(_updateState) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::moving from state init -> state preparing
>Thread-2264::INFO::2014-04-10 17:25:30,424::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2264::DEBUG::2014-04-10 17:25:30,425::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`90d59d93-9899-49a2-a5a2-9b1bdb6ac92e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2264::DEBUG::2014-04-10 17:25:30,425::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2264::DEBUG::2014-04-10 17:25:30,425::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2264::DEBUG::2014-04-10 17:25:30,426::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`90d59d93-9899-49a2-a5a2-9b1bdb6ac92e`::Granted request
>Thread-2264::DEBUG::2014-04-10 17:25:30,426::task::811::TaskManager.Task::(resourceAcquired) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2264::DEBUG::2014-04-10 17:25:30,426::task::974::TaskManager.Task::(_decref) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::ref 1 aborting False
>Thread-2264::INFO::2014-04-10 17:25:30,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2264::DEBUG::2014-04-10 17:25:30,429::task::1168::TaskManager.Task::(prepare) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2264::DEBUG::2014-04-10 17:25:30,429::task::579::TaskManager.Task::(_updateState) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::moving from state preparing -> state finished
>Thread-2264::DEBUG::2014-04-10 17:25:30,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2264::DEBUG::2014-04-10 17:25:30,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2264::DEBUG::2014-04-10 17:25:30,429::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2264::DEBUG::2014-04-10 17:25:30,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2264::DEBUG::2014-04-10 17:25:30,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2264::DEBUG::2014-04-10 17:25:30,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2264::DEBUG::2014-04-10 17:25:30,430::task::974::TaskManager.Task::(_decref) Task=`21825974-cc5e-4d79-aa70-5993ea267fa4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:33,044::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 17:25:33,048::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:25:33,053::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:25:33,057::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:25:33,057::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:25:33,059::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:25:33,062::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 17:25:33,063::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 17:25:33,064::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:25:33,064::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:25:33,064::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:25:33,065::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:25:33,066::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:25:33,066::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:25:33,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:33,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:33,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025977 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:33,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261986 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:34,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:34,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000520663 s, 707 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:34,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:34,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000528397 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2276::DEBUG::2014-04-10 17:25:40,522::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2276::DEBUG::2014-04-10 17:25:40,522::task::579::TaskManager.Task::(_updateState) Task=`6e34309e-497d-404a-af2d-0e19fc56e0bc`::moving from state init -> state preparing
>Thread-2276::INFO::2014-04-10 17:25:40,523::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2276::INFO::2014-04-10 17:25:40,523::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2276::DEBUG::2014-04-10 17:25:40,523::task::1168::TaskManager.Task::(prepare) Task=`6e34309e-497d-404a-af2d-0e19fc56e0bc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2276::DEBUG::2014-04-10 17:25:40,523::task::579::TaskManager.Task::(_updateState) Task=`6e34309e-497d-404a-af2d-0e19fc56e0bc`::moving from state preparing -> state finished
>Thread-2276::DEBUG::2014-04-10 17:25:40,523::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2276::DEBUG::2014-04-10 17:25:40,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2276::DEBUG::2014-04-10 17:25:40,524::task::974::TaskManager.Task::(_decref) Task=`6e34309e-497d-404a-af2d-0e19fc56e0bc`::ref 0 aborting False
>Thread-2277::DEBUG::2014-04-10 17:25:40,531::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2277::DEBUG::2014-04-10 17:25:40,532::task::579::TaskManager.Task::(_updateState) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::moving from state init -> state preparing
>Thread-2277::INFO::2014-04-10 17:25:40,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2277::DEBUG::2014-04-10 17:25:40,532::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33f3449d-6e79-40cc-9053-767cb6cf274a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2277::DEBUG::2014-04-10 17:25:40,533::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2277::DEBUG::2014-04-10 17:25:40,533::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2277::DEBUG::2014-04-10 17:25:40,533::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33f3449d-6e79-40cc-9053-767cb6cf274a`::Granted request
>Thread-2277::DEBUG::2014-04-10 17:25:40,534::task::811::TaskManager.Task::(resourceAcquired) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2277::DEBUG::2014-04-10 17:25:40,535::task::974::TaskManager.Task::(_decref) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::ref 1 aborting False
>Thread-2277::INFO::2014-04-10 17:25:40,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2277::DEBUG::2014-04-10 17:25:40,537::task::1168::TaskManager.Task::(prepare) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2277::DEBUG::2014-04-10 17:25:40,537::task::579::TaskManager.Task::(_updateState) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::moving from state preparing -> state finished
>Thread-2277::DEBUG::2014-04-10 17:25:40,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2277::DEBUG::2014-04-10 17:25:40,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2277::DEBUG::2014-04-10 17:25:40,538::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2277::DEBUG::2014-04-10 17:25:40,538::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2277::DEBUG::2014-04-10 17:25:40,538::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2277::DEBUG::2014-04-10 17:25:40,538::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2277::DEBUG::2014-04-10 17:25:40,539::task::974::TaskManager.Task::(_decref) Task=`0d044ebe-bc38-4c8f-b381-0bc41b974325`::ref 0 aborting False
>Thread-2278::DEBUG::2014-04-10 17:25:41,404::task::579::TaskManager.Task::(_updateState) Task=`b536adfc-a3b2-4849-af30-965ee3debf24`::moving from state init -> state preparing
>Thread-2278::INFO::2014-04-10 17:25:41,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2278::INFO::2014-04-10 17:25:41,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528397', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025977', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261986', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520663', 'lastCheck': '7.3', 'valid': True}}
>Thread-2278::DEBUG::2014-04-10 17:25:41,405::task::1168::TaskManager.Task::(prepare) Task=`b536adfc-a3b2-4849-af30-965ee3debf24`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528397', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025977', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261986', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520663', 'lastCheck': '7.3', 'valid': True}}
>Thread-2278::DEBUG::2014-04-10 17:25:41,405::task::579::TaskManager.Task::(_updateState) Task=`b536adfc-a3b2-4849-af30-965ee3debf24`::moving from state preparing -> state finished
>Thread-2278::DEBUG::2014-04-10 17:25:41,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2278::DEBUG::2014-04-10 17:25:41,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2278::DEBUG::2014-04-10 17:25:41,405::task::974::TaskManager.Task::(_decref) Task=`b536adfc-a3b2-4849-af30-965ee3debf24`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:43,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:43,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:43,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323432 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:43,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032435 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:44,127::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:44,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000583713 s, 630 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:44,177::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:44,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000511374 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2283::DEBUG::2014-04-10 17:25:50,628::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2283::DEBUG::2014-04-10 17:25:50,629::task::579::TaskManager.Task::(_updateState) Task=`2ddaf98a-ce86-4005-b9d5-8e99266297c3`::moving from state init -> state preparing
>Thread-2283::INFO::2014-04-10 17:25:50,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2283::INFO::2014-04-10 17:25:50,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2283::DEBUG::2014-04-10 17:25:50,629::task::1168::TaskManager.Task::(prepare) Task=`2ddaf98a-ce86-4005-b9d5-8e99266297c3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2283::DEBUG::2014-04-10 17:25:50,630::task::579::TaskManager.Task::(_updateState) Task=`2ddaf98a-ce86-4005-b9d5-8e99266297c3`::moving from state preparing -> state finished
>Thread-2283::DEBUG::2014-04-10 17:25:50,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2283::DEBUG::2014-04-10 17:25:50,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2283::DEBUG::2014-04-10 17:25:50,630::task::974::TaskManager.Task::(_decref) Task=`2ddaf98a-ce86-4005-b9d5-8e99266297c3`::ref 0 aborting False
>Thread-2284::DEBUG::2014-04-10 17:25:50,637::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2284::DEBUG::2014-04-10 17:25:50,638::task::579::TaskManager.Task::(_updateState) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::moving from state init -> state preparing
>Thread-2284::INFO::2014-04-10 17:25:50,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2284::DEBUG::2014-04-10 17:25:50,638::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ceac39dc-f3d6-42f3-8515-7f4f88262d1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2284::DEBUG::2014-04-10 17:25:50,639::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2284::DEBUG::2014-04-10 17:25:50,639::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2284::DEBUG::2014-04-10 17:25:50,639::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ceac39dc-f3d6-42f3-8515-7f4f88262d1f`::Granted request
>Thread-2284::DEBUG::2014-04-10 17:25:50,639::task::811::TaskManager.Task::(resourceAcquired) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2284::DEBUG::2014-04-10 17:25:50,640::task::974::TaskManager.Task::(_decref) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::ref 1 aborting False
>Thread-2284::INFO::2014-04-10 17:25:50,642::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2284::DEBUG::2014-04-10 17:25:50,642::task::1168::TaskManager.Task::(prepare) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2284::DEBUG::2014-04-10 17:25:50,642::task::579::TaskManager.Task::(_updateState) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::moving from state preparing -> state finished
>Thread-2284::DEBUG::2014-04-10 17:25:50,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2284::DEBUG::2014-04-10 17:25:50,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2284::DEBUG::2014-04-10 17:25:50,643::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2284::DEBUG::2014-04-10 17:25:50,643::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2284::DEBUG::2014-04-10 17:25:50,643::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2284::DEBUG::2014-04-10 17:25:50,643::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2284::DEBUG::2014-04-10 17:25:50,644::task::974::TaskManager.Task::(_decref) Task=`89d6a58a-0706-4512-9c38-dc1634d7d931`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:25:53,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:25:53,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00023916 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:25:53,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:25:53,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290199 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:25:54,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:25:54,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000526462 s, 699 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:25:54,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:25:54,198::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460921 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2286::DEBUG::2014-04-10 17:25:56,558::task::579::TaskManager.Task::(_updateState) Task=`b4bb67be-6967-44a9-a354-d7b7f5e9fc59`::moving from state init -> state preparing
>Thread-2286::INFO::2014-04-10 17:25:56,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2286::INFO::2014-04-10 17:25:56,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460921', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023916', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290199', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526462', 'lastCheck': '2.4', 'valid': True}}
>Thread-2286::DEBUG::2014-04-10 17:25:56,559::task::1168::TaskManager.Task::(prepare) Task=`b4bb67be-6967-44a9-a354-d7b7f5e9fc59`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460921', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023916', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290199', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526462', 'lastCheck': '2.4', 'valid': True}}
>Thread-2286::DEBUG::2014-04-10 17:25:56,559::task::579::TaskManager.Task::(_updateState) Task=`b4bb67be-6967-44a9-a354-d7b7f5e9fc59`::moving from state preparing -> state finished
>Thread-2286::DEBUG::2014-04-10 17:25:56,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2286::DEBUG::2014-04-10 17:25:56,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2286::DEBUG::2014-04-10 17:25:56,559::task::974::TaskManager.Task::(_decref) Task=`b4bb67be-6967-44a9-a354-d7b7f5e9fc59`::ref 0 aborting False
>Thread-2289::DEBUG::2014-04-10 17:26:00,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2289::DEBUG::2014-04-10 17:26:00,721::task::579::TaskManager.Task::(_updateState) Task=`be6c07d8-2a9f-4417-8c33-8d82bf4784dc`::moving from state init -> state preparing
>Thread-2289::INFO::2014-04-10 17:26:00,721::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2289::INFO::2014-04-10 17:26:00,721::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2289::DEBUG::2014-04-10 17:26:00,721::task::1168::TaskManager.Task::(prepare) Task=`be6c07d8-2a9f-4417-8c33-8d82bf4784dc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2289::DEBUG::2014-04-10 17:26:00,722::task::579::TaskManager.Task::(_updateState) Task=`be6c07d8-2a9f-4417-8c33-8d82bf4784dc`::moving from state preparing -> state finished
>Thread-2289::DEBUG::2014-04-10 17:26:00,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2289::DEBUG::2014-04-10 17:26:00,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2289::DEBUG::2014-04-10 17:26:00,722::task::974::TaskManager.Task::(_decref) Task=`be6c07d8-2a9f-4417-8c33-8d82bf4784dc`::ref 0 aborting False
>Thread-2290::DEBUG::2014-04-10 17:26:00,729::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2290::DEBUG::2014-04-10 17:26:00,729::task::579::TaskManager.Task::(_updateState) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::moving from state init -> state preparing
>Thread-2290::INFO::2014-04-10 17:26:00,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2290::DEBUG::2014-04-10 17:26:00,730::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4e62bafd-a067-46ff-a629-70870935b824`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2290::DEBUG::2014-04-10 17:26:00,730::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2290::DEBUG::2014-04-10 17:26:00,731::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2290::DEBUG::2014-04-10 17:26:00,731::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4e62bafd-a067-46ff-a629-70870935b824`::Granted request
>Thread-2290::DEBUG::2014-04-10 17:26:00,731::task::811::TaskManager.Task::(resourceAcquired) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2290::DEBUG::2014-04-10 17:26:00,731::task::974::TaskManager.Task::(_decref) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::ref 1 aborting False
>Thread-2290::INFO::2014-04-10 17:26:00,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2290::DEBUG::2014-04-10 17:26:00,734::task::1168::TaskManager.Task::(prepare) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2290::DEBUG::2014-04-10 17:26:00,734::task::579::TaskManager.Task::(_updateState) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::moving from state preparing -> state finished
>Thread-2290::DEBUG::2014-04-10 17:26:00,734::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2290::DEBUG::2014-04-10 17:26:00,734::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2290::DEBUG::2014-04-10 17:26:00,735::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2290::DEBUG::2014-04-10 17:26:00,735::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2290::DEBUG::2014-04-10 17:26:00,735::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2290::DEBUG::2014-04-10 17:26:00,735::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2290::DEBUG::2014-04-10 17:26:00,735::task::974::TaskManager.Task::(_decref) Task=`45c0dc71-8434-4724-a716-979cab2b2f50`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:03,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:03,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000416361 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:03,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:03,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280276 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:04,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:04,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000450989 s, 816 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:04,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:04,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000565918 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2294::DEBUG::2014-04-10 17:26:10,844::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2294::DEBUG::2014-04-10 17:26:10,845::task::579::TaskManager.Task::(_updateState) Task=`ccde72ad-12f4-4578-8ca7-24d4ffdae05c`::moving from state init -> state preparing
>Thread-2294::INFO::2014-04-10 17:26:10,845::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2294::INFO::2014-04-10 17:26:10,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2294::DEBUG::2014-04-10 17:26:10,845::task::1168::TaskManager.Task::(prepare) Task=`ccde72ad-12f4-4578-8ca7-24d4ffdae05c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2294::DEBUG::2014-04-10 17:26:10,846::task::579::TaskManager.Task::(_updateState) Task=`ccde72ad-12f4-4578-8ca7-24d4ffdae05c`::moving from state preparing -> state finished
>Thread-2294::DEBUG::2014-04-10 17:26:10,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2294::DEBUG::2014-04-10 17:26:10,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2294::DEBUG::2014-04-10 17:26:10,846::task::974::TaskManager.Task::(_decref) Task=`ccde72ad-12f4-4578-8ca7-24d4ffdae05c`::ref 0 aborting False
>Thread-2295::DEBUG::2014-04-10 17:26:10,853::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2295::DEBUG::2014-04-10 17:26:10,854::task::579::TaskManager.Task::(_updateState) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::moving from state init -> state preparing
>Thread-2295::INFO::2014-04-10 17:26:10,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2295::DEBUG::2014-04-10 17:26:10,855::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59e32ffb-ea1c-4e88-a82c-3e8daa3bad26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2295::DEBUG::2014-04-10 17:26:10,855::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2295::DEBUG::2014-04-10 17:26:10,855::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2295::DEBUG::2014-04-10 17:26:10,855::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59e32ffb-ea1c-4e88-a82c-3e8daa3bad26`::Granted request
>Thread-2295::DEBUG::2014-04-10 17:26:10,856::task::811::TaskManager.Task::(resourceAcquired) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2295::DEBUG::2014-04-10 17:26:10,856::task::974::TaskManager.Task::(_decref) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::ref 1 aborting False
>Thread-2295::INFO::2014-04-10 17:26:10,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2295::DEBUG::2014-04-10 17:26:10,858::task::1168::TaskManager.Task::(prepare) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::task::579::TaskManager.Task::(_updateState) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::moving from state preparing -> state finished
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2295::DEBUG::2014-04-10 17:26:10,859::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2295::DEBUG::2014-04-10 17:26:10,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2295::DEBUG::2014-04-10 17:26:10,860::task::974::TaskManager.Task::(_decref) Task=`28896cb6-b649-48f2-b3dd-5b43c3a5eda0`::ref 0 aborting False
>Thread-2296::DEBUG::2014-04-10 17:26:12,281::task::579::TaskManager.Task::(_updateState) Task=`1d967bed-f16c-4e18-883e-3cc9add9b838`::moving from state init -> state preparing
>Thread-2296::INFO::2014-04-10 17:26:12,281::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2296::INFO::2014-04-10 17:26:12,281::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565918', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416361', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280276', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450989', 'lastCheck': '8.1', 'valid': True}}
>Thread-2296::DEBUG::2014-04-10 17:26:12,281::task::1168::TaskManager.Task::(prepare) Task=`1d967bed-f16c-4e18-883e-3cc9add9b838`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565918', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416361', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280276', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450989', 'lastCheck': '8.1', 'valid': True}}
>Thread-2296::DEBUG::2014-04-10 17:26:12,281::task::579::TaskManager.Task::(_updateState) Task=`1d967bed-f16c-4e18-883e-3cc9add9b838`::moving from state preparing -> state finished
>Thread-2296::DEBUG::2014-04-10 17:26:12,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2296::DEBUG::2014-04-10 17:26:12,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2296::DEBUG::2014-04-10 17:26:12,282::task::974::TaskManager.Task::(_decref) Task=`1d967bed-f16c-4e18-883e-3cc9add9b838`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:13,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:13,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281483 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:13,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:13,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025707 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:14,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:14,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000518449 s, 710 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:14,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:14,228::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000519024 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2300::DEBUG::2014-04-10 17:26:20,949::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2300::DEBUG::2014-04-10 17:26:20,949::task::579::TaskManager.Task::(_updateState) Task=`dcfe997c-e511-4abd-b08a-fb68e99c3813`::moving from state init -> state preparing
>Thread-2300::INFO::2014-04-10 17:26:20,950::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2300::INFO::2014-04-10 17:26:20,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2300::DEBUG::2014-04-10 17:26:20,950::task::1168::TaskManager.Task::(prepare) Task=`dcfe997c-e511-4abd-b08a-fb68e99c3813`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2300::DEBUG::2014-04-10 17:26:20,950::task::579::TaskManager.Task::(_updateState) Task=`dcfe997c-e511-4abd-b08a-fb68e99c3813`::moving from state preparing -> state finished
>Thread-2300::DEBUG::2014-04-10 17:26:20,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2300::DEBUG::2014-04-10 17:26:20,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2300::DEBUG::2014-04-10 17:26:20,951::task::974::TaskManager.Task::(_decref) Task=`dcfe997c-e511-4abd-b08a-fb68e99c3813`::ref 0 aborting False
>Thread-2301::DEBUG::2014-04-10 17:26:20,958::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2301::DEBUG::2014-04-10 17:26:20,958::task::579::TaskManager.Task::(_updateState) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::moving from state init -> state preparing
>Thread-2301::INFO::2014-04-10 17:26:20,959::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2301::DEBUG::2014-04-10 17:26:20,959::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4687444c-d448-42cf-b2cc-e08c73ce3203`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2301::DEBUG::2014-04-10 17:26:20,959::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2301::DEBUG::2014-04-10 17:26:20,960::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2301::DEBUG::2014-04-10 17:26:20,960::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4687444c-d448-42cf-b2cc-e08c73ce3203`::Granted request
>Thread-2301::DEBUG::2014-04-10 17:26:20,961::task::811::TaskManager.Task::(resourceAcquired) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2301::DEBUG::2014-04-10 17:26:20,961::task::974::TaskManager.Task::(_decref) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::ref 1 aborting False
>Thread-2301::INFO::2014-04-10 17:26:20,964::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2301::DEBUG::2014-04-10 17:26:20,964::task::1168::TaskManager.Task::(prepare) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2301::DEBUG::2014-04-10 17:26:20,964::task::579::TaskManager.Task::(_updateState) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::moving from state preparing -> state finished
>Thread-2301::DEBUG::2014-04-10 17:26:20,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2301::DEBUG::2014-04-10 17:26:20,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2301::DEBUG::2014-04-10 17:26:20,965::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2301::DEBUG::2014-04-10 17:26:20,965::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2301::DEBUG::2014-04-10 17:26:20,965::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2301::DEBUG::2014-04-10 17:26:20,965::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2301::DEBUG::2014-04-10 17:26:20,965::task::974::TaskManager.Task::(_decref) Task=`3b28c9b5-f8cf-49ae-98c6-d7d39765fdfc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:23,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:23,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305392 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:23,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:23,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270189 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:24,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:24,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000494627 s, 744 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:24,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:24,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000432549 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2304::DEBUG::2014-04-10 17:26:27,443::task::579::TaskManager.Task::(_updateState) Task=`5e1e437a-1cc6-4242-866f-9c9194468065`::moving from state init -> state preparing
>Thread-2304::INFO::2014-04-10 17:26:27,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2304::INFO::2014-04-10 17:26:27,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432549', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305392', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270189', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494627', 'lastCheck': '3.2', 'valid': True}}
>Thread-2304::DEBUG::2014-04-10 17:26:27,444::task::1168::TaskManager.Task::(prepare) Task=`5e1e437a-1cc6-4242-866f-9c9194468065`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432549', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000305392', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270189', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494627', 'lastCheck': '3.2', 'valid': True}}
>Thread-2304::DEBUG::2014-04-10 17:26:27,444::task::579::TaskManager.Task::(_updateState) Task=`5e1e437a-1cc6-4242-866f-9c9194468065`::moving from state preparing -> state finished
>Thread-2304::DEBUG::2014-04-10 17:26:27,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2304::DEBUG::2014-04-10 17:26:27,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2304::DEBUG::2014-04-10 17:26:27,445::task::974::TaskManager.Task::(_decref) Task=`5e1e437a-1cc6-4242-866f-9c9194468065`::ref 0 aborting False
>Thread-2307::DEBUG::2014-04-10 17:26:31,475::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2307::DEBUG::2014-04-10 17:26:31,476::task::579::TaskManager.Task::(_updateState) Task=`4db95d16-d951-48f5-86dd-3da7375a55a8`::moving from state init -> state preparing
>Thread-2307::INFO::2014-04-10 17:26:31,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2307::INFO::2014-04-10 17:26:31,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2307::DEBUG::2014-04-10 17:26:31,477::task::1168::TaskManager.Task::(prepare) Task=`4db95d16-d951-48f5-86dd-3da7375a55a8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2307::DEBUG::2014-04-10 17:26:31,477::task::579::TaskManager.Task::(_updateState) Task=`4db95d16-d951-48f5-86dd-3da7375a55a8`::moving from state preparing -> state finished
>Thread-2307::DEBUG::2014-04-10 17:26:31,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2307::DEBUG::2014-04-10 17:26:31,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2307::DEBUG::2014-04-10 17:26:31,477::task::974::TaskManager.Task::(_decref) Task=`4db95d16-d951-48f5-86dd-3da7375a55a8`::ref 0 aborting False
>Thread-2308::DEBUG::2014-04-10 17:26:31,484::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2308::DEBUG::2014-04-10 17:26:31,485::task::579::TaskManager.Task::(_updateState) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::moving from state init -> state preparing
>Thread-2308::INFO::2014-04-10 17:26:31,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2308::DEBUG::2014-04-10 17:26:31,485::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7fb3d44a-e5dc-4167-b35e-50fcd97d6e7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2308::DEBUG::2014-04-10 17:26:31,485::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2308::DEBUG::2014-04-10 17:26:31,486::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2308::DEBUG::2014-04-10 17:26:31,486::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7fb3d44a-e5dc-4167-b35e-50fcd97d6e7c`::Granted request
>Thread-2308::DEBUG::2014-04-10 17:26:31,486::task::811::TaskManager.Task::(resourceAcquired) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2308::DEBUG::2014-04-10 17:26:31,486::task::974::TaskManager.Task::(_decref) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::ref 1 aborting False
>Thread-2308::INFO::2014-04-10 17:26:31,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2308::DEBUG::2014-04-10 17:26:31,488::task::1168::TaskManager.Task::(prepare) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2308::DEBUG::2014-04-10 17:26:31,489::task::579::TaskManager.Task::(_updateState) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::moving from state preparing -> state finished
>Thread-2308::DEBUG::2014-04-10 17:26:31,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2308::DEBUG::2014-04-10 17:26:31,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2308::DEBUG::2014-04-10 17:26:31,489::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2308::DEBUG::2014-04-10 17:26:31,489::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2308::DEBUG::2014-04-10 17:26:31,490::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2308::DEBUG::2014-04-10 17:26:31,490::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2308::DEBUG::2014-04-10 17:26:31,490::task::974::TaskManager.Task::(_decref) Task=`8b4b28c3-aaf3-4331-8603-8eef9ad9b478`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:33,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:33,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386823 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:33,374::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:33,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273692 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:34,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:34,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466181 s, 789 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:34,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:34,257::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459562 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2312::DEBUG::2014-04-10 17:26:41,604::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2312::DEBUG::2014-04-10 17:26:41,605::task::579::TaskManager.Task::(_updateState) Task=`df41854a-7558-41d9-8045-9e6e0a088119`::moving from state init -> state preparing
>Thread-2312::INFO::2014-04-10 17:26:41,605::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2312::INFO::2014-04-10 17:26:41,606::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2312::DEBUG::2014-04-10 17:26:41,606::task::1168::TaskManager.Task::(prepare) Task=`df41854a-7558-41d9-8045-9e6e0a088119`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2312::DEBUG::2014-04-10 17:26:41,606::task::579::TaskManager.Task::(_updateState) Task=`df41854a-7558-41d9-8045-9e6e0a088119`::moving from state preparing -> state finished
>Thread-2312::DEBUG::2014-04-10 17:26:41,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2312::DEBUG::2014-04-10 17:26:41,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2312::DEBUG::2014-04-10 17:26:41,607::task::974::TaskManager.Task::(_decref) Task=`df41854a-7558-41d9-8045-9e6e0a088119`::ref 0 aborting False
>Thread-2313::DEBUG::2014-04-10 17:26:41,613::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2313::DEBUG::2014-04-10 17:26:41,614::task::579::TaskManager.Task::(_updateState) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::moving from state init -> state preparing
>Thread-2313::INFO::2014-04-10 17:26:41,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2313::DEBUG::2014-04-10 17:26:41,615::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9c20099-3302-4df0-bf3c-a5037b754296`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2313::DEBUG::2014-04-10 17:26:41,615::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2313::DEBUG::2014-04-10 17:26:41,615::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2313::DEBUG::2014-04-10 17:26:41,615::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9c20099-3302-4df0-bf3c-a5037b754296`::Granted request
>Thread-2313::DEBUG::2014-04-10 17:26:41,616::task::811::TaskManager.Task::(resourceAcquired) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2313::DEBUG::2014-04-10 17:26:41,616::task::974::TaskManager.Task::(_decref) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::ref 1 aborting False
>Thread-2313::INFO::2014-04-10 17:26:41,618::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2313::DEBUG::2014-04-10 17:26:41,618::task::1168::TaskManager.Task::(prepare) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2313::DEBUG::2014-04-10 17:26:41,618::task::579::TaskManager.Task::(_updateState) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::moving from state preparing -> state finished
>Thread-2313::DEBUG::2014-04-10 17:26:41,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2313::DEBUG::2014-04-10 17:26:41,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2313::DEBUG::2014-04-10 17:26:41,619::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2313::DEBUG::2014-04-10 17:26:41,619::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2313::DEBUG::2014-04-10 17:26:41,619::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2313::DEBUG::2014-04-10 17:26:41,620::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2313::DEBUG::2014-04-10 17:26:41,620::task::974::TaskManager.Task::(_decref) Task=`b39da879-bf38-4ede-823f-1eb4da5865f8`::ref 0 aborting False
>Thread-2314::DEBUG::2014-04-10 17:26:42,725::task::579::TaskManager.Task::(_updateState) Task=`ebc370a3-a702-4e34-a15e-55cf7359caa2`::moving from state init -> state preparing
>Thread-2314::INFO::2014-04-10 17:26:42,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2314::INFO::2014-04-10 17:26:42,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459562', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386823', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273692', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466181', 'lastCheck': '8.5', 'valid': True}}
>Thread-2314::DEBUG::2014-04-10 17:26:42,725::task::1168::TaskManager.Task::(prepare) Task=`ebc370a3-a702-4e34-a15e-55cf7359caa2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459562', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386823', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273692', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466181', 'lastCheck': '8.5', 'valid': True}}
>Thread-2314::DEBUG::2014-04-10 17:26:42,726::task::579::TaskManager.Task::(_updateState) Task=`ebc370a3-a702-4e34-a15e-55cf7359caa2`::moving from state preparing -> state finished
>Thread-2314::DEBUG::2014-04-10 17:26:42,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2314::DEBUG::2014-04-10 17:26:42,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2314::DEBUG::2014-04-10 17:26:42,726::task::974::TaskManager.Task::(_decref) Task=`ebc370a3-a702-4e34-a15e-55cf7359caa2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:43,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:43,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387965 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:43,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:43,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340919 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:44,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:44,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000513903 s, 716 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:44,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:44,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000447119 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2318::DEBUG::2014-04-10 17:26:51,702::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2318::DEBUG::2014-04-10 17:26:51,703::task::579::TaskManager.Task::(_updateState) Task=`f6fe28c0-f7a2-43d3-88b7-3a12c98b445f`::moving from state init -> state preparing
>Thread-2318::INFO::2014-04-10 17:26:51,703::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2318::INFO::2014-04-10 17:26:51,703::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2318::DEBUG::2014-04-10 17:26:51,704::task::1168::TaskManager.Task::(prepare) Task=`f6fe28c0-f7a2-43d3-88b7-3a12c98b445f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2318::DEBUG::2014-04-10 17:26:51,704::task::579::TaskManager.Task::(_updateState) Task=`f6fe28c0-f7a2-43d3-88b7-3a12c98b445f`::moving from state preparing -> state finished
>Thread-2318::DEBUG::2014-04-10 17:26:51,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2318::DEBUG::2014-04-10 17:26:51,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2318::DEBUG::2014-04-10 17:26:51,704::task::974::TaskManager.Task::(_decref) Task=`f6fe28c0-f7a2-43d3-88b7-3a12c98b445f`::ref 0 aborting False
>Thread-2319::DEBUG::2014-04-10 17:26:51,711::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2319::DEBUG::2014-04-10 17:26:51,712::task::579::TaskManager.Task::(_updateState) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::moving from state init -> state preparing
>Thread-2319::INFO::2014-04-10 17:26:51,712::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2319::DEBUG::2014-04-10 17:26:51,712::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc619a5f-1b17-4e4b-93ca-051102f5a9a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2319::DEBUG::2014-04-10 17:26:51,712::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2319::DEBUG::2014-04-10 17:26:51,713::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2319::DEBUG::2014-04-10 17:26:51,713::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc619a5f-1b17-4e4b-93ca-051102f5a9a1`::Granted request
>Thread-2319::DEBUG::2014-04-10 17:26:51,713::task::811::TaskManager.Task::(resourceAcquired) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2319::DEBUG::2014-04-10 17:26:51,713::task::974::TaskManager.Task::(_decref) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::ref 1 aborting False
>Thread-2319::INFO::2014-04-10 17:26:51,716::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2319::DEBUG::2014-04-10 17:26:51,716::task::1168::TaskManager.Task::(prepare) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2319::DEBUG::2014-04-10 17:26:51,716::task::579::TaskManager.Task::(_updateState) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::moving from state preparing -> state finished
>Thread-2319::DEBUG::2014-04-10 17:26:51,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2319::DEBUG::2014-04-10 17:26:51,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2319::DEBUG::2014-04-10 17:26:51,717::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2319::DEBUG::2014-04-10 17:26:51,717::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2319::DEBUG::2014-04-10 17:26:51,717::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2319::DEBUG::2014-04-10 17:26:51,717::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2319::DEBUG::2014-04-10 17:26:51,717::task::974::TaskManager.Task::(_decref) Task=`b401b951-2801-4a17-b1ba-f7ccb6e9d60d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:26:53,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:26:53,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372976 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:26:53,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:26:53,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355572 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:26:54,223::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:26:54,240::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:26:54,242::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:26:54,247::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:26:54,248::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:26:54,249::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:26:54,249::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:26:54,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:26:54,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000401517 s, 917 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:26:54,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:26:54,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000339655 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2326::DEBUG::2014-04-10 17:26:58,090::task::579::TaskManager.Task::(_updateState) Task=`34fb6507-1bb5-4400-bc56-c932f50462fd`::moving from state init -> state preparing
>Thread-2326::INFO::2014-04-10 17:26:58,091::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2326::INFO::2014-04-10 17:26:58,091::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339655', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372976', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355572', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401517', 'lastCheck': '3.8', 'valid': True}}
>Thread-2326::DEBUG::2014-04-10 17:26:58,091::task::1168::TaskManager.Task::(prepare) Task=`34fb6507-1bb5-4400-bc56-c932f50462fd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339655', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372976', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355572', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401517', 'lastCheck': '3.8', 'valid': True}}
>Thread-2326::DEBUG::2014-04-10 17:26:58,092::task::579::TaskManager.Task::(_updateState) Task=`34fb6507-1bb5-4400-bc56-c932f50462fd`::moving from state preparing -> state finished
>Thread-2326::DEBUG::2014-04-10 17:26:58,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2326::DEBUG::2014-04-10 17:26:58,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2326::DEBUG::2014-04-10 17:26:58,092::task::974::TaskManager.Task::(_decref) Task=`34fb6507-1bb5-4400-bc56-c932f50462fd`::ref 0 aborting False
>Thread-2329::DEBUG::2014-04-10 17:27:01,803::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-2329::DEBUG::2014-04-10 17:27:01,803::task::579::TaskManager.Task::(_updateState) Task=`43e784dc-4a27-4354-bf25-2609268f1bb0`::moving from state init -> state preparing
>Thread-2329::INFO::2014-04-10 17:27:01,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2329::INFO::2014-04-10 17:27:01,804::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2329::DEBUG::2014-04-10 17:27:01,804::task::1168::TaskManager.Task::(prepare) Task=`43e784dc-4a27-4354-bf25-2609268f1bb0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2329::DEBUG::2014-04-10 17:27:01,804::task::579::TaskManager.Task::(_updateState) Task=`43e784dc-4a27-4354-bf25-2609268f1bb0`::moving from state preparing -> state finished
>Thread-2329::DEBUG::2014-04-10 17:27:01,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2329::DEBUG::2014-04-10 17:27:01,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2329::DEBUG::2014-04-10 17:27:01,805::task::974::TaskManager.Task::(_decref) Task=`43e784dc-4a27-4354-bf25-2609268f1bb0`::ref 0 aborting False
>Thread-2330::DEBUG::2014-04-10 17:27:01,811::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-2330::DEBUG::2014-04-10 17:27:01,812::task::579::TaskManager.Task::(_updateState) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::moving from state init -> state preparing
>Thread-2330::INFO::2014-04-10 17:27:01,812::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2330::DEBUG::2014-04-10 17:27:01,812::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87c910de-1131-47ad-90a7-914bc7ff6a26`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2330::DEBUG::2014-04-10 17:27:01,813::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2330::DEBUG::2014-04-10 17:27:01,813::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2330::DEBUG::2014-04-10 17:27:01,813::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87c910de-1131-47ad-90a7-914bc7ff6a26`::Granted request
>Thread-2330::DEBUG::2014-04-10 17:27:01,814::task::811::TaskManager.Task::(resourceAcquired) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2330::DEBUG::2014-04-10 17:27:01,814::task::974::TaskManager.Task::(_decref) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::ref 1 aborting False
>Thread-2330::INFO::2014-04-10 17:27:01,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2330::DEBUG::2014-04-10 17:27:01,816::task::1168::TaskManager.Task::(prepare) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2330::DEBUG::2014-04-10 17:27:01,816::task::579::TaskManager.Task::(_updateState) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::moving from state preparing -> state finished
>Thread-2330::DEBUG::2014-04-10 17:27:01,816::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2330::DEBUG::2014-04-10 17:27:01,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2330::DEBUG::2014-04-10 17:27:01,817::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2330::DEBUG::2014-04-10 17:27:01,817::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2330::DEBUG::2014-04-10 17:27:01,817::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2330::DEBUG::2014-04-10 17:27:01,817::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2330::DEBUG::2014-04-10 17:27:01,818::task::974::TaskManager.Task::(_decref) Task=`88ea8a55-a8cd-4213-9f10-b77d4b14a596`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:03,389::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:03,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000439296 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:03,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:03,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034497 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:27:04,268::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:04,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00040817 s, 902 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:04,295::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:04,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000419038 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2334::DEBUG::2014-04-10 17:27:11,988::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-2334::DEBUG::2014-04-10 17:27:11,988::task::579::TaskManager.Task::(_updateState) Task=`a1b2a67e-6061-4aa1-a56e-a75dedc154b7`::moving from state init -> state preparing
>Thread-2334::INFO::2014-04-10 17:27:11,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2334::INFO::2014-04-10 17:27:11,989::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2334::DEBUG::2014-04-10 17:27:11,989::task::1168::TaskManager.Task::(prepare) Task=`a1b2a67e-6061-4aa1-a56e-a75dedc154b7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2334::DEBUG::2014-04-10 17:27:11,989::task::579::TaskManager.Task::(_updateState) Task=`a1b2a67e-6061-4aa1-a56e-a75dedc154b7`::moving from state preparing -> state finished
>Thread-2334::DEBUG::2014-04-10 17:27:11,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2334::DEBUG::2014-04-10 17:27:11,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2334::DEBUG::2014-04-10 17:27:11,990::task::974::TaskManager.Task::(_decref) Task=`a1b2a67e-6061-4aa1-a56e-a75dedc154b7`::ref 0 aborting False
>Thread-2335::DEBUG::2014-04-10 17:27:11,997::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-2335::DEBUG::2014-04-10 17:27:11,997::task::579::TaskManager.Task::(_updateState) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::moving from state init -> state preparing
>Thread-2335::INFO::2014-04-10 17:27:11,997::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2335::DEBUG::2014-04-10 17:27:11,998::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0eddefaa-e50d-4aa0-9eb2-7ecc4cdf662a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2335::DEBUG::2014-04-10 17:27:11,998::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2335::DEBUG::2014-04-10 17:27:11,998::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2335::DEBUG::2014-04-10 17:27:11,999::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0eddefaa-e50d-4aa0-9eb2-7ecc4cdf662a`::Granted request
>Thread-2335::DEBUG::2014-04-10 17:27:11,999::task::811::TaskManager.Task::(resourceAcquired) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2335::DEBUG::2014-04-10 17:27:11,999::task::974::TaskManager.Task::(_decref) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::ref 1 aborting False
>Thread-2335::INFO::2014-04-10 17:27:12,001::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2335::DEBUG::2014-04-10 17:27:12,002::task::1168::TaskManager.Task::(prepare) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2335::DEBUG::2014-04-10 17:27:12,002::task::579::TaskManager.Task::(_updateState) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::moving from state preparing -> state finished
>Thread-2335::DEBUG::2014-04-10 17:27:12,002::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2335::DEBUG::2014-04-10 17:27:12,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2335::DEBUG::2014-04-10 17:27:12,002::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2335::DEBUG::2014-04-10 17:27:12,003::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2335::DEBUG::2014-04-10 17:27:12,003::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2335::DEBUG::2014-04-10 17:27:12,003::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2335::DEBUG::2014-04-10 17:27:12,003::task::974::TaskManager.Task::(_decref) Task=`037a622c-2ff0-425c-82ba-af1abd68b8c5`::ref 0 aborting False
>Thread-2336::DEBUG::2014-04-10 17:27:13,268::task::579::TaskManager.Task::(_updateState) Task=`aeccf66c-f5dd-4af7-8d1f-c16e68d08525`::moving from state init -> state preparing
>Thread-2336::INFO::2014-04-10 17:27:13,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2336::INFO::2014-04-10 17:27:13,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419038', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439296', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034497', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040817', 'lastCheck': '9.0', 'valid': True}}
>Thread-2336::DEBUG::2014-04-10 17:27:13,269::task::1168::TaskManager.Task::(prepare) Task=`aeccf66c-f5dd-4af7-8d1f-c16e68d08525`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419038', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439296', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034497', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040817', 'lastCheck': '9.0', 'valid': True}}
>Thread-2336::DEBUG::2014-04-10 17:27:13,269::task::579::TaskManager.Task::(_updateState) Task=`aeccf66c-f5dd-4af7-8d1f-c16e68d08525`::moving from state preparing -> state finished
>Thread-2336::DEBUG::2014-04-10 17:27:13,269::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2336::DEBUG::2014-04-10 17:27:13,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2336::DEBUG::2014-04-10 17:27:13,270::task::974::TaskManager.Task::(_decref) Task=`aeccf66c-f5dd-4af7-8d1f-c16e68d08525`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:13,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:13,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000430923 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:13,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:13,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380069 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:27:14,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:14,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000460138 s, 800 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:14,310::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:14,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000443254 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2340::DEBUG::2014-04-10 17:27:22,091::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-2340::DEBUG::2014-04-10 17:27:22,092::task::579::TaskManager.Task::(_updateState) Task=`bf496830-362e-46ac-bd3d-11cb4936d96f`::moving from state init -> state preparing
>Thread-2340::INFO::2014-04-10 17:27:22,092::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2340::INFO::2014-04-10 17:27:22,092::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2340::DEBUG::2014-04-10 17:27:22,092::task::1168::TaskManager.Task::(prepare) Task=`bf496830-362e-46ac-bd3d-11cb4936d96f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2340::DEBUG::2014-04-10 17:27:22,093::task::579::TaskManager.Task::(_updateState) Task=`bf496830-362e-46ac-bd3d-11cb4936d96f`::moving from state preparing -> state finished
>Thread-2340::DEBUG::2014-04-10 17:27:22,093::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2340::DEBUG::2014-04-10 17:27:22,093::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2340::DEBUG::2014-04-10 17:27:22,093::task::974::TaskManager.Task::(_decref) Task=`bf496830-362e-46ac-bd3d-11cb4936d96f`::ref 0 aborting False
>Thread-2341::DEBUG::2014-04-10 17:27:22,100::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-2341::DEBUG::2014-04-10 17:27:22,100::task::579::TaskManager.Task::(_updateState) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::moving from state init -> state preparing
>Thread-2341::INFO::2014-04-10 17:27:22,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2341::DEBUG::2014-04-10 17:27:22,100::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73a7f791-201c-4a1f-9108-8b28ecdbbd5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2341::DEBUG::2014-04-10 17:27:22,101::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2341::DEBUG::2014-04-10 17:27:22,101::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2341::DEBUG::2014-04-10 17:27:22,101::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73a7f791-201c-4a1f-9108-8b28ecdbbd5b`::Granted request
>Thread-2341::DEBUG::2014-04-10 17:27:22,101::task::811::TaskManager.Task::(resourceAcquired) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2341::DEBUG::2014-04-10 17:27:22,102::task::974::TaskManager.Task::(_decref) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::ref 1 aborting False
>Thread-2341::INFO::2014-04-10 17:27:22,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2341::DEBUG::2014-04-10 17:27:22,104::task::1168::TaskManager.Task::(prepare) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2341::DEBUG::2014-04-10 17:27:22,104::task::579::TaskManager.Task::(_updateState) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::moving from state preparing -> state finished
>Thread-2341::DEBUG::2014-04-10 17:27:22,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2341::DEBUG::2014-04-10 17:27:22,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2341::DEBUG::2014-04-10 17:27:22,104::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2341::DEBUG::2014-04-10 17:27:22,105::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2341::DEBUG::2014-04-10 17:27:22,105::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2341::DEBUG::2014-04-10 17:27:22,105::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2341::DEBUG::2014-04-10 17:27:22,105::task::974::TaskManager.Task::(_decref) Task=`a2e18c17-609a-4afb-ad3c-b83c0e316f67`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:23,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:23,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381646 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:23,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:23,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346696 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:27:24,299::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:24,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000426715 s, 862 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:24,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:24,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459545 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2344::DEBUG::2014-04-10 17:27:28,451::task::579::TaskManager.Task::(_updateState) Task=`97f94d0d-809e-47e4-a359-e61a4369623f`::moving from state init -> state preparing
>Thread-2344::INFO::2014-04-10 17:27:28,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2344::INFO::2014-04-10 17:27:28,452::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459545', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381646', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346696', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426715', 'lastCheck': '4.1', 'valid': True}}
>Thread-2344::DEBUG::2014-04-10 17:27:28,452::task::1168::TaskManager.Task::(prepare) Task=`97f94d0d-809e-47e4-a359-e61a4369623f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459545', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381646', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346696', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426715', 'lastCheck': '4.1', 'valid': True}}
>Thread-2344::DEBUG::2014-04-10 17:27:28,452::task::579::TaskManager.Task::(_updateState) Task=`97f94d0d-809e-47e4-a359-e61a4369623f`::moving from state preparing -> state finished
>Thread-2344::DEBUG::2014-04-10 17:27:28,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2344::DEBUG::2014-04-10 17:27:28,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2344::DEBUG::2014-04-10 17:27:28,452::task::974::TaskManager.Task::(_decref) Task=`97f94d0d-809e-47e4-a359-e61a4369623f`::ref 0 aborting False
>Thread-2347::DEBUG::2014-04-10 17:27:32,199::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2347::DEBUG::2014-04-10 17:27:32,199::task::579::TaskManager.Task::(_updateState) Task=`36d65335-a8ee-4f51-b747-02dd36c34ee6`::moving from state init -> state preparing
>Thread-2347::INFO::2014-04-10 17:27:32,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2347::INFO::2014-04-10 17:27:32,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2347::DEBUG::2014-04-10 17:27:32,200::task::1168::TaskManager.Task::(prepare) Task=`36d65335-a8ee-4f51-b747-02dd36c34ee6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2347::DEBUG::2014-04-10 17:27:32,200::task::579::TaskManager.Task::(_updateState) Task=`36d65335-a8ee-4f51-b747-02dd36c34ee6`::moving from state preparing -> state finished
>Thread-2347::DEBUG::2014-04-10 17:27:32,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2347::DEBUG::2014-04-10 17:27:32,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2347::DEBUG::2014-04-10 17:27:32,201::task::974::TaskManager.Task::(_decref) Task=`36d65335-a8ee-4f51-b747-02dd36c34ee6`::ref 0 aborting False
>Thread-2348::DEBUG::2014-04-10 17:27:32,208::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2348::DEBUG::2014-04-10 17:27:32,208::task::579::TaskManager.Task::(_updateState) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::moving from state init -> state preparing
>Thread-2348::INFO::2014-04-10 17:27:32,208::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2348::DEBUG::2014-04-10 17:27:32,209::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`400b835a-8c66-40fa-9d35-ed1408646ec9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2348::DEBUG::2014-04-10 17:27:32,209::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2348::DEBUG::2014-04-10 17:27:32,209::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2348::DEBUG::2014-04-10 17:27:32,209::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`400b835a-8c66-40fa-9d35-ed1408646ec9`::Granted request
>Thread-2348::DEBUG::2014-04-10 17:27:32,210::task::811::TaskManager.Task::(resourceAcquired) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2348::DEBUG::2014-04-10 17:27:32,210::task::974::TaskManager.Task::(_decref) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::ref 1 aborting False
>Thread-2348::INFO::2014-04-10 17:27:32,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2348::DEBUG::2014-04-10 17:27:32,212::task::1168::TaskManager.Task::(prepare) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2348::DEBUG::2014-04-10 17:27:32,213::task::579::TaskManager.Task::(_updateState) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::moving from state preparing -> state finished
>Thread-2348::DEBUG::2014-04-10 17:27:32,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2348::DEBUG::2014-04-10 17:27:32,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2348::DEBUG::2014-04-10 17:27:32,213::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2348::DEBUG::2014-04-10 17:27:32,213::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2348::DEBUG::2014-04-10 17:27:32,214::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2348::DEBUG::2014-04-10 17:27:32,214::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2348::DEBUG::2014-04-10 17:27:32,214::task::974::TaskManager.Task::(_decref) Task=`254d5e0e-0111-4f05-9746-117f4189c8e7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:33,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:33,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344466 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:33,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:33,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343376 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:27:34,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:34,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000434936 s, 846 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:34,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:34,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410426 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2352::DEBUG::2014-04-10 17:27:42,305::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2352::DEBUG::2014-04-10 17:27:42,307::task::579::TaskManager.Task::(_updateState) Task=`e0055efe-a33b-4a22-b86b-8989e193c461`::moving from state init -> state preparing
>Thread-2352::INFO::2014-04-10 17:27:42,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2352::INFO::2014-04-10 17:27:42,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2352::DEBUG::2014-04-10 17:27:42,308::task::1168::TaskManager.Task::(prepare) Task=`e0055efe-a33b-4a22-b86b-8989e193c461`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2352::DEBUG::2014-04-10 17:27:42,308::task::579::TaskManager.Task::(_updateState) Task=`e0055efe-a33b-4a22-b86b-8989e193c461`::moving from state preparing -> state finished
>Thread-2352::DEBUG::2014-04-10 17:27:42,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2352::DEBUG::2014-04-10 17:27:42,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2352::DEBUG::2014-04-10 17:27:42,309::task::974::TaskManager.Task::(_decref) Task=`e0055efe-a33b-4a22-b86b-8989e193c461`::ref 0 aborting False
>Thread-2353::DEBUG::2014-04-10 17:27:42,315::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2353::DEBUG::2014-04-10 17:27:42,316::task::579::TaskManager.Task::(_updateState) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::moving from state init -> state preparing
>Thread-2353::INFO::2014-04-10 17:27:42,316::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2353::DEBUG::2014-04-10 17:27:42,317::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`096abea4-9bad-4f58-85c2-5f59a1769eb4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2353::DEBUG::2014-04-10 17:27:42,317::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2353::DEBUG::2014-04-10 17:27:42,317::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2353::DEBUG::2014-04-10 17:27:42,317::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`096abea4-9bad-4f58-85c2-5f59a1769eb4`::Granted request
>Thread-2353::DEBUG::2014-04-10 17:27:42,318::task::811::TaskManager.Task::(resourceAcquired) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2353::DEBUG::2014-04-10 17:27:42,318::task::974::TaskManager.Task::(_decref) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::ref 1 aborting False
>Thread-2353::INFO::2014-04-10 17:27:42,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2353::DEBUG::2014-04-10 17:27:42,320::task::1168::TaskManager.Task::(prepare) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2353::DEBUG::2014-04-10 17:27:42,321::task::579::TaskManager.Task::(_updateState) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::moving from state preparing -> state finished
>Thread-2353::DEBUG::2014-04-10 17:27:42,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2353::DEBUG::2014-04-10 17:27:42,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2353::DEBUG::2014-04-10 17:27:42,321::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2353::DEBUG::2014-04-10 17:27:42,321::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2353::DEBUG::2014-04-10 17:27:42,322::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2353::DEBUG::2014-04-10 17:27:42,322::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2353::DEBUG::2014-04-10 17:27:42,322::task::974::TaskManager.Task::(_decref) Task=`16ad6ead-1e68-468e-8519-b65af7eac93d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:43,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:43,459::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335012 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:43,478::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:43,483::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263377 s, 2.5 MB/s\n'; <rc> = 0
>Thread-2354::DEBUG::2014-04-10 17:27:43,748::task::579::TaskManager.Task::(_updateState) Task=`e90967df-1d87-4175-aa94-0bd5d4665375`::moving from state init -> state preparing
>Thread-2354::INFO::2014-04-10 17:27:43,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2354::INFO::2014-04-10 17:27:43,749::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410426', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335012', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263377', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434936', 'lastCheck': '9.4', 'valid': True}}
>Thread-2354::DEBUG::2014-04-10 17:27:43,749::task::1168::TaskManager.Task::(prepare) Task=`e90967df-1d87-4175-aa94-0bd5d4665375`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410426', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335012', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263377', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434936', 'lastCheck': '9.4', 'valid': True}}
>Thread-2354::DEBUG::2014-04-10 17:27:43,749::task::579::TaskManager.Task::(_updateState) Task=`e90967df-1d87-4175-aa94-0bd5d4665375`::moving from state preparing -> state finished
>Thread-2354::DEBUG::2014-04-10 17:27:43,749::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2354::DEBUG::2014-04-10 17:27:43,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2354::DEBUG::2014-04-10 17:27:43,749::task::974::TaskManager.Task::(_decref) Task=`e90967df-1d87-4175-aa94-0bd5d4665375`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:27:44,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:44,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485665 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:44,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:44,359::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000453579 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2358::DEBUG::2014-04-10 17:27:52,402::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2358::DEBUG::2014-04-10 17:27:52,403::task::579::TaskManager.Task::(_updateState) Task=`c402eb31-8142-44f2-bc2b-3f1e7528e85c`::moving from state init -> state preparing
>Thread-2358::INFO::2014-04-10 17:27:52,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2358::INFO::2014-04-10 17:27:52,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2358::DEBUG::2014-04-10 17:27:52,404::task::1168::TaskManager.Task::(prepare) Task=`c402eb31-8142-44f2-bc2b-3f1e7528e85c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2358::DEBUG::2014-04-10 17:27:52,404::task::579::TaskManager.Task::(_updateState) Task=`c402eb31-8142-44f2-bc2b-3f1e7528e85c`::moving from state preparing -> state finished
>Thread-2358::DEBUG::2014-04-10 17:27:52,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2358::DEBUG::2014-04-10 17:27:52,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2358::DEBUG::2014-04-10 17:27:52,404::task::974::TaskManager.Task::(_decref) Task=`c402eb31-8142-44f2-bc2b-3f1e7528e85c`::ref 0 aborting False
>Thread-2359::DEBUG::2014-04-10 17:27:52,411::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2359::DEBUG::2014-04-10 17:27:52,412::task::579::TaskManager.Task::(_updateState) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::moving from state init -> state preparing
>Thread-2359::INFO::2014-04-10 17:27:52,412::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2359::DEBUG::2014-04-10 17:27:52,412::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3d258f1-b61f-44a0-9a07-f800137cf43b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2359::DEBUG::2014-04-10 17:27:52,413::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2359::DEBUG::2014-04-10 17:27:52,413::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2359::DEBUG::2014-04-10 17:27:52,413::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3d258f1-b61f-44a0-9a07-f800137cf43b`::Granted request
>Thread-2359::DEBUG::2014-04-10 17:27:52,413::task::811::TaskManager.Task::(resourceAcquired) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2359::DEBUG::2014-04-10 17:27:52,413::task::974::TaskManager.Task::(_decref) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::ref 1 aborting False
>Thread-2359::INFO::2014-04-10 17:27:52,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::task::1168::TaskManager.Task::(prepare) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::task::579::TaskManager.Task::(_updateState) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::moving from state preparing -> state finished
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2359::DEBUG::2014-04-10 17:27:52,416::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2359::DEBUG::2014-04-10 17:27:52,417::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2359::DEBUG::2014-04-10 17:27:52,417::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2359::DEBUG::2014-04-10 17:27:52,417::task::974::TaskManager.Task::(_decref) Task=`2256b0bb-7509-49ee-b114-f22a19f303a2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:27:53,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:27:53,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330797 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:27:53,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:27:53,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320924 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:27:54,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:27:54,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481693 s, 764 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:27:54,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:27:54,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484137 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2362::DEBUG::2014-04-10 17:27:59,187::task::579::TaskManager.Task::(_updateState) Task=`5f0f2077-1c83-4ea7-9a1b-9658d18bfc83`::moving from state init -> state preparing
>Thread-2362::INFO::2014-04-10 17:27:59,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2362::INFO::2014-04-10 17:27:59,187::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484137', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330797', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320924', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481693', 'lastCheck': '4.8', 'valid': True}}
>Thread-2362::DEBUG::2014-04-10 17:27:59,187::task::1168::TaskManager.Task::(prepare) Task=`5f0f2077-1c83-4ea7-9a1b-9658d18bfc83`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484137', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330797', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320924', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481693', 'lastCheck': '4.8', 'valid': True}}
>Thread-2362::DEBUG::2014-04-10 17:27:59,188::task::579::TaskManager.Task::(_updateState) Task=`5f0f2077-1c83-4ea7-9a1b-9658d18bfc83`::moving from state preparing -> state finished
>Thread-2362::DEBUG::2014-04-10 17:27:59,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2362::DEBUG::2014-04-10 17:27:59,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2362::DEBUG::2014-04-10 17:27:59,188::task::974::TaskManager.Task::(_decref) Task=`5f0f2077-1c83-4ea7-9a1b-9658d18bfc83`::ref 0 aborting False
>Thread-2365::DEBUG::2014-04-10 17:28:02,525::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-2365::DEBUG::2014-04-10 17:28:02,526::task::579::TaskManager.Task::(_updateState) Task=`2a37259f-e8ab-48b2-a1c9-08a4fadc284d`::moving from state init -> state preparing
>Thread-2365::INFO::2014-04-10 17:28:02,526::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2365::INFO::2014-04-10 17:28:02,527::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2365::DEBUG::2014-04-10 17:28:02,527::task::1168::TaskManager.Task::(prepare) Task=`2a37259f-e8ab-48b2-a1c9-08a4fadc284d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2365::DEBUG::2014-04-10 17:28:02,527::task::579::TaskManager.Task::(_updateState) Task=`2a37259f-e8ab-48b2-a1c9-08a4fadc284d`::moving from state preparing -> state finished
>Thread-2365::DEBUG::2014-04-10 17:28:02,527::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2365::DEBUG::2014-04-10 17:28:02,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2365::DEBUG::2014-04-10 17:28:02,527::task::974::TaskManager.Task::(_decref) Task=`2a37259f-e8ab-48b2-a1c9-08a4fadc284d`::ref 0 aborting False
>Thread-2366::DEBUG::2014-04-10 17:28:02,534::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-2366::DEBUG::2014-04-10 17:28:02,534::task::579::TaskManager.Task::(_updateState) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::moving from state init -> state preparing
>Thread-2366::INFO::2014-04-10 17:28:02,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2366::DEBUG::2014-04-10 17:28:02,535::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9000172-04d0-4158-8155-ba5c6fa7267d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2366::DEBUG::2014-04-10 17:28:02,535::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2366::DEBUG::2014-04-10 17:28:02,535::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2366::DEBUG::2014-04-10 17:28:02,536::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f9000172-04d0-4158-8155-ba5c6fa7267d`::Granted request
>Thread-2366::DEBUG::2014-04-10 17:28:02,536::task::811::TaskManager.Task::(resourceAcquired) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2366::DEBUG::2014-04-10 17:28:02,536::task::974::TaskManager.Task::(_decref) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::ref 1 aborting False
>Thread-2366::INFO::2014-04-10 17:28:02,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2366::DEBUG::2014-04-10 17:28:02,538::task::1168::TaskManager.Task::(prepare) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2366::DEBUG::2014-04-10 17:28:02,539::task::579::TaskManager.Task::(_updateState) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::moving from state preparing -> state finished
>Thread-2366::DEBUG::2014-04-10 17:28:02,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2366::DEBUG::2014-04-10 17:28:02,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2366::DEBUG::2014-04-10 17:28:02,539::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2366::DEBUG::2014-04-10 17:28:02,540::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2366::DEBUG::2014-04-10 17:28:02,540::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2366::DEBUG::2014-04-10 17:28:02,540::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2366::DEBUG::2014-04-10 17:28:02,540::task::974::TaskManager.Task::(_decref) Task=`9e8c404c-ffae-48d9-9585-f9bce22ea513`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:03,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:03,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000569697 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:03,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:03,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349613 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:28:04,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:04,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048162 s, 764 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:04,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:04,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000489503 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2370::DEBUG::2014-04-10 17:28:12,650::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-2370::DEBUG::2014-04-10 17:28:12,651::task::579::TaskManager.Task::(_updateState) Task=`e0f2087d-bc7a-42a6-b1b8-20d1f27e7f0b`::moving from state init -> state preparing
>Thread-2370::INFO::2014-04-10 17:28:12,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2370::INFO::2014-04-10 17:28:12,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2370::DEBUG::2014-04-10 17:28:12,651::task::1168::TaskManager.Task::(prepare) Task=`e0f2087d-bc7a-42a6-b1b8-20d1f27e7f0b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2370::DEBUG::2014-04-10 17:28:12,652::task::579::TaskManager.Task::(_updateState) Task=`e0f2087d-bc7a-42a6-b1b8-20d1f27e7f0b`::moving from state preparing -> state finished
>Thread-2370::DEBUG::2014-04-10 17:28:12,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2370::DEBUG::2014-04-10 17:28:12,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2370::DEBUG::2014-04-10 17:28:12,652::task::974::TaskManager.Task::(_decref) Task=`e0f2087d-bc7a-42a6-b1b8-20d1f27e7f0b`::ref 0 aborting False
>Thread-2371::DEBUG::2014-04-10 17:28:12,659::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-2371::DEBUG::2014-04-10 17:28:12,659::task::579::TaskManager.Task::(_updateState) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::moving from state init -> state preparing
>Thread-2371::INFO::2014-04-10 17:28:12,659::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2371::DEBUG::2014-04-10 17:28:12,660::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b22d53f1-c644-4c4d-8618-97d3c1193c9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2371::DEBUG::2014-04-10 17:28:12,660::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2371::DEBUG::2014-04-10 17:28:12,660::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2371::DEBUG::2014-04-10 17:28:12,660::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b22d53f1-c644-4c4d-8618-97d3c1193c9d`::Granted request
>Thread-2371::DEBUG::2014-04-10 17:28:12,661::task::811::TaskManager.Task::(resourceAcquired) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2371::DEBUG::2014-04-10 17:28:12,661::task::974::TaskManager.Task::(_decref) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::ref 1 aborting False
>Thread-2371::INFO::2014-04-10 17:28:12,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2371::DEBUG::2014-04-10 17:28:12,663::task::1168::TaskManager.Task::(prepare) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2371::DEBUG::2014-04-10 17:28:12,664::task::579::TaskManager.Task::(_updateState) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::moving from state preparing -> state finished
>Thread-2371::DEBUG::2014-04-10 17:28:12,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2371::DEBUG::2014-04-10 17:28:12,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2371::DEBUG::2014-04-10 17:28:12,664::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2371::DEBUG::2014-04-10 17:28:12,664::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2371::DEBUG::2014-04-10 17:28:12,665::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2371::DEBUG::2014-04-10 17:28:12,665::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2371::DEBUG::2014-04-10 17:28:12,665::task::974::TaskManager.Task::(_decref) Task=`b28cafbf-09d6-48d5-a92f-9772e342280b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:13,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:13,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328149 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:13,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:13,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340597 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2372::DEBUG::2014-04-10 17:28:14,348::task::579::TaskManager.Task::(_updateState) Task=`ad2e50bf-5d98-427f-b6ec-680b5c315c99`::moving from state init -> state preparing
>Thread-2372::INFO::2014-04-10 17:28:14,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2372::INFO::2014-04-10 17:28:14,349::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489503', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328149', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340597', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048162', 'lastCheck': '10.0', 'valid': True}}
>Thread-2372::DEBUG::2014-04-10 17:28:14,349::task::1168::TaskManager.Task::(prepare) Task=`ad2e50bf-5d98-427f-b6ec-680b5c315c99`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489503', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328149', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340597', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048162', 'lastCheck': '10.0', 'valid': True}}
>Thread-2372::DEBUG::2014-04-10 17:28:14,349::task::579::TaskManager.Task::(_updateState) Task=`ad2e50bf-5d98-427f-b6ec-680b5c315c99`::moving from state preparing -> state finished
>Thread-2372::DEBUG::2014-04-10 17:28:14,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2372::DEBUG::2014-04-10 17:28:14,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2372::DEBUG::2014-04-10 17:28:14,350::task::974::TaskManager.Task::(_decref) Task=`ad2e50bf-5d98-427f-b6ec-680b5c315c99`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:28:14,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:14,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000508394 s, 724 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:14,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:14,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000408105 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2376::DEBUG::2014-04-10 17:28:22,741::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2376::DEBUG::2014-04-10 17:28:22,754::task::579::TaskManager.Task::(_updateState) Task=`d9359774-a72f-4475-abf3-15be39d67a27`::moving from state init -> state preparing
>Thread-2376::INFO::2014-04-10 17:28:22,754::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2376::INFO::2014-04-10 17:28:22,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2376::DEBUG::2014-04-10 17:28:22,755::task::1168::TaskManager.Task::(prepare) Task=`d9359774-a72f-4475-abf3-15be39d67a27`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2376::DEBUG::2014-04-10 17:28:22,755::task::579::TaskManager.Task::(_updateState) Task=`d9359774-a72f-4475-abf3-15be39d67a27`::moving from state preparing -> state finished
>Thread-2376::DEBUG::2014-04-10 17:28:22,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2376::DEBUG::2014-04-10 17:28:22,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2376::DEBUG::2014-04-10 17:28:22,755::task::974::TaskManager.Task::(_decref) Task=`d9359774-a72f-4475-abf3-15be39d67a27`::ref 0 aborting False
>Thread-2377::DEBUG::2014-04-10 17:28:22,762::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2377::DEBUG::2014-04-10 17:28:22,762::task::579::TaskManager.Task::(_updateState) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::moving from state init -> state preparing
>Thread-2377::INFO::2014-04-10 17:28:22,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2377::DEBUG::2014-04-10 17:28:22,763::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b049240-a971-4d81-8456-9aec8768cdd5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2377::DEBUG::2014-04-10 17:28:22,763::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2377::DEBUG::2014-04-10 17:28:22,763::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2377::DEBUG::2014-04-10 17:28:22,763::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b049240-a971-4d81-8456-9aec8768cdd5`::Granted request
>Thread-2377::DEBUG::2014-04-10 17:28:22,764::task::811::TaskManager.Task::(resourceAcquired) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2377::DEBUG::2014-04-10 17:28:22,764::task::974::TaskManager.Task::(_decref) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::ref 1 aborting False
>Thread-2377::INFO::2014-04-10 17:28:22,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2377::DEBUG::2014-04-10 17:28:22,766::task::1168::TaskManager.Task::(prepare) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2377::DEBUG::2014-04-10 17:28:22,766::task::579::TaskManager.Task::(_updateState) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::moving from state preparing -> state finished
>Thread-2377::DEBUG::2014-04-10 17:28:22,766::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2377::DEBUG::2014-04-10 17:28:22,766::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2377::DEBUG::2014-04-10 17:28:22,766::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2377::DEBUG::2014-04-10 17:28:22,767::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2377::DEBUG::2014-04-10 17:28:22,767::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2377::DEBUG::2014-04-10 17:28:22,767::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2377::DEBUG::2014-04-10 17:28:22,767::task::974::TaskManager.Task::(_decref) Task=`8fe4dfa9-b7a9-49bb-bed1-f5a57ad8cf6d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:23,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:23,516::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355275 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:23,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:23,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287793 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:28:24,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:24,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000482484 s, 763 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:24,405::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:28:24,420::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:28:24,422::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:28:24,427::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:28:24,429::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:28:24,429::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:28:24,429::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:28:24,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:24,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000357496 s, 1.8 MB/s\n'; <rc> = 0
>Thread-2384::DEBUG::2014-04-10 17:28:29,517::task::579::TaskManager.Task::(_updateState) Task=`3933ebd1-2b9d-4796-aa2f-e0dccf598551`::moving from state init -> state preparing
>Thread-2384::INFO::2014-04-10 17:28:29,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2384::INFO::2014-04-10 17:28:29,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357496', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355275', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287793', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482484', 'lastCheck': '5.1', 'valid': True}}
>Thread-2384::DEBUG::2014-04-10 17:28:29,517::task::1168::TaskManager.Task::(prepare) Task=`3933ebd1-2b9d-4796-aa2f-e0dccf598551`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357496', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355275', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287793', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482484', 'lastCheck': '5.1', 'valid': True}}
>Thread-2384::DEBUG::2014-04-10 17:28:29,518::task::579::TaskManager.Task::(_updateState) Task=`3933ebd1-2b9d-4796-aa2f-e0dccf598551`::moving from state preparing -> state finished
>Thread-2384::DEBUG::2014-04-10 17:28:29,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2384::DEBUG::2014-04-10 17:28:29,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2384::DEBUG::2014-04-10 17:28:29,518::task::974::TaskManager.Task::(_decref) Task=`3933ebd1-2b9d-4796-aa2f-e0dccf598551`::ref 0 aborting False
>Thread-2387::DEBUG::2014-04-10 17:28:32,855::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2387::DEBUG::2014-04-10 17:28:32,856::task::579::TaskManager.Task::(_updateState) Task=`2b86e434-9007-4a18-bec3-22480cbdc1da`::moving from state init -> state preparing
>Thread-2387::INFO::2014-04-10 17:28:32,856::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2387::INFO::2014-04-10 17:28:32,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2387::DEBUG::2014-04-10 17:28:32,857::task::1168::TaskManager.Task::(prepare) Task=`2b86e434-9007-4a18-bec3-22480cbdc1da`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2387::DEBUG::2014-04-10 17:28:32,857::task::579::TaskManager.Task::(_updateState) Task=`2b86e434-9007-4a18-bec3-22480cbdc1da`::moving from state preparing -> state finished
>Thread-2387::DEBUG::2014-04-10 17:28:32,857::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2387::DEBUG::2014-04-10 17:28:32,857::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2387::DEBUG::2014-04-10 17:28:32,857::task::974::TaskManager.Task::(_decref) Task=`2b86e434-9007-4a18-bec3-22480cbdc1da`::ref 0 aborting False
>Thread-2388::DEBUG::2014-04-10 17:28:32,864::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2388::DEBUG::2014-04-10 17:28:32,864::task::579::TaskManager.Task::(_updateState) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::moving from state init -> state preparing
>Thread-2388::INFO::2014-04-10 17:28:32,865::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2388::DEBUG::2014-04-10 17:28:32,865::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec1ce04c-de64-41b4-8415-a545dfa4f796`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2388::DEBUG::2014-04-10 17:28:32,865::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2388::DEBUG::2014-04-10 17:28:32,866::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2388::DEBUG::2014-04-10 17:28:32,866::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec1ce04c-de64-41b4-8415-a545dfa4f796`::Granted request
>Thread-2388::DEBUG::2014-04-10 17:28:32,866::task::811::TaskManager.Task::(resourceAcquired) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2388::DEBUG::2014-04-10 17:28:32,866::task::974::TaskManager.Task::(_decref) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::ref 1 aborting False
>Thread-2388::INFO::2014-04-10 17:28:32,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2388::DEBUG::2014-04-10 17:28:32,869::task::1168::TaskManager.Task::(prepare) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2388::DEBUG::2014-04-10 17:28:32,869::task::579::TaskManager.Task::(_updateState) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::moving from state preparing -> state finished
>Thread-2388::DEBUG::2014-04-10 17:28:32,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2388::DEBUG::2014-04-10 17:28:32,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2388::DEBUG::2014-04-10 17:28:32,870::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2388::DEBUG::2014-04-10 17:28:32,870::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2388::DEBUG::2014-04-10 17:28:32,870::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2388::DEBUG::2014-04-10 17:28:32,870::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2388::DEBUG::2014-04-10 17:28:32,870::task::974::TaskManager.Task::(_decref) Task=`35e1fcbf-0d90-40ce-8907-4586c19a5fb2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:33,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:33,530::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296482 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:33,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:33,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000327861 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:28:34,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:34,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000367988 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:34,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:34,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000451562 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2392::DEBUG::2014-04-10 17:28:42,945::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2392::DEBUG::2014-04-10 17:28:42,946::task::579::TaskManager.Task::(_updateState) Task=`f8428d37-4dd7-432d-9202-1913de32a8d8`::moving from state init -> state preparing
>Thread-2392::INFO::2014-04-10 17:28:42,946::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2392::INFO::2014-04-10 17:28:42,946::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2392::DEBUG::2014-04-10 17:28:42,946::task::1168::TaskManager.Task::(prepare) Task=`f8428d37-4dd7-432d-9202-1913de32a8d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2392::DEBUG::2014-04-10 17:28:42,946::task::579::TaskManager.Task::(_updateState) Task=`f8428d37-4dd7-432d-9202-1913de32a8d8`::moving from state preparing -> state finished
>Thread-2392::DEBUG::2014-04-10 17:28:42,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2392::DEBUG::2014-04-10 17:28:42,947::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2392::DEBUG::2014-04-10 17:28:42,947::task::974::TaskManager.Task::(_decref) Task=`f8428d37-4dd7-432d-9202-1913de32a8d8`::ref 0 aborting False
>Thread-2393::DEBUG::2014-04-10 17:28:42,953::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2393::DEBUG::2014-04-10 17:28:42,954::task::579::TaskManager.Task::(_updateState) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::moving from state init -> state preparing
>Thread-2393::INFO::2014-04-10 17:28:42,954::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2393::DEBUG::2014-04-10 17:28:42,954::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9cb0e22a-7530-416c-85c8-575327827718`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2393::DEBUG::2014-04-10 17:28:42,955::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2393::DEBUG::2014-04-10 17:28:42,955::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2393::DEBUG::2014-04-10 17:28:42,955::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9cb0e22a-7530-416c-85c8-575327827718`::Granted request
>Thread-2393::DEBUG::2014-04-10 17:28:42,955::task::811::TaskManager.Task::(resourceAcquired) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2393::DEBUG::2014-04-10 17:28:42,955::task::974::TaskManager.Task::(_decref) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::ref 1 aborting False
>Thread-2393::INFO::2014-04-10 17:28:42,957::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::task::1168::TaskManager.Task::(prepare) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::task::579::TaskManager.Task::(_updateState) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::moving from state preparing -> state finished
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2393::DEBUG::2014-04-10 17:28:42,958::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2393::DEBUG::2014-04-10 17:28:42,959::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2393::DEBUG::2014-04-10 17:28:42,959::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2393::DEBUG::2014-04-10 17:28:42,959::task::974::TaskManager.Task::(_decref) Task=`9d9cc294-ef97-4bcf-8740-bdd020226f3f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:43,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:43,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389104 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:43,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:43,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360352 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:28:44,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:44,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456377 s, 806 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:44,465::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:44,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000422839 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2394::DEBUG::2014-04-10 17:28:44,686::task::579::TaskManager.Task::(_updateState) Task=`38f8e327-a3e1-42ef-946b-bbf1baeab069`::moving from state init -> state preparing
>Thread-2394::INFO::2014-04-10 17:28:44,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2394::INFO::2014-04-10 17:28:44,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422839', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389104', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360352', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456377', 'lastCheck': '0.3', 'valid': True}}
>Thread-2394::DEBUG::2014-04-10 17:28:44,687::task::1168::TaskManager.Task::(prepare) Task=`38f8e327-a3e1-42ef-946b-bbf1baeab069`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422839', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389104', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360352', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456377', 'lastCheck': '0.3', 'valid': True}}
>Thread-2394::DEBUG::2014-04-10 17:28:44,687::task::579::TaskManager.Task::(_updateState) Task=`38f8e327-a3e1-42ef-946b-bbf1baeab069`::moving from state preparing -> state finished
>Thread-2394::DEBUG::2014-04-10 17:28:44,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2394::DEBUG::2014-04-10 17:28:44,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2394::DEBUG::2014-04-10 17:28:44,687::task::974::TaskManager.Task::(_decref) Task=`38f8e327-a3e1-42ef-946b-bbf1baeab069`::ref 0 aborting False
>Thread-2398::DEBUG::2014-04-10 17:28:53,053::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-2398::DEBUG::2014-04-10 17:28:53,065::task::579::TaskManager.Task::(_updateState) Task=`ebaacdad-5e04-4ca8-86ca-1a1c41397c3b`::moving from state init -> state preparing
>Thread-2398::INFO::2014-04-10 17:28:53,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2398::INFO::2014-04-10 17:28:53,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2398::DEBUG::2014-04-10 17:28:53,066::task::1168::TaskManager.Task::(prepare) Task=`ebaacdad-5e04-4ca8-86ca-1a1c41397c3b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2398::DEBUG::2014-04-10 17:28:53,066::task::579::TaskManager.Task::(_updateState) Task=`ebaacdad-5e04-4ca8-86ca-1a1c41397c3b`::moving from state preparing -> state finished
>Thread-2398::DEBUG::2014-04-10 17:28:53,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2398::DEBUG::2014-04-10 17:28:53,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2398::DEBUG::2014-04-10 17:28:53,066::task::974::TaskManager.Task::(_decref) Task=`ebaacdad-5e04-4ca8-86ca-1a1c41397c3b`::ref 0 aborting False
>Thread-2399::DEBUG::2014-04-10 17:28:53,073::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-2399::DEBUG::2014-04-10 17:28:53,073::task::579::TaskManager.Task::(_updateState) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::moving from state init -> state preparing
>Thread-2399::INFO::2014-04-10 17:28:53,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2399::DEBUG::2014-04-10 17:28:53,074::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f40516d-6031-42ce-b986-4d8fd511afa8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2399::DEBUG::2014-04-10 17:28:53,074::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2399::DEBUG::2014-04-10 17:28:53,074::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2399::DEBUG::2014-04-10 17:28:53,074::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f40516d-6031-42ce-b986-4d8fd511afa8`::Granted request
>Thread-2399::DEBUG::2014-04-10 17:28:53,075::task::811::TaskManager.Task::(resourceAcquired) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2399::DEBUG::2014-04-10 17:28:53,075::task::974::TaskManager.Task::(_decref) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::ref 1 aborting False
>Thread-2399::INFO::2014-04-10 17:28:53,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2399::DEBUG::2014-04-10 17:28:53,077::task::1168::TaskManager.Task::(prepare) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2399::DEBUG::2014-04-10 17:28:53,077::task::579::TaskManager.Task::(_updateState) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::moving from state preparing -> state finished
>Thread-2399::DEBUG::2014-04-10 17:28:53,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2399::DEBUG::2014-04-10 17:28:53,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2399::DEBUG::2014-04-10 17:28:53,077::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2399::DEBUG::2014-04-10 17:28:53,078::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2399::DEBUG::2014-04-10 17:28:53,078::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2399::DEBUG::2014-04-10 17:28:53,078::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2399::DEBUG::2014-04-10 17:28:53,078::task::974::TaskManager.Task::(_decref) Task=`931dec80-1cef-4fda-8e4a-4f1b78e834de`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:28:53,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:28:53,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362334 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:28:53,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:28:53,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00223903 s, 300 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:28:54,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:28:54,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000522607 s, 704 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:28:54,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:28:54,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477641 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2402::DEBUG::2014-04-10 17:28:59,843::task::579::TaskManager.Task::(_updateState) Task=`0a8260f0-c068-4ae2-96fd-04f1a22416b0`::moving from state init -> state preparing
>Thread-2402::INFO::2014-04-10 17:28:59,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2402::INFO::2014-04-10 17:28:59,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477641', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362334', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223903', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522607', 'lastCheck': '5.4', 'valid': True}}
>Thread-2402::DEBUG::2014-04-10 17:28:59,843::task::1168::TaskManager.Task::(prepare) Task=`0a8260f0-c068-4ae2-96fd-04f1a22416b0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477641', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362334', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223903', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522607', 'lastCheck': '5.4', 'valid': True}}
>Thread-2402::DEBUG::2014-04-10 17:28:59,844::task::579::TaskManager.Task::(_updateState) Task=`0a8260f0-c068-4ae2-96fd-04f1a22416b0`::moving from state preparing -> state finished
>Thread-2402::DEBUG::2014-04-10 17:28:59,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2402::DEBUG::2014-04-10 17:28:59,844::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2402::DEBUG::2014-04-10 17:28:59,844::task::974::TaskManager.Task::(_decref) Task=`0a8260f0-c068-4ae2-96fd-04f1a22416b0`::ref 0 aborting False
>Thread-2405::DEBUG::2014-04-10 17:29:03,168::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2405::DEBUG::2014-04-10 17:29:03,169::task::579::TaskManager.Task::(_updateState) Task=`8856ae0c-d134-4052-bfac-48c4bb596c86`::moving from state init -> state preparing
>Thread-2405::INFO::2014-04-10 17:29:03,169::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2405::INFO::2014-04-10 17:29:03,170::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2405::DEBUG::2014-04-10 17:29:03,170::task::1168::TaskManager.Task::(prepare) Task=`8856ae0c-d134-4052-bfac-48c4bb596c86`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2405::DEBUG::2014-04-10 17:29:03,170::task::579::TaskManager.Task::(_updateState) Task=`8856ae0c-d134-4052-bfac-48c4bb596c86`::moving from state preparing -> state finished
>Thread-2405::DEBUG::2014-04-10 17:29:03,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2405::DEBUG::2014-04-10 17:29:03,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2405::DEBUG::2014-04-10 17:29:03,170::task::974::TaskManager.Task::(_decref) Task=`8856ae0c-d134-4052-bfac-48c4bb596c86`::ref 0 aborting False
>Thread-2406::DEBUG::2014-04-10 17:29:03,177::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2406::DEBUG::2014-04-10 17:29:03,178::task::579::TaskManager.Task::(_updateState) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::moving from state init -> state preparing
>Thread-2406::INFO::2014-04-10 17:29:03,178::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2406::DEBUG::2014-04-10 17:29:03,178::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f55e4e6-bd0d-4181-ace1-0afb38971d8b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2406::DEBUG::2014-04-10 17:29:03,179::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2406::DEBUG::2014-04-10 17:29:03,179::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2406::DEBUG::2014-04-10 17:29:03,179::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f55e4e6-bd0d-4181-ace1-0afb38971d8b`::Granted request
>Thread-2406::DEBUG::2014-04-10 17:29:03,179::task::811::TaskManager.Task::(resourceAcquired) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2406::DEBUG::2014-04-10 17:29:03,180::task::974::TaskManager.Task::(_decref) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::ref 1 aborting False
>Thread-2406::INFO::2014-04-10 17:29:03,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2406::DEBUG::2014-04-10 17:29:03,182::task::1168::TaskManager.Task::(prepare) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2406::DEBUG::2014-04-10 17:29:03,182::task::579::TaskManager.Task::(_updateState) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::moving from state preparing -> state finished
>Thread-2406::DEBUG::2014-04-10 17:29:03,182::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2406::DEBUG::2014-04-10 17:29:03,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2406::DEBUG::2014-04-10 17:29:03,183::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2406::DEBUG::2014-04-10 17:29:03,183::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2406::DEBUG::2014-04-10 17:29:03,183::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2406::DEBUG::2014-04-10 17:29:03,183::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2406::DEBUG::2014-04-10 17:29:03,184::task::974::TaskManager.Task::(_decref) Task=`a5c68a2b-9be7-4252-9f07-5f1e9650ae80`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:03,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:03,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000478021 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:03,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:29:03,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347495 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:29:04,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:04,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431654 s, 853 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:04,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:04,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000414063 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2410::DEBUG::2014-04-10 17:29:13,256::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2410::DEBUG::2014-04-10 17:29:13,257::task::579::TaskManager.Task::(_updateState) Task=`ce72056e-a41b-4fbe-ad01-36d35344829b`::moving from state init -> state preparing
>Thread-2410::INFO::2014-04-10 17:29:13,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2410::INFO::2014-04-10 17:29:13,258::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2410::DEBUG::2014-04-10 17:29:13,258::task::1168::TaskManager.Task::(prepare) Task=`ce72056e-a41b-4fbe-ad01-36d35344829b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2410::DEBUG::2014-04-10 17:29:13,258::task::579::TaskManager.Task::(_updateState) Task=`ce72056e-a41b-4fbe-ad01-36d35344829b`::moving from state preparing -> state finished
>Thread-2410::DEBUG::2014-04-10 17:29:13,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2410::DEBUG::2014-04-10 17:29:13,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2410::DEBUG::2014-04-10 17:29:13,258::task::974::TaskManager.Task::(_decref) Task=`ce72056e-a41b-4fbe-ad01-36d35344829b`::ref 0 aborting False
>Thread-2411::DEBUG::2014-04-10 17:29:13,265::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2411::DEBUG::2014-04-10 17:29:13,266::task::579::TaskManager.Task::(_updateState) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::moving from state init -> state preparing
>Thread-2411::INFO::2014-04-10 17:29:13,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2411::DEBUG::2014-04-10 17:29:13,266::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cd436a2c-8049-48fa-ba2a-f9576c98a06b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2411::DEBUG::2014-04-10 17:29:13,266::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2411::DEBUG::2014-04-10 17:29:13,267::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2411::DEBUG::2014-04-10 17:29:13,267::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cd436a2c-8049-48fa-ba2a-f9576c98a06b`::Granted request
>Thread-2411::DEBUG::2014-04-10 17:29:13,267::task::811::TaskManager.Task::(resourceAcquired) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2411::DEBUG::2014-04-10 17:29:13,267::task::974::TaskManager.Task::(_decref) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::ref 1 aborting False
>Thread-2411::INFO::2014-04-10 17:29:13,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2411::DEBUG::2014-04-10 17:29:13,269::task::1168::TaskManager.Task::(prepare) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2411::DEBUG::2014-04-10 17:29:13,270::task::579::TaskManager.Task::(_updateState) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::moving from state preparing -> state finished
>Thread-2411::DEBUG::2014-04-10 17:29:13,270::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2411::DEBUG::2014-04-10 17:29:13,270::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2411::DEBUG::2014-04-10 17:29:13,270::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2411::DEBUG::2014-04-10 17:29:13,270::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2411::DEBUG::2014-04-10 17:29:13,271::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2411::DEBUG::2014-04-10 17:29:13,271::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2411::DEBUG::2014-04-10 17:29:13,271::task::974::TaskManager.Task::(_decref) Task=`39b7fe92-efd6-4aa0-be7e-f701a9775891`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:13,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:13,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353225 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:13,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:29:13,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031078 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:29:14,459::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:14,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517093 s, 712 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:14,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:14,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000520228 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2412::DEBUG::2014-04-10 17:29:15,012::task::579::TaskManager.Task::(_updateState) Task=`dfb9d266-c707-49c6-a050-c32cce80528a`::moving from state init -> state preparing
>Thread-2412::INFO::2014-04-10 17:29:15,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2412::INFO::2014-04-10 17:29:15,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520228', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353225', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031078', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517093', 'lastCheck': '0.5', 'valid': True}}
>Thread-2412::DEBUG::2014-04-10 17:29:15,013::task::1168::TaskManager.Task::(prepare) Task=`dfb9d266-c707-49c6-a050-c32cce80528a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520228', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353225', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031078', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517093', 'lastCheck': '0.5', 'valid': True}}
>Thread-2412::DEBUG::2014-04-10 17:29:15,013::task::579::TaskManager.Task::(_updateState) Task=`dfb9d266-c707-49c6-a050-c32cce80528a`::moving from state preparing -> state finished
>Thread-2412::DEBUG::2014-04-10 17:29:15,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2412::DEBUG::2014-04-10 17:29:15,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2412::DEBUG::2014-04-10 17:29:15,014::task::974::TaskManager.Task::(_decref) Task=`dfb9d266-c707-49c6-a050-c32cce80528a`::ref 0 aborting False
>Thread-2416::DEBUG::2014-04-10 17:29:23,348::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2416::DEBUG::2014-04-10 17:29:23,348::task::579::TaskManager.Task::(_updateState) Task=`d3d392c3-572e-4b2a-9109-9049fa7fc74b`::moving from state init -> state preparing
>Thread-2416::INFO::2014-04-10 17:29:23,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2416::INFO::2014-04-10 17:29:23,349::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2416::DEBUG::2014-04-10 17:29:23,349::task::1168::TaskManager.Task::(prepare) Task=`d3d392c3-572e-4b2a-9109-9049fa7fc74b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2416::DEBUG::2014-04-10 17:29:23,349::task::579::TaskManager.Task::(_updateState) Task=`d3d392c3-572e-4b2a-9109-9049fa7fc74b`::moving from state preparing -> state finished
>Thread-2416::DEBUG::2014-04-10 17:29:23,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2416::DEBUG::2014-04-10 17:29:23,350::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2416::DEBUG::2014-04-10 17:29:23,350::task::974::TaskManager.Task::(_decref) Task=`d3d392c3-572e-4b2a-9109-9049fa7fc74b`::ref 0 aborting False
>Thread-2417::DEBUG::2014-04-10 17:29:23,356::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2417::DEBUG::2014-04-10 17:29:23,357::task::579::TaskManager.Task::(_updateState) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::moving from state init -> state preparing
>Thread-2417::INFO::2014-04-10 17:29:23,357::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2417::DEBUG::2014-04-10 17:29:23,357::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51ea797d-a0ac-49c6-94b1-5e2439a3c501`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2417::DEBUG::2014-04-10 17:29:23,357::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2417::DEBUG::2014-04-10 17:29:23,358::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2417::DEBUG::2014-04-10 17:29:23,358::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51ea797d-a0ac-49c6-94b1-5e2439a3c501`::Granted request
>Thread-2417::DEBUG::2014-04-10 17:29:23,358::task::811::TaskManager.Task::(resourceAcquired) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2417::DEBUG::2014-04-10 17:29:23,358::task::974::TaskManager.Task::(_decref) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::ref 1 aborting False
>Thread-2417::INFO::2014-04-10 17:29:23,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2417::DEBUG::2014-04-10 17:29:23,360::task::1168::TaskManager.Task::(prepare) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::task::579::TaskManager.Task::(_updateState) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::moving from state preparing -> state finished
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2417::DEBUG::2014-04-10 17:29:23,361::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2417::DEBUG::2014-04-10 17:29:23,362::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2417::DEBUG::2014-04-10 17:29:23,362::task::974::TaskManager.Task::(_decref) Task=`4e90561e-66a5-4dbe-b152-66f3d9d6da75`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:23,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:23,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000644969 s, 1.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:23,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:29:23,623::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326866 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:29:24,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:24,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000499148 s, 737 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:24,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:24,530::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00054528 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2420::DEBUG::2014-04-10 17:29:30,190::task::579::TaskManager.Task::(_updateState) Task=`369e3d42-acc5-4955-b649-7a7089a1e432`::moving from state init -> state preparing
>Thread-2420::INFO::2014-04-10 17:29:30,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2420::INFO::2014-04-10 17:29:30,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054528', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644969', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326866', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499148', 'lastCheck': '5.7', 'valid': True}}
>Thread-2420::DEBUG::2014-04-10 17:29:30,191::task::1168::TaskManager.Task::(prepare) Task=`369e3d42-acc5-4955-b649-7a7089a1e432`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054528', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644969', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326866', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499148', 'lastCheck': '5.7', 'valid': True}}
>Thread-2420::DEBUG::2014-04-10 17:29:30,191::task::579::TaskManager.Task::(_updateState) Task=`369e3d42-acc5-4955-b649-7a7089a1e432`::moving from state preparing -> state finished
>Thread-2420::DEBUG::2014-04-10 17:29:30,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2420::DEBUG::2014-04-10 17:29:30,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2420::DEBUG::2014-04-10 17:29:30,192::task::974::TaskManager.Task::(_decref) Task=`369e3d42-acc5-4955-b649-7a7089a1e432`::ref 0 aborting False
>Thread-2423::DEBUG::2014-04-10 17:29:33,454::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2423::DEBUG::2014-04-10 17:29:33,455::task::579::TaskManager.Task::(_updateState) Task=`30fbd017-9b00-40ec-b811-1869fff4c48d`::moving from state init -> state preparing
>Thread-2423::INFO::2014-04-10 17:29:33,455::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2423::INFO::2014-04-10 17:29:33,455::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2423::DEBUG::2014-04-10 17:29:33,456::task::1168::TaskManager.Task::(prepare) Task=`30fbd017-9b00-40ec-b811-1869fff4c48d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2423::DEBUG::2014-04-10 17:29:33,456::task::579::TaskManager.Task::(_updateState) Task=`30fbd017-9b00-40ec-b811-1869fff4c48d`::moving from state preparing -> state finished
>Thread-2423::DEBUG::2014-04-10 17:29:33,456::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2423::DEBUG::2014-04-10 17:29:33,456::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2423::DEBUG::2014-04-10 17:29:33,456::task::974::TaskManager.Task::(_decref) Task=`30fbd017-9b00-40ec-b811-1869fff4c48d`::ref 0 aborting False
>Thread-2424::DEBUG::2014-04-10 17:29:33,463::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2424::DEBUG::2014-04-10 17:29:33,463::task::579::TaskManager.Task::(_updateState) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::moving from state init -> state preparing
>Thread-2424::INFO::2014-04-10 17:29:33,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2424::DEBUG::2014-04-10 17:29:33,464::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acba9c81-78e7-423f-8004-7e934538fc4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2424::DEBUG::2014-04-10 17:29:33,464::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2424::DEBUG::2014-04-10 17:29:33,464::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2424::DEBUG::2014-04-10 17:29:33,464::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acba9c81-78e7-423f-8004-7e934538fc4a`::Granted request
>Thread-2424::DEBUG::2014-04-10 17:29:33,465::task::811::TaskManager.Task::(resourceAcquired) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2424::DEBUG::2014-04-10 17:29:33,465::task::974::TaskManager.Task::(_decref) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::ref 1 aborting False
>Thread-2424::INFO::2014-04-10 17:29:33,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2424::DEBUG::2014-04-10 17:29:33,467::task::1168::TaskManager.Task::(prepare) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2424::DEBUG::2014-04-10 17:29:33,468::task::579::TaskManager.Task::(_updateState) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::moving from state preparing -> state finished
>Thread-2424::DEBUG::2014-04-10 17:29:33,468::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2424::DEBUG::2014-04-10 17:29:33,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2424::DEBUG::2014-04-10 17:29:33,468::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2424::DEBUG::2014-04-10 17:29:33,469::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2424::DEBUG::2014-04-10 17:29:33,469::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2424::DEBUG::2014-04-10 17:29:33,469::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2424::DEBUG::2014-04-10 17:29:33,469::task::974::TaskManager.Task::(_decref) Task=`61fc77a7-fb4b-4f42-9f52-e32779b4da1e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:33,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:33,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000527783 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:33,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:29:33,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335359 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:29:34,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:34,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457983 s, 804 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:34,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:34,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000565236 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2428::DEBUG::2014-04-10 17:29:43,555::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2428::DEBUG::2014-04-10 17:29:43,557::task::579::TaskManager.Task::(_updateState) Task=`793f6f74-dbe7-4e1c-9f6c-c566846a0da8`::moving from state init -> state preparing
>Thread-2428::INFO::2014-04-10 17:29:43,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2428::INFO::2014-04-10 17:29:43,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2428::DEBUG::2014-04-10 17:29:43,558::task::1168::TaskManager.Task::(prepare) Task=`793f6f74-dbe7-4e1c-9f6c-c566846a0da8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2428::DEBUG::2014-04-10 17:29:43,558::task::579::TaskManager.Task::(_updateState) Task=`793f6f74-dbe7-4e1c-9f6c-c566846a0da8`::moving from state preparing -> state finished
>Thread-2428::DEBUG::2014-04-10 17:29:43,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2428::DEBUG::2014-04-10 17:29:43,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2428::DEBUG::2014-04-10 17:29:43,558::task::974::TaskManager.Task::(_decref) Task=`793f6f74-dbe7-4e1c-9f6c-c566846a0da8`::ref 0 aborting False
>Thread-2429::DEBUG::2014-04-10 17:29:43,565::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-2429::DEBUG::2014-04-10 17:29:43,565::task::579::TaskManager.Task::(_updateState) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::moving from state init -> state preparing
>Thread-2429::INFO::2014-04-10 17:29:43,565::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2429::DEBUG::2014-04-10 17:29:43,566::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2389acc5-ae24-443a-ac04-bb5fb7b1c44c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2429::DEBUG::2014-04-10 17:29:43,566::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2429::DEBUG::2014-04-10 17:29:43,566::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2429::DEBUG::2014-04-10 17:29:43,566::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2389acc5-ae24-443a-ac04-bb5fb7b1c44c`::Granted request
>Thread-2429::DEBUG::2014-04-10 17:29:43,567::task::811::TaskManager.Task::(resourceAcquired) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2429::DEBUG::2014-04-10 17:29:43,567::task::974::TaskManager.Task::(_decref) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::ref 1 aborting False
>Thread-2429::INFO::2014-04-10 17:29:43,569::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2429::DEBUG::2014-04-10 17:29:43,569::task::1168::TaskManager.Task::(prepare) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2429::DEBUG::2014-04-10 17:29:43,569::task::579::TaskManager.Task::(_updateState) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::moving from state preparing -> state finished
>Thread-2429::DEBUG::2014-04-10 17:29:43,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2429::DEBUG::2014-04-10 17:29:43,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2429::DEBUG::2014-04-10 17:29:43,569::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2429::DEBUG::2014-04-10 17:29:43,570::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2429::DEBUG::2014-04-10 17:29:43,570::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2429::DEBUG::2014-04-10 17:29:43,570::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2429::DEBUG::2014-04-10 17:29:43,570::task::974::TaskManager.Task::(_decref) Task=`984a1880-05da-42cc-bc64-381d68ee60b4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:43,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:43,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359794 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:43,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:29:43,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376821 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:29:44,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:44,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442562 s, 832 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:44,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:44,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473103 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2430::DEBUG::2014-04-10 17:29:45,350::task::579::TaskManager.Task::(_updateState) Task=`607133b0-ba71-4a46-b606-3c67bff04475`::moving from state init -> state preparing
>Thread-2430::INFO::2014-04-10 17:29:45,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2430::INFO::2014-04-10 17:29:45,351::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473103', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359794', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376821', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442562', 'lastCheck': '0.8', 'valid': True}}
>Thread-2430::DEBUG::2014-04-10 17:29:45,351::task::1168::TaskManager.Task::(prepare) Task=`607133b0-ba71-4a46-b606-3c67bff04475`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473103', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359794', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376821', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442562', 'lastCheck': '0.8', 'valid': True}}
>Thread-2430::DEBUG::2014-04-10 17:29:45,351::task::579::TaskManager.Task::(_updateState) Task=`607133b0-ba71-4a46-b606-3c67bff04475`::moving from state preparing -> state finished
>Thread-2430::DEBUG::2014-04-10 17:29:45,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2430::DEBUG::2014-04-10 17:29:45,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2430::DEBUG::2014-04-10 17:29:45,352::task::974::TaskManager.Task::(_decref) Task=`607133b0-ba71-4a46-b606-3c67bff04475`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:29:53,640::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:29:53,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000455793 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:29:53,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-2434::DEBUG::2014-04-10 17:29:53,663::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2434::DEBUG::2014-04-10 17:29:53,672::task::579::TaskManager.Task::(_updateState) Task=`2e11c9c1-02bd-4297-b3de-ca06e9b3822c`::moving from state init -> state preparing
>Thread-2434::INFO::2014-04-10 17:29:53,674::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2434::INFO::2014-04-10 17:29:53,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2434::DEBUG::2014-04-10 17:29:53,679::task::1168::TaskManager.Task::(prepare) Task=`2e11c9c1-02bd-4297-b3de-ca06e9b3822c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2434::DEBUG::2014-04-10 17:29:53,682::task::579::TaskManager.Task::(_updateState) Task=`2e11c9c1-02bd-4297-b3de-ca06e9b3822c`::moving from state preparing -> state finished
>Thread-2434::DEBUG::2014-04-10 17:29:53,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2434::DEBUG::2014-04-10 17:29:53,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2434::DEBUG::2014-04-10 17:29:53,689::task::974::TaskManager.Task::(_decref) Task=`2e11c9c1-02bd-4297-b3de-ca06e9b3822c`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 17:29:53,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320354 s, 2.1 MB/s\n'; <rc> = 0
>Thread-2435::DEBUG::2014-04-10 17:29:53,699::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2435::DEBUG::2014-04-10 17:29:53,699::task::579::TaskManager.Task::(_updateState) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::moving from state init -> state preparing
>Thread-2435::INFO::2014-04-10 17:29:53,700::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2435::DEBUG::2014-04-10 17:29:53,700::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6fcbcafa-986d-46c4-8b58-ea4f81b265bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2435::DEBUG::2014-04-10 17:29:53,700::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2435::DEBUG::2014-04-10 17:29:53,701::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2435::DEBUG::2014-04-10 17:29:53,701::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6fcbcafa-986d-46c4-8b58-ea4f81b265bc`::Granted request
>Thread-2435::DEBUG::2014-04-10 17:29:53,701::task::811::TaskManager.Task::(resourceAcquired) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2435::DEBUG::2014-04-10 17:29:53,701::task::974::TaskManager.Task::(_decref) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::ref 1 aborting False
>Thread-2435::INFO::2014-04-10 17:29:53,704::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2435::DEBUG::2014-04-10 17:29:53,704::task::1168::TaskManager.Task::(prepare) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2435::DEBUG::2014-04-10 17:29:53,704::task::579::TaskManager.Task::(_updateState) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::moving from state preparing -> state finished
>Thread-2435::DEBUG::2014-04-10 17:29:53,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2435::DEBUG::2014-04-10 17:29:53,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2435::DEBUG::2014-04-10 17:29:53,705::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2435::DEBUG::2014-04-10 17:29:53,705::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2435::DEBUG::2014-04-10 17:29:53,705::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2435::DEBUG::2014-04-10 17:29:53,705::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2435::DEBUG::2014-04-10 17:29:53,705::task::974::TaskManager.Task::(_decref) Task=`3a2cd196-c72e-41c0-8085-05cad58b5539`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:29:54,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:29:54,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000528669 s, 696 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:29:54,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:29:54,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0004563 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2438::DEBUG::2014-04-10 17:30:00,514::task::579::TaskManager.Task::(_updateState) Task=`9d66e709-7cc9-4d22-b007-9fff7ea3af3a`::moving from state init -> state preparing
>Thread-2438::INFO::2014-04-10 17:30:00,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2438::INFO::2014-04-10 17:30:00,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004563', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455793', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320354', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528669', 'lastCheck': '6.0', 'valid': True}}
>Thread-2438::DEBUG::2014-04-10 17:30:00,515::task::1168::TaskManager.Task::(prepare) Task=`9d66e709-7cc9-4d22-b007-9fff7ea3af3a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004563', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455793', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320354', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528669', 'lastCheck': '6.0', 'valid': True}}
>Thread-2438::DEBUG::2014-04-10 17:30:00,515::task::579::TaskManager.Task::(_updateState) Task=`9d66e709-7cc9-4d22-b007-9fff7ea3af3a`::moving from state preparing -> state finished
>Thread-2438::DEBUG::2014-04-10 17:30:00,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2438::DEBUG::2014-04-10 17:30:00,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2438::DEBUG::2014-04-10 17:30:00,516::task::974::TaskManager.Task::(_decref) Task=`9d66e709-7cc9-4d22-b007-9fff7ea3af3a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:30:03,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:03,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349898 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:30:03,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:03,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333487 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2441::DEBUG::2014-04-10 17:30:03,880::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2441::DEBUG::2014-04-10 17:30:03,881::task::579::TaskManager.Task::(_updateState) Task=`ca47e1fa-4a2f-42d6-82bf-daeb82b3bfb0`::moving from state init -> state preparing
>Thread-2441::INFO::2014-04-10 17:30:03,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2441::INFO::2014-04-10 17:30:03,881::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2441::DEBUG::2014-04-10 17:30:03,882::task::1168::TaskManager.Task::(prepare) Task=`ca47e1fa-4a2f-42d6-82bf-daeb82b3bfb0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2441::DEBUG::2014-04-10 17:30:03,882::task::579::TaskManager.Task::(_updateState) Task=`ca47e1fa-4a2f-42d6-82bf-daeb82b3bfb0`::moving from state preparing -> state finished
>Thread-2441::DEBUG::2014-04-10 17:30:03,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2441::DEBUG::2014-04-10 17:30:03,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2441::DEBUG::2014-04-10 17:30:03,882::task::974::TaskManager.Task::(_decref) Task=`ca47e1fa-4a2f-42d6-82bf-daeb82b3bfb0`::ref 0 aborting False
>Thread-2442::DEBUG::2014-04-10 17:30:03,889::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2442::DEBUG::2014-04-10 17:30:03,889::task::579::TaskManager.Task::(_updateState) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::moving from state init -> state preparing
>Thread-2442::INFO::2014-04-10 17:30:03,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2442::DEBUG::2014-04-10 17:30:03,890::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2571bc6a-86f3-4245-aa00-1e0738958577`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2442::DEBUG::2014-04-10 17:30:03,890::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2442::DEBUG::2014-04-10 17:30:03,890::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2442::DEBUG::2014-04-10 17:30:03,890::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2571bc6a-86f3-4245-aa00-1e0738958577`::Granted request
>Thread-2442::DEBUG::2014-04-10 17:30:03,891::task::811::TaskManager.Task::(resourceAcquired) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2442::DEBUG::2014-04-10 17:30:03,891::task::974::TaskManager.Task::(_decref) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::ref 1 aborting False
>Thread-2442::INFO::2014-04-10 17:30:03,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2442::DEBUG::2014-04-10 17:30:03,893::task::1168::TaskManager.Task::(prepare) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2442::DEBUG::2014-04-10 17:30:03,893::task::579::TaskManager.Task::(_updateState) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::moving from state preparing -> state finished
>Thread-2442::DEBUG::2014-04-10 17:30:03,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2442::DEBUG::2014-04-10 17:30:03,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2442::DEBUG::2014-04-10 17:30:03,894::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2442::DEBUG::2014-04-10 17:30:03,894::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2442::DEBUG::2014-04-10 17:30:03,894::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2442::DEBUG::2014-04-10 17:30:03,895::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2442::DEBUG::2014-04-10 17:30:03,895::task::974::TaskManager.Task::(_decref) Task=`be45447b-05fa-433a-b93b-5b2885fec571`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:04,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:04,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000568877 s, 647 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:04,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:04,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000553694 s, 1.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:30:13,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:13,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397036 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:30:13,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:13,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355991 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2446::DEBUG::2014-04-10 17:30:13,992::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2446::DEBUG::2014-04-10 17:30:13,992::task::579::TaskManager.Task::(_updateState) Task=`9990c58e-7a47-4b79-8f56-ad7f872d9732`::moving from state init -> state preparing
>Thread-2446::INFO::2014-04-10 17:30:13,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2446::INFO::2014-04-10 17:30:13,993::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2446::DEBUG::2014-04-10 17:30:13,993::task::1168::TaskManager.Task::(prepare) Task=`9990c58e-7a47-4b79-8f56-ad7f872d9732`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2446::DEBUG::2014-04-10 17:30:13,993::task::579::TaskManager.Task::(_updateState) Task=`9990c58e-7a47-4b79-8f56-ad7f872d9732`::moving from state preparing -> state finished
>Thread-2446::DEBUG::2014-04-10 17:30:13,994::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2446::DEBUG::2014-04-10 17:30:13,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2446::DEBUG::2014-04-10 17:30:13,994::task::974::TaskManager.Task::(_decref) Task=`9990c58e-7a47-4b79-8f56-ad7f872d9732`::ref 0 aborting False
>Thread-2447::DEBUG::2014-04-10 17:30:14,001::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2447::DEBUG::2014-04-10 17:30:14,001::task::579::TaskManager.Task::(_updateState) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::moving from state init -> state preparing
>Thread-2447::INFO::2014-04-10 17:30:14,001::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2447::DEBUG::2014-04-10 17:30:14,002::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7556899e-c06c-4446-94f3-acdfc2604503`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2447::DEBUG::2014-04-10 17:30:14,002::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2447::DEBUG::2014-04-10 17:30:14,002::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2447::DEBUG::2014-04-10 17:30:14,003::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7556899e-c06c-4446-94f3-acdfc2604503`::Granted request
>Thread-2447::DEBUG::2014-04-10 17:30:14,003::task::811::TaskManager.Task::(resourceAcquired) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2447::DEBUG::2014-04-10 17:30:14,003::task::974::TaskManager.Task::(_decref) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::ref 1 aborting False
>Thread-2447::INFO::2014-04-10 17:30:14,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2447::DEBUG::2014-04-10 17:30:14,005::task::1168::TaskManager.Task::(prepare) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2447::DEBUG::2014-04-10 17:30:14,006::task::579::TaskManager.Task::(_updateState) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::moving from state preparing -> state finished
>Thread-2447::DEBUG::2014-04-10 17:30:14,006::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2447::DEBUG::2014-04-10 17:30:14,006::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2447::DEBUG::2014-04-10 17:30:14,006::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2447::DEBUG::2014-04-10 17:30:14,006::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2447::DEBUG::2014-04-10 17:30:14,007::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2447::DEBUG::2014-04-10 17:30:14,007::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2447::DEBUG::2014-04-10 17:30:14,007::task::974::TaskManager.Task::(_decref) Task=`182ab544-3346-4f7c-b2f3-2b49d1ec69bc`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:14,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:14,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000504054 s, 730 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:14,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:14,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000491193 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2448::DEBUG::2014-04-10 17:30:15,761::task::579::TaskManager.Task::(_updateState) Task=`2c4e2a9d-213f-436f-bce8-f19ca2d72b70`::moving from state init -> state preparing
>Thread-2448::INFO::2014-04-10 17:30:15,761::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2448::INFO::2014-04-10 17:30:15,761::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491193', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397036', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355991', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504054', 'lastCheck': '1.2', 'valid': True}}
>Thread-2448::DEBUG::2014-04-10 17:30:15,761::task::1168::TaskManager.Task::(prepare) Task=`2c4e2a9d-213f-436f-bce8-f19ca2d72b70`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491193', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397036', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355991', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504054', 'lastCheck': '1.2', 'valid': True}}
>Thread-2448::DEBUG::2014-04-10 17:30:15,762::task::579::TaskManager.Task::(_updateState) Task=`2c4e2a9d-213f-436f-bce8-f19ca2d72b70`::moving from state preparing -> state finished
>Thread-2448::DEBUG::2014-04-10 17:30:15,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2448::DEBUG::2014-04-10 17:30:15,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2448::DEBUG::2014-04-10 17:30:15,762::task::974::TaskManager.Task::(_decref) Task=`2c4e2a9d-213f-436f-bce8-f19ca2d72b70`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:30:23,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:23,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335741 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:30:23,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:23,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334663 s, 2.0 MB/s\n'; <rc> = 0
>Thread-2452::DEBUG::2014-04-10 17:30:24,102::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2452::DEBUG::2014-04-10 17:30:24,105::task::579::TaskManager.Task::(_updateState) Task=`bafe9ca6-3b6c-4f6a-9b0f-128fdee6b053`::moving from state init -> state preparing
>Thread-2452::INFO::2014-04-10 17:30:24,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2452::INFO::2014-04-10 17:30:24,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2452::DEBUG::2014-04-10 17:30:24,111::task::1168::TaskManager.Task::(prepare) Task=`bafe9ca6-3b6c-4f6a-9b0f-128fdee6b053`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2452::DEBUG::2014-04-10 17:30:24,112::task::579::TaskManager.Task::(_updateState) Task=`bafe9ca6-3b6c-4f6a-9b0f-128fdee6b053`::moving from state preparing -> state finished
>Thread-2452::DEBUG::2014-04-10 17:30:24,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2452::DEBUG::2014-04-10 17:30:24,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2452::DEBUG::2014-04-10 17:30:24,117::task::974::TaskManager.Task::(_decref) Task=`bafe9ca6-3b6c-4f6a-9b0f-128fdee6b053`::ref 0 aborting False
>Thread-2453::DEBUG::2014-04-10 17:30:24,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2453::DEBUG::2014-04-10 17:30:24,132::task::579::TaskManager.Task::(_updateState) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::moving from state init -> state preparing
>Thread-2453::INFO::2014-04-10 17:30:24,133::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2453::DEBUG::2014-04-10 17:30:24,135::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb1742f8-abda-4545-a7d0-09602d3e7d30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2453::DEBUG::2014-04-10 17:30:24,136::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2453::DEBUG::2014-04-10 17:30:24,137::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2453::DEBUG::2014-04-10 17:30:24,138::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb1742f8-abda-4545-a7d0-09602d3e7d30`::Granted request
>Thread-2453::DEBUG::2014-04-10 17:30:24,140::task::811::TaskManager.Task::(resourceAcquired) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2453::DEBUG::2014-04-10 17:30:24,141::task::974::TaskManager.Task::(_decref) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::ref 1 aborting False
>Thread-2453::INFO::2014-04-10 17:30:24,152::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2453::DEBUG::2014-04-10 17:30:24,152::task::1168::TaskManager.Task::(prepare) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2453::DEBUG::2014-04-10 17:30:24,153::task::579::TaskManager.Task::(_updateState) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::moving from state preparing -> state finished
>Thread-2453::DEBUG::2014-04-10 17:30:24,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2453::DEBUG::2014-04-10 17:30:24,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2453::DEBUG::2014-04-10 17:30:24,153::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2453::DEBUG::2014-04-10 17:30:24,153::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2453::DEBUG::2014-04-10 17:30:24,154::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2453::DEBUG::2014-04-10 17:30:24,154::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2453::DEBUG::2014-04-10 17:30:24,154::task::974::TaskManager.Task::(_decref) Task=`3c596b45-7b66-4bc3-af60-c0f66dbfed04`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:24,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:24,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000499475 s, 737 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:24,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:24,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000543327 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2456::DEBUG::2014-04-10 17:30:30,925::task::579::TaskManager.Task::(_updateState) Task=`a1b257b9-f492-49ff-83aa-3df70d916e53`::moving from state init -> state preparing
>Thread-2456::INFO::2014-04-10 17:30:30,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2456::INFO::2014-04-10 17:30:30,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543327', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335741', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334663', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499475', 'lastCheck': '6.4', 'valid': True}}
>Thread-2456::DEBUG::2014-04-10 17:30:30,926::task::1168::TaskManager.Task::(prepare) Task=`a1b257b9-f492-49ff-83aa-3df70d916e53`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543327', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335741', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334663', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499475', 'lastCheck': '6.4', 'valid': True}}
>Thread-2456::DEBUG::2014-04-10 17:30:30,927::task::579::TaskManager.Task::(_updateState) Task=`a1b257b9-f492-49ff-83aa-3df70d916e53`::moving from state preparing -> state finished
>Thread-2456::DEBUG::2014-04-10 17:30:30,927::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2456::DEBUG::2014-04-10 17:30:30,927::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2456::DEBUG::2014-04-10 17:30:30,927::task::974::TaskManager.Task::(_decref) Task=`a1b257b9-f492-49ff-83aa-3df70d916e53`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:30:33,804::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 17:30:33,815::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:30:33,848::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-468::DEBUG::2014-04-10 17:30:33,852::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:30:33,853::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:30:33,855::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:30:33,859::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 17:30:33,861::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 17:30:33,864::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:30:33,865::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:30:33,865::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:30:33,866::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:30:33,867::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:30:33,868::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:30:33,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:33,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:33,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331472 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:30:33,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364261 s, 1.8 MB/s\n'; <rc> = 0
>Thread-2467::DEBUG::2014-04-10 17:30:34,231::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2467::DEBUG::2014-04-10 17:30:34,231::task::579::TaskManager.Task::(_updateState) Task=`4d95cf99-d7f4-4228-b7ea-abcd89c2ba40`::moving from state init -> state preparing
>Thread-2467::INFO::2014-04-10 17:30:34,231::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2467::INFO::2014-04-10 17:30:34,232::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2467::DEBUG::2014-04-10 17:30:34,232::task::1168::TaskManager.Task::(prepare) Task=`4d95cf99-d7f4-4228-b7ea-abcd89c2ba40`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2467::DEBUG::2014-04-10 17:30:34,232::task::579::TaskManager.Task::(_updateState) Task=`4d95cf99-d7f4-4228-b7ea-abcd89c2ba40`::moving from state preparing -> state finished
>Thread-2467::DEBUG::2014-04-10 17:30:34,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2467::DEBUG::2014-04-10 17:30:34,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2467::DEBUG::2014-04-10 17:30:34,232::task::974::TaskManager.Task::(_decref) Task=`4d95cf99-d7f4-4228-b7ea-abcd89c2ba40`::ref 0 aborting False
>Thread-2468::DEBUG::2014-04-10 17:30:34,239::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2468::DEBUG::2014-04-10 17:30:34,239::task::579::TaskManager.Task::(_updateState) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::moving from state init -> state preparing
>Thread-2468::INFO::2014-04-10 17:30:34,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2468::DEBUG::2014-04-10 17:30:34,240::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d7a81ac6-1035-4a87-be2f-998bcd8c83a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2468::DEBUG::2014-04-10 17:30:34,240::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2468::DEBUG::2014-04-10 17:30:34,240::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2468::DEBUG::2014-04-10 17:30:34,241::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d7a81ac6-1035-4a87-be2f-998bcd8c83a2`::Granted request
>Thread-2468::DEBUG::2014-04-10 17:30:34,241::task::811::TaskManager.Task::(resourceAcquired) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2468::DEBUG::2014-04-10 17:30:34,241::task::974::TaskManager.Task::(_decref) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::ref 1 aborting False
>Thread-2468::INFO::2014-04-10 17:30:34,243::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2468::DEBUG::2014-04-10 17:30:34,243::task::1168::TaskManager.Task::(prepare) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2468::DEBUG::2014-04-10 17:30:34,243::task::579::TaskManager.Task::(_updateState) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::moving from state preparing -> state finished
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2468::DEBUG::2014-04-10 17:30:34,244::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2468::DEBUG::2014-04-10 17:30:34,245::task::974::TaskManager.Task::(_decref) Task=`5827df48-9dce-44a9-bb73-c47a60a02c3a`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:34,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:34,578::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00056614 s, 650 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:34,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:34,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470643 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:30:43,944::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:43,946::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:43,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00129734 s, 517 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:30:43,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269661 s, 2.5 MB/s\n'; <rc> = 0
>Thread-2472::DEBUG::2014-04-10 17:30:44,363::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2472::DEBUG::2014-04-10 17:30:44,363::task::579::TaskManager.Task::(_updateState) Task=`219b0fd4-e0cf-4edd-b6d1-e84183a566a6`::moving from state init -> state preparing
>Thread-2472::INFO::2014-04-10 17:30:44,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2472::INFO::2014-04-10 17:30:44,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2472::DEBUG::2014-04-10 17:30:44,364::task::1168::TaskManager.Task::(prepare) Task=`219b0fd4-e0cf-4edd-b6d1-e84183a566a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2472::DEBUG::2014-04-10 17:30:44,364::task::579::TaskManager.Task::(_updateState) Task=`219b0fd4-e0cf-4edd-b6d1-e84183a566a6`::moving from state preparing -> state finished
>Thread-2472::DEBUG::2014-04-10 17:30:44,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2472::DEBUG::2014-04-10 17:30:44,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2472::DEBUG::2014-04-10 17:30:44,365::task::974::TaskManager.Task::(_decref) Task=`219b0fd4-e0cf-4edd-b6d1-e84183a566a6`::ref 0 aborting False
>Thread-2473::DEBUG::2014-04-10 17:30:44,371::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2473::DEBUG::2014-04-10 17:30:44,372::task::579::TaskManager.Task::(_updateState) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::moving from state init -> state preparing
>Thread-2473::INFO::2014-04-10 17:30:44,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2473::DEBUG::2014-04-10 17:30:44,372::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`331cd723-3c41-4bd9-ba02-b2f760237370`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2473::DEBUG::2014-04-10 17:30:44,373::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2473::DEBUG::2014-04-10 17:30:44,373::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2473::DEBUG::2014-04-10 17:30:44,373::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`331cd723-3c41-4bd9-ba02-b2f760237370`::Granted request
>Thread-2473::DEBUG::2014-04-10 17:30:44,373::task::811::TaskManager.Task::(resourceAcquired) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2473::DEBUG::2014-04-10 17:30:44,374::task::974::TaskManager.Task::(_decref) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::ref 1 aborting False
>Thread-2473::INFO::2014-04-10 17:30:44,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2473::DEBUG::2014-04-10 17:30:44,376::task::1168::TaskManager.Task::(prepare) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2473::DEBUG::2014-04-10 17:30:44,376::task::579::TaskManager.Task::(_updateState) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::moving from state preparing -> state finished
>Thread-2473::DEBUG::2014-04-10 17:30:44,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2473::DEBUG::2014-04-10 17:30:44,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2473::DEBUG::2014-04-10 17:30:44,377::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2473::DEBUG::2014-04-10 17:30:44,377::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2473::DEBUG::2014-04-10 17:30:44,377::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2473::DEBUG::2014-04-10 17:30:44,377::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2473::DEBUG::2014-04-10 17:30:44,377::task::974::TaskManager.Task::(_decref) Task=`c87ccec2-a50f-4e25-a25f-a0e777e485c5`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:44,586::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:44,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444096 s, 829 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:44,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:44,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480275 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2474::DEBUG::2014-04-10 17:30:46,259::task::579::TaskManager.Task::(_updateState) Task=`ea948e29-bb1e-46b9-9d06-7319449193d6`::moving from state init -> state preparing
>Thread-2474::INFO::2014-04-10 17:30:46,260::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2474::INFO::2014-04-10 17:30:46,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480275', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269661', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129734', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444096', 'lastCheck': '1.7', 'valid': True}}
>Thread-2474::DEBUG::2014-04-10 17:30:46,260::task::1168::TaskManager.Task::(prepare) Task=`ea948e29-bb1e-46b9-9d06-7319449193d6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480275', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269661', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129734', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444096', 'lastCheck': '1.7', 'valid': True}}
>Thread-2474::DEBUG::2014-04-10 17:30:46,260::task::579::TaskManager.Task::(_updateState) Task=`ea948e29-bb1e-46b9-9d06-7319449193d6`::moving from state preparing -> state finished
>Thread-2474::DEBUG::2014-04-10 17:30:46,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2474::DEBUG::2014-04-10 17:30:46,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2474::DEBUG::2014-04-10 17:30:46,261::task::974::TaskManager.Task::(_decref) Task=`ea948e29-bb1e-46b9-9d06-7319449193d6`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 17:30:53,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:30:53,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:30:54,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279709 s, 2.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:30:54,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029992 s, 2.2 MB/s\n'; <rc> = 0
>Thread-2478::DEBUG::2014-04-10 17:30:54,462::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2478::DEBUG::2014-04-10 17:30:54,462::task::579::TaskManager.Task::(_updateState) Task=`3fbead8e-b438-4d6f-bd85-f73e9bfd1735`::moving from state init -> state preparing
>Thread-2478::INFO::2014-04-10 17:30:54,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2478::INFO::2014-04-10 17:30:54,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2478::DEBUG::2014-04-10 17:30:54,463::task::1168::TaskManager.Task::(prepare) Task=`3fbead8e-b438-4d6f-bd85-f73e9bfd1735`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2478::DEBUG::2014-04-10 17:30:54,463::task::579::TaskManager.Task::(_updateState) Task=`3fbead8e-b438-4d6f-bd85-f73e9bfd1735`::moving from state preparing -> state finished
>Thread-2478::DEBUG::2014-04-10 17:30:54,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2478::DEBUG::2014-04-10 17:30:54,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2478::DEBUG::2014-04-10 17:30:54,464::task::974::TaskManager.Task::(_decref) Task=`3fbead8e-b438-4d6f-bd85-f73e9bfd1735`::ref 0 aborting False
>Thread-2479::DEBUG::2014-04-10 17:30:54,471::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2479::DEBUG::2014-04-10 17:30:54,471::task::579::TaskManager.Task::(_updateState) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::moving from state init -> state preparing
>Thread-2479::INFO::2014-04-10 17:30:54,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2479::DEBUG::2014-04-10 17:30:54,472::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bcebe27d-d0b4-4e3e-b790-a4ff0f9a2c32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2479::DEBUG::2014-04-10 17:30:54,472::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2479::DEBUG::2014-04-10 17:30:54,472::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2479::DEBUG::2014-04-10 17:30:54,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bcebe27d-d0b4-4e3e-b790-a4ff0f9a2c32`::Granted request
>Thread-2479::DEBUG::2014-04-10 17:30:54,473::task::811::TaskManager.Task::(resourceAcquired) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2479::DEBUG::2014-04-10 17:30:54,473::task::974::TaskManager.Task::(_decref) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::ref 1 aborting False
>Thread-2479::INFO::2014-04-10 17:30:54,475::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2479::DEBUG::2014-04-10 17:30:54,475::task::1168::TaskManager.Task::(prepare) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2479::DEBUG::2014-04-10 17:30:54,476::task::579::TaskManager.Task::(_updateState) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::moving from state preparing -> state finished
>Thread-2479::DEBUG::2014-04-10 17:30:54,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2479::DEBUG::2014-04-10 17:30:54,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2479::DEBUG::2014-04-10 17:30:54,476::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2479::DEBUG::2014-04-10 17:30:54,477::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2479::DEBUG::2014-04-10 17:30:54,477::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2479::DEBUG::2014-04-10 17:30:54,477::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2479::DEBUG::2014-04-10 17:30:54,477::task::974::TaskManager.Task::(_decref) Task=`838af18f-2b6a-4c10-8181-cc5bf21e4517`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:30:54,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:30:54,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000501355 s, 734 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:30:54,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:30:54,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000536916 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2482::DEBUG::2014-04-10 17:31:01,416::task::579::TaskManager.Task::(_updateState) Task=`3a17cf64-35f6-4869-9f28-052bc3265691`::moving from state init -> state preparing
>Thread-2482::INFO::2014-04-10 17:31:01,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2482::INFO::2014-04-10 17:31:01,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536916', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029992', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279709', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501355', 'lastCheck': '6.8', 'valid': True}}
>Thread-2482::DEBUG::2014-04-10 17:31:01,417::task::1168::TaskManager.Task::(prepare) Task=`3a17cf64-35f6-4869-9f28-052bc3265691`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536916', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029992', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279709', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501355', 'lastCheck': '6.8', 'valid': True}}
>Thread-2482::DEBUG::2014-04-10 17:31:01,417::task::579::TaskManager.Task::(_updateState) Task=`3a17cf64-35f6-4869-9f28-052bc3265691`::moving from state preparing -> state finished
>Thread-2482::DEBUG::2014-04-10 17:31:01,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2482::DEBUG::2014-04-10 17:31:01,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2482::DEBUG::2014-04-10 17:31:01,417::task::974::TaskManager.Task::(_decref) Task=`3a17cf64-35f6-4869-9f28-052bc3265691`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:31:04,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:04,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:04,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358441 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:04,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283175 s, 2.4 MB/s\n'; <rc> = 0
>Thread-2485::DEBUG::2014-04-10 17:31:04,550::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-2485::DEBUG::2014-04-10 17:31:04,551::task::579::TaskManager.Task::(_updateState) Task=`4ff01a76-0f8e-488a-bb38-72ea8384f1fe`::moving from state init -> state preparing
>Thread-2485::INFO::2014-04-10 17:31:04,551::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2485::INFO::2014-04-10 17:31:04,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2485::DEBUG::2014-04-10 17:31:04,552::task::1168::TaskManager.Task::(prepare) Task=`4ff01a76-0f8e-488a-bb38-72ea8384f1fe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2485::DEBUG::2014-04-10 17:31:04,552::task::579::TaskManager.Task::(_updateState) Task=`4ff01a76-0f8e-488a-bb38-72ea8384f1fe`::moving from state preparing -> state finished
>Thread-2485::DEBUG::2014-04-10 17:31:04,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2485::DEBUG::2014-04-10 17:31:04,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2485::DEBUG::2014-04-10 17:31:04,552::task::974::TaskManager.Task::(_decref) Task=`4ff01a76-0f8e-488a-bb38-72ea8384f1fe`::ref 0 aborting False
>Thread-2486::DEBUG::2014-04-10 17:31:04,559::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-2486::DEBUG::2014-04-10 17:31:04,560::task::579::TaskManager.Task::(_updateState) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::moving from state init -> state preparing
>Thread-2486::INFO::2014-04-10 17:31:04,560::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2486::DEBUG::2014-04-10 17:31:04,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1fb93dde-65a9-4ce1-a44f-42b38a643238`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2486::DEBUG::2014-04-10 17:31:04,561::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2486::DEBUG::2014-04-10 17:31:04,561::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2486::DEBUG::2014-04-10 17:31:04,561::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1fb93dde-65a9-4ce1-a44f-42b38a643238`::Granted request
>Thread-2486::DEBUG::2014-04-10 17:31:04,562::task::811::TaskManager.Task::(resourceAcquired) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2486::DEBUG::2014-04-10 17:31:04,562::task::974::TaskManager.Task::(_decref) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::ref 1 aborting False
>Thread-2486::INFO::2014-04-10 17:31:04,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2486::DEBUG::2014-04-10 17:31:04,564::task::1168::TaskManager.Task::(prepare) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2486::DEBUG::2014-04-10 17:31:04,564::task::579::TaskManager.Task::(_updateState) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::moving from state preparing -> state finished
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2486::DEBUG::2014-04-10 17:31:04,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2486::DEBUG::2014-04-10 17:31:04,566::task::974::TaskManager.Task::(_decref) Task=`b28e9e2f-e7db-42dc-9511-fa050823b352`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:31:04,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:04,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000404529 s, 910 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:31:04,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:04,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000532007 s, 1.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:31:14,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:14,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000465911 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:14,156::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:14,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272376 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:31:14,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:14,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004551 s, 809 kB/s\n'; <rc> = 0
>Thread-2490::DEBUG::2014-04-10 17:31:14,641::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2490::DEBUG::2014-04-10 17:31:14,641::task::579::TaskManager.Task::(_updateState) Task=`0b03d8e3-58e3-49e1-aacf-cea0f2c7f664`::moving from state init -> state preparing
>Thread-2490::INFO::2014-04-10 17:31:14,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2490::INFO::2014-04-10 17:31:14,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2490::DEBUG::2014-04-10 17:31:14,642::task::1168::TaskManager.Task::(prepare) Task=`0b03d8e3-58e3-49e1-aacf-cea0f2c7f664`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2490::DEBUG::2014-04-10 17:31:14,642::task::579::TaskManager.Task::(_updateState) Task=`0b03d8e3-58e3-49e1-aacf-cea0f2c7f664`::moving from state preparing -> state finished
>Thread-2490::DEBUG::2014-04-10 17:31:14,643::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2490::DEBUG::2014-04-10 17:31:14,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2490::DEBUG::2014-04-10 17:31:14,643::task::974::TaskManager.Task::(_decref) Task=`0b03d8e3-58e3-49e1-aacf-cea0f2c7f664`::ref 0 aborting False
>Thread-2491::DEBUG::2014-04-10 17:31:14,650::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2491::DEBUG::2014-04-10 17:31:14,650::task::579::TaskManager.Task::(_updateState) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::moving from state init -> state preparing
>Thread-2491::INFO::2014-04-10 17:31:14,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2491::DEBUG::2014-04-10 17:31:14,651::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5598e5e7-bd50-462c-b04d-5c4c949c606c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2491::DEBUG::2014-04-10 17:31:14,651::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2491::DEBUG::2014-04-10 17:31:14,651::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2491::DEBUG::2014-04-10 17:31:14,651::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5598e5e7-bd50-462c-b04d-5c4c949c606c`::Granted request
>Thread-2491::DEBUG::2014-04-10 17:31:14,652::task::811::TaskManager.Task::(resourceAcquired) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2491::DEBUG::2014-04-10 17:31:14,652::task::974::TaskManager.Task::(_decref) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::ref 1 aborting False
>Thread-2491::INFO::2014-04-10 17:31:14,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2491::DEBUG::2014-04-10 17:31:14,654::task::1168::TaskManager.Task::(prepare) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2491::DEBUG::2014-04-10 17:31:14,654::task::579::TaskManager.Task::(_updateState) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::moving from state preparing -> state finished
>Thread-2491::DEBUG::2014-04-10 17:31:14,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2491::DEBUG::2014-04-10 17:31:14,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2491::DEBUG::2014-04-10 17:31:14,655::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2491::DEBUG::2014-04-10 17:31:14,655::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2491::DEBUG::2014-04-10 17:31:14,655::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2491::DEBUG::2014-04-10 17:31:14,656::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2491::DEBUG::2014-04-10 17:31:14,656::task::974::TaskManager.Task::(_decref) Task=`8b0dd3d2-fbc0-41a1-a489-12524db8bf04`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:31:14,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:14,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448338 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2492::DEBUG::2014-04-10 17:31:16,574::task::579::TaskManager.Task::(_updateState) Task=`0585cbb0-fcee-4f57-8a79-df90c302efd0`::moving from state init -> state preparing
>Thread-2492::INFO::2014-04-10 17:31:16,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2492::INFO::2014-04-10 17:31:16,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448338', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465911', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272376', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004551', 'lastCheck': '1.9', 'valid': True}}
>Thread-2492::DEBUG::2014-04-10 17:31:16,575::task::1168::TaskManager.Task::(prepare) Task=`0585cbb0-fcee-4f57-8a79-df90c302efd0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448338', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465911', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272376', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004551', 'lastCheck': '1.9', 'valid': True}}
>Thread-2492::DEBUG::2014-04-10 17:31:16,575::task::579::TaskManager.Task::(_updateState) Task=`0585cbb0-fcee-4f57-8a79-df90c302efd0`::moving from state preparing -> state finished
>Thread-2492::DEBUG::2014-04-10 17:31:16,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2492::DEBUG::2014-04-10 17:31:16,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2492::DEBUG::2014-04-10 17:31:16,576::task::974::TaskManager.Task::(_decref) Task=`0585cbb0-fcee-4f57-8a79-df90c302efd0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:31:24,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:24,218::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343544 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:24,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:24,233::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319562 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:31:24,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:24,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00049508 s, 743 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:31:24,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:24,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000490651 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2496::DEBUG::2014-04-10 17:31:24,748::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2496::DEBUG::2014-04-10 17:31:24,749::task::579::TaskManager.Task::(_updateState) Task=`29f5e9e5-004f-467f-98d1-2897a122afce`::moving from state init -> state preparing
>Thread-2496::INFO::2014-04-10 17:31:24,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2496::INFO::2014-04-10 17:31:24,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2496::DEBUG::2014-04-10 17:31:24,750::task::1168::TaskManager.Task::(prepare) Task=`29f5e9e5-004f-467f-98d1-2897a122afce`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2496::DEBUG::2014-04-10 17:31:24,750::task::579::TaskManager.Task::(_updateState) Task=`29f5e9e5-004f-467f-98d1-2897a122afce`::moving from state preparing -> state finished
>Thread-2496::DEBUG::2014-04-10 17:31:24,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2496::DEBUG::2014-04-10 17:31:24,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2496::DEBUG::2014-04-10 17:31:24,751::task::974::TaskManager.Task::(_decref) Task=`29f5e9e5-004f-467f-98d1-2897a122afce`::ref 0 aborting False
>Thread-2497::DEBUG::2014-04-10 17:31:24,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2497::DEBUG::2014-04-10 17:31:24,758::task::579::TaskManager.Task::(_updateState) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::moving from state init -> state preparing
>Thread-2497::INFO::2014-04-10 17:31:24,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2497::DEBUG::2014-04-10 17:31:24,759::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6abea4e-685d-4c06-a857-66db824c0f44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2497::DEBUG::2014-04-10 17:31:24,759::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2497::DEBUG::2014-04-10 17:31:24,759::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2497::DEBUG::2014-04-10 17:31:24,759::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6abea4e-685d-4c06-a857-66db824c0f44`::Granted request
>Thread-2497::DEBUG::2014-04-10 17:31:24,760::task::811::TaskManager.Task::(resourceAcquired) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2497::DEBUG::2014-04-10 17:31:24,760::task::974::TaskManager.Task::(_decref) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::ref 1 aborting False
>Thread-2497::INFO::2014-04-10 17:31:24,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2497::DEBUG::2014-04-10 17:31:24,762::task::1168::TaskManager.Task::(prepare) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2497::DEBUG::2014-04-10 17:31:24,762::task::579::TaskManager.Task::(_updateState) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::moving from state preparing -> state finished
>Thread-2497::DEBUG::2014-04-10 17:31:24,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2497::DEBUG::2014-04-10 17:31:24,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2497::DEBUG::2014-04-10 17:31:24,763::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2497::DEBUG::2014-04-10 17:31:24,763::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2497::DEBUG::2014-04-10 17:31:24,763::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2497::DEBUG::2014-04-10 17:31:24,763::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2497::DEBUG::2014-04-10 17:31:24,764::task::974::TaskManager.Task::(_decref) Task=`cf0bf2b3-eb24-4733-8094-556419057b97`::ref 0 aborting False
>Thread-2500::DEBUG::2014-04-10 17:31:31,726::task::579::TaskManager.Task::(_updateState) Task=`69ffa085-d9f3-46a6-8f56-9657d6813710`::moving from state init -> state preparing
>Thread-2500::INFO::2014-04-10 17:31:31,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2500::INFO::2014-04-10 17:31:31,727::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490651', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343544', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319562', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049508', 'lastCheck': '7.1', 'valid': True}}
>Thread-2500::DEBUG::2014-04-10 17:31:31,727::task::1168::TaskManager.Task::(prepare) Task=`69ffa085-d9f3-46a6-8f56-9657d6813710`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490651', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343544', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319562', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049508', 'lastCheck': '7.1', 'valid': True}}
>Thread-2500::DEBUG::2014-04-10 17:31:31,727::task::579::TaskManager.Task::(_updateState) Task=`69ffa085-d9f3-46a6-8f56-9657d6813710`::moving from state preparing -> state finished
>Thread-2500::DEBUG::2014-04-10 17:31:31,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2500::DEBUG::2014-04-10 17:31:31,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2500::DEBUG::2014-04-10 17:31:31,728::task::974::TaskManager.Task::(_decref) Task=`69ffa085-d9f3-46a6-8f56-9657d6813710`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:31:34,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:34,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324181 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:34,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:34,274::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299886 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:31:34,657::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:34,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486215 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:31:34,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:34,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445017 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2503::DEBUG::2014-04-10 17:31:35,289::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2503::DEBUG::2014-04-10 17:31:35,289::task::579::TaskManager.Task::(_updateState) Task=`57d5f869-b00c-4637-aad0-fb0cd9daceeb`::moving from state init -> state preparing
>Thread-2503::INFO::2014-04-10 17:31:35,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2503::INFO::2014-04-10 17:31:35,290::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2503::DEBUG::2014-04-10 17:31:35,290::task::1168::TaskManager.Task::(prepare) Task=`57d5f869-b00c-4637-aad0-fb0cd9daceeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2503::DEBUG::2014-04-10 17:31:35,290::task::579::TaskManager.Task::(_updateState) Task=`57d5f869-b00c-4637-aad0-fb0cd9daceeb`::moving from state preparing -> state finished
>Thread-2503::DEBUG::2014-04-10 17:31:35,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2503::DEBUG::2014-04-10 17:31:35,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2503::DEBUG::2014-04-10 17:31:35,291::task::974::TaskManager.Task::(_decref) Task=`57d5f869-b00c-4637-aad0-fb0cd9daceeb`::ref 0 aborting False
>Thread-2504::DEBUG::2014-04-10 17:31:35,298::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2504::DEBUG::2014-04-10 17:31:35,299::task::579::TaskManager.Task::(_updateState) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::moving from state init -> state preparing
>Thread-2504::INFO::2014-04-10 17:31:35,299::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2504::DEBUG::2014-04-10 17:31:35,299::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`81470c67-9392-47ce-bca6-f25631fef483`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2504::DEBUG::2014-04-10 17:31:35,300::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2504::DEBUG::2014-04-10 17:31:35,300::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2504::DEBUG::2014-04-10 17:31:35,300::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`81470c67-9392-47ce-bca6-f25631fef483`::Granted request
>Thread-2504::DEBUG::2014-04-10 17:31:35,301::task::811::TaskManager.Task::(resourceAcquired) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2504::DEBUG::2014-04-10 17:31:35,301::task::974::TaskManager.Task::(_decref) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::ref 1 aborting False
>Thread-2504::INFO::2014-04-10 17:31:35,303::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2504::DEBUG::2014-04-10 17:31:35,304::task::1168::TaskManager.Task::(prepare) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2504::DEBUG::2014-04-10 17:31:35,304::task::579::TaskManager.Task::(_updateState) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::moving from state preparing -> state finished
>Thread-2504::DEBUG::2014-04-10 17:31:35,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2504::DEBUG::2014-04-10 17:31:35,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2504::DEBUG::2014-04-10 17:31:35,305::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2504::DEBUG::2014-04-10 17:31:35,305::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2504::DEBUG::2014-04-10 17:31:35,305::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2504::DEBUG::2014-04-10 17:31:35,305::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2504::DEBUG::2014-04-10 17:31:35,305::task::974::TaskManager.Task::(_decref) Task=`7d34a09a-34db-4383-95ae-4222d19ab994`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:31:44,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:44,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:44,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317817 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:44,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328914 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:31:44,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:44,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000404636 s, 909 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:31:44,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:44,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000515714 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2508::DEBUG::2014-04-10 17:31:45,386::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2508::DEBUG::2014-04-10 17:31:45,387::task::579::TaskManager.Task::(_updateState) Task=`1ba20c88-e3cc-4643-a37f-aa0da6dee188`::moving from state init -> state preparing
>Thread-2508::INFO::2014-04-10 17:31:45,387::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2508::INFO::2014-04-10 17:31:45,388::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2508::DEBUG::2014-04-10 17:31:45,388::task::1168::TaskManager.Task::(prepare) Task=`1ba20c88-e3cc-4643-a37f-aa0da6dee188`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2508::DEBUG::2014-04-10 17:31:45,388::task::579::TaskManager.Task::(_updateState) Task=`1ba20c88-e3cc-4643-a37f-aa0da6dee188`::moving from state preparing -> state finished
>Thread-2508::DEBUG::2014-04-10 17:31:45,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2508::DEBUG::2014-04-10 17:31:45,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2508::DEBUG::2014-04-10 17:31:45,388::task::974::TaskManager.Task::(_decref) Task=`1ba20c88-e3cc-4643-a37f-aa0da6dee188`::ref 0 aborting False
>Thread-2509::DEBUG::2014-04-10 17:31:45,395::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2509::DEBUG::2014-04-10 17:31:45,395::task::579::TaskManager.Task::(_updateState) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::moving from state init -> state preparing
>Thread-2509::INFO::2014-04-10 17:31:45,396::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2509::DEBUG::2014-04-10 17:31:45,396::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9812ec53-6818-4cd9-8e55-4e7c13a9af12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2509::DEBUG::2014-04-10 17:31:45,396::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2509::DEBUG::2014-04-10 17:31:45,396::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2509::DEBUG::2014-04-10 17:31:45,397::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9812ec53-6818-4cd9-8e55-4e7c13a9af12`::Granted request
>Thread-2509::DEBUG::2014-04-10 17:31:45,397::task::811::TaskManager.Task::(resourceAcquired) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2509::DEBUG::2014-04-10 17:31:45,397::task::974::TaskManager.Task::(_decref) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::ref 1 aborting False
>Thread-2509::INFO::2014-04-10 17:31:45,399::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2509::DEBUG::2014-04-10 17:31:45,399::task::1168::TaskManager.Task::(prepare) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2509::DEBUG::2014-04-10 17:31:45,400::task::579::TaskManager.Task::(_updateState) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::moving from state preparing -> state finished
>Thread-2509::DEBUG::2014-04-10 17:31:45,400::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2509::DEBUG::2014-04-10 17:31:45,400::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2509::DEBUG::2014-04-10 17:31:45,400::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2509::DEBUG::2014-04-10 17:31:45,401::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2509::DEBUG::2014-04-10 17:31:45,401::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2509::DEBUG::2014-04-10 17:31:45,401::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2509::DEBUG::2014-04-10 17:31:45,401::task::974::TaskManager.Task::(_decref) Task=`bfec5282-63a7-4ed5-b27e-f84556fe40ad`::ref 0 aborting False
>Thread-2510::DEBUG::2014-04-10 17:31:47,373::task::579::TaskManager.Task::(_updateState) Task=`3ff944a3-d0c8-40b0-ac70-e6f67496d2ea`::moving from state init -> state preparing
>Thread-2510::INFO::2014-04-10 17:31:47,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2510::INFO::2014-04-10 17:31:47,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515714', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317817', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328914', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404636', 'lastCheck': '2.7', 'valid': True}}
>Thread-2510::DEBUG::2014-04-10 17:31:47,375::task::1168::TaskManager.Task::(prepare) Task=`3ff944a3-d0c8-40b0-ac70-e6f67496d2ea`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515714', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317817', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328914', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404636', 'lastCheck': '2.7', 'valid': True}}
>Thread-2510::DEBUG::2014-04-10 17:31:47,376::task::579::TaskManager.Task::(_updateState) Task=`3ff944a3-d0c8-40b0-ac70-e6f67496d2ea`::moving from state preparing -> state finished
>Thread-2510::DEBUG::2014-04-10 17:31:47,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2510::DEBUG::2014-04-10 17:31:47,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2510::DEBUG::2014-04-10 17:31:47,377::task::974::TaskManager.Task::(_decref) Task=`3ff944a3-d0c8-40b0-ac70-e6f67496d2ea`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:31:54,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:31:54,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338165 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:31:54,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:31:54,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287349 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:31:54,679::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:31:54,695::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:31:54,697::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:31:54,702::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:31:54,704::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:31:54,704::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:31:54,704::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:31:54,709::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:31:54,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000353461 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:31:54,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:31:54,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000433154 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2518::DEBUG::2014-04-10 17:31:55,493::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2518::DEBUG::2014-04-10 17:31:55,494::task::579::TaskManager.Task::(_updateState) Task=`b9be325a-37be-4adf-87a6-8c96150adfeb`::moving from state init -> state preparing
>Thread-2518::INFO::2014-04-10 17:31:55,494::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2518::INFO::2014-04-10 17:31:55,495::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2518::DEBUG::2014-04-10 17:31:55,495::task::1168::TaskManager.Task::(prepare) Task=`b9be325a-37be-4adf-87a6-8c96150adfeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2518::DEBUG::2014-04-10 17:31:55,495::task::579::TaskManager.Task::(_updateState) Task=`b9be325a-37be-4adf-87a6-8c96150adfeb`::moving from state preparing -> state finished
>Thread-2518::DEBUG::2014-04-10 17:31:55,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2518::DEBUG::2014-04-10 17:31:55,495::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2518::DEBUG::2014-04-10 17:31:55,495::task::974::TaskManager.Task::(_decref) Task=`b9be325a-37be-4adf-87a6-8c96150adfeb`::ref 0 aborting False
>Thread-2519::DEBUG::2014-04-10 17:31:55,502::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2519::DEBUG::2014-04-10 17:31:55,502::task::579::TaskManager.Task::(_updateState) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::moving from state init -> state preparing
>Thread-2519::INFO::2014-04-10 17:31:55,502::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2519::DEBUG::2014-04-10 17:31:55,503::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a5bca94e-9791-4823-b396-ef92e5619ffa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2519::DEBUG::2014-04-10 17:31:55,503::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2519::DEBUG::2014-04-10 17:31:55,503::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2519::DEBUG::2014-04-10 17:31:55,503::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a5bca94e-9791-4823-b396-ef92e5619ffa`::Granted request
>Thread-2519::DEBUG::2014-04-10 17:31:55,503::task::811::TaskManager.Task::(resourceAcquired) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2519::DEBUG::2014-04-10 17:31:55,504::task::974::TaskManager.Task::(_decref) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::ref 1 aborting False
>Thread-2519::INFO::2014-04-10 17:31:55,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2519::DEBUG::2014-04-10 17:31:55,506::task::1168::TaskManager.Task::(prepare) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2519::DEBUG::2014-04-10 17:31:55,506::task::579::TaskManager.Task::(_updateState) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::moving from state preparing -> state finished
>Thread-2519::DEBUG::2014-04-10 17:31:55,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2519::DEBUG::2014-04-10 17:31:55,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2519::DEBUG::2014-04-10 17:31:55,506::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2519::DEBUG::2014-04-10 17:31:55,507::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2519::DEBUG::2014-04-10 17:31:55,507::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2519::DEBUG::2014-04-10 17:31:55,507::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2519::DEBUG::2014-04-10 17:31:55,507::task::974::TaskManager.Task::(_decref) Task=`a19f63b3-1648-422e-b1db-898f9f9f847a`::ref 0 aborting False
>Thread-2522::DEBUG::2014-04-10 17:32:02,687::task::579::TaskManager.Task::(_updateState) Task=`1e5a14e3-1605-4d1a-a6cb-23e1e9de0cc1`::moving from state init -> state preparing
>Thread-2522::INFO::2014-04-10 17:32:02,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2522::INFO::2014-04-10 17:32:02,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433154', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338165', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287349', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353461', 'lastCheck': '8.0', 'valid': True}}
>Thread-2522::DEBUG::2014-04-10 17:32:02,688::task::1168::TaskManager.Task::(prepare) Task=`1e5a14e3-1605-4d1a-a6cb-23e1e9de0cc1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433154', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338165', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287349', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353461', 'lastCheck': '8.0', 'valid': True}}
>Thread-2522::DEBUG::2014-04-10 17:32:02,689::task::579::TaskManager.Task::(_updateState) Task=`1e5a14e3-1605-4d1a-a6cb-23e1e9de0cc1`::moving from state preparing -> state finished
>Thread-2522::DEBUG::2014-04-10 17:32:02,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2522::DEBUG::2014-04-10 17:32:02,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2522::DEBUG::2014-04-10 17:32:02,689::task::974::TaskManager.Task::(_decref) Task=`1e5a14e3-1605-4d1a-a6cb-23e1e9de0cc1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:04,406::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:04,423::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:04,423::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339446 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:04,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295616 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:04,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:04,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488449 s, 753 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:04,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:04,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473024 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2524::DEBUG::2014-04-10 17:32:05,585::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2524::DEBUG::2014-04-10 17:32:05,586::task::579::TaskManager.Task::(_updateState) Task=`076efea8-65b6-4667-95b6-4bd9138bc46f`::moving from state init -> state preparing
>Thread-2524::INFO::2014-04-10 17:32:05,586::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2524::INFO::2014-04-10 17:32:05,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2524::DEBUG::2014-04-10 17:32:05,587::task::1168::TaskManager.Task::(prepare) Task=`076efea8-65b6-4667-95b6-4bd9138bc46f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2524::DEBUG::2014-04-10 17:32:05,587::task::579::TaskManager.Task::(_updateState) Task=`076efea8-65b6-4667-95b6-4bd9138bc46f`::moving from state preparing -> state finished
>Thread-2524::DEBUG::2014-04-10 17:32:05,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2524::DEBUG::2014-04-10 17:32:05,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2524::DEBUG::2014-04-10 17:32:05,587::task::974::TaskManager.Task::(_decref) Task=`076efea8-65b6-4667-95b6-4bd9138bc46f`::ref 0 aborting False
>Thread-2525::DEBUG::2014-04-10 17:32:05,594::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2525::DEBUG::2014-04-10 17:32:05,594::task::579::TaskManager.Task::(_updateState) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::moving from state init -> state preparing
>Thread-2525::INFO::2014-04-10 17:32:05,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2525::DEBUG::2014-04-10 17:32:05,595::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`de86bed3-4e33-4250-92db-1b21764735b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2525::DEBUG::2014-04-10 17:32:05,595::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2525::DEBUG::2014-04-10 17:32:05,596::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2525::DEBUG::2014-04-10 17:32:05,596::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`de86bed3-4e33-4250-92db-1b21764735b8`::Granted request
>Thread-2525::DEBUG::2014-04-10 17:32:05,596::task::811::TaskManager.Task::(resourceAcquired) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2525::DEBUG::2014-04-10 17:32:05,596::task::974::TaskManager.Task::(_decref) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::ref 1 aborting False
>Thread-2525::INFO::2014-04-10 17:32:05,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2525::DEBUG::2014-04-10 17:32:05,599::task::1168::TaskManager.Task::(prepare) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2525::DEBUG::2014-04-10 17:32:05,599::task::579::TaskManager.Task::(_updateState) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::moving from state preparing -> state finished
>Thread-2525::DEBUG::2014-04-10 17:32:05,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2525::DEBUG::2014-04-10 17:32:05,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2525::DEBUG::2014-04-10 17:32:05,599::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2525::DEBUG::2014-04-10 17:32:05,600::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2525::DEBUG::2014-04-10 17:32:05,600::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2525::DEBUG::2014-04-10 17:32:05,600::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2525::DEBUG::2014-04-10 17:32:05,600::task::974::TaskManager.Task::(_decref) Task=`8693ce34-15a7-40ef-ac1f-19d0b26e1eb9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:14,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:14,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000385803 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:14,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:14,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368083 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:14,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:14,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000527007 s, 698 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:14,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:14,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000417374 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2530::DEBUG::2014-04-10 17:32:15,674::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2530::DEBUG::2014-04-10 17:32:15,675::task::579::TaskManager.Task::(_updateState) Task=`264e52d2-7c44-458a-bfcf-43ef07318967`::moving from state init -> state preparing
>Thread-2530::INFO::2014-04-10 17:32:15,675::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2530::INFO::2014-04-10 17:32:15,675::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2530::DEBUG::2014-04-10 17:32:15,675::task::1168::TaskManager.Task::(prepare) Task=`264e52d2-7c44-458a-bfcf-43ef07318967`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2530::DEBUG::2014-04-10 17:32:15,676::task::579::TaskManager.Task::(_updateState) Task=`264e52d2-7c44-458a-bfcf-43ef07318967`::moving from state preparing -> state finished
>Thread-2530::DEBUG::2014-04-10 17:32:15,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2530::DEBUG::2014-04-10 17:32:15,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2530::DEBUG::2014-04-10 17:32:15,676::task::974::TaskManager.Task::(_decref) Task=`264e52d2-7c44-458a-bfcf-43ef07318967`::ref 0 aborting False
>Thread-2531::DEBUG::2014-04-10 17:32:15,683::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2531::DEBUG::2014-04-10 17:32:15,683::task::579::TaskManager.Task::(_updateState) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::moving from state init -> state preparing
>Thread-2531::INFO::2014-04-10 17:32:15,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2531::DEBUG::2014-04-10 17:32:15,684::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b2b1549-e1f7-4400-90a8-1f6ffc1f636b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2531::DEBUG::2014-04-10 17:32:15,686::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2531::DEBUG::2014-04-10 17:32:15,686::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2531::DEBUG::2014-04-10 17:32:15,686::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b2b1549-e1f7-4400-90a8-1f6ffc1f636b`::Granted request
>Thread-2531::DEBUG::2014-04-10 17:32:15,686::task::811::TaskManager.Task::(resourceAcquired) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2531::DEBUG::2014-04-10 17:32:15,687::task::974::TaskManager.Task::(_decref) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::ref 1 aborting False
>Thread-2531::INFO::2014-04-10 17:32:15,689::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2531::DEBUG::2014-04-10 17:32:15,689::task::1168::TaskManager.Task::(prepare) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2531::DEBUG::2014-04-10 17:32:15,689::task::579::TaskManager.Task::(_updateState) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::moving from state preparing -> state finished
>Thread-2531::DEBUG::2014-04-10 17:32:15,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2531::DEBUG::2014-04-10 17:32:15,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2531::DEBUG::2014-04-10 17:32:15,690::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2531::DEBUG::2014-04-10 17:32:15,690::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2531::DEBUG::2014-04-10 17:32:15,690::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2531::DEBUG::2014-04-10 17:32:15,690::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2531::DEBUG::2014-04-10 17:32:15,691::task::974::TaskManager.Task::(_decref) Task=`3bd63bc0-1569-43cf-aa55-cae8b0beb1ca`::ref 0 aborting False
>Thread-2532::DEBUG::2014-04-10 17:32:17,864::task::579::TaskManager.Task::(_updateState) Task=`a0d3685d-96d3-4cf5-8868-39285f790e42`::moving from state init -> state preparing
>Thread-2532::INFO::2014-04-10 17:32:17,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2532::INFO::2014-04-10 17:32:17,865::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417374', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385803', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368083', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527007', 'lastCheck': '3.1', 'valid': True}}
>Thread-2532::DEBUG::2014-04-10 17:32:17,865::task::1168::TaskManager.Task::(prepare) Task=`a0d3685d-96d3-4cf5-8868-39285f790e42`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417374', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385803', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368083', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527007', 'lastCheck': '3.1', 'valid': True}}
>Thread-2532::DEBUG::2014-04-10 17:32:17,866::task::579::TaskManager.Task::(_updateState) Task=`a0d3685d-96d3-4cf5-8868-39285f790e42`::moving from state preparing -> state finished
>Thread-2532::DEBUG::2014-04-10 17:32:17,866::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2532::DEBUG::2014-04-10 17:32:17,866::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2532::DEBUG::2014-04-10 17:32:17,866::task::974::TaskManager.Task::(_decref) Task=`a0d3685d-96d3-4cf5-8868-39285f790e42`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:24,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:24,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390231 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:24,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:24,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325752 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:24,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:24,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000483932 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:24,790::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:24,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000453702 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2536::DEBUG::2014-04-10 17:32:25,772::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2536::DEBUG::2014-04-10 17:32:25,773::task::579::TaskManager.Task::(_updateState) Task=`bec74c2e-6224-459a-9c5e-d34939cce50e`::moving from state init -> state preparing
>Thread-2536::INFO::2014-04-10 17:32:25,773::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2536::INFO::2014-04-10 17:32:25,773::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2536::DEBUG::2014-04-10 17:32:25,774::task::1168::TaskManager.Task::(prepare) Task=`bec74c2e-6224-459a-9c5e-d34939cce50e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2536::DEBUG::2014-04-10 17:32:25,774::task::579::TaskManager.Task::(_updateState) Task=`bec74c2e-6224-459a-9c5e-d34939cce50e`::moving from state preparing -> state finished
>Thread-2536::DEBUG::2014-04-10 17:32:25,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2536::DEBUG::2014-04-10 17:32:25,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2536::DEBUG::2014-04-10 17:32:25,774::task::974::TaskManager.Task::(_decref) Task=`bec74c2e-6224-459a-9c5e-d34939cce50e`::ref 0 aborting False
>Thread-2537::DEBUG::2014-04-10 17:32:25,781::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2537::DEBUG::2014-04-10 17:32:25,782::task::579::TaskManager.Task::(_updateState) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::moving from state init -> state preparing
>Thread-2537::INFO::2014-04-10 17:32:25,782::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2537::DEBUG::2014-04-10 17:32:25,782::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a184c77-daba-4fda-bab1-d82a8e180427`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2537::DEBUG::2014-04-10 17:32:25,783::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2537::DEBUG::2014-04-10 17:32:25,783::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2537::DEBUG::2014-04-10 17:32:25,783::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a184c77-daba-4fda-bab1-d82a8e180427`::Granted request
>Thread-2537::DEBUG::2014-04-10 17:32:25,783::task::811::TaskManager.Task::(resourceAcquired) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2537::DEBUG::2014-04-10 17:32:25,783::task::974::TaskManager.Task::(_decref) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::ref 1 aborting False
>Thread-2537::INFO::2014-04-10 17:32:25,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2537::DEBUG::2014-04-10 17:32:25,785::task::1168::TaskManager.Task::(prepare) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::task::579::TaskManager.Task::(_updateState) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::moving from state preparing -> state finished
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2537::DEBUG::2014-04-10 17:32:25,786::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2537::DEBUG::2014-04-10 17:32:25,787::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2537::DEBUG::2014-04-10 17:32:25,787::task::974::TaskManager.Task::(_decref) Task=`18dd7948-b375-43e8-a76e-c3cdeec9feec`::ref 0 aborting False
>Thread-2540::DEBUG::2014-04-10 17:32:33,058::task::579::TaskManager.Task::(_updateState) Task=`db05b694-8e6e-4862-ba00-27ad66059a82`::moving from state init -> state preparing
>Thread-2540::INFO::2014-04-10 17:32:33,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2540::INFO::2014-04-10 17:32:33,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453702', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390231', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325752', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483932', 'lastCheck': '8.3', 'valid': True}}
>Thread-2540::DEBUG::2014-04-10 17:32:33,059::task::1168::TaskManager.Task::(prepare) Task=`db05b694-8e6e-4862-ba00-27ad66059a82`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453702', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390231', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325752', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483932', 'lastCheck': '8.3', 'valid': True}}
>Thread-2540::DEBUG::2014-04-10 17:32:33,059::task::579::TaskManager.Task::(_updateState) Task=`db05b694-8e6e-4862-ba00-27ad66059a82`::moving from state preparing -> state finished
>Thread-2540::DEBUG::2014-04-10 17:32:33,059::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2540::DEBUG::2014-04-10 17:32:33,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2540::DEBUG::2014-04-10 17:32:33,060::task::974::TaskManager.Task::(_decref) Task=`db05b694-8e6e-4862-ba00-27ad66059a82`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:34,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:34,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000409903 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:34,543::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:34,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355616 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:34,769::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:34,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000455527 s, 808 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:34,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:34,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479363 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2542::DEBUG::2014-04-10 17:32:36,210::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2542::DEBUG::2014-04-10 17:32:36,212::task::579::TaskManager.Task::(_updateState) Task=`b7fa7477-be86-4a22-bf2c-a2ae4c34e286`::moving from state init -> state preparing
>Thread-2542::INFO::2014-04-10 17:32:36,214::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2542::INFO::2014-04-10 17:32:36,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2542::DEBUG::2014-04-10 17:32:36,220::task::1168::TaskManager.Task::(prepare) Task=`b7fa7477-be86-4a22-bf2c-a2ae4c34e286`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2542::DEBUG::2014-04-10 17:32:36,221::task::579::TaskManager.Task::(_updateState) Task=`b7fa7477-be86-4a22-bf2c-a2ae4c34e286`::moving from state preparing -> state finished
>Thread-2542::DEBUG::2014-04-10 17:32:36,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2542::DEBUG::2014-04-10 17:32:36,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2542::DEBUG::2014-04-10 17:32:36,222::task::974::TaskManager.Task::(_decref) Task=`b7fa7477-be86-4a22-bf2c-a2ae4c34e286`::ref 0 aborting False
>Thread-2544::DEBUG::2014-04-10 17:32:36,231::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2544::DEBUG::2014-04-10 17:32:36,231::task::579::TaskManager.Task::(_updateState) Task=`f159a392-33ce-4778-b345-00064e76eec3`::moving from state init -> state preparing
>Thread-2544::INFO::2014-04-10 17:32:36,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2544::DEBUG::2014-04-10 17:32:36,232::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ea7ff648-2258-4572-a56e-f91e5ea52aa8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2544::DEBUG::2014-04-10 17:32:36,232::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2544::DEBUG::2014-04-10 17:32:36,232::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2544::DEBUG::2014-04-10 17:32:36,232::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ea7ff648-2258-4572-a56e-f91e5ea52aa8`::Granted request
>Thread-2544::DEBUG::2014-04-10 17:32:36,233::task::811::TaskManager.Task::(resourceAcquired) Task=`f159a392-33ce-4778-b345-00064e76eec3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2544::DEBUG::2014-04-10 17:32:36,233::task::974::TaskManager.Task::(_decref) Task=`f159a392-33ce-4778-b345-00064e76eec3`::ref 1 aborting False
>Thread-2544::INFO::2014-04-10 17:32:36,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2544::DEBUG::2014-04-10 17:32:36,235::task::1168::TaskManager.Task::(prepare) Task=`f159a392-33ce-4778-b345-00064e76eec3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2544::DEBUG::2014-04-10 17:32:36,235::task::579::TaskManager.Task::(_updateState) Task=`f159a392-33ce-4778-b345-00064e76eec3`::moving from state preparing -> state finished
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2544::DEBUG::2014-04-10 17:32:36,236::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2544::DEBUG::2014-04-10 17:32:36,237::task::974::TaskManager.Task::(_decref) Task=`f159a392-33ce-4778-b345-00064e76eec3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:44,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:44,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339612 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:44,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:44,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294696 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:44,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:44,790::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000386819 s, 951 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:44,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:44,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460392 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2548::DEBUG::2014-04-10 17:32:46,311::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2548::DEBUG::2014-04-10 17:32:46,311::task::579::TaskManager.Task::(_updateState) Task=`9f2928e0-6090-496d-a2c1-197462c900c9`::moving from state init -> state preparing
>Thread-2548::INFO::2014-04-10 17:32:46,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2548::INFO::2014-04-10 17:32:46,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2548::DEBUG::2014-04-10 17:32:46,312::task::1168::TaskManager.Task::(prepare) Task=`9f2928e0-6090-496d-a2c1-197462c900c9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2548::DEBUG::2014-04-10 17:32:46,312::task::579::TaskManager.Task::(_updateState) Task=`9f2928e0-6090-496d-a2c1-197462c900c9`::moving from state preparing -> state finished
>Thread-2548::DEBUG::2014-04-10 17:32:46,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2548::DEBUG::2014-04-10 17:32:46,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2548::DEBUG::2014-04-10 17:32:46,313::task::974::TaskManager.Task::(_decref) Task=`9f2928e0-6090-496d-a2c1-197462c900c9`::ref 0 aborting False
>Thread-2549::DEBUG::2014-04-10 17:32:46,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2549::DEBUG::2014-04-10 17:32:46,319::task::579::TaskManager.Task::(_updateState) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::moving from state init -> state preparing
>Thread-2549::INFO::2014-04-10 17:32:46,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2549::DEBUG::2014-04-10 17:32:46,320::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a213ec2-b6eb-479a-89c3-b9e046ac5b7d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2549::DEBUG::2014-04-10 17:32:46,320::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2549::DEBUG::2014-04-10 17:32:46,320::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2549::DEBUG::2014-04-10 17:32:46,320::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a213ec2-b6eb-479a-89c3-b9e046ac5b7d`::Granted request
>Thread-2549::DEBUG::2014-04-10 17:32:46,321::task::811::TaskManager.Task::(resourceAcquired) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2549::DEBUG::2014-04-10 17:32:46,321::task::974::TaskManager.Task::(_decref) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::ref 1 aborting False
>Thread-2549::INFO::2014-04-10 17:32:46,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2549::DEBUG::2014-04-10 17:32:46,323::task::1168::TaskManager.Task::(prepare) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2549::DEBUG::2014-04-10 17:32:46,323::task::579::TaskManager.Task::(_updateState) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::moving from state preparing -> state finished
>Thread-2549::DEBUG::2014-04-10 17:32:46,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2549::DEBUG::2014-04-10 17:32:46,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2549::DEBUG::2014-04-10 17:32:46,323::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2549::DEBUG::2014-04-10 17:32:46,324::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2549::DEBUG::2014-04-10 17:32:46,324::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2549::DEBUG::2014-04-10 17:32:46,324::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2549::DEBUG::2014-04-10 17:32:46,324::task::974::TaskManager.Task::(_decref) Task=`3b0edfc9-6b6a-4c49-b74e-e19fe28e7734`::ref 0 aborting False
>Thread-2550::DEBUG::2014-04-10 17:32:48,297::task::579::TaskManager.Task::(_updateState) Task=`6b7200fb-01ff-4f65-9b5e-a28844ccd7b1`::moving from state init -> state preparing
>Thread-2550::INFO::2014-04-10 17:32:48,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2550::INFO::2014-04-10 17:32:48,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460392', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339612', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294696', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386819', 'lastCheck': '3.5', 'valid': True}}
>Thread-2550::DEBUG::2014-04-10 17:32:48,298::task::1168::TaskManager.Task::(prepare) Task=`6b7200fb-01ff-4f65-9b5e-a28844ccd7b1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460392', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339612', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294696', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386819', 'lastCheck': '3.5', 'valid': True}}
>Thread-2550::DEBUG::2014-04-10 17:32:48,298::task::579::TaskManager.Task::(_updateState) Task=`6b7200fb-01ff-4f65-9b5e-a28844ccd7b1`::moving from state preparing -> state finished
>Thread-2550::DEBUG::2014-04-10 17:32:48,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2550::DEBUG::2014-04-10 17:32:48,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2550::DEBUG::2014-04-10 17:32:48,298::task::974::TaskManager.Task::(_decref) Task=`6b7200fb-01ff-4f65-9b5e-a28844ccd7b1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:32:54,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:32:54,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377073 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:32:54,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:32:54,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335705 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:32:54,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:32:54,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000411162 s, 895 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:32:54,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:32:54,838::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000442972 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2554::DEBUG::2014-04-10 17:32:56,393::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2554::DEBUG::2014-04-10 17:32:56,393::task::579::TaskManager.Task::(_updateState) Task=`b6181b92-84bb-4067-8f2b-46d5494aa8c7`::moving from state init -> state preparing
>Thread-2554::INFO::2014-04-10 17:32:56,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2554::INFO::2014-04-10 17:32:56,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2554::DEBUG::2014-04-10 17:32:56,394::task::1168::TaskManager.Task::(prepare) Task=`b6181b92-84bb-4067-8f2b-46d5494aa8c7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2554::DEBUG::2014-04-10 17:32:56,394::task::579::TaskManager.Task::(_updateState) Task=`b6181b92-84bb-4067-8f2b-46d5494aa8c7`::moving from state preparing -> state finished
>Thread-2554::DEBUG::2014-04-10 17:32:56,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2554::DEBUG::2014-04-10 17:32:56,395::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2554::DEBUG::2014-04-10 17:32:56,395::task::974::TaskManager.Task::(_decref) Task=`b6181b92-84bb-4067-8f2b-46d5494aa8c7`::ref 0 aborting False
>Thread-2555::DEBUG::2014-04-10 17:32:56,401::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2555::DEBUG::2014-04-10 17:32:56,401::task::579::TaskManager.Task::(_updateState) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::moving from state init -> state preparing
>Thread-2555::INFO::2014-04-10 17:32:56,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2555::DEBUG::2014-04-10 17:32:56,402::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`906cf83a-3e5f-4589-b231-d3120b72b7db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2555::DEBUG::2014-04-10 17:32:56,402::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2555::DEBUG::2014-04-10 17:32:56,403::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2555::DEBUG::2014-04-10 17:32:56,403::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`906cf83a-3e5f-4589-b231-d3120b72b7db`::Granted request
>Thread-2555::DEBUG::2014-04-10 17:32:56,404::task::811::TaskManager.Task::(resourceAcquired) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2555::DEBUG::2014-04-10 17:32:56,404::task::974::TaskManager.Task::(_decref) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::ref 1 aborting False
>Thread-2555::INFO::2014-04-10 17:32:56,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2555::DEBUG::2014-04-10 17:32:56,406::task::1168::TaskManager.Task::(prepare) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2555::DEBUG::2014-04-10 17:32:56,406::task::579::TaskManager.Task::(_updateState) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::moving from state preparing -> state finished
>Thread-2555::DEBUG::2014-04-10 17:32:56,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2555::DEBUG::2014-04-10 17:32:56,407::task::974::TaskManager.Task::(_decref) Task=`80ab9f63-e859-46b2-97f1-c829058535b5`::ref 0 aborting False
>Thread-2558::DEBUG::2014-04-10 17:33:03,497::task::579::TaskManager.Task::(_updateState) Task=`1473718c-ee9c-4d69-818b-92a88f5a1526`::moving from state init -> state preparing
>Thread-2558::INFO::2014-04-10 17:33:03,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2558::INFO::2014-04-10 17:33:03,498::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442972', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377073', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335705', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411162', 'lastCheck': '8.7', 'valid': True}}
>Thread-2558::DEBUG::2014-04-10 17:33:03,498::task::1168::TaskManager.Task::(prepare) Task=`1473718c-ee9c-4d69-818b-92a88f5a1526`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442972', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377073', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335705', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411162', 'lastCheck': '8.7', 'valid': True}}
>Thread-2558::DEBUG::2014-04-10 17:33:03,498::task::579::TaskManager.Task::(_updateState) Task=`1473718c-ee9c-4d69-818b-92a88f5a1526`::moving from state preparing -> state finished
>Thread-2558::DEBUG::2014-04-10 17:33:03,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2558::DEBUG::2014-04-10 17:33:03,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2558::DEBUG::2014-04-10 17:33:03,499::task::974::TaskManager.Task::(_decref) Task=`1473718c-ee9c-4d69-818b-92a88f5a1526`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:04,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:04,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000438073 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:04,638::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:04,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333552 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:04,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:04,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533752 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:04,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:04,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000363832 s, 1.8 MB/s\n'; <rc> = 0
>Thread-2560::DEBUG::2014-04-10 17:33:06,485::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2560::DEBUG::2014-04-10 17:33:06,485::task::579::TaskManager.Task::(_updateState) Task=`f49ca06f-da5b-4c11-9d85-27eb7e7060b5`::moving from state init -> state preparing
>Thread-2560::INFO::2014-04-10 17:33:06,486::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2560::INFO::2014-04-10 17:33:06,486::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2560::DEBUG::2014-04-10 17:33:06,486::task::1168::TaskManager.Task::(prepare) Task=`f49ca06f-da5b-4c11-9d85-27eb7e7060b5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2560::DEBUG::2014-04-10 17:33:06,486::task::579::TaskManager.Task::(_updateState) Task=`f49ca06f-da5b-4c11-9d85-27eb7e7060b5`::moving from state preparing -> state finished
>Thread-2560::DEBUG::2014-04-10 17:33:06,486::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2560::DEBUG::2014-04-10 17:33:06,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2560::DEBUG::2014-04-10 17:33:06,487::task::974::TaskManager.Task::(_decref) Task=`f49ca06f-da5b-4c11-9d85-27eb7e7060b5`::ref 0 aborting False
>Thread-2561::DEBUG::2014-04-10 17:33:06,494::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2561::DEBUG::2014-04-10 17:33:06,494::task::579::TaskManager.Task::(_updateState) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::moving from state init -> state preparing
>Thread-2561::INFO::2014-04-10 17:33:06,494::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2561::DEBUG::2014-04-10 17:33:06,495::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9a2c1d28-e33c-4e3c-b3a0-98267be6843a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2561::DEBUG::2014-04-10 17:33:06,495::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2561::DEBUG::2014-04-10 17:33:06,495::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2561::DEBUG::2014-04-10 17:33:06,495::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9a2c1d28-e33c-4e3c-b3a0-98267be6843a`::Granted request
>Thread-2561::DEBUG::2014-04-10 17:33:06,496::task::811::TaskManager.Task::(resourceAcquired) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2561::DEBUG::2014-04-10 17:33:06,496::task::974::TaskManager.Task::(_decref) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::ref 1 aborting False
>Thread-2561::INFO::2014-04-10 17:33:06,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2561::DEBUG::2014-04-10 17:33:06,498::task::1168::TaskManager.Task::(prepare) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2561::DEBUG::2014-04-10 17:33:06,499::task::579::TaskManager.Task::(_updateState) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::moving from state preparing -> state finished
>Thread-2561::DEBUG::2014-04-10 17:33:06,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2561::DEBUG::2014-04-10 17:33:06,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2561::DEBUG::2014-04-10 17:33:06,499::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2561::DEBUG::2014-04-10 17:33:06,499::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2561::DEBUG::2014-04-10 17:33:06,500::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2561::DEBUG::2014-04-10 17:33:06,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2561::DEBUG::2014-04-10 17:33:06,500::task::974::TaskManager.Task::(_decref) Task=`a3e02598-2f5f-4684-bd99-a944e6282747`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:14,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:14,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334728 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:14,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:14,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348228 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:14,829::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:14,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000535086 s, 688 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:14,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:14,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000440137 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2566::DEBUG::2014-04-10 17:33:16,582::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2566::DEBUG::2014-04-10 17:33:16,582::task::579::TaskManager.Task::(_updateState) Task=`b5a7ce2a-3ff5-4e2d-9870-8c4a5b855fcd`::moving from state init -> state preparing
>Thread-2566::INFO::2014-04-10 17:33:16,583::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2566::INFO::2014-04-10 17:33:16,583::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2566::DEBUG::2014-04-10 17:33:16,583::task::1168::TaskManager.Task::(prepare) Task=`b5a7ce2a-3ff5-4e2d-9870-8c4a5b855fcd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2566::DEBUG::2014-04-10 17:33:16,583::task::579::TaskManager.Task::(_updateState) Task=`b5a7ce2a-3ff5-4e2d-9870-8c4a5b855fcd`::moving from state preparing -> state finished
>Thread-2566::DEBUG::2014-04-10 17:33:16,583::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2566::DEBUG::2014-04-10 17:33:16,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2566::DEBUG::2014-04-10 17:33:16,584::task::974::TaskManager.Task::(_decref) Task=`b5a7ce2a-3ff5-4e2d-9870-8c4a5b855fcd`::ref 0 aborting False
>Thread-2567::DEBUG::2014-04-10 17:33:16,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2567::DEBUG::2014-04-10 17:33:16,590::task::579::TaskManager.Task::(_updateState) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::moving from state init -> state preparing
>Thread-2567::INFO::2014-04-10 17:33:16,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2567::DEBUG::2014-04-10 17:33:16,591::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c4aa458-b705-4867-a433-2d168a64d6c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2567::DEBUG::2014-04-10 17:33:16,591::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2567::DEBUG::2014-04-10 17:33:16,591::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2567::DEBUG::2014-04-10 17:33:16,591::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c4aa458-b705-4867-a433-2d168a64d6c8`::Granted request
>Thread-2567::DEBUG::2014-04-10 17:33:16,592::task::811::TaskManager.Task::(resourceAcquired) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2567::DEBUG::2014-04-10 17:33:16,592::task::974::TaskManager.Task::(_decref) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::ref 1 aborting False
>Thread-2567::INFO::2014-04-10 17:33:16,593::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2567::DEBUG::2014-04-10 17:33:16,594::task::1168::TaskManager.Task::(prepare) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2567::DEBUG::2014-04-10 17:33:16,594::task::579::TaskManager.Task::(_updateState) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::moving from state preparing -> state finished
>Thread-2567::DEBUG::2014-04-10 17:33:16,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2567::DEBUG::2014-04-10 17:33:16,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2567::DEBUG::2014-04-10 17:33:16,594::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2567::DEBUG::2014-04-10 17:33:16,595::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2567::DEBUG::2014-04-10 17:33:16,595::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2567::DEBUG::2014-04-10 17:33:16,595::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2567::DEBUG::2014-04-10 17:33:16,595::task::974::TaskManager.Task::(_decref) Task=`c2d157ee-235f-409f-811a-3ba22d85b00b`::ref 0 aborting False
>Thread-2568::DEBUG::2014-04-10 17:33:18,756::task::579::TaskManager.Task::(_updateState) Task=`b6761c00-29da-4a10-81c4-bcea715cd521`::moving from state init -> state preparing
>Thread-2568::INFO::2014-04-10 17:33:18,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2568::INFO::2014-04-10 17:33:18,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440137', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334728', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348228', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535086', 'lastCheck': '3.9', 'valid': True}}
>Thread-2568::DEBUG::2014-04-10 17:33:18,756::task::1168::TaskManager.Task::(prepare) Task=`b6761c00-29da-4a10-81c4-bcea715cd521`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440137', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334728', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348228', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535086', 'lastCheck': '3.9', 'valid': True}}
>Thread-2568::DEBUG::2014-04-10 17:33:18,757::task::579::TaskManager.Task::(_updateState) Task=`b6761c00-29da-4a10-81c4-bcea715cd521`::moving from state preparing -> state finished
>Thread-2568::DEBUG::2014-04-10 17:33:18,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2568::DEBUG::2014-04-10 17:33:18,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2568::DEBUG::2014-04-10 17:33:18,757::task::974::TaskManager.Task::(_decref) Task=`b6761c00-29da-4a10-81c4-bcea715cd521`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:24,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:24,641::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003847 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:24,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:24,671::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000241885 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:24,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:24,849::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000503014 s, 732 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:24,871::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:33:24,885::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:33:24,886::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:33:24,891::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:33:24,893::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:33:24,893::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:33:24,893::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:33:24,899::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:24,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000493118 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2576::DEBUG::2014-04-10 17:33:26,663::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2576::DEBUG::2014-04-10 17:33:26,664::task::579::TaskManager.Task::(_updateState) Task=`6c4c2c65-16c9-4e17-a9bb-cd42b6b8dda3`::moving from state init -> state preparing
>Thread-2576::INFO::2014-04-10 17:33:26,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2576::INFO::2014-04-10 17:33:26,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2576::DEBUG::2014-04-10 17:33:26,665::task::1168::TaskManager.Task::(prepare) Task=`6c4c2c65-16c9-4e17-a9bb-cd42b6b8dda3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2576::DEBUG::2014-04-10 17:33:26,665::task::579::TaskManager.Task::(_updateState) Task=`6c4c2c65-16c9-4e17-a9bb-cd42b6b8dda3`::moving from state preparing -> state finished
>Thread-2576::DEBUG::2014-04-10 17:33:26,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2576::DEBUG::2014-04-10 17:33:26,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2576::DEBUG::2014-04-10 17:33:26,665::task::974::TaskManager.Task::(_decref) Task=`6c4c2c65-16c9-4e17-a9bb-cd42b6b8dda3`::ref 0 aborting False
>Thread-2577::DEBUG::2014-04-10 17:33:26,672::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2577::DEBUG::2014-04-10 17:33:26,672::task::579::TaskManager.Task::(_updateState) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::moving from state init -> state preparing
>Thread-2577::INFO::2014-04-10 17:33:26,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2577::DEBUG::2014-04-10 17:33:26,673::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`10d25a80-7ba3-426a-8a4e-4a6b66fda4e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2577::DEBUG::2014-04-10 17:33:26,673::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2577::DEBUG::2014-04-10 17:33:26,673::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2577::DEBUG::2014-04-10 17:33:26,673::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`10d25a80-7ba3-426a-8a4e-4a6b66fda4e8`::Granted request
>Thread-2577::DEBUG::2014-04-10 17:33:26,674::task::811::TaskManager.Task::(resourceAcquired) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2577::DEBUG::2014-04-10 17:33:26,674::task::974::TaskManager.Task::(_decref) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::ref 1 aborting False
>Thread-2577::INFO::2014-04-10 17:33:26,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2577::DEBUG::2014-04-10 17:33:26,676::task::1168::TaskManager.Task::(prepare) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2577::DEBUG::2014-04-10 17:33:26,676::task::579::TaskManager.Task::(_updateState) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::moving from state preparing -> state finished
>Thread-2577::DEBUG::2014-04-10 17:33:26,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2577::DEBUG::2014-04-10 17:33:26,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2577::DEBUG::2014-04-10 17:33:26,676::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2577::DEBUG::2014-04-10 17:33:26,677::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2577::DEBUG::2014-04-10 17:33:26,677::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2577::DEBUG::2014-04-10 17:33:26,677::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2577::DEBUG::2014-04-10 17:33:26,677::task::974::TaskManager.Task::(_decref) Task=`9c1d2f64-49dd-4167-a478-3c360f2bd15f`::ref 0 aborting False
>Thread-2580::DEBUG::2014-04-10 17:33:33,912::task::579::TaskManager.Task::(_updateState) Task=`c0c0dd78-bbb6-4922-8137-a657f41032dd`::moving from state init -> state preparing
>Thread-2580::INFO::2014-04-10 17:33:33,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2580::INFO::2014-04-10 17:33:33,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493118', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003847', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241885', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503014', 'lastCheck': '9.1', 'valid': True}}
>Thread-2580::DEBUG::2014-04-10 17:33:33,913::task::1168::TaskManager.Task::(prepare) Task=`c0c0dd78-bbb6-4922-8137-a657f41032dd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493118', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003847', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241885', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503014', 'lastCheck': '9.1', 'valid': True}}
>Thread-2580::DEBUG::2014-04-10 17:33:33,913::task::579::TaskManager.Task::(_updateState) Task=`c0c0dd78-bbb6-4922-8137-a657f41032dd`::moving from state preparing -> state finished
>Thread-2580::DEBUG::2014-04-10 17:33:33,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2580::DEBUG::2014-04-10 17:33:33,914::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2580::DEBUG::2014-04-10 17:33:33,914::task::974::TaskManager.Task::(_decref) Task=`c0c0dd78-bbb6-4922-8137-a657f41032dd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:34,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:34,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328386 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:34,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:34,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321298 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:34,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:34,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000420513 s, 875 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:34,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:34,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398566 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2582::DEBUG::2014-04-10 17:33:36,763::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2582::DEBUG::2014-04-10 17:33:36,764::task::579::TaskManager.Task::(_updateState) Task=`6c8e68aa-841f-4e30-a5de-b0bd706cc0e9`::moving from state init -> state preparing
>Thread-2582::INFO::2014-04-10 17:33:36,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2582::INFO::2014-04-10 17:33:36,765::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2582::DEBUG::2014-04-10 17:33:36,765::task::1168::TaskManager.Task::(prepare) Task=`6c8e68aa-841f-4e30-a5de-b0bd706cc0e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2582::DEBUG::2014-04-10 17:33:36,765::task::579::TaskManager.Task::(_updateState) Task=`6c8e68aa-841f-4e30-a5de-b0bd706cc0e9`::moving from state preparing -> state finished
>Thread-2582::DEBUG::2014-04-10 17:33:36,765::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2582::DEBUG::2014-04-10 17:33:36,765::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2582::DEBUG::2014-04-10 17:33:36,766::task::974::TaskManager.Task::(_decref) Task=`6c8e68aa-841f-4e30-a5de-b0bd706cc0e9`::ref 0 aborting False
>Thread-2583::DEBUG::2014-04-10 17:33:36,772::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2583::DEBUG::2014-04-10 17:33:36,773::task::579::TaskManager.Task::(_updateState) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::moving from state init -> state preparing
>Thread-2583::INFO::2014-04-10 17:33:36,773::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2583::DEBUG::2014-04-10 17:33:36,773::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc74cfd4-ecf0-4e52-808e-0fd1e3a161da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2583::DEBUG::2014-04-10 17:33:36,773::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2583::DEBUG::2014-04-10 17:33:36,774::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2583::DEBUG::2014-04-10 17:33:36,774::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc74cfd4-ecf0-4e52-808e-0fd1e3a161da`::Granted request
>Thread-2583::DEBUG::2014-04-10 17:33:36,775::task::811::TaskManager.Task::(resourceAcquired) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2583::DEBUG::2014-04-10 17:33:36,775::task::974::TaskManager.Task::(_decref) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::ref 1 aborting False
>Thread-2583::INFO::2014-04-10 17:33:36,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2583::DEBUG::2014-04-10 17:33:36,778::task::1168::TaskManager.Task::(prepare) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2583::DEBUG::2014-04-10 17:33:36,778::task::579::TaskManager.Task::(_updateState) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::moving from state preparing -> state finished
>Thread-2583::DEBUG::2014-04-10 17:33:36,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2583::DEBUG::2014-04-10 17:33:36,778::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2583::DEBUG::2014-04-10 17:33:36,779::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2583::DEBUG::2014-04-10 17:33:36,779::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2583::DEBUG::2014-04-10 17:33:36,779::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2583::DEBUG::2014-04-10 17:33:36,779::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2583::DEBUG::2014-04-10 17:33:36,779::task::974::TaskManager.Task::(_decref) Task=`98532bb8-c9cf-4b7c-9dd8-fc31110f04ab`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:44,663::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:44,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292916 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:44,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:44,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259836 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:44,869::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:44,876::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000526226 s, 699 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:44,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:44,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00043938 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2588::DEBUG::2014-04-10 17:33:46,861::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2588::DEBUG::2014-04-10 17:33:46,862::task::579::TaskManager.Task::(_updateState) Task=`ba3cf5bd-3271-43f1-94f2-52f70b27da87`::moving from state init -> state preparing
>Thread-2588::INFO::2014-04-10 17:33:46,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2588::INFO::2014-04-10 17:33:46,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2588::DEBUG::2014-04-10 17:33:46,863::task::1168::TaskManager.Task::(prepare) Task=`ba3cf5bd-3271-43f1-94f2-52f70b27da87`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2588::DEBUG::2014-04-10 17:33:46,863::task::579::TaskManager.Task::(_updateState) Task=`ba3cf5bd-3271-43f1-94f2-52f70b27da87`::moving from state preparing -> state finished
>Thread-2588::DEBUG::2014-04-10 17:33:46,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2588::DEBUG::2014-04-10 17:33:46,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2588::DEBUG::2014-04-10 17:33:46,863::task::974::TaskManager.Task::(_decref) Task=`ba3cf5bd-3271-43f1-94f2-52f70b27da87`::ref 0 aborting False
>Thread-2589::DEBUG::2014-04-10 17:33:46,870::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2589::DEBUG::2014-04-10 17:33:46,870::task::579::TaskManager.Task::(_updateState) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::moving from state init -> state preparing
>Thread-2589::INFO::2014-04-10 17:33:46,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2589::DEBUG::2014-04-10 17:33:46,871::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`60e37b6b-c7ac-4f01-81c7-6a31a8c4704d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2589::DEBUG::2014-04-10 17:33:46,871::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2589::DEBUG::2014-04-10 17:33:46,871::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2589::DEBUG::2014-04-10 17:33:46,871::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`60e37b6b-c7ac-4f01-81c7-6a31a8c4704d`::Granted request
>Thread-2589::DEBUG::2014-04-10 17:33:46,872::task::811::TaskManager.Task::(resourceAcquired) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2589::DEBUG::2014-04-10 17:33:46,872::task::974::TaskManager.Task::(_decref) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::ref 1 aborting False
>Thread-2589::INFO::2014-04-10 17:33:46,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2589::DEBUG::2014-04-10 17:33:46,874::task::1168::TaskManager.Task::(prepare) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2589::DEBUG::2014-04-10 17:33:46,874::task::579::TaskManager.Task::(_updateState) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::moving from state preparing -> state finished
>Thread-2589::DEBUG::2014-04-10 17:33:46,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2589::DEBUG::2014-04-10 17:33:46,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2589::DEBUG::2014-04-10 17:33:46,874::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2589::DEBUG::2014-04-10 17:33:46,875::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2589::DEBUG::2014-04-10 17:33:46,875::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2589::DEBUG::2014-04-10 17:33:46,875::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2589::DEBUG::2014-04-10 17:33:46,875::task::974::TaskManager.Task::(_decref) Task=`0a7d46d3-d3bf-4504-b6fa-f283c9b7ad8d`::ref 0 aborting False
>Thread-2590::DEBUG::2014-04-10 17:33:49,064::task::579::TaskManager.Task::(_updateState) Task=`961047dd-871f-4617-80a2-037778417e2f`::moving from state init -> state preparing
>Thread-2590::INFO::2014-04-10 17:33:49,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2590::INFO::2014-04-10 17:33:49,065::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043938', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292916', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259836', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526226', 'lastCheck': '4.2', 'valid': True}}
>Thread-2590::DEBUG::2014-04-10 17:33:49,065::task::1168::TaskManager.Task::(prepare) Task=`961047dd-871f-4617-80a2-037778417e2f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043938', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000292916', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259836', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526226', 'lastCheck': '4.2', 'valid': True}}
>Thread-2590::DEBUG::2014-04-10 17:33:49,065::task::579::TaskManager.Task::(_updateState) Task=`961047dd-871f-4617-80a2-037778417e2f`::moving from state preparing -> state finished
>Thread-2590::DEBUG::2014-04-10 17:33:49,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2590::DEBUG::2014-04-10 17:33:49,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2590::DEBUG::2014-04-10 17:33:49,066::task::974::TaskManager.Task::(_decref) Task=`961047dd-871f-4617-80a2-037778417e2f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:33:54,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:33:54,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339233 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:33:54,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:33:54,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270717 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:33:54,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:33:54,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000515038 s, 715 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:33:54,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:33:54,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000461567 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2594::DEBUG::2014-04-10 17:33:56,960::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2594::DEBUG::2014-04-10 17:33:56,960::task::579::TaskManager.Task::(_updateState) Task=`bd3024b8-2cd0-49a2-920f-b0c08ad2a0ab`::moving from state init -> state preparing
>Thread-2594::INFO::2014-04-10 17:33:56,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2594::INFO::2014-04-10 17:33:56,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2594::DEBUG::2014-04-10 17:33:56,961::task::1168::TaskManager.Task::(prepare) Task=`bd3024b8-2cd0-49a2-920f-b0c08ad2a0ab`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2594::DEBUG::2014-04-10 17:33:56,961::task::579::TaskManager.Task::(_updateState) Task=`bd3024b8-2cd0-49a2-920f-b0c08ad2a0ab`::moving from state preparing -> state finished
>Thread-2594::DEBUG::2014-04-10 17:33:56,961::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2594::DEBUG::2014-04-10 17:33:56,961::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2594::DEBUG::2014-04-10 17:33:56,962::task::974::TaskManager.Task::(_decref) Task=`bd3024b8-2cd0-49a2-920f-b0c08ad2a0ab`::ref 0 aborting False
>Thread-2595::DEBUG::2014-04-10 17:33:56,968::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-2595::DEBUG::2014-04-10 17:33:56,968::task::579::TaskManager.Task::(_updateState) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::moving from state init -> state preparing
>Thread-2595::INFO::2014-04-10 17:33:56,968::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2595::DEBUG::2014-04-10 17:33:56,969::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`14fa828b-c7a4-44fe-92f9-3ed7bfcb3ddb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2595::DEBUG::2014-04-10 17:33:56,969::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2595::DEBUG::2014-04-10 17:33:56,969::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2595::DEBUG::2014-04-10 17:33:56,969::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`14fa828b-c7a4-44fe-92f9-3ed7bfcb3ddb`::Granted request
>Thread-2595::DEBUG::2014-04-10 17:33:56,970::task::811::TaskManager.Task::(resourceAcquired) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2595::DEBUG::2014-04-10 17:33:56,970::task::974::TaskManager.Task::(_decref) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::ref 1 aborting False
>Thread-2595::INFO::2014-04-10 17:33:56,972::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2595::DEBUG::2014-04-10 17:33:56,972::task::1168::TaskManager.Task::(prepare) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2595::DEBUG::2014-04-10 17:33:56,972::task::579::TaskManager.Task::(_updateState) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::moving from state preparing -> state finished
>Thread-2595::DEBUG::2014-04-10 17:33:56,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2595::DEBUG::2014-04-10 17:33:56,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2595::DEBUG::2014-04-10 17:33:56,972::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2595::DEBUG::2014-04-10 17:33:56,973::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2595::DEBUG::2014-04-10 17:33:56,973::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2595::DEBUG::2014-04-10 17:33:56,973::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2595::DEBUG::2014-04-10 17:33:56,973::task::974::TaskManager.Task::(_decref) Task=`d5b2d403-6d14-4a48-83b3-5853613a66bb`::ref 0 aborting False
>Thread-2598::DEBUG::2014-04-10 17:34:04,228::task::579::TaskManager.Task::(_updateState) Task=`1427a04a-41e3-401f-a9f2-14923daa9cf8`::moving from state init -> state preparing
>Thread-2598::INFO::2014-04-10 17:34:04,228::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2598::INFO::2014-04-10 17:34:04,229::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461567', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339233', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270717', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515038', 'lastCheck': '9.3', 'valid': True}}
>Thread-2598::DEBUG::2014-04-10 17:34:04,229::task::1168::TaskManager.Task::(prepare) Task=`1427a04a-41e3-401f-a9f2-14923daa9cf8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461567', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339233', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270717', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515038', 'lastCheck': '9.3', 'valid': True}}
>Thread-2598::DEBUG::2014-04-10 17:34:04,229::task::579::TaskManager.Task::(_updateState) Task=`1427a04a-41e3-401f-a9f2-14923daa9cf8`::moving from state preparing -> state finished
>Thread-2598::DEBUG::2014-04-10 17:34:04,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2598::DEBUG::2014-04-10 17:34:04,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2598::DEBUG::2014-04-10 17:34:04,230::task::974::TaskManager.Task::(_decref) Task=`1427a04a-41e3-401f-a9f2-14923daa9cf8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:04,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:04,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288007 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:04,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:04,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264983 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:04,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:04,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478336 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:04,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:04,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000504443 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2600::DEBUG::2014-04-10 17:34:07,050::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2600::DEBUG::2014-04-10 17:34:07,059::task::579::TaskManager.Task::(_updateState) Task=`384f3d58-9798-4598-bfcb-5f14eb33dc3a`::moving from state init -> state preparing
>Thread-2600::INFO::2014-04-10 17:34:07,059::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2600::INFO::2014-04-10 17:34:07,060::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2600::DEBUG::2014-04-10 17:34:07,060::task::1168::TaskManager.Task::(prepare) Task=`384f3d58-9798-4598-bfcb-5f14eb33dc3a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2600::DEBUG::2014-04-10 17:34:07,060::task::579::TaskManager.Task::(_updateState) Task=`384f3d58-9798-4598-bfcb-5f14eb33dc3a`::moving from state preparing -> state finished
>Thread-2600::DEBUG::2014-04-10 17:34:07,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2600::DEBUG::2014-04-10 17:34:07,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2600::DEBUG::2014-04-10 17:34:07,060::task::974::TaskManager.Task::(_decref) Task=`384f3d58-9798-4598-bfcb-5f14eb33dc3a`::ref 0 aborting False
>Thread-2601::DEBUG::2014-04-10 17:34:07,067::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2601::DEBUG::2014-04-10 17:34:07,068::task::579::TaskManager.Task::(_updateState) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::moving from state init -> state preparing
>Thread-2601::INFO::2014-04-10 17:34:07,068::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2601::DEBUG::2014-04-10 17:34:07,069::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad84630a-dede-46d7-9856-d1f3d3d2580f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2601::DEBUG::2014-04-10 17:34:07,069::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2601::DEBUG::2014-04-10 17:34:07,069::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2601::DEBUG::2014-04-10 17:34:07,069::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad84630a-dede-46d7-9856-d1f3d3d2580f`::Granted request
>Thread-2601::DEBUG::2014-04-10 17:34:07,070::task::811::TaskManager.Task::(resourceAcquired) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2601::DEBUG::2014-04-10 17:34:07,070::task::974::TaskManager.Task::(_decref) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::ref 1 aborting False
>Thread-2601::INFO::2014-04-10 17:34:07,072::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2601::DEBUG::2014-04-10 17:34:07,072::task::1168::TaskManager.Task::(prepare) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2601::DEBUG::2014-04-10 17:34:07,072::task::579::TaskManager.Task::(_updateState) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::moving from state preparing -> state finished
>Thread-2601::DEBUG::2014-04-10 17:34:07,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2601::DEBUG::2014-04-10 17:34:07,073::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2601::DEBUG::2014-04-10 17:34:07,073::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2601::DEBUG::2014-04-10 17:34:07,073::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2601::DEBUG::2014-04-10 17:34:07,073::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2601::DEBUG::2014-04-10 17:34:07,074::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2601::DEBUG::2014-04-10 17:34:07,074::task::974::TaskManager.Task::(_decref) Task=`870f691f-5826-456d-bb4c-aaa75ac8f1d7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:14,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:14,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395385 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:14,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:14,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314196 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:14,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:14,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000338143 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:14,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:14,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00044182 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2606::DEBUG::2014-04-10 17:34:17,157::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2606::DEBUG::2014-04-10 17:34:17,158::task::579::TaskManager.Task::(_updateState) Task=`c8936294-8251-4f66-b3a5-ebeb50beb956`::moving from state init -> state preparing
>Thread-2606::INFO::2014-04-10 17:34:17,158::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2606::INFO::2014-04-10 17:34:17,158::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2606::DEBUG::2014-04-10 17:34:17,158::task::1168::TaskManager.Task::(prepare) Task=`c8936294-8251-4f66-b3a5-ebeb50beb956`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2606::DEBUG::2014-04-10 17:34:17,159::task::579::TaskManager.Task::(_updateState) Task=`c8936294-8251-4f66-b3a5-ebeb50beb956`::moving from state preparing -> state finished
>Thread-2606::DEBUG::2014-04-10 17:34:17,159::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2606::DEBUG::2014-04-10 17:34:17,159::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2606::DEBUG::2014-04-10 17:34:17,159::task::974::TaskManager.Task::(_decref) Task=`c8936294-8251-4f66-b3a5-ebeb50beb956`::ref 0 aborting False
>Thread-2607::DEBUG::2014-04-10 17:34:17,165::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2607::DEBUG::2014-04-10 17:34:17,166::task::579::TaskManager.Task::(_updateState) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::moving from state init -> state preparing
>Thread-2607::INFO::2014-04-10 17:34:17,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2607::DEBUG::2014-04-10 17:34:17,166::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b29cae14-64cb-41ad-b8f1-8056fcbe30a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2607::DEBUG::2014-04-10 17:34:17,166::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2607::DEBUG::2014-04-10 17:34:17,167::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2607::DEBUG::2014-04-10 17:34:17,167::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b29cae14-64cb-41ad-b8f1-8056fcbe30a9`::Granted request
>Thread-2607::DEBUG::2014-04-10 17:34:17,168::task::811::TaskManager.Task::(resourceAcquired) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2607::DEBUG::2014-04-10 17:34:17,168::task::974::TaskManager.Task::(_decref) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::ref 1 aborting False
>Thread-2607::INFO::2014-04-10 17:34:17,170::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2607::DEBUG::2014-04-10 17:34:17,170::task::1168::TaskManager.Task::(prepare) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2607::DEBUG::2014-04-10 17:34:17,170::task::579::TaskManager.Task::(_updateState) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::moving from state preparing -> state finished
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2607::DEBUG::2014-04-10 17:34:17,171::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2607::DEBUG::2014-04-10 17:34:17,172::task::974::TaskManager.Task::(_decref) Task=`9309f613-a9e1-44a2-b4a3-605d0c25be93`::ref 0 aborting False
>Thread-2608::DEBUG::2014-04-10 17:34:19,386::task::579::TaskManager.Task::(_updateState) Task=`0c460504-275a-4334-8996-2121109bc194`::moving from state init -> state preparing
>Thread-2608::INFO::2014-04-10 17:34:19,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2608::INFO::2014-04-10 17:34:19,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044182', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395385', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314196', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338143', 'lastCheck': '4.4', 'valid': True}}
>Thread-2608::DEBUG::2014-04-10 17:34:19,387::task::1168::TaskManager.Task::(prepare) Task=`0c460504-275a-4334-8996-2121109bc194`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044182', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395385', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314196', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338143', 'lastCheck': '4.4', 'valid': True}}
>Thread-2608::DEBUG::2014-04-10 17:34:19,387::task::579::TaskManager.Task::(_updateState) Task=`0c460504-275a-4334-8996-2121109bc194`::moving from state preparing -> state finished
>Thread-2608::DEBUG::2014-04-10 17:34:19,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2608::DEBUG::2014-04-10 17:34:19,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2608::DEBUG::2014-04-10 17:34:19,387::task::974::TaskManager.Task::(_decref) Task=`0c460504-275a-4334-8996-2121109bc194`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:24,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:24,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000351083 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:24,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:24,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000315099 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:24,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:25,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004327 s, 850 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:25,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:25,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000377756 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2612::DEBUG::2014-04-10 17:34:27,255::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2612::DEBUG::2014-04-10 17:34:27,256::task::579::TaskManager.Task::(_updateState) Task=`2d701f74-a0dc-465e-abd1-96dcba6e5d66`::moving from state init -> state preparing
>Thread-2612::INFO::2014-04-10 17:34:27,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2612::INFO::2014-04-10 17:34:27,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2612::DEBUG::2014-04-10 17:34:27,257::task::1168::TaskManager.Task::(prepare) Task=`2d701f74-a0dc-465e-abd1-96dcba6e5d66`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2612::DEBUG::2014-04-10 17:34:27,257::task::579::TaskManager.Task::(_updateState) Task=`2d701f74-a0dc-465e-abd1-96dcba6e5d66`::moving from state preparing -> state finished
>Thread-2612::DEBUG::2014-04-10 17:34:27,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2612::DEBUG::2014-04-10 17:34:27,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2612::DEBUG::2014-04-10 17:34:27,257::task::974::TaskManager.Task::(_decref) Task=`2d701f74-a0dc-465e-abd1-96dcba6e5d66`::ref 0 aborting False
>Thread-2613::DEBUG::2014-04-10 17:34:27,264::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-2613::DEBUG::2014-04-10 17:34:27,264::task::579::TaskManager.Task::(_updateState) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::moving from state init -> state preparing
>Thread-2613::INFO::2014-04-10 17:34:27,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2613::DEBUG::2014-04-10 17:34:27,265::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cf195aa5-53f5-4ea9-9189-e8c3dde0d14e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2613::DEBUG::2014-04-10 17:34:27,265::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2613::DEBUG::2014-04-10 17:34:27,265::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2613::DEBUG::2014-04-10 17:34:27,266::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cf195aa5-53f5-4ea9-9189-e8c3dde0d14e`::Granted request
>Thread-2613::DEBUG::2014-04-10 17:34:27,266::task::811::TaskManager.Task::(resourceAcquired) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2613::DEBUG::2014-04-10 17:34:27,266::task::974::TaskManager.Task::(_decref) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::ref 1 aborting False
>Thread-2613::INFO::2014-04-10 17:34:27,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2613::DEBUG::2014-04-10 17:34:27,268::task::1168::TaskManager.Task::(prepare) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2613::DEBUG::2014-04-10 17:34:27,268::task::579::TaskManager.Task::(_updateState) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::moving from state preparing -> state finished
>Thread-2613::DEBUG::2014-04-10 17:34:27,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2613::DEBUG::2014-04-10 17:34:27,269::task::974::TaskManager.Task::(_decref) Task=`98130637-dc56-4adc-8463-e4c25289eadb`::ref 0 aborting False
>Thread-2616::DEBUG::2014-04-10 17:34:34,537::task::579::TaskManager.Task::(_updateState) Task=`aa16370e-91cb-4d5f-bdb7-54c8393e5085`::moving from state init -> state preparing
>Thread-2616::INFO::2014-04-10 17:34:34,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2616::INFO::2014-04-10 17:34:34,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377756', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351083', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315099', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004327', 'lastCheck': '9.5', 'valid': True}}
>Thread-2616::DEBUG::2014-04-10 17:34:34,538::task::1168::TaskManager.Task::(prepare) Task=`aa16370e-91cb-4d5f-bdb7-54c8393e5085`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377756', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351083', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315099', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004327', 'lastCheck': '9.5', 'valid': True}}
>Thread-2616::DEBUG::2014-04-10 17:34:34,538::task::579::TaskManager.Task::(_updateState) Task=`aa16370e-91cb-4d5f-bdb7-54c8393e5085`::moving from state preparing -> state finished
>Thread-2616::DEBUG::2014-04-10 17:34:34,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2616::DEBUG::2014-04-10 17:34:34,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2616::DEBUG::2014-04-10 17:34:34,539::task::974::TaskManager.Task::(_decref) Task=`aa16370e-91cb-4d5f-bdb7-54c8393e5085`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:34,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:34,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386667 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:34,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:34,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345672 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:35,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:35,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509594 s, 722 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:35,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:35,117::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000539805 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2618::DEBUG::2014-04-10 17:34:37,363::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2618::DEBUG::2014-04-10 17:34:37,364::task::579::TaskManager.Task::(_updateState) Task=`ea8127a3-7fd9-4de6-a3f2-9edf9be9c2e0`::moving from state init -> state preparing
>Thread-2618::INFO::2014-04-10 17:34:37,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2618::INFO::2014-04-10 17:34:37,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2618::DEBUG::2014-04-10 17:34:37,365::task::1168::TaskManager.Task::(prepare) Task=`ea8127a3-7fd9-4de6-a3f2-9edf9be9c2e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2618::DEBUG::2014-04-10 17:34:37,365::task::579::TaskManager.Task::(_updateState) Task=`ea8127a3-7fd9-4de6-a3f2-9edf9be9c2e0`::moving from state preparing -> state finished
>Thread-2618::DEBUG::2014-04-10 17:34:37,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2618::DEBUG::2014-04-10 17:34:37,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2618::DEBUG::2014-04-10 17:34:37,365::task::974::TaskManager.Task::(_decref) Task=`ea8127a3-7fd9-4de6-a3f2-9edf9be9c2e0`::ref 0 aborting False
>Thread-2619::DEBUG::2014-04-10 17:34:37,372::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2619::DEBUG::2014-04-10 17:34:37,372::task::579::TaskManager.Task::(_updateState) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::moving from state init -> state preparing
>Thread-2619::INFO::2014-04-10 17:34:37,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2619::DEBUG::2014-04-10 17:34:37,373::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dba409a8-b61b-4c2d-9d30-5bdd54c34fec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2619::DEBUG::2014-04-10 17:34:37,373::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2619::DEBUG::2014-04-10 17:34:37,373::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2619::DEBUG::2014-04-10 17:34:37,373::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dba409a8-b61b-4c2d-9d30-5bdd54c34fec`::Granted request
>Thread-2619::DEBUG::2014-04-10 17:34:37,373::task::811::TaskManager.Task::(resourceAcquired) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2619::DEBUG::2014-04-10 17:34:37,374::task::974::TaskManager.Task::(_decref) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::ref 1 aborting False
>Thread-2619::INFO::2014-04-10 17:34:37,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::task::1168::TaskManager.Task::(prepare) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::task::579::TaskManager.Task::(_updateState) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::moving from state preparing -> state finished
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2619::DEBUG::2014-04-10 17:34:37,376::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2619::DEBUG::2014-04-10 17:34:37,377::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2619::DEBUG::2014-04-10 17:34:37,377::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2619::DEBUG::2014-04-10 17:34:37,377::task::974::TaskManager.Task::(_decref) Task=`939790e8-7be4-410c-ba02-34af0012ff0b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:44,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:44,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360079 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:44,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:44,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365517 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:45,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:45,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000452037 s, 814 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:45,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:45,132::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000531501 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2624::DEBUG::2014-04-10 17:34:47,543::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2624::DEBUG::2014-04-10 17:34:47,544::task::579::TaskManager.Task::(_updateState) Task=`c20eed40-500f-4380-b529-c171d5a589a2`::moving from state init -> state preparing
>Thread-2624::INFO::2014-04-10 17:34:47,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2624::INFO::2014-04-10 17:34:47,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2624::DEBUG::2014-04-10 17:34:47,544::task::1168::TaskManager.Task::(prepare) Task=`c20eed40-500f-4380-b529-c171d5a589a2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2624::DEBUG::2014-04-10 17:34:47,545::task::579::TaskManager.Task::(_updateState) Task=`c20eed40-500f-4380-b529-c171d5a589a2`::moving from state preparing -> state finished
>Thread-2624::DEBUG::2014-04-10 17:34:47,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2624::DEBUG::2014-04-10 17:34:47,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2624::DEBUG::2014-04-10 17:34:47,545::task::974::TaskManager.Task::(_decref) Task=`c20eed40-500f-4380-b529-c171d5a589a2`::ref 0 aborting False
>Thread-2625::DEBUG::2014-04-10 17:34:47,551::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2625::DEBUG::2014-04-10 17:34:47,552::task::579::TaskManager.Task::(_updateState) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::moving from state init -> state preparing
>Thread-2625::INFO::2014-04-10 17:34:47,552::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2625::DEBUG::2014-04-10 17:34:47,552::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0c53f36-4c29-43ec-9fee-a0cc21c754e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2625::DEBUG::2014-04-10 17:34:47,552::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2625::DEBUG::2014-04-10 17:34:47,552::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2625::DEBUG::2014-04-10 17:34:47,553::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0c53f36-4c29-43ec-9fee-a0cc21c754e2`::Granted request
>Thread-2625::DEBUG::2014-04-10 17:34:47,553::task::811::TaskManager.Task::(resourceAcquired) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2625::DEBUG::2014-04-10 17:34:47,553::task::974::TaskManager.Task::(_decref) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::ref 1 aborting False
>Thread-2625::INFO::2014-04-10 17:34:47,555::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2625::DEBUG::2014-04-10 17:34:47,555::task::1168::TaskManager.Task::(prepare) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2625::DEBUG::2014-04-10 17:34:47,555::task::579::TaskManager.Task::(_updateState) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::moving from state preparing -> state finished
>Thread-2625::DEBUG::2014-04-10 17:34:47,555::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2625::DEBUG::2014-04-10 17:34:47,556::task::974::TaskManager.Task::(_decref) Task=`86c214ba-33df-46dc-8b3d-7405f60dfebf`::ref 0 aborting False
>Thread-2626::DEBUG::2014-04-10 17:34:49,706::task::579::TaskManager.Task::(_updateState) Task=`ea43a9e0-d71d-432b-bc89-c093339c04c7`::moving from state init -> state preparing
>Thread-2626::INFO::2014-04-10 17:34:49,707::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2626::INFO::2014-04-10 17:34:49,707::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531501', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360079', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365517', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452037', 'lastCheck': '4.6', 'valid': True}}
>Thread-2626::DEBUG::2014-04-10 17:34:49,707::task::1168::TaskManager.Task::(prepare) Task=`ea43a9e0-d71d-432b-bc89-c093339c04c7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531501', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360079', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365517', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452037', 'lastCheck': '4.6', 'valid': True}}
>Thread-2626::DEBUG::2014-04-10 17:34:49,707::task::579::TaskManager.Task::(_updateState) Task=`ea43a9e0-d71d-432b-bc89-c093339c04c7`::moving from state preparing -> state finished
>Thread-2626::DEBUG::2014-04-10 17:34:49,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2626::DEBUG::2014-04-10 17:34:49,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2626::DEBUG::2014-04-10 17:34:49,708::task::974::TaskManager.Task::(_decref) Task=`ea43a9e0-d71d-432b-bc89-c093339c04c7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:34:54,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:34:54,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370783 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:34:54,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:34:54,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365535 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:34:55,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:34:55,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449016 s, 820 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:34:55,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:34:55,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000515814 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2630::DEBUG::2014-04-10 17:34:57,709::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2630::DEBUG::2014-04-10 17:34:57,709::task::579::TaskManager.Task::(_updateState) Task=`01a24395-a3e9-4936-9b55-99bc9d91bb31`::moving from state init -> state preparing
>Thread-2630::INFO::2014-04-10 17:34:57,709::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2630::INFO::2014-04-10 17:34:57,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2630::DEBUG::2014-04-10 17:34:57,710::task::1168::TaskManager.Task::(prepare) Task=`01a24395-a3e9-4936-9b55-99bc9d91bb31`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2630::DEBUG::2014-04-10 17:34:57,710::task::579::TaskManager.Task::(_updateState) Task=`01a24395-a3e9-4936-9b55-99bc9d91bb31`::moving from state preparing -> state finished
>Thread-2630::DEBUG::2014-04-10 17:34:57,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2630::DEBUG::2014-04-10 17:34:57,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2630::DEBUG::2014-04-10 17:34:57,710::task::974::TaskManager.Task::(_decref) Task=`01a24395-a3e9-4936-9b55-99bc9d91bb31`::ref 0 aborting False
>Thread-2631::DEBUG::2014-04-10 17:34:57,717::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2631::DEBUG::2014-04-10 17:34:57,717::task::579::TaskManager.Task::(_updateState) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::moving from state init -> state preparing
>Thread-2631::INFO::2014-04-10 17:34:57,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2631::DEBUG::2014-04-10 17:34:57,718::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`38475e63-c920-462e-8823-0d7da694ad39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2631::DEBUG::2014-04-10 17:34:57,718::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2631::DEBUG::2014-04-10 17:34:57,718::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2631::DEBUG::2014-04-10 17:34:57,719::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`38475e63-c920-462e-8823-0d7da694ad39`::Granted request
>Thread-2631::DEBUG::2014-04-10 17:34:57,719::task::811::TaskManager.Task::(resourceAcquired) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2631::DEBUG::2014-04-10 17:34:57,720::task::974::TaskManager.Task::(_decref) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::ref 1 aborting False
>Thread-2631::INFO::2014-04-10 17:34:57,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2631::DEBUG::2014-04-10 17:34:57,721::task::1168::TaskManager.Task::(prepare) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2631::DEBUG::2014-04-10 17:34:57,722::task::579::TaskManager.Task::(_updateState) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::moving from state preparing -> state finished
>Thread-2631::DEBUG::2014-04-10 17:34:57,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2631::DEBUG::2014-04-10 17:34:57,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2631::DEBUG::2014-04-10 17:34:57,722::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2631::DEBUG::2014-04-10 17:34:57,722::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2631::DEBUG::2014-04-10 17:34:57,723::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2631::DEBUG::2014-04-10 17:34:57,723::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2631::DEBUG::2014-04-10 17:34:57,723::task::974::TaskManager.Task::(_decref) Task=`fcd928aa-a064-42f3-bd68-d21db39d7576`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:04,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:35:04,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036551 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:35:04,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:04,860::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000293688 s, 2.3 MB/s\n'; <rc> = 0
>Thread-2634::DEBUG::2014-04-10 17:35:04,872::task::579::TaskManager.Task::(_updateState) Task=`6e16e02e-6061-405f-a220-2505b45aa9a2`::moving from state init -> state preparing
>Thread-2634::INFO::2014-04-10 17:35:04,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2634::INFO::2014-04-10 17:35:04,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515814', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036551', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293688', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449016', 'lastCheck': '9.8', 'valid': True}}
>Thread-2634::DEBUG::2014-04-10 17:35:04,873::task::1168::TaskManager.Task::(prepare) Task=`6e16e02e-6061-405f-a220-2505b45aa9a2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515814', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036551', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293688', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449016', 'lastCheck': '9.8', 'valid': True}}
>Thread-2634::DEBUG::2014-04-10 17:35:04,873::task::579::TaskManager.Task::(_updateState) Task=`6e16e02e-6061-405f-a220-2505b45aa9a2`::moving from state preparing -> state finished
>Thread-2634::DEBUG::2014-04-10 17:35:04,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2634::DEBUG::2014-04-10 17:35:04,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2634::DEBUG::2014-04-10 17:35:04,874::task::974::TaskManager.Task::(_decref) Task=`6e16e02e-6061-405f-a220-2505b45aa9a2`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:35:05,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:05,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000369264 s, 997 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:05,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:05,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000396778 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2636::DEBUG::2014-04-10 17:35:07,816::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-2636::DEBUG::2014-04-10 17:35:07,817::task::579::TaskManager.Task::(_updateState) Task=`41b3e53e-c3ac-48b1-85fc-f6858307c344`::moving from state init -> state preparing
>Thread-2636::INFO::2014-04-10 17:35:07,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2636::INFO::2014-04-10 17:35:07,817::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2636::DEBUG::2014-04-10 17:35:07,817::task::1168::TaskManager.Task::(prepare) Task=`41b3e53e-c3ac-48b1-85fc-f6858307c344`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2636::DEBUG::2014-04-10 17:35:07,817::task::579::TaskManager.Task::(_updateState) Task=`41b3e53e-c3ac-48b1-85fc-f6858307c344`::moving from state preparing -> state finished
>Thread-2636::DEBUG::2014-04-10 17:35:07,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2636::DEBUG::2014-04-10 17:35:07,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2636::DEBUG::2014-04-10 17:35:07,818::task::974::TaskManager.Task::(_decref) Task=`41b3e53e-c3ac-48b1-85fc-f6858307c344`::ref 0 aborting False
>Thread-2637::DEBUG::2014-04-10 17:35:07,825::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ea46189]
>Thread-2637::DEBUG::2014-04-10 17:35:07,825::task::579::TaskManager.Task::(_updateState) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::moving from state init -> state preparing
>Thread-2637::INFO::2014-04-10 17:35:07,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2637::DEBUG::2014-04-10 17:35:07,826::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9354d8e7-eb7f-44d3-8c92-61e6bec35d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2637::DEBUG::2014-04-10 17:35:07,826::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2637::DEBUG::2014-04-10 17:35:07,826::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2637::DEBUG::2014-04-10 17:35:07,826::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9354d8e7-eb7f-44d3-8c92-61e6bec35d50`::Granted request
>Thread-2637::DEBUG::2014-04-10 17:35:07,827::task::811::TaskManager.Task::(resourceAcquired) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2637::DEBUG::2014-04-10 17:35:07,827::task::974::TaskManager.Task::(_decref) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::ref 1 aborting False
>Thread-2637::INFO::2014-04-10 17:35:07,829::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2637::DEBUG::2014-04-10 17:35:07,829::task::1168::TaskManager.Task::(prepare) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2637::DEBUG::2014-04-10 17:35:07,829::task::579::TaskManager.Task::(_updateState) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::moving from state preparing -> state finished
>Thread-2637::DEBUG::2014-04-10 17:35:07,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2637::DEBUG::2014-04-10 17:35:07,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2637::DEBUG::2014-04-10 17:35:07,829::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2637::DEBUG::2014-04-10 17:35:07,830::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2637::DEBUG::2014-04-10 17:35:07,830::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2637::DEBUG::2014-04-10 17:35:07,830::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2637::DEBUG::2014-04-10 17:35:07,830::task::974::TaskManager.Task::(_decref) Task=`fceccb98-78c3-4ff0-8ab2-822f670c2706`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:14,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:35:14,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00042629 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:35:14,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:14,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362328 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:35:15,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:15,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502091 s, 733 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:15,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:15,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448815 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2642::DEBUG::2014-04-10 17:35:17,906::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2642::DEBUG::2014-04-10 17:35:17,906::task::579::TaskManager.Task::(_updateState) Task=`b76e04a4-1af0-4aba-b239-e7a5e4e0055f`::moving from state init -> state preparing
>Thread-2642::INFO::2014-04-10 17:35:17,906::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2642::INFO::2014-04-10 17:35:17,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2642::DEBUG::2014-04-10 17:35:17,907::task::1168::TaskManager.Task::(prepare) Task=`b76e04a4-1af0-4aba-b239-e7a5e4e0055f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2642::DEBUG::2014-04-10 17:35:17,907::task::579::TaskManager.Task::(_updateState) Task=`b76e04a4-1af0-4aba-b239-e7a5e4e0055f`::moving from state preparing -> state finished
>Thread-2642::DEBUG::2014-04-10 17:35:17,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2642::DEBUG::2014-04-10 17:35:17,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2642::DEBUG::2014-04-10 17:35:17,907::task::974::TaskManager.Task::(_decref) Task=`b76e04a4-1af0-4aba-b239-e7a5e4e0055f`::ref 0 aborting False
>Thread-2643::DEBUG::2014-04-10 17:35:17,914::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2643::DEBUG::2014-04-10 17:35:17,914::task::579::TaskManager.Task::(_updateState) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::moving from state init -> state preparing
>Thread-2643::INFO::2014-04-10 17:35:17,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2643::DEBUG::2014-04-10 17:35:17,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b4db3e11-9040-4c52-b8ae-f9311fbee5dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2643::DEBUG::2014-04-10 17:35:17,915::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2643::DEBUG::2014-04-10 17:35:17,915::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2643::DEBUG::2014-04-10 17:35:17,915::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b4db3e11-9040-4c52-b8ae-f9311fbee5dc`::Granted request
>Thread-2643::DEBUG::2014-04-10 17:35:17,915::task::811::TaskManager.Task::(resourceAcquired) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2643::DEBUG::2014-04-10 17:35:17,916::task::974::TaskManager.Task::(_decref) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::ref 1 aborting False
>Thread-2643::INFO::2014-04-10 17:35:17,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2643::DEBUG::2014-04-10 17:35:17,918::task::1168::TaskManager.Task::(prepare) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2643::DEBUG::2014-04-10 17:35:17,918::task::579::TaskManager.Task::(_updateState) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::moving from state preparing -> state finished
>Thread-2643::DEBUG::2014-04-10 17:35:17,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2643::DEBUG::2014-04-10 17:35:17,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2643::DEBUG::2014-04-10 17:35:17,918::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2643::DEBUG::2014-04-10 17:35:17,919::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2643::DEBUG::2014-04-10 17:35:17,919::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2643::DEBUG::2014-04-10 17:35:17,919::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2643::DEBUG::2014-04-10 17:35:17,919::task::974::TaskManager.Task::(_decref) Task=`92d39471-b912-4a28-a8de-ca68224546d5`::ref 0 aborting False
>Thread-2644::DEBUG::2014-04-10 17:35:20,786::task::579::TaskManager.Task::(_updateState) Task=`d9a69c8b-d535-4c91-a467-fa187cf9d70b`::moving from state init -> state preparing
>Thread-2644::INFO::2014-04-10 17:35:20,786::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2644::INFO::2014-04-10 17:35:20,787::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448815', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042629', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362328', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502091', 'lastCheck': '5.7', 'valid': True}}
>Thread-2644::DEBUG::2014-04-10 17:35:20,787::task::1168::TaskManager.Task::(prepare) Task=`d9a69c8b-d535-4c91-a467-fa187cf9d70b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448815', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042629', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362328', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502091', 'lastCheck': '5.7', 'valid': True}}
>Thread-2644::DEBUG::2014-04-10 17:35:20,787::task::579::TaskManager.Task::(_updateState) Task=`d9a69c8b-d535-4c91-a467-fa187cf9d70b`::moving from state preparing -> state finished
>Thread-2644::DEBUG::2014-04-10 17:35:20,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2644::DEBUG::2014-04-10 17:35:20,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2644::DEBUG::2014-04-10 17:35:20,788::task::974::TaskManager.Task::(_decref) Task=`d9a69c8b-d535-4c91-a467-fa187cf9d70b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:24,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:35:24,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279485 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:35:24,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:24,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358592 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:35:25,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:25,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466082 s, 790 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:25,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:25,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000515144 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2648::DEBUG::2014-04-10 17:35:27,995::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2648::DEBUG::2014-04-10 17:35:27,995::task::579::TaskManager.Task::(_updateState) Task=`73b9c20e-d44e-4f18-940d-480cd3fdd60c`::moving from state init -> state preparing
>Thread-2648::INFO::2014-04-10 17:35:27,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2648::INFO::2014-04-10 17:35:27,996::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2648::DEBUG::2014-04-10 17:35:27,996::task::1168::TaskManager.Task::(prepare) Task=`73b9c20e-d44e-4f18-940d-480cd3fdd60c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2648::DEBUG::2014-04-10 17:35:27,996::task::579::TaskManager.Task::(_updateState) Task=`73b9c20e-d44e-4f18-940d-480cd3fdd60c`::moving from state preparing -> state finished
>Thread-2648::DEBUG::2014-04-10 17:35:27,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2648::DEBUG::2014-04-10 17:35:27,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2648::DEBUG::2014-04-10 17:35:27,997::task::974::TaskManager.Task::(_decref) Task=`73b9c20e-d44e-4f18-940d-480cd3fdd60c`::ref 0 aborting False
>Thread-2649::DEBUG::2014-04-10 17:35:28,003::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2649::DEBUG::2014-04-10 17:35:28,004::task::579::TaskManager.Task::(_updateState) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::moving from state init -> state preparing
>Thread-2649::INFO::2014-04-10 17:35:28,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2649::DEBUG::2014-04-10 17:35:28,004::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d963e8be-e486-4d63-9b28-2045253eb75d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2649::DEBUG::2014-04-10 17:35:28,005::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2649::DEBUG::2014-04-10 17:35:28,005::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2649::DEBUG::2014-04-10 17:35:28,005::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d963e8be-e486-4d63-9b28-2045253eb75d`::Granted request
>Thread-2649::DEBUG::2014-04-10 17:35:28,005::task::811::TaskManager.Task::(resourceAcquired) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2649::DEBUG::2014-04-10 17:35:28,005::task::974::TaskManager.Task::(_decref) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::ref 1 aborting False
>Thread-2649::INFO::2014-04-10 17:35:28,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2649::DEBUG::2014-04-10 17:35:28,007::task::1168::TaskManager.Task::(prepare) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::task::579::TaskManager.Task::(_updateState) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::moving from state preparing -> state finished
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2649::DEBUG::2014-04-10 17:35:28,008::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2649::DEBUG::2014-04-10 17:35:28,009::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2649::DEBUG::2014-04-10 17:35:28,009::task::974::TaskManager.Task::(_decref) Task=`e5c6b12c-1aa8-45f1-b7ea-7c5cb5e02273`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:34,936::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:35:34,945::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:35:34,946::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:35:34,946::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 17:35:34,952::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-468::DEBUG::2014-04-10 17:35:34,952::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:35:34,955::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:35:34,955::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:35:34,956::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:35:34,956::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:35:34,960::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-466::DEBUG::2014-04-10 17:35:34,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:34,969::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::DEBUG::2014-04-10 17:35:34,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263799 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::INFO::2014-04-10 17:35:34,971::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:35:34,972::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:35:34,986::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:34,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00038288 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:35:35,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:35,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000538614 s, 683 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:35,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:35,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000540426 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2660::DEBUG::2014-04-10 17:35:35,950::task::579::TaskManager.Task::(_updateState) Task=`40c13b0f-de96-48d9-b1ca-129aa1c29ca3`::moving from state init -> state preparing
>Thread-2660::INFO::2014-04-10 17:35:35,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2660::INFO::2014-04-10 17:35:35,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540426', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263799', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038288', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538614', 'lastCheck': '0.8', 'valid': True}}
>Thread-2660::DEBUG::2014-04-10 17:35:35,951::task::1168::TaskManager.Task::(prepare) Task=`40c13b0f-de96-48d9-b1ca-129aa1c29ca3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540426', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263799', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038288', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538614', 'lastCheck': '0.8', 'valid': True}}
>Thread-2660::DEBUG::2014-04-10 17:35:35,951::task::579::TaskManager.Task::(_updateState) Task=`40c13b0f-de96-48d9-b1ca-129aa1c29ca3`::moving from state preparing -> state finished
>Thread-2660::DEBUG::2014-04-10 17:35:35,951::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2660::DEBUG::2014-04-10 17:35:35,951::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2660::DEBUG::2014-04-10 17:35:35,952::task::974::TaskManager.Task::(_decref) Task=`40c13b0f-de96-48d9-b1ca-129aa1c29ca3`::ref 0 aborting False
>Thread-2662::DEBUG::2014-04-10 17:35:38,103::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2662::DEBUG::2014-04-10 17:35:38,131::task::579::TaskManager.Task::(_updateState) Task=`51dabf84-9ced-457e-8524-a4cc6c713d11`::moving from state init -> state preparing
>Thread-2662::INFO::2014-04-10 17:35:38,132::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2662::INFO::2014-04-10 17:35:38,132::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2662::DEBUG::2014-04-10 17:35:38,132::task::1168::TaskManager.Task::(prepare) Task=`51dabf84-9ced-457e-8524-a4cc6c713d11`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2662::DEBUG::2014-04-10 17:35:38,132::task::579::TaskManager.Task::(_updateState) Task=`51dabf84-9ced-457e-8524-a4cc6c713d11`::moving from state preparing -> state finished
>Thread-2662::DEBUG::2014-04-10 17:35:38,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2662::DEBUG::2014-04-10 17:35:38,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2662::DEBUG::2014-04-10 17:35:38,133::task::974::TaskManager.Task::(_decref) Task=`51dabf84-9ced-457e-8524-a4cc6c713d11`::ref 0 aborting False
>Thread-2663::DEBUG::2014-04-10 17:35:38,139::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2663::DEBUG::2014-04-10 17:35:38,140::task::579::TaskManager.Task::(_updateState) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::moving from state init -> state preparing
>Thread-2663::INFO::2014-04-10 17:35:38,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2663::DEBUG::2014-04-10 17:35:38,140::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef0a3d4d-6897-41fd-bfda-299da63097b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2663::DEBUG::2014-04-10 17:35:38,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2663::DEBUG::2014-04-10 17:35:38,141::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2663::DEBUG::2014-04-10 17:35:38,141::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef0a3d4d-6897-41fd-bfda-299da63097b7`::Granted request
>Thread-2663::DEBUG::2014-04-10 17:35:38,141::task::811::TaskManager.Task::(resourceAcquired) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2663::DEBUG::2014-04-10 17:35:38,141::task::974::TaskManager.Task::(_decref) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::ref 1 aborting False
>Thread-2663::INFO::2014-04-10 17:35:38,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2663::DEBUG::2014-04-10 17:35:38,143::task::1168::TaskManager.Task::(prepare) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2663::DEBUG::2014-04-10 17:35:38,143::task::579::TaskManager.Task::(_updateState) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::moving from state preparing -> state finished
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2663::DEBUG::2014-04-10 17:35:38,144::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2663::DEBUG::2014-04-10 17:35:38,145::task::974::TaskManager.Task::(_decref) Task=`e3f30bcf-084e-4e51-a477-7f512a45d707`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:44,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:35:45,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280463 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:35:45,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:45,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410702 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:35:45,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:45,147::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000526555 s, 699 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:45,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:45,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000575553 s, 1.1 MB/s\n'; <rc> = 0
>Thread-2668::DEBUG::2014-04-10 17:35:48,226::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2668::DEBUG::2014-04-10 17:35:48,227::task::579::TaskManager.Task::(_updateState) Task=`96533e32-2bdb-44f8-baab-7696fa2f95b0`::moving from state init -> state preparing
>Thread-2668::INFO::2014-04-10 17:35:48,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2668::INFO::2014-04-10 17:35:48,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2668::DEBUG::2014-04-10 17:35:48,227::task::1168::TaskManager.Task::(prepare) Task=`96533e32-2bdb-44f8-baab-7696fa2f95b0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2668::DEBUG::2014-04-10 17:35:48,227::task::579::TaskManager.Task::(_updateState) Task=`96533e32-2bdb-44f8-baab-7696fa2f95b0`::moving from state preparing -> state finished
>Thread-2668::DEBUG::2014-04-10 17:35:48,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2668::DEBUG::2014-04-10 17:35:48,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2668::DEBUG::2014-04-10 17:35:48,228::task::974::TaskManager.Task::(_decref) Task=`96533e32-2bdb-44f8-baab-7696fa2f95b0`::ref 0 aborting False
>Thread-2669::DEBUG::2014-04-10 17:35:48,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2669::DEBUG::2014-04-10 17:35:48,235::task::579::TaskManager.Task::(_updateState) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::moving from state init -> state preparing
>Thread-2669::INFO::2014-04-10 17:35:48,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2669::DEBUG::2014-04-10 17:35:48,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b79c3398-722f-44be-9413-8108e44c4b4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2669::DEBUG::2014-04-10 17:35:48,235::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2669::DEBUG::2014-04-10 17:35:48,236::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2669::DEBUG::2014-04-10 17:35:48,236::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b79c3398-722f-44be-9413-8108e44c4b4c`::Granted request
>Thread-2669::DEBUG::2014-04-10 17:35:48,236::task::811::TaskManager.Task::(resourceAcquired) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2669::DEBUG::2014-04-10 17:35:48,236::task::974::TaskManager.Task::(_decref) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::ref 1 aborting False
>Thread-2669::INFO::2014-04-10 17:35:48,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2669::DEBUG::2014-04-10 17:35:48,238::task::1168::TaskManager.Task::(prepare) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2669::DEBUG::2014-04-10 17:35:48,238::task::579::TaskManager.Task::(_updateState) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::moving from state preparing -> state finished
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2669::DEBUG::2014-04-10 17:35:48,239::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2669::DEBUG::2014-04-10 17:35:48,240::task::974::TaskManager.Task::(_decref) Task=`72211df7-34e8-4d17-ba82-25e9eb045789`::ref 0 aborting False
>Thread-2670::DEBUG::2014-04-10 17:35:51,114::task::579::TaskManager.Task::(_updateState) Task=`bf750fa3-1020-4cee-b714-a9e5b2ad2e88`::moving from state init -> state preparing
>Thread-2670::INFO::2014-04-10 17:35:51,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2670::INFO::2014-04-10 17:35:51,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575553', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280463', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410702', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526555', 'lastCheck': '6.0', 'valid': True}}
>Thread-2670::DEBUG::2014-04-10 17:35:51,114::task::1168::TaskManager.Task::(prepare) Task=`bf750fa3-1020-4cee-b714-a9e5b2ad2e88`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575553', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280463', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410702', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526555', 'lastCheck': '6.0', 'valid': True}}
>Thread-2670::DEBUG::2014-04-10 17:35:51,115::task::579::TaskManager.Task::(_updateState) Task=`bf750fa3-1020-4cee-b714-a9e5b2ad2e88`::moving from state preparing -> state finished
>Thread-2670::DEBUG::2014-04-10 17:35:51,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2670::DEBUG::2014-04-10 17:35:51,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2670::DEBUG::2014-04-10 17:35:51,115::task::974::TaskManager.Task::(_decref) Task=`bf750fa3-1020-4cee-b714-a9e5b2ad2e88`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:35:55,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:35:55,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033158 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:35:55,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:35:55,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371508 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:35:55,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:35:55,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457946 s, 804 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:35:55,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:35:55,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494155 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2674::DEBUG::2014-04-10 17:35:58,317::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2674::DEBUG::2014-04-10 17:35:58,317::task::579::TaskManager.Task::(_updateState) Task=`ff2943a3-48a6-4916-ac68-ca8ecff7092e`::moving from state init -> state preparing
>Thread-2674::INFO::2014-04-10 17:35:58,318::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2674::INFO::2014-04-10 17:35:58,318::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2674::DEBUG::2014-04-10 17:35:58,318::task::1168::TaskManager.Task::(prepare) Task=`ff2943a3-48a6-4916-ac68-ca8ecff7092e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2674::DEBUG::2014-04-10 17:35:58,318::task::579::TaskManager.Task::(_updateState) Task=`ff2943a3-48a6-4916-ac68-ca8ecff7092e`::moving from state preparing -> state finished
>Thread-2674::DEBUG::2014-04-10 17:35:58,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2674::DEBUG::2014-04-10 17:35:58,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2674::DEBUG::2014-04-10 17:35:58,319::task::974::TaskManager.Task::(_decref) Task=`ff2943a3-48a6-4916-ac68-ca8ecff7092e`::ref 0 aborting False
>Thread-2675::DEBUG::2014-04-10 17:35:58,325::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2675::DEBUG::2014-04-10 17:35:58,325::task::579::TaskManager.Task::(_updateState) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::moving from state init -> state preparing
>Thread-2675::INFO::2014-04-10 17:35:58,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2675::DEBUG::2014-04-10 17:35:58,326::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8bfae922-8037-45c8-b44f-61c364d2ab5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2675::DEBUG::2014-04-10 17:35:58,326::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2675::DEBUG::2014-04-10 17:35:58,326::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2675::DEBUG::2014-04-10 17:35:58,327::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8bfae922-8037-45c8-b44f-61c364d2ab5e`::Granted request
>Thread-2675::DEBUG::2014-04-10 17:35:58,327::task::811::TaskManager.Task::(resourceAcquired) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2675::DEBUG::2014-04-10 17:35:58,327::task::974::TaskManager.Task::(_decref) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::ref 1 aborting False
>Thread-2675::INFO::2014-04-10 17:35:58,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2675::DEBUG::2014-04-10 17:35:58,329::task::1168::TaskManager.Task::(prepare) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2675::DEBUG::2014-04-10 17:35:58,329::task::579::TaskManager.Task::(_updateState) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::moving from state preparing -> state finished
>Thread-2675::DEBUG::2014-04-10 17:35:58,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2675::DEBUG::2014-04-10 17:35:58,330::task::974::TaskManager.Task::(_decref) Task=`73d224e4-1d79-4dac-9249-45b6cb8f86b7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:05,074::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:05,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000416182 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:05,114::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:05,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000418941 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:05,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:05,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000607711 s, 606 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:36:05,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:36:05,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000519612 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2678::DEBUG::2014-04-10 17:36:06,285::task::579::TaskManager.Task::(_updateState) Task=`6d4559a7-2d70-479a-9e92-ad948bca0042`::moving from state init -> state preparing
>Thread-2678::INFO::2014-04-10 17:36:06,286::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2678::INFO::2014-04-10 17:36:06,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519612', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416182', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418941', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607711', 'lastCheck': '1.1', 'valid': True}}
>Thread-2678::DEBUG::2014-04-10 17:36:06,286::task::1168::TaskManager.Task::(prepare) Task=`6d4559a7-2d70-479a-9e92-ad948bca0042`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519612', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416182', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418941', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000607711', 'lastCheck': '1.1', 'valid': True}}
>Thread-2678::DEBUG::2014-04-10 17:36:06,286::task::579::TaskManager.Task::(_updateState) Task=`6d4559a7-2d70-479a-9e92-ad948bca0042`::moving from state preparing -> state finished
>Thread-2678::DEBUG::2014-04-10 17:36:06,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2678::DEBUG::2014-04-10 17:36:06,287::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2678::DEBUG::2014-04-10 17:36:06,287::task::974::TaskManager.Task::(_decref) Task=`6d4559a7-2d70-479a-9e92-ad948bca0042`::ref 0 aborting False
>Thread-2680::DEBUG::2014-04-10 17:36:08,449::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2680::DEBUG::2014-04-10 17:36:08,459::task::579::TaskManager.Task::(_updateState) Task=`dd2561ab-ea48-4eed-b88c-3afbc3bb3a62`::moving from state init -> state preparing
>Thread-2680::INFO::2014-04-10 17:36:08,459::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2680::INFO::2014-04-10 17:36:08,459::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2680::DEBUG::2014-04-10 17:36:08,459::task::1168::TaskManager.Task::(prepare) Task=`dd2561ab-ea48-4eed-b88c-3afbc3bb3a62`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2680::DEBUG::2014-04-10 17:36:08,460::task::579::TaskManager.Task::(_updateState) Task=`dd2561ab-ea48-4eed-b88c-3afbc3bb3a62`::moving from state preparing -> state finished
>Thread-2680::DEBUG::2014-04-10 17:36:08,460::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2680::DEBUG::2014-04-10 17:36:08,460::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2680::DEBUG::2014-04-10 17:36:08,460::task::974::TaskManager.Task::(_decref) Task=`dd2561ab-ea48-4eed-b88c-3afbc3bb3a62`::ref 0 aborting False
>Thread-2681::DEBUG::2014-04-10 17:36:08,466::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2681::DEBUG::2014-04-10 17:36:08,467::task::579::TaskManager.Task::(_updateState) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::moving from state init -> state preparing
>Thread-2681::INFO::2014-04-10 17:36:08,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2681::DEBUG::2014-04-10 17:36:08,467::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad7f616-0533-43c9-bb68-f3c13001946f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2681::DEBUG::2014-04-10 17:36:08,467::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2681::DEBUG::2014-04-10 17:36:08,468::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2681::DEBUG::2014-04-10 17:36:08,468::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad7f616-0533-43c9-bb68-f3c13001946f`::Granted request
>Thread-2681::DEBUG::2014-04-10 17:36:08,468::task::811::TaskManager.Task::(resourceAcquired) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2681::DEBUG::2014-04-10 17:36:08,468::task::974::TaskManager.Task::(_decref) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::ref 1 aborting False
>Thread-2681::INFO::2014-04-10 17:36:08,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2681::DEBUG::2014-04-10 17:36:08,470::task::1168::TaskManager.Task::(prepare) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2681::DEBUG::2014-04-10 17:36:08,470::task::579::TaskManager.Task::(_updateState) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::moving from state preparing -> state finished
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2681::DEBUG::2014-04-10 17:36:08,471::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2681::DEBUG::2014-04-10 17:36:08,472::task::974::TaskManager.Task::(_decref) Task=`e0c1a859-073e-4a2a-acb6-092cb88449b6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:15,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:15,142::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396342 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:15,154::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:15,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339318 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:15,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:15,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044431 s, 828 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:36:15,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:36:15,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496964 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2686::DEBUG::2014-04-10 17:36:18,563::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-2686::DEBUG::2014-04-10 17:36:18,564::task::579::TaskManager.Task::(_updateState) Task=`dc63d8e9-f28c-4833-81b4-592ec5c12d80`::moving from state init -> state preparing
>Thread-2686::INFO::2014-04-10 17:36:18,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2686::INFO::2014-04-10 17:36:18,564::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2686::DEBUG::2014-04-10 17:36:18,564::task::1168::TaskManager.Task::(prepare) Task=`dc63d8e9-f28c-4833-81b4-592ec5c12d80`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2686::DEBUG::2014-04-10 17:36:18,565::task::579::TaskManager.Task::(_updateState) Task=`dc63d8e9-f28c-4833-81b4-592ec5c12d80`::moving from state preparing -> state finished
>Thread-2686::DEBUG::2014-04-10 17:36:18,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2686::DEBUG::2014-04-10 17:36:18,565::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2686::DEBUG::2014-04-10 17:36:18,565::task::974::TaskManager.Task::(_decref) Task=`dc63d8e9-f28c-4833-81b4-592ec5c12d80`::ref 0 aborting False
>Thread-2687::DEBUG::2014-04-10 17:36:18,572::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-2687::DEBUG::2014-04-10 17:36:18,572::task::579::TaskManager.Task::(_updateState) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::moving from state init -> state preparing
>Thread-2687::INFO::2014-04-10 17:36:18,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2687::DEBUG::2014-04-10 17:36:18,574::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9deb4b92-b3ba-4717-a2a5-9a6042b51a8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2687::DEBUG::2014-04-10 17:36:18,574::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2687::DEBUG::2014-04-10 17:36:18,574::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2687::DEBUG::2014-04-10 17:36:18,574::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9deb4b92-b3ba-4717-a2a5-9a6042b51a8a`::Granted request
>Thread-2687::DEBUG::2014-04-10 17:36:18,575::task::811::TaskManager.Task::(resourceAcquired) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2687::DEBUG::2014-04-10 17:36:18,575::task::974::TaskManager.Task::(_decref) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::ref 1 aborting False
>Thread-2687::INFO::2014-04-10 17:36:18,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::task::1168::TaskManager.Task::(prepare) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::task::579::TaskManager.Task::(_updateState) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::moving from state preparing -> state finished
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2687::DEBUG::2014-04-10 17:36:18,577::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2687::DEBUG::2014-04-10 17:36:18,578::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2687::DEBUG::2014-04-10 17:36:18,578::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2687::DEBUG::2014-04-10 17:36:18,578::task::974::TaskManager.Task::(_decref) Task=`a5767a65-6f27-4275-b32e-c92ec40eab38`::ref 0 aborting False
>Thread-2688::DEBUG::2014-04-10 17:36:21,460::task::579::TaskManager.Task::(_updateState) Task=`225d0ced-c811-4a62-af0b-32f788dfbe1b`::moving from state init -> state preparing
>Thread-2688::INFO::2014-04-10 17:36:21,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2688::INFO::2014-04-10 17:36:21,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496964', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396342', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339318', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044431', 'lastCheck': '6.3', 'valid': True}}
>Thread-2688::DEBUG::2014-04-10 17:36:21,461::task::1168::TaskManager.Task::(prepare) Task=`225d0ced-c811-4a62-af0b-32f788dfbe1b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496964', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396342', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339318', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044431', 'lastCheck': '6.3', 'valid': True}}
>Thread-2688::DEBUG::2014-04-10 17:36:21,461::task::579::TaskManager.Task::(_updateState) Task=`225d0ced-c811-4a62-af0b-32f788dfbe1b`::moving from state preparing -> state finished
>Thread-2688::DEBUG::2014-04-10 17:36:21,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2688::DEBUG::2014-04-10 17:36:21,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2688::DEBUG::2014-04-10 17:36:21,461::task::974::TaskManager.Task::(_decref) Task=`225d0ced-c811-4a62-af0b-32f788dfbe1b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:25,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:25,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271748 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:25,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:25,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314062 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:25,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:25,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0003915 s, 940 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:36:25,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:36:25,282::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00047575 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2692::DEBUG::2014-04-10 17:36:28,653::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2692::DEBUG::2014-04-10 17:36:28,654::task::579::TaskManager.Task::(_updateState) Task=`12062f55-9b85-413b-8404-a2424b0cfd45`::moving from state init -> state preparing
>Thread-2692::INFO::2014-04-10 17:36:28,654::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2692::INFO::2014-04-10 17:36:28,655::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2692::DEBUG::2014-04-10 17:36:28,655::task::1168::TaskManager.Task::(prepare) Task=`12062f55-9b85-413b-8404-a2424b0cfd45`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2692::DEBUG::2014-04-10 17:36:28,655::task::579::TaskManager.Task::(_updateState) Task=`12062f55-9b85-413b-8404-a2424b0cfd45`::moving from state preparing -> state finished
>Thread-2692::DEBUG::2014-04-10 17:36:28,655::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2692::DEBUG::2014-04-10 17:36:28,655::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2692::DEBUG::2014-04-10 17:36:28,656::task::974::TaskManager.Task::(_decref) Task=`12062f55-9b85-413b-8404-a2424b0cfd45`::ref 0 aborting False
>Thread-2693::DEBUG::2014-04-10 17:36:28,663::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2693::DEBUG::2014-04-10 17:36:28,663::task::579::TaskManager.Task::(_updateState) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::moving from state init -> state preparing
>Thread-2693::INFO::2014-04-10 17:36:28,663::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2693::DEBUG::2014-04-10 17:36:28,664::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25134f3d-02d0-4fba-b383-67c35076a69a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2693::DEBUG::2014-04-10 17:36:28,664::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2693::DEBUG::2014-04-10 17:36:28,664::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2693::DEBUG::2014-04-10 17:36:28,665::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25134f3d-02d0-4fba-b383-67c35076a69a`::Granted request
>Thread-2693::DEBUG::2014-04-10 17:36:28,665::task::811::TaskManager.Task::(resourceAcquired) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2693::DEBUG::2014-04-10 17:36:28,665::task::974::TaskManager.Task::(_decref) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::ref 1 aborting False
>Thread-2693::INFO::2014-04-10 17:36:28,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2693::DEBUG::2014-04-10 17:36:28,668::task::1168::TaskManager.Task::(prepare) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2693::DEBUG::2014-04-10 17:36:28,668::task::579::TaskManager.Task::(_updateState) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::moving from state preparing -> state finished
>Thread-2693::DEBUG::2014-04-10 17:36:28,668::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2693::DEBUG::2014-04-10 17:36:28,668::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2693::DEBUG::2014-04-10 17:36:28,668::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2693::DEBUG::2014-04-10 17:36:28,669::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2693::DEBUG::2014-04-10 17:36:28,669::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2693::DEBUG::2014-04-10 17:36:28,669::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2693::DEBUG::2014-04-10 17:36:28,669::task::974::TaskManager.Task::(_decref) Task=`866733a6-b26c-483f-8d05-e3a2edd7f221`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:35,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:35,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000419099 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:35,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:35,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:35,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324956 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:35,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479187 s, 768 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:36:35,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:36:35,399::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000493376 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2696::DEBUG::2014-04-10 17:36:36,675::task::579::TaskManager.Task::(_updateState) Task=`de11b86d-85eb-4cfe-965f-7dc137bc07e6`::moving from state init -> state preparing
>Thread-2696::INFO::2014-04-10 17:36:36,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2696::INFO::2014-04-10 17:36:36,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493376', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419099', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324956', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479187', 'lastCheck': '1.3', 'valid': True}}
>Thread-2696::DEBUG::2014-04-10 17:36:36,675::task::1168::TaskManager.Task::(prepare) Task=`de11b86d-85eb-4cfe-965f-7dc137bc07e6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493376', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419099', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324956', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479187', 'lastCheck': '1.3', 'valid': True}}
>Thread-2696::DEBUG::2014-04-10 17:36:36,676::task::579::TaskManager.Task::(_updateState) Task=`de11b86d-85eb-4cfe-965f-7dc137bc07e6`::moving from state preparing -> state finished
>Thread-2696::DEBUG::2014-04-10 17:36:36,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2696::DEBUG::2014-04-10 17:36:36,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2696::DEBUG::2014-04-10 17:36:36,676::task::974::TaskManager.Task::(_decref) Task=`de11b86d-85eb-4cfe-965f-7dc137bc07e6`::ref 0 aborting False
>Thread-2698::DEBUG::2014-04-10 17:36:39,085::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2698::DEBUG::2014-04-10 17:36:39,093::task::579::TaskManager.Task::(_updateState) Task=`b300af91-b3c2-47a0-9d0e-530881208850`::moving from state init -> state preparing
>Thread-2698::INFO::2014-04-10 17:36:39,093::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2698::INFO::2014-04-10 17:36:39,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2698::DEBUG::2014-04-10 17:36:39,094::task::1168::TaskManager.Task::(prepare) Task=`b300af91-b3c2-47a0-9d0e-530881208850`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2698::DEBUG::2014-04-10 17:36:39,094::task::579::TaskManager.Task::(_updateState) Task=`b300af91-b3c2-47a0-9d0e-530881208850`::moving from state preparing -> state finished
>Thread-2698::DEBUG::2014-04-10 17:36:39,094::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2698::DEBUG::2014-04-10 17:36:39,094::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2698::DEBUG::2014-04-10 17:36:39,095::task::974::TaskManager.Task::(_decref) Task=`b300af91-b3c2-47a0-9d0e-530881208850`::ref 0 aborting False
>Thread-2699::DEBUG::2014-04-10 17:36:39,102::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2699::DEBUG::2014-04-10 17:36:39,102::task::579::TaskManager.Task::(_updateState) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::moving from state init -> state preparing
>Thread-2699::INFO::2014-04-10 17:36:39,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2699::DEBUG::2014-04-10 17:36:39,103::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5b4b1af7-89e0-415c-9e75-ae4d7c5adaf2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2699::DEBUG::2014-04-10 17:36:39,103::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2699::DEBUG::2014-04-10 17:36:39,104::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2699::DEBUG::2014-04-10 17:36:39,104::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5b4b1af7-89e0-415c-9e75-ae4d7c5adaf2`::Granted request
>Thread-2699::DEBUG::2014-04-10 17:36:39,104::task::811::TaskManager.Task::(resourceAcquired) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2699::DEBUG::2014-04-10 17:36:39,104::task::974::TaskManager.Task::(_decref) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::ref 1 aborting False
>Thread-2699::INFO::2014-04-10 17:36:39,107::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2699::DEBUG::2014-04-10 17:36:39,107::task::1168::TaskManager.Task::(prepare) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2699::DEBUG::2014-04-10 17:36:39,107::task::579::TaskManager.Task::(_updateState) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::moving from state preparing -> state finished
>Thread-2699::DEBUG::2014-04-10 17:36:39,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2699::DEBUG::2014-04-10 17:36:39,108::task::974::TaskManager.Task::(_decref) Task=`e903e737-cd41-4345-a205-a67a81507b6d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:45,220::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:45,227::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382946 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:45,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:45,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000253709 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:45,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:36:45,473::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:45,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00066517 s, 553 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:36:45,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000644416 s, 1.0 MB/s\n'; <rc> = 0
>Thread-2704::DEBUG::2014-04-10 17:36:49,183::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2704::DEBUG::2014-04-10 17:36:49,184::task::579::TaskManager.Task::(_updateState) Task=`ded5573d-d428-43de-a041-327d4c10f6cb`::moving from state init -> state preparing
>Thread-2704::INFO::2014-04-10 17:36:49,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2704::INFO::2014-04-10 17:36:49,185::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2704::DEBUG::2014-04-10 17:36:49,185::task::1168::TaskManager.Task::(prepare) Task=`ded5573d-d428-43de-a041-327d4c10f6cb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2704::DEBUG::2014-04-10 17:36:49,185::task::579::TaskManager.Task::(_updateState) Task=`ded5573d-d428-43de-a041-327d4c10f6cb`::moving from state preparing -> state finished
>Thread-2704::DEBUG::2014-04-10 17:36:49,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2704::DEBUG::2014-04-10 17:36:49,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2704::DEBUG::2014-04-10 17:36:49,186::task::974::TaskManager.Task::(_decref) Task=`ded5573d-d428-43de-a041-327d4c10f6cb`::ref 0 aborting False
>Thread-2705::DEBUG::2014-04-10 17:36:49,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2705::DEBUG::2014-04-10 17:36:49,193::task::579::TaskManager.Task::(_updateState) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::moving from state init -> state preparing
>Thread-2705::INFO::2014-04-10 17:36:49,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2705::DEBUG::2014-04-10 17:36:49,193::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`26d511fe-e533-41fa-a39b-9283252304d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2705::DEBUG::2014-04-10 17:36:49,194::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2705::DEBUG::2014-04-10 17:36:49,194::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2705::DEBUG::2014-04-10 17:36:49,194::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`26d511fe-e533-41fa-a39b-9283252304d7`::Granted request
>Thread-2705::DEBUG::2014-04-10 17:36:49,194::task::811::TaskManager.Task::(resourceAcquired) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2705::DEBUG::2014-04-10 17:36:49,195::task::974::TaskManager.Task::(_decref) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::ref 1 aborting False
>Thread-2705::INFO::2014-04-10 17:36:49,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2705::DEBUG::2014-04-10 17:36:49,197::task::1168::TaskManager.Task::(prepare) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2705::DEBUG::2014-04-10 17:36:49,197::task::579::TaskManager.Task::(_updateState) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::moving from state preparing -> state finished
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2705::DEBUG::2014-04-10 17:36:49,198::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2705::DEBUG::2014-04-10 17:36:49,199::task::974::TaskManager.Task::(_decref) Task=`5932fcad-a1b1-4998-af67-2943168dd18f`::ref 0 aborting False
>Thread-2706::DEBUG::2014-04-10 17:36:52,084::task::579::TaskManager.Task::(_updateState) Task=`66b7e0ce-41d7-4682-afba-41e17ccb453c`::moving from state init -> state preparing
>Thread-2706::INFO::2014-04-10 17:36:52,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2706::INFO::2014-04-10 17:36:52,084::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644416', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382946', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253709', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066517', 'lastCheck': '6.6', 'valid': True}}
>Thread-2706::DEBUG::2014-04-10 17:36:52,084::task::1168::TaskManager.Task::(prepare) Task=`66b7e0ce-41d7-4682-afba-41e17ccb453c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644416', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382946', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253709', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066517', 'lastCheck': '6.6', 'valid': True}}
>Thread-2706::DEBUG::2014-04-10 17:36:52,085::task::579::TaskManager.Task::(_updateState) Task=`66b7e0ce-41d7-4682-afba-41e17ccb453c`::moving from state preparing -> state finished
>Thread-2706::DEBUG::2014-04-10 17:36:52,085::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2706::DEBUG::2014-04-10 17:36:52,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2706::DEBUG::2014-04-10 17:36:52,085::task::974::TaskManager.Task::(_decref) Task=`66b7e0ce-41d7-4682-afba-41e17ccb453c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:36:55,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:36:55,243::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359913 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:36:55,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:36:55,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000419546 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:55,493::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:36:55,522::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:36:55,524::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:36:55,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:55,536::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-467::DEBUG::2014-04-10 17:36:55,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000361544 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:36:55,543::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:36:55,544::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:36:55,545::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:36:55,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:36:55,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456785 s, 806 kB/s\n'; <rc> = 0
>Thread-2714::DEBUG::2014-04-10 17:36:59,490::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2714::DEBUG::2014-04-10 17:36:59,491::task::579::TaskManager.Task::(_updateState) Task=`217394c8-2269-428e-9659-ffad5157bc50`::moving from state init -> state preparing
>Thread-2714::INFO::2014-04-10 17:36:59,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2714::INFO::2014-04-10 17:36:59,492::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2714::DEBUG::2014-04-10 17:36:59,492::task::1168::TaskManager.Task::(prepare) Task=`217394c8-2269-428e-9659-ffad5157bc50`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2714::DEBUG::2014-04-10 17:36:59,492::task::579::TaskManager.Task::(_updateState) Task=`217394c8-2269-428e-9659-ffad5157bc50`::moving from state preparing -> state finished
>Thread-2714::DEBUG::2014-04-10 17:36:59,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2714::DEBUG::2014-04-10 17:36:59,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2714::DEBUG::2014-04-10 17:36:59,493::task::974::TaskManager.Task::(_decref) Task=`217394c8-2269-428e-9659-ffad5157bc50`::ref 0 aborting False
>Thread-2715::DEBUG::2014-04-10 17:36:59,500::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2715::DEBUG::2014-04-10 17:36:59,500::task::579::TaskManager.Task::(_updateState) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::moving from state init -> state preparing
>Thread-2715::INFO::2014-04-10 17:36:59,500::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2715::DEBUG::2014-04-10 17:36:59,501::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9ba02a5-ce05-4cc9-afdb-7ca18fcc949f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2715::DEBUG::2014-04-10 17:36:59,501::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2715::DEBUG::2014-04-10 17:36:59,501::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2715::DEBUG::2014-04-10 17:36:59,501::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9ba02a5-ce05-4cc9-afdb-7ca18fcc949f`::Granted request
>Thread-2715::DEBUG::2014-04-10 17:36:59,503::task::811::TaskManager.Task::(resourceAcquired) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2715::DEBUG::2014-04-10 17:36:59,503::task::974::TaskManager.Task::(_decref) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::ref 1 aborting False
>Thread-2715::INFO::2014-04-10 17:36:59,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2715::DEBUG::2014-04-10 17:36:59,505::task::1168::TaskManager.Task::(prepare) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::task::579::TaskManager.Task::(_updateState) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::moving from state preparing -> state finished
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2715::DEBUG::2014-04-10 17:36:59,506::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2715::DEBUG::2014-04-10 17:36:59,507::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2715::DEBUG::2014-04-10 17:36:59,507::task::974::TaskManager.Task::(_decref) Task=`e5a36910-1f76-4a9c-b052-0ad88dba1e1e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:05,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:05,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379897 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:05,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:05,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000403333 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:05,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:05,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000520251 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:05,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:05,607::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048749 s, 755 kB/s\n'; <rc> = 0
>Thread-2718::DEBUG::2014-04-10 17:37:07,239::task::579::TaskManager.Task::(_updateState) Task=`23bf0d21-adf2-404a-a369-3472b1e72f0e`::moving from state init -> state preparing
>Thread-2718::INFO::2014-04-10 17:37:07,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2718::INFO::2014-04-10 17:37:07,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520251', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379897', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403333', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048749', 'lastCheck': '1.6', 'valid': True}}
>Thread-2718::DEBUG::2014-04-10 17:37:07,239::task::1168::TaskManager.Task::(prepare) Task=`23bf0d21-adf2-404a-a369-3472b1e72f0e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520251', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379897', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403333', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048749', 'lastCheck': '1.6', 'valid': True}}
>Thread-2718::DEBUG::2014-04-10 17:37:07,240::task::579::TaskManager.Task::(_updateState) Task=`23bf0d21-adf2-404a-a369-3472b1e72f0e`::moving from state preparing -> state finished
>Thread-2718::DEBUG::2014-04-10 17:37:07,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2718::DEBUG::2014-04-10 17:37:07,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2718::DEBUG::2014-04-10 17:37:07,240::task::974::TaskManager.Task::(_decref) Task=`23bf0d21-adf2-404a-a369-3472b1e72f0e`::ref 0 aborting False
>Thread-2720::DEBUG::2014-04-10 17:37:09,582::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2720::DEBUG::2014-04-10 17:37:09,590::task::579::TaskManager.Task::(_updateState) Task=`131e3e8e-baed-4305-8ca2-23690777da04`::moving from state init -> state preparing
>Thread-2720::INFO::2014-04-10 17:37:09,590::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2720::INFO::2014-04-10 17:37:09,590::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2720::DEBUG::2014-04-10 17:37:09,590::task::1168::TaskManager.Task::(prepare) Task=`131e3e8e-baed-4305-8ca2-23690777da04`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2720::DEBUG::2014-04-10 17:37:09,591::task::579::TaskManager.Task::(_updateState) Task=`131e3e8e-baed-4305-8ca2-23690777da04`::moving from state preparing -> state finished
>Thread-2720::DEBUG::2014-04-10 17:37:09,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2720::DEBUG::2014-04-10 17:37:09,591::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2720::DEBUG::2014-04-10 17:37:09,591::task::974::TaskManager.Task::(_decref) Task=`131e3e8e-baed-4305-8ca2-23690777da04`::ref 0 aborting False
>Thread-2721::DEBUG::2014-04-10 17:37:09,598::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2721::DEBUG::2014-04-10 17:37:09,598::task::579::TaskManager.Task::(_updateState) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::moving from state init -> state preparing
>Thread-2721::INFO::2014-04-10 17:37:09,599::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2721::DEBUG::2014-04-10 17:37:09,599::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`39170bb0-c648-4e62-a908-762d831c1494`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2721::DEBUG::2014-04-10 17:37:09,599::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2721::DEBUG::2014-04-10 17:37:09,600::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2721::DEBUG::2014-04-10 17:37:09,600::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`39170bb0-c648-4e62-a908-762d831c1494`::Granted request
>Thread-2721::DEBUG::2014-04-10 17:37:09,600::task::811::TaskManager.Task::(resourceAcquired) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2721::DEBUG::2014-04-10 17:37:09,600::task::974::TaskManager.Task::(_decref) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::ref 1 aborting False
>Thread-2721::INFO::2014-04-10 17:37:09,603::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2721::DEBUG::2014-04-10 17:37:09,603::task::1168::TaskManager.Task::(prepare) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2721::DEBUG::2014-04-10 17:37:09,603::task::579::TaskManager.Task::(_updateState) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::moving from state preparing -> state finished
>Thread-2721::DEBUG::2014-04-10 17:37:09,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2721::DEBUG::2014-04-10 17:37:09,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2721::DEBUG::2014-04-10 17:37:09,604::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2721::DEBUG::2014-04-10 17:37:09,604::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2721::DEBUG::2014-04-10 17:37:09,604::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2721::DEBUG::2014-04-10 17:37:09,604::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2721::DEBUG::2014-04-10 17:37:09,604::task::974::TaskManager.Task::(_decref) Task=`ee49bc43-3bd7-47a3-9b2c-ed6d7a668403`::ref 0 aborting False
>Thread-2723::DEBUG::2014-04-10 17:37:10,895::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2723::DEBUG::2014-04-10 17:37:10,896::task::579::TaskManager.Task::(_updateState) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::moving from state init -> state preparing
>Thread-2723::INFO::2014-04-10 17:37:10,896::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmList=[{'imglist': 'fe90abc5-8638-40e8-b394-9082b3217731', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.3.0.0"><References><File ovf:href="fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc" ovf:id="7879e1b7-c238-4222-95eb-e922c5cf80dc" ovf:size="2147483648" ovf:description="Active VM"/><Nic ovf:id="f52ee26e-672c-4351-8f7c-fb6de08dbc59"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="7879e1b7-c238-4222-95eb-e922c5cf80dc" ovf:size="2" ovf:actual_size="0" ovf:vm_snapshot_id="4b354d6f-2c3d-41ce-8de5-f592db292d11" ovf:parentRef="" ovf:fileRef="fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm2_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/04/10 08:26:27</CreationDate><ExportDate>2014/04/10 09:37:11</ExportDate><DeleteProtected>false</DeleteProtected><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>3</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>vm2</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><Section ovf:id="af1debb5-7b64-4d09-8455-850ddba3e546" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.3.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm2_Disk1</rasd:Caption><rasd:InstanceId>7879e1b7-c238-4222-95eb-e922c5cf80dc</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>fe90abc5-8638-40e8-b394-9082b3217731/7879e1b7-c238-4222-95eb-e922c5cf80dc</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76</rasd:StorageId><rasd:StoragePoolId>f721168f-5edd-4f5f-8976-591eb93f960e</rasd:StoragePoolId><rasd:CreationDate>2014/04/10 08:26:55</rasd:CreationDate><rasd:LastModified>2014/04/10 08:26:55</rasd:LastModified><rasd:last_modified_date>2014/04/10 09:37:11</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>f52ee26e-672c-4351-8f7c-fb6de08dbc59</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:01:a4:a5:a5:06</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': 'af1debb5-7b64-4d09-8455-850ddba3e546'}], sdUUID=None, options=None)
>Thread-2723::DEBUG::2014-04-10 17:37:10,896::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`950c9db8-2f4b-4e21-9616-aac0e6e55f9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1330' at 'updateVM'
>Thread-2723::DEBUG::2014-04-10 17:37:10,896::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2723::DEBUG::2014-04-10 17:37:10,896::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2723::DEBUG::2014-04-10 17:37:10,897::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`950c9db8-2f4b-4e21-9616-aac0e6e55f9c`::Granted request
>Thread-2723::DEBUG::2014-04-10 17:37:10,897::task::811::TaskManager.Task::(resourceAcquired) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2723::DEBUG::2014-04-10 17:37:10,897::task::974::TaskManager.Task::(_decref) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::ref 1 aborting False
>Thread-2723::DEBUG::2014-04-10 17:37:10,897::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`881155fa-89b9-498e-87aa-e78054df225e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1340' at 'updateVM'
>Thread-2723::DEBUG::2014-04-10 17:37:10,898::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2723::DEBUG::2014-04-10 17:37:10,898::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2723::DEBUG::2014-04-10 17:37:10,898::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`881155fa-89b9-498e-87aa-e78054df225e`::Granted request
>Thread-2723::DEBUG::2014-04-10 17:37:10,898::task::811::TaskManager.Task::(resourceAcquired) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::_resourcesAcquired: Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2723::DEBUG::2014-04-10 17:37:10,898::task::974::TaskManager.Task::(_decref) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::ref 1 aborting False
>Thread-2723::INFO::2014-04-10 17:37:10,898::sp::1322::Storage.StoragePool::(updateVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2723::INFO::2014-04-10 17:37:10,899::sp::1333::Storage.StoragePool::(updateVM) vmUUID=af1debb5-7b64-4d09-8455-850ddba3e546 imgList=['fe90abc5-8638-40e8-b394-9082b3217731']
>Thread-2723::INFO::2014-04-10 17:37:10,987::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None
>Thread-2723::DEBUG::2014-04-10 17:37:10,987::task::1168::TaskManager.Task::(prepare) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::finished: None
>Thread-2723::DEBUG::2014-04-10 17:37:10,987::task::579::TaskManager.Task::(_updateState) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::moving from state preparing -> state finished
>Thread-2723::DEBUG::2014-04-10 17:37:10,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2723::DEBUG::2014-04-10 17:37:10,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2723::DEBUG::2014-04-10 17:37:10,987::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2723::DEBUG::2014-04-10 17:37:10,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2723::DEBUG::2014-04-10 17:37:10,989::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.af1debb5-7b64-4d09-8455-850ddba3e546_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2723::DEBUG::2014-04-10 17:37:10,989::task::974::TaskManager.Task::(_decref) Task=`ecd8b304-9968-43f6-8831-46a89399795e`::ref 0 aborting False
>Thread-2724::DEBUG::2014-04-10 17:37:11,015::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2724::DEBUG::2014-04-10 17:37:11,015::task::579::TaskManager.Task::(_updateState) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::moving from state init -> state preparing
>Thread-2724::INFO::2014-04-10 17:37:11,015::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='e7983b62-8992-42a8-afd7-f7b815d80bbb', sdUUID=None, options=None)
>Thread-2724::DEBUG::2014-04-10 17:37:11,016::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f1a14e78-bf86-4726-a038-b38a3ffd6849`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2724::DEBUG::2014-04-10 17:37:11,016::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2724::DEBUG::2014-04-10 17:37:11,016::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2724::DEBUG::2014-04-10 17:37:11,016::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f1a14e78-bf86-4726-a038-b38a3ffd6849`::Granted request
>Thread-2724::DEBUG::2014-04-10 17:37:11,017::task::811::TaskManager.Task::(resourceAcquired) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2724::DEBUG::2014-04-10 17:37:11,017::task::974::TaskManager.Task::(_decref) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::ref 1 aborting False
>Thread-2724::DEBUG::2014-04-10 17:37:11,017::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`57ac5833-1185-4161-9254-e34819e88b21`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2724::DEBUG::2014-04-10 17:37:11,017::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2724::DEBUG::2014-04-10 17:37:11,017::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2724::DEBUG::2014-04-10 17:37:11,018::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`57ac5833-1185-4161-9254-e34819e88b21`::Granted request
>Thread-2724::DEBUG::2014-04-10 17:37:11,018::task::811::TaskManager.Task::(resourceAcquired) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::_resourcesAcquired: Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2724::DEBUG::2014-04-10 17:37:11,018::task::974::TaskManager.Task::(_decref) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::ref 1 aborting False
>Thread-2724::INFO::2014-04-10 17:37:11,018::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=e7983b62-8992-42a8-afd7-f7b815d80bbb sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2724::INFO::2014-04-10 17:37:11,019::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2724::DEBUG::2014-04-10 17:37:11,019::task::1168::TaskManager.Task::(prepare) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::finished: None
>Thread-2724::DEBUG::2014-04-10 17:37:11,019::task::579::TaskManager.Task::(_updateState) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::moving from state preparing -> state finished
>Thread-2724::DEBUG::2014-04-10 17:37:11,019::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2724::DEBUG::2014-04-10 17:37:11,019::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2724::DEBUG::2014-04-10 17:37:11,020::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2724::DEBUG::2014-04-10 17:37:11,021::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2724::DEBUG::2014-04-10 17:37:11,021::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e7983b62-8992-42a8-afd7-f7b815d80bbb_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2724::DEBUG::2014-04-10 17:37:11,021::task::974::TaskManager.Task::(_decref) Task=`dce4627c-0ad7-4248-88c1-c8d20366e4ac`::ref 0 aborting False
>Thread-2725::DEBUG::2014-04-10 17:37:11,029::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2725::DEBUG::2014-04-10 17:37:11,029::task::579::TaskManager.Task::(_updateState) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::moving from state init -> state preparing
>Thread-2725::INFO::2014-04-10 17:37:11,029::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='c9ccfdfe-0f0d-4c96-8bd7-47723067081a', sdUUID=None, options=None)
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`096f78b5-277e-48bc-9ad5-acf3f15ca747`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`096f78b5-277e-48bc-9ad5-acf3f15ca747`::Granted request
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::task::811::TaskManager.Task::(resourceAcquired) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2725::DEBUG::2014-04-10 17:37:11,030::task::974::TaskManager.Task::(_decref) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::ref 1 aborting False
>Thread-2725::DEBUG::2014-04-10 17:37:11,031::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`74199734-b446-426f-8bad-29b5ccc52809`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2725::DEBUG::2014-04-10 17:37:11,031::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2725::DEBUG::2014-04-10 17:37:11,031::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2725::DEBUG::2014-04-10 17:37:11,031::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`74199734-b446-426f-8bad-29b5ccc52809`::Granted request
>Thread-2725::DEBUG::2014-04-10 17:37:11,032::task::811::TaskManager.Task::(resourceAcquired) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::_resourcesAcquired: Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2725::DEBUG::2014-04-10 17:37:11,032::task::974::TaskManager.Task::(_decref) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::ref 1 aborting False
>Thread-2725::INFO::2014-04-10 17:37:11,032::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=c9ccfdfe-0f0d-4c96-8bd7-47723067081a sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2725::INFO::2014-04-10 17:37:11,032::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::task::1168::TaskManager.Task::(prepare) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::finished: None
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::task::579::TaskManager.Task::(_updateState) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::moving from state preparing -> state finished
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2725::DEBUG::2014-04-10 17:37:11,033::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2725::DEBUG::2014-04-10 17:37:11,034::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.c9ccfdfe-0f0d-4c96-8bd7-47723067081a_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2725::DEBUG::2014-04-10 17:37:11,035::task::974::TaskManager.Task::(_decref) Task=`f3ed2267-fd4a-41c3-a95f-6d96d176e8da`::ref 0 aborting False
>Thread-2726::DEBUG::2014-04-10 17:37:11,041::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2726::DEBUG::2014-04-10 17:37:11,042::task::579::TaskManager.Task::(_updateState) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::moving from state init -> state preparing
>Thread-2726::INFO::2014-04-10 17:37:11,042::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='a3a055b8-512e-47e3-95ec-2a8cfd338eb4', sdUUID=None, options=None)
>Thread-2726::DEBUG::2014-04-10 17:37:11,042::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ce221f97-5aab-4e3d-a9b2-ce58efa29442`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2726::DEBUG::2014-04-10 17:37:11,042::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2726::DEBUG::2014-04-10 17:37:11,042::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2726::DEBUG::2014-04-10 17:37:11,043::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ce221f97-5aab-4e3d-a9b2-ce58efa29442`::Granted request
>Thread-2726::DEBUG::2014-04-10 17:37:11,043::task::811::TaskManager.Task::(resourceAcquired) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2726::DEBUG::2014-04-10 17:37:11,043::task::974::TaskManager.Task::(_decref) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::ref 1 aborting False
>Thread-2726::DEBUG::2014-04-10 17:37:11,043::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`001b5edf-d899-478e-a87d-70f8e6ed1a0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2726::DEBUG::2014-04-10 17:37:11,044::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2726::DEBUG::2014-04-10 17:37:11,044::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2726::DEBUG::2014-04-10 17:37:11,044::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`001b5edf-d899-478e-a87d-70f8e6ed1a0b`::Granted request
>Thread-2726::DEBUG::2014-04-10 17:37:11,044::task::811::TaskManager.Task::(resourceAcquired) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::_resourcesAcquired: Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2726::DEBUG::2014-04-10 17:37:11,044::task::974::TaskManager.Task::(_decref) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::ref 1 aborting False
>Thread-2726::INFO::2014-04-10 17:37:11,044::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=a3a055b8-512e-47e3-95ec-2a8cfd338eb4 sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2726::INFO::2014-04-10 17:37:11,045::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2726::DEBUG::2014-04-10 17:37:11,045::task::1168::TaskManager.Task::(prepare) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::finished: None
>Thread-2726::DEBUG::2014-04-10 17:37:11,045::task::579::TaskManager.Task::(_updateState) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::moving from state preparing -> state finished
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2726::DEBUG::2014-04-10 17:37:11,046::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2726::DEBUG::2014-04-10 17:37:11,047::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2726::DEBUG::2014-04-10 17:37:11,047::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2726::DEBUG::2014-04-10 17:37:11,047::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2726::DEBUG::2014-04-10 17:37:11,047::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a3a055b8-512e-47e3-95ec-2a8cfd338eb4_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2726::DEBUG::2014-04-10 17:37:11,047::task::974::TaskManager.Task::(_decref) Task=`1e556f72-2f97-4d74-82fb-e5137d07eaa6`::ref 0 aborting False
>Thread-2727::DEBUG::2014-04-10 17:37:11,054::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2727::DEBUG::2014-04-10 17:37:11,054::task::579::TaskManager.Task::(_updateState) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::moving from state init -> state preparing
>Thread-2727::INFO::2014-04-10 17:37:11,054::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f', sdUUID=None, options=None)
>Thread-2727::DEBUG::2014-04-10 17:37:11,055::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e8a5c95-dc78-497d-b0bd-5417ab6bb5d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2727::DEBUG::2014-04-10 17:37:11,055::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2727::DEBUG::2014-04-10 17:37:11,055::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2727::DEBUG::2014-04-10 17:37:11,055::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e8a5c95-dc78-497d-b0bd-5417ab6bb5d2`::Granted request
>Thread-2727::DEBUG::2014-04-10 17:37:11,055::task::811::TaskManager.Task::(resourceAcquired) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2727::DEBUG::2014-04-10 17:37:11,056::task::974::TaskManager.Task::(_decref) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::ref 1 aborting False
>Thread-2727::DEBUG::2014-04-10 17:37:11,056::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`a908c77c-77ce-445f-ab01-a9d31010c3e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2727::DEBUG::2014-04-10 17:37:11,056::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2727::DEBUG::2014-04-10 17:37:11,056::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2727::DEBUG::2014-04-10 17:37:11,056::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`a908c77c-77ce-445f-ab01-a9d31010c3e8`::Granted request
>Thread-2727::DEBUG::2014-04-10 17:37:11,057::task::811::TaskManager.Task::(resourceAcquired) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::_resourcesAcquired: Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2727::DEBUG::2014-04-10 17:37:11,057::task::974::TaskManager.Task::(_decref) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::ref 1 aborting False
>Thread-2727::INFO::2014-04-10 17:37:11,057::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2727::INFO::2014-04-10 17:37:11,057::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2727::DEBUG::2014-04-10 17:37:11,058::task::1168::TaskManager.Task::(prepare) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::finished: None
>Thread-2727::DEBUG::2014-04-10 17:37:11,058::task::579::TaskManager.Task::(_updateState) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::moving from state preparing -> state finished
>Thread-2727::DEBUG::2014-04-10 17:37:11,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2727::DEBUG::2014-04-10 17:37:11,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2727::DEBUG::2014-04-10 17:37:11,058::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2727::DEBUG::2014-04-10 17:37:11,059::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2727::DEBUG::2014-04-10 17:37:11,059::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2727::DEBUG::2014-04-10 17:37:11,059::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2727::DEBUG::2014-04-10 17:37:11,059::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2727::DEBUG::2014-04-10 17:37:11,059::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2727::DEBUG::2014-04-10 17:37:11,060::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2727::DEBUG::2014-04-10 17:37:11,060::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.3cd82d27-8ea4-4ca6-af5b-8c7f9ea59d3f_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2727::DEBUG::2014-04-10 17:37:11,060::task::974::TaskManager.Task::(_decref) Task=`d6d00126-90f4-4ddf-8a24-77138dca3522`::ref 0 aborting False
>Thread-2728::DEBUG::2014-04-10 17:37:11,066::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2728::DEBUG::2014-04-10 17:37:11,067::task::579::TaskManager.Task::(_updateState) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::moving from state init -> state preparing
>Thread-2728::INFO::2014-04-10 17:37:11,067::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='5ad91579-e7e9-4ca3-af75-2aa157c818f9', sdUUID=None, options=None)
>Thread-2728::DEBUG::2014-04-10 17:37:11,067::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`61c334cb-f22d-436c-bb2a-d07db7226c6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2728::DEBUG::2014-04-10 17:37:11,067::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2728::DEBUG::2014-04-10 17:37:11,068::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2728::DEBUG::2014-04-10 17:37:11,068::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`61c334cb-f22d-436c-bb2a-d07db7226c6a`::Granted request
>Thread-2728::DEBUG::2014-04-10 17:37:11,068::task::811::TaskManager.Task::(resourceAcquired) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2728::DEBUG::2014-04-10 17:37:11,068::task::974::TaskManager.Task::(_decref) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::ref 1 aborting False
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`c5a571e6-456a-4e09-a3ae-5cb6b46bd13a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`c5a571e6-456a-4e09-a3ae-5cb6b46bd13a`::Granted request
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::task::811::TaskManager.Task::(resourceAcquired) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::_resourcesAcquired: Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2728::DEBUG::2014-04-10 17:37:11,069::task::974::TaskManager.Task::(_decref) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::ref 1 aborting False
>Thread-2728::INFO::2014-04-10 17:37:11,070::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=5ad91579-e7e9-4ca3-af75-2aa157c818f9 sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2728::INFO::2014-04-10 17:37:11,070::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2728::DEBUG::2014-04-10 17:37:11,070::task::1168::TaskManager.Task::(prepare) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::finished: None
>Thread-2728::DEBUG::2014-04-10 17:37:11,070::task::579::TaskManager.Task::(_updateState) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::moving from state preparing -> state finished
>Thread-2728::DEBUG::2014-04-10 17:37:11,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2728::DEBUG::2014-04-10 17:37:11,071::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2728::DEBUG::2014-04-10 17:37:11,072::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2728::DEBUG::2014-04-10 17:37:11,072::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2728::DEBUG::2014-04-10 17:37:11,072::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5ad91579-e7e9-4ca3-af75-2aa157c818f9_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2728::DEBUG::2014-04-10 17:37:11,072::task::974::TaskManager.Task::(_decref) Task=`61759087-01dc-4f9b-a392-3bda781fd163`::ref 0 aborting False
>Thread-2729::DEBUG::2014-04-10 17:37:11,079::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2729::DEBUG::2014-04-10 17:37:11,079::task::579::TaskManager.Task::(_updateState) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::moving from state init -> state preparing
>Thread-2729::INFO::2014-04-10 17:37:11,079::logUtils::44::dispatcher::(wrapper) Run and protect: removeVM(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', vmUUID='f1ae6634-10d0-47fe-a4fb-d05ab0893d70', sdUUID=None, options=None)
>Thread-2729::DEBUG::2014-04-10 17:37:11,079::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed505550-f199-459a-b1c9-3529db03bf71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1358' at 'removeVM'
>Thread-2729::DEBUG::2014-04-10 17:37:11,079::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2729::DEBUG::2014-04-10 17:37:11,080::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2729::DEBUG::2014-04-10 17:37:11,080::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed505550-f199-459a-b1c9-3529db03bf71`::Granted request
>Thread-2729::DEBUG::2014-04-10 17:37:11,080::task::811::TaskManager.Task::(resourceAcquired) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2729::DEBUG::2014-04-10 17:37:11,080::task::974::TaskManager.Task::(_decref) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::ref 1 aborting False
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`8cc30556-339c-4f84-bf95-ea384d3907fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1364' at 'removeVM'
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`8cc30556-339c-4f84-bf95-ea384d3907fd`::Granted request
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::task::811::TaskManager.Task::(resourceAcquired) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::_resourcesAcquired: Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-2729::DEBUG::2014-04-10 17:37:11,081::task::974::TaskManager.Task::(_decref) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::ref 1 aborting False
>Thread-2729::INFO::2014-04-10 17:37:11,082::sp::1360::Storage.StoragePool::(removeVM) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e vmUUID=f1ae6634-10d0-47fe-a4fb-d05ab0893d70 sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-2729::INFO::2014-04-10 17:37:11,082::logUtils::47::dispatcher::(wrapper) Run and protect: removeVM, Return response: None
>Thread-2729::DEBUG::2014-04-10 17:37:11,082::task::1168::TaskManager.Task::(prepare) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::finished: None
>Thread-2729::DEBUG::2014-04-10 17:37:11,082::task::579::TaskManager.Task::(_updateState) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::moving from state preparing -> state finished
>Thread-2729::DEBUG::2014-04-10 17:37:11,082::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>, 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f1ae6634-10d0-47fe-a4fb-d05ab0893d70_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-2729::DEBUG::2014-04-10 17:37:11,083::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2729::DEBUG::2014-04-10 17:37:11,084::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2729::DEBUG::2014-04-10 17:37:11,084::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2729::DEBUG::2014-04-10 17:37:11,084::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2729::DEBUG::2014-04-10 17:37:11,084::task::974::TaskManager.Task::(_decref) Task=`d79deedb-5446-44ea-bd03-e379e612b455`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:15,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:15,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000430986 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:15,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:15,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000384221 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:15,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:15,586::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00049673 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:15,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:15,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000408624 s, 901 kB/s\n'; <rc> = 0
>Thread-2733::DEBUG::2014-04-10 17:37:19,696::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-2733::DEBUG::2014-04-10 17:37:19,697::task::579::TaskManager.Task::(_updateState) Task=`e0371858-5bf4-434a-a708-f26a1231fa68`::moving from state init -> state preparing
>Thread-2733::INFO::2014-04-10 17:37:19,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2733::INFO::2014-04-10 17:37:19,698::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2733::DEBUG::2014-04-10 17:37:19,698::task::1168::TaskManager.Task::(prepare) Task=`e0371858-5bf4-434a-a708-f26a1231fa68`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2733::DEBUG::2014-04-10 17:37:19,698::task::579::TaskManager.Task::(_updateState) Task=`e0371858-5bf4-434a-a708-f26a1231fa68`::moving from state preparing -> state finished
>Thread-2733::DEBUG::2014-04-10 17:37:19,698::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2733::DEBUG::2014-04-10 17:37:19,698::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2733::DEBUG::2014-04-10 17:37:19,698::task::974::TaskManager.Task::(_decref) Task=`e0371858-5bf4-434a-a708-f26a1231fa68`::ref 0 aborting False
>Thread-2734::DEBUG::2014-04-10 17:37:19,705::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-2734::DEBUG::2014-04-10 17:37:19,705::task::579::TaskManager.Task::(_updateState) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::moving from state init -> state preparing
>Thread-2734::INFO::2014-04-10 17:37:19,706::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2734::DEBUG::2014-04-10 17:37:19,706::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ab962149-c8f7-40e5-9e28-7f25121f9823`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2734::DEBUG::2014-04-10 17:37:19,706::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2734::DEBUG::2014-04-10 17:37:19,706::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2734::DEBUG::2014-04-10 17:37:19,707::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ab962149-c8f7-40e5-9e28-7f25121f9823`::Granted request
>Thread-2734::DEBUG::2014-04-10 17:37:19,707::task::811::TaskManager.Task::(resourceAcquired) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2734::DEBUG::2014-04-10 17:37:19,707::task::974::TaskManager.Task::(_decref) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::ref 1 aborting False
>Thread-2734::INFO::2014-04-10 17:37:19,709::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2734::DEBUG::2014-04-10 17:37:19,709::task::1168::TaskManager.Task::(prepare) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2734::DEBUG::2014-04-10 17:37:19,709::task::579::TaskManager.Task::(_updateState) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::moving from state preparing -> state finished
>Thread-2734::DEBUG::2014-04-10 17:37:19,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2734::DEBUG::2014-04-10 17:37:19,710::task::974::TaskManager.Task::(_decref) Task=`0968fce9-dad3-467f-b568-fa6076d6afd0`::ref 0 aborting False
>Thread-2735::DEBUG::2014-04-10 17:37:22,409::task::579::TaskManager.Task::(_updateState) Task=`1f19d5af-5f27-4e8d-a610-864629b1033d`::moving from state init -> state preparing
>Thread-2735::INFO::2014-04-10 17:37:22,409::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2735::INFO::2014-04-10 17:37:22,409::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049673', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430986', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384221', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408624', 'lastCheck': '6.8', 'valid': True}}
>Thread-2735::DEBUG::2014-04-10 17:37:22,409::task::1168::TaskManager.Task::(prepare) Task=`1f19d5af-5f27-4e8d-a610-864629b1033d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049673', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430986', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384221', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408624', 'lastCheck': '6.8', 'valid': True}}
>Thread-2735::DEBUG::2014-04-10 17:37:22,409::task::579::TaskManager.Task::(_updateState) Task=`1f19d5af-5f27-4e8d-a610-864629b1033d`::moving from state preparing -> state finished
>Thread-2735::DEBUG::2014-04-10 17:37:22,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2735::DEBUG::2014-04-10 17:37:22,410::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2735::DEBUG::2014-04-10 17:37:22,410::task::974::TaskManager.Task::(_decref) Task=`1f19d5af-5f27-4e8d-a610-864629b1033d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:25,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:25,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359775 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:25,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:25,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414242 s, 1.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:25,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:25,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000518261 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:25,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:25,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000452941 s, 812 kB/s\n'; <rc> = 0
>Thread-2739::DEBUG::2014-04-10 17:37:29,788::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2739::DEBUG::2014-04-10 17:37:29,789::task::579::TaskManager.Task::(_updateState) Task=`4dc229ce-8c8d-4268-a243-f467229a1f26`::moving from state init -> state preparing
>Thread-2739::INFO::2014-04-10 17:37:29,789::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2739::INFO::2014-04-10 17:37:29,790::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2739::DEBUG::2014-04-10 17:37:29,790::task::1168::TaskManager.Task::(prepare) Task=`4dc229ce-8c8d-4268-a243-f467229a1f26`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2739::DEBUG::2014-04-10 17:37:29,790::task::579::TaskManager.Task::(_updateState) Task=`4dc229ce-8c8d-4268-a243-f467229a1f26`::moving from state preparing -> state finished
>Thread-2739::DEBUG::2014-04-10 17:37:29,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2739::DEBUG::2014-04-10 17:37:29,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2739::DEBUG::2014-04-10 17:37:29,791::task::974::TaskManager.Task::(_decref) Task=`4dc229ce-8c8d-4268-a243-f467229a1f26`::ref 0 aborting False
>Thread-2740::DEBUG::2014-04-10 17:37:29,797::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2740::DEBUG::2014-04-10 17:37:29,797::task::579::TaskManager.Task::(_updateState) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::moving from state init -> state preparing
>Thread-2740::INFO::2014-04-10 17:37:29,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2740::DEBUG::2014-04-10 17:37:29,798::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1390e15c-4247-42e0-b89d-6e1c38856a89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2740::DEBUG::2014-04-10 17:37:29,798::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2740::DEBUG::2014-04-10 17:37:29,799::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2740::DEBUG::2014-04-10 17:37:29,799::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1390e15c-4247-42e0-b89d-6e1c38856a89`::Granted request
>Thread-2740::DEBUG::2014-04-10 17:37:29,799::task::811::TaskManager.Task::(resourceAcquired) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2740::DEBUG::2014-04-10 17:37:29,799::task::974::TaskManager.Task::(_decref) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::ref 1 aborting False
>Thread-2740::INFO::2014-04-10 17:37:29,801::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2740::DEBUG::2014-04-10 17:37:29,802::task::1168::TaskManager.Task::(prepare) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2740::DEBUG::2014-04-10 17:37:29,802::task::579::TaskManager.Task::(_updateState) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::moving from state preparing -> state finished
>Thread-2740::DEBUG::2014-04-10 17:37:29,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2740::DEBUG::2014-04-10 17:37:29,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2740::DEBUG::2014-04-10 17:37:29,803::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2740::DEBUG::2014-04-10 17:37:29,803::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2740::DEBUG::2014-04-10 17:37:29,803::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2740::DEBUG::2014-04-10 17:37:29,803::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2740::DEBUG::2014-04-10 17:37:29,803::task::974::TaskManager.Task::(_decref) Task=`ab7ff82a-add7-4cbc-8735-fe849f5ad0c3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:35,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:35,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000438325 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:35,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:35,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396699 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:35,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:35,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00050034 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:35,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:35,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0003708 s, 992 kB/s\n'; <rc> = 0
>Thread-2743::DEBUG::2014-04-10 17:37:37,600::task::579::TaskManager.Task::(_updateState) Task=`da76a0d0-f519-4f02-8fb1-d14136f90d1d`::moving from state init -> state preparing
>Thread-2743::INFO::2014-04-10 17:37:37,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2743::INFO::2014-04-10 17:37:37,600::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050034', 'lastCheck': '2.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438325', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396699', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003708', 'lastCheck': '2.0', 'valid': True}}
>Thread-2743::DEBUG::2014-04-10 17:37:37,600::task::1168::TaskManager.Task::(prepare) Task=`da76a0d0-f519-4f02-8fb1-d14136f90d1d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050034', 'lastCheck': '2.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438325', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396699', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003708', 'lastCheck': '2.0', 'valid': True}}
>Thread-2743::DEBUG::2014-04-10 17:37:37,601::task::579::TaskManager.Task::(_updateState) Task=`da76a0d0-f519-4f02-8fb1-d14136f90d1d`::moving from state preparing -> state finished
>Thread-2743::DEBUG::2014-04-10 17:37:37,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2743::DEBUG::2014-04-10 17:37:37,601::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2743::DEBUG::2014-04-10 17:37:37,601::task::974::TaskManager.Task::(_decref) Task=`da76a0d0-f519-4f02-8fb1-d14136f90d1d`::ref 0 aborting False
>Thread-2745::DEBUG::2014-04-10 17:37:39,887::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2745::DEBUG::2014-04-10 17:37:39,907::task::579::TaskManager.Task::(_updateState) Task=`4a7dbecb-504c-45b5-876d-c50304fb1463`::moving from state init -> state preparing
>Thread-2745::INFO::2014-04-10 17:37:39,907::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2745::INFO::2014-04-10 17:37:39,907::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2745::DEBUG::2014-04-10 17:37:39,908::task::1168::TaskManager.Task::(prepare) Task=`4a7dbecb-504c-45b5-876d-c50304fb1463`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2745::DEBUG::2014-04-10 17:37:39,908::task::579::TaskManager.Task::(_updateState) Task=`4a7dbecb-504c-45b5-876d-c50304fb1463`::moving from state preparing -> state finished
>Thread-2745::DEBUG::2014-04-10 17:37:39,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2745::DEBUG::2014-04-10 17:37:39,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2745::DEBUG::2014-04-10 17:37:39,908::task::974::TaskManager.Task::(_decref) Task=`4a7dbecb-504c-45b5-876d-c50304fb1463`::ref 0 aborting False
>Thread-2746::DEBUG::2014-04-10 17:37:39,915::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2746::DEBUG::2014-04-10 17:37:39,915::task::579::TaskManager.Task::(_updateState) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::moving from state init -> state preparing
>Thread-2746::INFO::2014-04-10 17:37:39,916::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2746::DEBUG::2014-04-10 17:37:39,916::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`106893ba-6716-4937-98df-11a1ab0a6bf7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2746::DEBUG::2014-04-10 17:37:39,916::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2746::DEBUG::2014-04-10 17:37:39,917::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2746::DEBUG::2014-04-10 17:37:39,917::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`106893ba-6716-4937-98df-11a1ab0a6bf7`::Granted request
>Thread-2746::DEBUG::2014-04-10 17:37:39,917::task::811::TaskManager.Task::(resourceAcquired) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2746::DEBUG::2014-04-10 17:37:39,917::task::974::TaskManager.Task::(_decref) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::ref 1 aborting False
>Thread-2746::INFO::2014-04-10 17:37:39,920::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2746::DEBUG::2014-04-10 17:37:39,920::task::1168::TaskManager.Task::(prepare) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2746::DEBUG::2014-04-10 17:37:39,920::task::579::TaskManager.Task::(_updateState) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::moving from state preparing -> state finished
>Thread-2746::DEBUG::2014-04-10 17:37:39,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2746::DEBUG::2014-04-10 17:37:39,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2746::DEBUG::2014-04-10 17:37:39,921::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2746::DEBUG::2014-04-10 17:37:39,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2746::DEBUG::2014-04-10 17:37:39,921::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2746::DEBUG::2014-04-10 17:37:39,921::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2746::DEBUG::2014-04-10 17:37:39,921::task::974::TaskManager.Task::(_decref) Task=`cb4ed060-d257-4d37-87c9-4769acf1dd19`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:45,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:45,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366038 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:45,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:45,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335878 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:45,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:45,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00048305 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:45,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:45,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000407845 s, 902 kB/s\n'; <rc> = 0
>Thread-2750::DEBUG::2014-04-10 17:37:50,001::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-2750::DEBUG::2014-04-10 17:37:50,002::task::579::TaskManager.Task::(_updateState) Task=`97ec5d72-16f8-4a6f-b77a-68c7e03f7779`::moving from state init -> state preparing
>Thread-2750::INFO::2014-04-10 17:37:50,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2750::INFO::2014-04-10 17:37:50,002::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2750::DEBUG::2014-04-10 17:37:50,003::task::1168::TaskManager.Task::(prepare) Task=`97ec5d72-16f8-4a6f-b77a-68c7e03f7779`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2750::DEBUG::2014-04-10 17:37:50,003::task::579::TaskManager.Task::(_updateState) Task=`97ec5d72-16f8-4a6f-b77a-68c7e03f7779`::moving from state preparing -> state finished
>Thread-2750::DEBUG::2014-04-10 17:37:50,003::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2750::DEBUG::2014-04-10 17:37:50,003::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2750::DEBUG::2014-04-10 17:37:50,003::task::974::TaskManager.Task::(_decref) Task=`97ec5d72-16f8-4a6f-b77a-68c7e03f7779`::ref 0 aborting False
>Thread-2751::DEBUG::2014-04-10 17:37:50,010::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-2751::DEBUG::2014-04-10 17:37:50,010::task::579::TaskManager.Task::(_updateState) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::moving from state init -> state preparing
>Thread-2751::INFO::2014-04-10 17:37:50,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2751::DEBUG::2014-04-10 17:37:50,011::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db164ac3-d617-4860-9297-da68f03ab1b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2751::DEBUG::2014-04-10 17:37:50,011::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2751::DEBUG::2014-04-10 17:37:50,011::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2751::DEBUG::2014-04-10 17:37:50,012::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db164ac3-d617-4860-9297-da68f03ab1b6`::Granted request
>Thread-2751::DEBUG::2014-04-10 17:37:50,012::task::811::TaskManager.Task::(resourceAcquired) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2751::DEBUG::2014-04-10 17:37:50,012::task::974::TaskManager.Task::(_decref) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::ref 1 aborting False
>Thread-2751::INFO::2014-04-10 17:37:50,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2751::DEBUG::2014-04-10 17:37:50,014::task::1168::TaskManager.Task::(prepare) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2751::DEBUG::2014-04-10 17:37:50,014::task::579::TaskManager.Task::(_updateState) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::moving from state preparing -> state finished
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2751::DEBUG::2014-04-10 17:37:50,015::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2751::DEBUG::2014-04-10 17:37:50,016::task::974::TaskManager.Task::(_decref) Task=`f5091e0f-52df-4e51-a012-c599498dea35`::ref 0 aborting False
>Thread-2753::DEBUG::2014-04-10 17:37:53,112::task::579::TaskManager.Task::(_updateState) Task=`54cbaba9-7793-4a53-a2d5-2ce8b2d76053`::moving from state init -> state preparing
>Thread-2753::INFO::2014-04-10 17:37:53,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2753::INFO::2014-04-10 17:37:53,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048305', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366038', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335878', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407845', 'lastCheck': '7.5', 'valid': True}}
>Thread-2753::DEBUG::2014-04-10 17:37:53,113::task::1168::TaskManager.Task::(prepare) Task=`54cbaba9-7793-4a53-a2d5-2ce8b2d76053`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048305', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366038', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335878', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407845', 'lastCheck': '7.5', 'valid': True}}
>Thread-2753::DEBUG::2014-04-10 17:37:53,113::task::579::TaskManager.Task::(_updateState) Task=`54cbaba9-7793-4a53-a2d5-2ce8b2d76053`::moving from state preparing -> state finished
>Thread-2753::DEBUG::2014-04-10 17:37:53,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2753::DEBUG::2014-04-10 17:37:53,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2753::DEBUG::2014-04-10 17:37:53,114::task::974::TaskManager.Task::(_decref) Task=`54cbaba9-7793-4a53-a2d5-2ce8b2d76053`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:37:55,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:37:55,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376918 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:37:55,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:37:55,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359515 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:37:55,645::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:37:55,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000524492 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:37:55,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:37:55,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000452554 s, 813 kB/s\n'; <rc> = 0
>Thread-2757::DEBUG::2014-04-10 17:38:00,133::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2757::DEBUG::2014-04-10 17:38:00,134::task::579::TaskManager.Task::(_updateState) Task=`318412e5-f448-42b8-a64b-2e32239d05f7`::moving from state init -> state preparing
>Thread-2757::INFO::2014-04-10 17:38:00,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2757::INFO::2014-04-10 17:38:00,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2757::DEBUG::2014-04-10 17:38:00,135::task::1168::TaskManager.Task::(prepare) Task=`318412e5-f448-42b8-a64b-2e32239d05f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2757::DEBUG::2014-04-10 17:38:00,135::task::579::TaskManager.Task::(_updateState) Task=`318412e5-f448-42b8-a64b-2e32239d05f7`::moving from state preparing -> state finished
>Thread-2757::DEBUG::2014-04-10 17:38:00,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2757::DEBUG::2014-04-10 17:38:00,135::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2757::DEBUG::2014-04-10 17:38:00,135::task::974::TaskManager.Task::(_decref) Task=`318412e5-f448-42b8-a64b-2e32239d05f7`::ref 0 aborting False
>Thread-2758::DEBUG::2014-04-10 17:38:00,142::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2758::DEBUG::2014-04-10 17:38:00,142::task::579::TaskManager.Task::(_updateState) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::moving from state init -> state preparing
>Thread-2758::INFO::2014-04-10 17:38:00,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2758::DEBUG::2014-04-10 17:38:00,143::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ac46ae63-c03e-4ed5-84d3-2aaffbd158ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2758::DEBUG::2014-04-10 17:38:00,143::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2758::DEBUG::2014-04-10 17:38:00,143::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2758::DEBUG::2014-04-10 17:38:00,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ac46ae63-c03e-4ed5-84d3-2aaffbd158ae`::Granted request
>Thread-2758::DEBUG::2014-04-10 17:38:00,144::task::811::TaskManager.Task::(resourceAcquired) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2758::DEBUG::2014-04-10 17:38:00,144::task::974::TaskManager.Task::(_decref) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::ref 1 aborting False
>Thread-2758::INFO::2014-04-10 17:38:00,146::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2758::DEBUG::2014-04-10 17:38:00,147::task::1168::TaskManager.Task::(prepare) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2758::DEBUG::2014-04-10 17:38:00,147::task::579::TaskManager.Task::(_updateState) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::moving from state preparing -> state finished
>Thread-2758::DEBUG::2014-04-10 17:38:00,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2758::DEBUG::2014-04-10 17:38:00,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2758::DEBUG::2014-04-10 17:38:00,147::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2758::DEBUG::2014-04-10 17:38:00,148::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2758::DEBUG::2014-04-10 17:38:00,148::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2758::DEBUG::2014-04-10 17:38:00,148::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2758::DEBUG::2014-04-10 17:38:00,148::task::974::TaskManager.Task::(_decref) Task=`75f18b57-8c26-498e-b8e8-6da30363af54`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:05,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:05,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00040205 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:05,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:05,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356402 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:05,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:05,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000559673 s, 1.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:38:05,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:38:05,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442199 s, 832 kB/s\n'; <rc> = 0
>Thread-2761::DEBUG::2014-04-10 17:38:08,286::task::579::TaskManager.Task::(_updateState) Task=`8d1151a0-9f70-4e95-bcb3-3edc147a4f2f`::moving from state init -> state preparing
>Thread-2761::INFO::2014-04-10 17:38:08,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2761::INFO::2014-04-10 17:38:08,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559673', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040205', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356402', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442199', 'lastCheck': '2.6', 'valid': True}}
>Thread-2761::DEBUG::2014-04-10 17:38:08,287::task::1168::TaskManager.Task::(prepare) Task=`8d1151a0-9f70-4e95-bcb3-3edc147a4f2f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559673', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040205', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356402', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442199', 'lastCheck': '2.6', 'valid': True}}
>Thread-2761::DEBUG::2014-04-10 17:38:08,287::task::579::TaskManager.Task::(_updateState) Task=`8d1151a0-9f70-4e95-bcb3-3edc147a4f2f`::moving from state preparing -> state finished
>Thread-2761::DEBUG::2014-04-10 17:38:08,287::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2761::DEBUG::2014-04-10 17:38:08,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2761::DEBUG::2014-04-10 17:38:08,288::task::974::TaskManager.Task::(_decref) Task=`8d1151a0-9f70-4e95-bcb3-3edc147a4f2f`::ref 0 aborting False
>Thread-2763::DEBUG::2014-04-10 17:38:10,224::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2763::DEBUG::2014-04-10 17:38:10,225::task::579::TaskManager.Task::(_updateState) Task=`52da296f-3b9b-4d14-9d75-47701420d91b`::moving from state init -> state preparing
>Thread-2763::INFO::2014-04-10 17:38:10,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2763::INFO::2014-04-10 17:38:10,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2763::DEBUG::2014-04-10 17:38:10,226::task::1168::TaskManager.Task::(prepare) Task=`52da296f-3b9b-4d14-9d75-47701420d91b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2763::DEBUG::2014-04-10 17:38:10,226::task::579::TaskManager.Task::(_updateState) Task=`52da296f-3b9b-4d14-9d75-47701420d91b`::moving from state preparing -> state finished
>Thread-2763::DEBUG::2014-04-10 17:38:10,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2763::DEBUG::2014-04-10 17:38:10,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2763::DEBUG::2014-04-10 17:38:10,226::task::974::TaskManager.Task::(_decref) Task=`52da296f-3b9b-4d14-9d75-47701420d91b`::ref 0 aborting False
>Thread-2764::DEBUG::2014-04-10 17:38:10,233::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2764::DEBUG::2014-04-10 17:38:10,234::task::579::TaskManager.Task::(_updateState) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::moving from state init -> state preparing
>Thread-2764::INFO::2014-04-10 17:38:10,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2764::DEBUG::2014-04-10 17:38:10,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a27c2c6c-3126-416c-a392-25c9cb35685b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2764::DEBUG::2014-04-10 17:38:10,235::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2764::DEBUG::2014-04-10 17:38:10,235::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2764::DEBUG::2014-04-10 17:38:10,235::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a27c2c6c-3126-416c-a392-25c9cb35685b`::Granted request
>Thread-2764::DEBUG::2014-04-10 17:38:10,236::task::811::TaskManager.Task::(resourceAcquired) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2764::DEBUG::2014-04-10 17:38:10,236::task::974::TaskManager.Task::(_decref) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::ref 1 aborting False
>Thread-2764::INFO::2014-04-10 17:38:10,238::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2764::DEBUG::2014-04-10 17:38:10,238::task::1168::TaskManager.Task::(prepare) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2764::DEBUG::2014-04-10 17:38:10,238::task::579::TaskManager.Task::(_updateState) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::moving from state preparing -> state finished
>Thread-2764::DEBUG::2014-04-10 17:38:10,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2764::DEBUG::2014-04-10 17:38:10,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2764::DEBUG::2014-04-10 17:38:10,239::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2764::DEBUG::2014-04-10 17:38:10,239::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2764::DEBUG::2014-04-10 17:38:10,239::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2764::DEBUG::2014-04-10 17:38:10,240::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2764::DEBUG::2014-04-10 17:38:10,240::task::974::TaskManager.Task::(_decref) Task=`da405f65-e35f-473e-90e8-82d45cdf0c40`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:15,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:15,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420542 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:15,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:15,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343636 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:15,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:15,686::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000512792 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:38:15,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:38:15,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000425034 s, 866 kB/s\n'; <rc> = 0
>Thread-2768::DEBUG::2014-04-10 17:38:20,314::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2768::DEBUG::2014-04-10 17:38:20,314::task::579::TaskManager.Task::(_updateState) Task=`dd3a9943-f217-4815-83dc-124efdd49b76`::moving from state init -> state preparing
>Thread-2768::INFO::2014-04-10 17:38:20,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2768::INFO::2014-04-10 17:38:20,315::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2768::DEBUG::2014-04-10 17:38:20,315::task::1168::TaskManager.Task::(prepare) Task=`dd3a9943-f217-4815-83dc-124efdd49b76`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2768::DEBUG::2014-04-10 17:38:20,315::task::579::TaskManager.Task::(_updateState) Task=`dd3a9943-f217-4815-83dc-124efdd49b76`::moving from state preparing -> state finished
>Thread-2768::DEBUG::2014-04-10 17:38:20,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2768::DEBUG::2014-04-10 17:38:20,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2768::DEBUG::2014-04-10 17:38:20,316::task::974::TaskManager.Task::(_decref) Task=`dd3a9943-f217-4815-83dc-124efdd49b76`::ref 0 aborting False
>Thread-2769::DEBUG::2014-04-10 17:38:20,322::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2769::DEBUG::2014-04-10 17:38:20,322::task::579::TaskManager.Task::(_updateState) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::moving from state init -> state preparing
>Thread-2769::INFO::2014-04-10 17:38:20,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2769::DEBUG::2014-04-10 17:38:20,323::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fa3e6d76-cdd2-407a-bc54-381cf17babf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2769::DEBUG::2014-04-10 17:38:20,323::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2769::DEBUG::2014-04-10 17:38:20,323::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2769::DEBUG::2014-04-10 17:38:20,324::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fa3e6d76-cdd2-407a-bc54-381cf17babf8`::Granted request
>Thread-2769::DEBUG::2014-04-10 17:38:20,324::task::811::TaskManager.Task::(resourceAcquired) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2769::DEBUG::2014-04-10 17:38:20,324::task::974::TaskManager.Task::(_decref) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::ref 1 aborting False
>Thread-2769::INFO::2014-04-10 17:38:20,326::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2769::DEBUG::2014-04-10 17:38:20,326::task::1168::TaskManager.Task::(prepare) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2769::DEBUG::2014-04-10 17:38:20,326::task::579::TaskManager.Task::(_updateState) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::moving from state preparing -> state finished
>Thread-2769::DEBUG::2014-04-10 17:38:20,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2769::DEBUG::2014-04-10 17:38:20,327::task::974::TaskManager.Task::(_decref) Task=`1ee65e7c-89d8-464f-b8da-527bd8496806`::ref 0 aborting False
>Thread-2771::DEBUG::2014-04-10 17:38:23,469::task::579::TaskManager.Task::(_updateState) Task=`f7403dae-2bcc-4693-97b4-7c040b8660f8`::moving from state init -> state preparing
>Thread-2771::INFO::2014-04-10 17:38:23,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2771::INFO::2014-04-10 17:38:23,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512792', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420542', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343636', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425034', 'lastCheck': '7.8', 'valid': True}}
>Thread-2771::DEBUG::2014-04-10 17:38:23,470::task::1168::TaskManager.Task::(prepare) Task=`f7403dae-2bcc-4693-97b4-7c040b8660f8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512792', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420542', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343636', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425034', 'lastCheck': '7.8', 'valid': True}}
>Thread-2771::DEBUG::2014-04-10 17:38:23,470::task::579::TaskManager.Task::(_updateState) Task=`f7403dae-2bcc-4693-97b4-7c040b8660f8`::moving from state preparing -> state finished
>Thread-2771::DEBUG::2014-04-10 17:38:23,470::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2771::DEBUG::2014-04-10 17:38:23,470::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2771::DEBUG::2014-04-10 17:38:23,470::task::974::TaskManager.Task::(_decref) Task=`f7403dae-2bcc-4693-97b4-7c040b8660f8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:25,389::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:25,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373149 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:25,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:25,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330873 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:25,695::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:38:25,723::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:38:25,725::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:38:25,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:25,737::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-469::DEBUG::2014-04-10 17:38:25,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00041406 s, 889 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:25,743::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:38:25,744::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:38:25,744::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:38:25,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:25,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000342172 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2779::DEBUG::2014-04-10 17:38:30,403::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2779::DEBUG::2014-04-10 17:38:30,411::task::579::TaskManager.Task::(_updateState) Task=`54c86232-3729-4f4f-a0d7-a7e7d54e8b2d`::moving from state init -> state preparing
>Thread-2779::INFO::2014-04-10 17:38:30,411::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2779::INFO::2014-04-10 17:38:30,412::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2779::DEBUG::2014-04-10 17:38:30,412::task::1168::TaskManager.Task::(prepare) Task=`54c86232-3729-4f4f-a0d7-a7e7d54e8b2d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2779::DEBUG::2014-04-10 17:38:30,412::task::579::TaskManager.Task::(_updateState) Task=`54c86232-3729-4f4f-a0d7-a7e7d54e8b2d`::moving from state preparing -> state finished
>Thread-2779::DEBUG::2014-04-10 17:38:30,412::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2779::DEBUG::2014-04-10 17:38:30,413::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2779::DEBUG::2014-04-10 17:38:30,413::task::974::TaskManager.Task::(_decref) Task=`54c86232-3729-4f4f-a0d7-a7e7d54e8b2d`::ref 0 aborting False
>Thread-2780::DEBUG::2014-04-10 17:38:30,420::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2780::DEBUG::2014-04-10 17:38:30,420::task::579::TaskManager.Task::(_updateState) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::moving from state init -> state preparing
>Thread-2780::INFO::2014-04-10 17:38:30,420::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2780::DEBUG::2014-04-10 17:38:30,421::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d560cb45-5d83-4b63-81c6-ae9ed7e0ec4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2780::DEBUG::2014-04-10 17:38:30,421::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2780::DEBUG::2014-04-10 17:38:30,421::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2780::DEBUG::2014-04-10 17:38:30,422::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d560cb45-5d83-4b63-81c6-ae9ed7e0ec4e`::Granted request
>Thread-2780::DEBUG::2014-04-10 17:38:30,422::task::811::TaskManager.Task::(resourceAcquired) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2780::DEBUG::2014-04-10 17:38:30,422::task::974::TaskManager.Task::(_decref) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::ref 1 aborting False
>Thread-2780::INFO::2014-04-10 17:38:30,424::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2780::DEBUG::2014-04-10 17:38:30,425::task::1168::TaskManager.Task::(prepare) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2780::DEBUG::2014-04-10 17:38:30,425::task::579::TaskManager.Task::(_updateState) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::moving from state preparing -> state finished
>Thread-2780::DEBUG::2014-04-10 17:38:30,425::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2780::DEBUG::2014-04-10 17:38:30,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2780::DEBUG::2014-04-10 17:38:30,425::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2780::DEBUG::2014-04-10 17:38:30,426::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2780::DEBUG::2014-04-10 17:38:30,426::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2780::DEBUG::2014-04-10 17:38:30,426::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2780::DEBUG::2014-04-10 17:38:30,426::task::974::TaskManager.Task::(_decref) Task=`702c30fd-a5b0-4f39-9957-9ca10cded19b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:35,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:35,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289498 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:35,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:35,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276401 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:38:35,752::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:38:35,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00057126 s, 644 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:35,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:35,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000556572 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2783::DEBUG::2014-04-10 17:38:38,640::task::579::TaskManager.Task::(_updateState) Task=`7112bee0-8c20-45f4-bff4-d52b9047e9fb`::moving from state init -> state preparing
>Thread-2783::INFO::2014-04-10 17:38:38,641::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2783::INFO::2014-04-10 17:38:38,641::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556572', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289498', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276401', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057126', 'lastCheck': '2.9', 'valid': True}}
>Thread-2783::DEBUG::2014-04-10 17:38:38,641::task::1168::TaskManager.Task::(prepare) Task=`7112bee0-8c20-45f4-bff4-d52b9047e9fb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556572', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289498', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276401', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057126', 'lastCheck': '2.9', 'valid': True}}
>Thread-2783::DEBUG::2014-04-10 17:38:38,641::task::579::TaskManager.Task::(_updateState) Task=`7112bee0-8c20-45f4-bff4-d52b9047e9fb`::moving from state preparing -> state finished
>Thread-2783::DEBUG::2014-04-10 17:38:38,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2783::DEBUG::2014-04-10 17:38:38,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2783::DEBUG::2014-04-10 17:38:38,642::task::974::TaskManager.Task::(_decref) Task=`7112bee0-8c20-45f4-bff4-d52b9047e9fb`::ref 0 aborting False
>Thread-2785::DEBUG::2014-04-10 17:38:40,519::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-2785::DEBUG::2014-04-10 17:38:40,529::task::579::TaskManager.Task::(_updateState) Task=`606deb59-0bb0-4639-855c-84137b64a57e`::moving from state init -> state preparing
>Thread-2785::INFO::2014-04-10 17:38:40,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2785::INFO::2014-04-10 17:38:40,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2785::DEBUG::2014-04-10 17:38:40,530::task::1168::TaskManager.Task::(prepare) Task=`606deb59-0bb0-4639-855c-84137b64a57e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2785::DEBUG::2014-04-10 17:38:40,530::task::579::TaskManager.Task::(_updateState) Task=`606deb59-0bb0-4639-855c-84137b64a57e`::moving from state preparing -> state finished
>Thread-2785::DEBUG::2014-04-10 17:38:40,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2785::DEBUG::2014-04-10 17:38:40,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2785::DEBUG::2014-04-10 17:38:40,531::task::974::TaskManager.Task::(_decref) Task=`606deb59-0bb0-4639-855c-84137b64a57e`::ref 0 aborting False
>Thread-2786::DEBUG::2014-04-10 17:38:40,537::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-2786::DEBUG::2014-04-10 17:38:40,538::task::579::TaskManager.Task::(_updateState) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::moving from state init -> state preparing
>Thread-2786::INFO::2014-04-10 17:38:40,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2786::DEBUG::2014-04-10 17:38:40,539::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`16a657d9-04bd-4e55-b281-8e32f8e45f56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2786::DEBUG::2014-04-10 17:38:40,539::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2786::DEBUG::2014-04-10 17:38:40,539::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2786::DEBUG::2014-04-10 17:38:40,539::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`16a657d9-04bd-4e55-b281-8e32f8e45f56`::Granted request
>Thread-2786::DEBUG::2014-04-10 17:38:40,540::task::811::TaskManager.Task::(resourceAcquired) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2786::DEBUG::2014-04-10 17:38:40,540::task::974::TaskManager.Task::(_decref) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::ref 1 aborting False
>Thread-2786::INFO::2014-04-10 17:38:40,542::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2786::DEBUG::2014-04-10 17:38:40,542::task::1168::TaskManager.Task::(prepare) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2786::DEBUG::2014-04-10 17:38:40,542::task::579::TaskManager.Task::(_updateState) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::moving from state preparing -> state finished
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2786::DEBUG::2014-04-10 17:38:40,543::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2786::DEBUG::2014-04-10 17:38:40,544::task::974::TaskManager.Task::(_decref) Task=`d74791e6-9648-406c-a1d0-8e32527bf1cb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:45,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:45,433::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330072 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:45,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:45,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329912 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:38:45,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:38:45,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000534049 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:45,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:45,808::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470952 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2790::DEBUG::2014-04-10 17:38:50,626::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2790::DEBUG::2014-04-10 17:38:50,634::task::579::TaskManager.Task::(_updateState) Task=`3d58a38e-aeca-4d64-9f09-3a6d5d15c862`::moving from state init -> state preparing
>Thread-2790::INFO::2014-04-10 17:38:50,635::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2790::INFO::2014-04-10 17:38:50,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2790::DEBUG::2014-04-10 17:38:50,635::task::1168::TaskManager.Task::(prepare) Task=`3d58a38e-aeca-4d64-9f09-3a6d5d15c862`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2790::DEBUG::2014-04-10 17:38:50,635::task::579::TaskManager.Task::(_updateState) Task=`3d58a38e-aeca-4d64-9f09-3a6d5d15c862`::moving from state preparing -> state finished
>Thread-2790::DEBUG::2014-04-10 17:38:50,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2790::DEBUG::2014-04-10 17:38:50,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2790::DEBUG::2014-04-10 17:38:50,636::task::974::TaskManager.Task::(_decref) Task=`3d58a38e-aeca-4d64-9f09-3a6d5d15c862`::ref 0 aborting False
>Thread-2791::DEBUG::2014-04-10 17:38:50,642::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2791::DEBUG::2014-04-10 17:38:50,643::task::579::TaskManager.Task::(_updateState) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::moving from state init -> state preparing
>Thread-2791::INFO::2014-04-10 17:38:50,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2791::DEBUG::2014-04-10 17:38:50,644::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb5b5f4f-eaf3-4bdf-bb83-eedfd42a8315`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2791::DEBUG::2014-04-10 17:38:50,644::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2791::DEBUG::2014-04-10 17:38:50,644::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2791::DEBUG::2014-04-10 17:38:50,644::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb5b5f4f-eaf3-4bdf-bb83-eedfd42a8315`::Granted request
>Thread-2791::DEBUG::2014-04-10 17:38:50,644::task::811::TaskManager.Task::(resourceAcquired) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2791::DEBUG::2014-04-10 17:38:50,645::task::974::TaskManager.Task::(_decref) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::ref 1 aborting False
>Thread-2791::INFO::2014-04-10 17:38:50,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2791::DEBUG::2014-04-10 17:38:50,647::task::1168::TaskManager.Task::(prepare) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2791::DEBUG::2014-04-10 17:38:50,647::task::579::TaskManager.Task::(_updateState) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::moving from state preparing -> state finished
>Thread-2791::DEBUG::2014-04-10 17:38:50,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2791::DEBUG::2014-04-10 17:38:50,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2791::DEBUG::2014-04-10 17:38:50,647::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2791::DEBUG::2014-04-10 17:38:50,648::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2791::DEBUG::2014-04-10 17:38:50,648::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2791::DEBUG::2014-04-10 17:38:50,648::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2791::DEBUG::2014-04-10 17:38:50,648::task::974::TaskManager.Task::(_decref) Task=`30ac4f88-c28a-48b1-bf8e-18b796b8f764`::ref 0 aborting False
>Thread-2793::DEBUG::2014-04-10 17:38:53,944::task::579::TaskManager.Task::(_updateState) Task=`3ae68b9e-51f7-48b7-93d5-2ab7ad8e8933`::moving from state init -> state preparing
>Thread-2793::INFO::2014-04-10 17:38:53,944::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2793::INFO::2014-04-10 17:38:53,944::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470952', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330072', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329912', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534049', 'lastCheck': '8.1', 'valid': True}}
>Thread-2793::DEBUG::2014-04-10 17:38:53,944::task::1168::TaskManager.Task::(prepare) Task=`3ae68b9e-51f7-48b7-93d5-2ab7ad8e8933`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470952', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330072', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329912', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534049', 'lastCheck': '8.1', 'valid': True}}
>Thread-2793::DEBUG::2014-04-10 17:38:53,944::task::579::TaskManager.Task::(_updateState) Task=`3ae68b9e-51f7-48b7-93d5-2ab7ad8e8933`::moving from state preparing -> state finished
>Thread-2793::DEBUG::2014-04-10 17:38:53,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2793::DEBUG::2014-04-10 17:38:53,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2793::DEBUG::2014-04-10 17:38:53,945::task::974::TaskManager.Task::(_decref) Task=`3ae68b9e-51f7-48b7-93d5-2ab7ad8e8933`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:38:55,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:38:55,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334654 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:38:55,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:38:55,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312182 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:38:55,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:38:55,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000475099 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:38:55,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:38:55,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000451483 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2797::DEBUG::2014-04-10 17:39:00,740::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2797::DEBUG::2014-04-10 17:39:00,749::task::579::TaskManager.Task::(_updateState) Task=`fb6351ef-70b9-45dc-8fe0-321790494526`::moving from state init -> state preparing
>Thread-2797::INFO::2014-04-10 17:39:00,750::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2797::INFO::2014-04-10 17:39:00,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2797::DEBUG::2014-04-10 17:39:00,750::task::1168::TaskManager.Task::(prepare) Task=`fb6351ef-70b9-45dc-8fe0-321790494526`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2797::DEBUG::2014-04-10 17:39:00,751::task::579::TaskManager.Task::(_updateState) Task=`fb6351ef-70b9-45dc-8fe0-321790494526`::moving from state preparing -> state finished
>Thread-2797::DEBUG::2014-04-10 17:39:00,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2797::DEBUG::2014-04-10 17:39:00,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2797::DEBUG::2014-04-10 17:39:00,751::task::974::TaskManager.Task::(_decref) Task=`fb6351ef-70b9-45dc-8fe0-321790494526`::ref 0 aborting False
>Thread-2798::DEBUG::2014-04-10 17:39:00,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2798::DEBUG::2014-04-10 17:39:00,758::task::579::TaskManager.Task::(_updateState) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::moving from state init -> state preparing
>Thread-2798::INFO::2014-04-10 17:39:00,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2798::DEBUG::2014-04-10 17:39:00,759::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1b743946-1ad5-47da-85f7-e15802ebca5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2798::DEBUG::2014-04-10 17:39:00,759::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2798::DEBUG::2014-04-10 17:39:00,760::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2798::DEBUG::2014-04-10 17:39:00,760::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1b743946-1ad5-47da-85f7-e15802ebca5d`::Granted request
>Thread-2798::DEBUG::2014-04-10 17:39:00,760::task::811::TaskManager.Task::(resourceAcquired) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2798::DEBUG::2014-04-10 17:39:00,760::task::974::TaskManager.Task::(_decref) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::ref 1 aborting False
>Thread-2798::INFO::2014-04-10 17:39:00,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2798::DEBUG::2014-04-10 17:39:00,763::task::1168::TaskManager.Task::(prepare) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2798::DEBUG::2014-04-10 17:39:00,763::task::579::TaskManager.Task::(_updateState) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::moving from state preparing -> state finished
>Thread-2798::DEBUG::2014-04-10 17:39:00,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2798::DEBUG::2014-04-10 17:39:00,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2798::DEBUG::2014-04-10 17:39:00,764::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2798::DEBUG::2014-04-10 17:39:00,764::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2798::DEBUG::2014-04-10 17:39:00,764::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2798::DEBUG::2014-04-10 17:39:00,764::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2798::DEBUG::2014-04-10 17:39:00,764::task::974::TaskManager.Task::(_decref) Task=`cd0cc3c2-517c-4615-8c65-0fd10c92d3b2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:05,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:05,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421071 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:05,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:05,655::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328505 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:05,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:05,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000541261 s, 680 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:05,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:05,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000457993 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2801::DEBUG::2014-04-10 17:39:09,464::task::579::TaskManager.Task::(_updateState) Task=`c89b3cfd-022c-49b1-aac4-d0084fc0aec8`::moving from state init -> state preparing
>Thread-2801::INFO::2014-04-10 17:39:09,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2801::INFO::2014-04-10 17:39:09,465::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457993', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421071', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328505', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541261', 'lastCheck': '3.6', 'valid': True}}
>Thread-2801::DEBUG::2014-04-10 17:39:09,465::task::1168::TaskManager.Task::(prepare) Task=`c89b3cfd-022c-49b1-aac4-d0084fc0aec8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457993', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421071', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328505', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541261', 'lastCheck': '3.6', 'valid': True}}
>Thread-2801::DEBUG::2014-04-10 17:39:09,465::task::579::TaskManager.Task::(_updateState) Task=`c89b3cfd-022c-49b1-aac4-d0084fc0aec8`::moving from state preparing -> state finished
>Thread-2801::DEBUG::2014-04-10 17:39:09,465::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2801::DEBUG::2014-04-10 17:39:09,465::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2801::DEBUG::2014-04-10 17:39:09,465::task::974::TaskManager.Task::(_decref) Task=`c89b3cfd-022c-49b1-aac4-d0084fc0aec8`::ref 0 aborting False
>Thread-2803::DEBUG::2014-04-10 17:39:10,839::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2803::DEBUG::2014-04-10 17:39:10,840::task::579::TaskManager.Task::(_updateState) Task=`4f168023-9251-4b8c-94b2-30945ad1f986`::moving from state init -> state preparing
>Thread-2803::INFO::2014-04-10 17:39:10,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2803::INFO::2014-04-10 17:39:10,840::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2803::DEBUG::2014-04-10 17:39:10,841::task::1168::TaskManager.Task::(prepare) Task=`4f168023-9251-4b8c-94b2-30945ad1f986`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2803::DEBUG::2014-04-10 17:39:10,841::task::579::TaskManager.Task::(_updateState) Task=`4f168023-9251-4b8c-94b2-30945ad1f986`::moving from state preparing -> state finished
>Thread-2803::DEBUG::2014-04-10 17:39:10,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2803::DEBUG::2014-04-10 17:39:10,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2803::DEBUG::2014-04-10 17:39:10,841::task::974::TaskManager.Task::(_decref) Task=`4f168023-9251-4b8c-94b2-30945ad1f986`::ref 0 aborting False
>Thread-2804::DEBUG::2014-04-10 17:39:10,858::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2804::DEBUG::2014-04-10 17:39:10,858::task::579::TaskManager.Task::(_updateState) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::moving from state init -> state preparing
>Thread-2804::INFO::2014-04-10 17:39:10,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2804::DEBUG::2014-04-10 17:39:10,859::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e463789-b1c6-403b-9067-75cc682be64e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2804::DEBUG::2014-04-10 17:39:10,859::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2804::DEBUG::2014-04-10 17:39:10,859::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2804::DEBUG::2014-04-10 17:39:10,859::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e463789-b1c6-403b-9067-75cc682be64e`::Granted request
>Thread-2804::DEBUG::2014-04-10 17:39:10,860::task::811::TaskManager.Task::(resourceAcquired) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2804::DEBUG::2014-04-10 17:39:10,860::task::974::TaskManager.Task::(_decref) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::ref 1 aborting False
>Thread-2804::INFO::2014-04-10 17:39:10,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2804::DEBUG::2014-04-10 17:39:10,862::task::1168::TaskManager.Task::(prepare) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2804::DEBUG::2014-04-10 17:39:10,862::task::579::TaskManager.Task::(_updateState) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::moving from state preparing -> state finished
>Thread-2804::DEBUG::2014-04-10 17:39:10,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2804::DEBUG::2014-04-10 17:39:10,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2804::DEBUG::2014-04-10 17:39:10,863::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2804::DEBUG::2014-04-10 17:39:10,863::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2804::DEBUG::2014-04-10 17:39:10,863::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2804::DEBUG::2014-04-10 17:39:10,863::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2804::DEBUG::2014-04-10 17:39:10,863::task::974::TaskManager.Task::(_decref) Task=`c4dd9874-3023-4cc8-ab0d-4468243e228b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:15,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:15,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272016 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:15,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:15,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341934 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:15,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:15,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462298 s, 796 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:15,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:15,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459072 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2808::DEBUG::2014-04-10 17:39:20,955::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2808::DEBUG::2014-04-10 17:39:20,964::task::579::TaskManager.Task::(_updateState) Task=`4618d36a-872a-4bed-b9b4-28723ab9cdb3`::moving from state init -> state preparing
>Thread-2808::INFO::2014-04-10 17:39:20,964::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2808::INFO::2014-04-10 17:39:20,964::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2808::DEBUG::2014-04-10 17:39:20,964::task::1168::TaskManager.Task::(prepare) Task=`4618d36a-872a-4bed-b9b4-28723ab9cdb3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2808::DEBUG::2014-04-10 17:39:20,964::task::579::TaskManager.Task::(_updateState) Task=`4618d36a-872a-4bed-b9b4-28723ab9cdb3`::moving from state preparing -> state finished
>Thread-2808::DEBUG::2014-04-10 17:39:20,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2808::DEBUG::2014-04-10 17:39:20,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2808::DEBUG::2014-04-10 17:39:20,965::task::974::TaskManager.Task::(_decref) Task=`4618d36a-872a-4bed-b9b4-28723ab9cdb3`::ref 0 aborting False
>Thread-2809::DEBUG::2014-04-10 17:39:20,971::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2809::DEBUG::2014-04-10 17:39:20,972::task::579::TaskManager.Task::(_updateState) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::moving from state init -> state preparing
>Thread-2809::INFO::2014-04-10 17:39:20,972::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2809::DEBUG::2014-04-10 17:39:20,973::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d098df54-4153-40b9-b1db-1b8f582b37ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2809::DEBUG::2014-04-10 17:39:20,973::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2809::DEBUG::2014-04-10 17:39:20,973::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2809::DEBUG::2014-04-10 17:39:20,973::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d098df54-4153-40b9-b1db-1b8f582b37ca`::Granted request
>Thread-2809::DEBUG::2014-04-10 17:39:20,973::task::811::TaskManager.Task::(resourceAcquired) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2809::DEBUG::2014-04-10 17:39:20,974::task::974::TaskManager.Task::(_decref) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::ref 1 aborting False
>Thread-2809::INFO::2014-04-10 17:39:20,975::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2809::DEBUG::2014-04-10 17:39:20,976::task::1168::TaskManager.Task::(prepare) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2809::DEBUG::2014-04-10 17:39:20,976::task::579::TaskManager.Task::(_updateState) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::moving from state preparing -> state finished
>Thread-2809::DEBUG::2014-04-10 17:39:20,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2809::DEBUG::2014-04-10 17:39:20,976::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2809::DEBUG::2014-04-10 17:39:20,976::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2809::DEBUG::2014-04-10 17:39:20,977::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2809::DEBUG::2014-04-10 17:39:20,977::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2809::DEBUG::2014-04-10 17:39:20,977::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2809::DEBUG::2014-04-10 17:39:20,977::task::974::TaskManager.Task::(_decref) Task=`9e4b74a3-d0df-42f2-b603-68b3cdc33b79`::ref 0 aborting False
>Thread-2811::DEBUG::2014-04-10 17:39:24,663::task::579::TaskManager.Task::(_updateState) Task=`87df946c-f89d-493e-9557-f4287e80e291`::moving from state init -> state preparing
>Thread-2811::INFO::2014-04-10 17:39:24,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2811::INFO::2014-04-10 17:39:24,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459072', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272016', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341934', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462298', 'lastCheck': '8.8', 'valid': True}}
>Thread-2811::DEBUG::2014-04-10 17:39:24,664::task::1168::TaskManager.Task::(prepare) Task=`87df946c-f89d-493e-9557-f4287e80e291`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459072', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272016', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341934', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462298', 'lastCheck': '8.8', 'valid': True}}
>Thread-2811::DEBUG::2014-04-10 17:39:24,664::task::579::TaskManager.Task::(_updateState) Task=`87df946c-f89d-493e-9557-f4287e80e291`::moving from state preparing -> state finished
>Thread-2811::DEBUG::2014-04-10 17:39:24,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2811::DEBUG::2014-04-10 17:39:24,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2811::DEBUG::2014-04-10 17:39:24,664::task::974::TaskManager.Task::(_decref) Task=`87df946c-f89d-493e-9557-f4287e80e291`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:25,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:25,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032061 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:25,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:25,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286787 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:25,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:25,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00052564 s, 700 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:25,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:25,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000515601 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2815::DEBUG::2014-04-10 17:39:31,053::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2815::DEBUG::2014-04-10 17:39:31,054::task::579::TaskManager.Task::(_updateState) Task=`4a79c136-be9e-4d22-b51b-34eafaec0a5a`::moving from state init -> state preparing
>Thread-2815::INFO::2014-04-10 17:39:31,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2815::INFO::2014-04-10 17:39:31,054::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2815::DEBUG::2014-04-10 17:39:31,054::task::1168::TaskManager.Task::(prepare) Task=`4a79c136-be9e-4d22-b51b-34eafaec0a5a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2815::DEBUG::2014-04-10 17:39:31,055::task::579::TaskManager.Task::(_updateState) Task=`4a79c136-be9e-4d22-b51b-34eafaec0a5a`::moving from state preparing -> state finished
>Thread-2815::DEBUG::2014-04-10 17:39:31,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2815::DEBUG::2014-04-10 17:39:31,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2815::DEBUG::2014-04-10 17:39:31,055::task::974::TaskManager.Task::(_decref) Task=`4a79c136-be9e-4d22-b51b-34eafaec0a5a`::ref 0 aborting False
>Thread-2816::DEBUG::2014-04-10 17:39:31,062::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2816::DEBUG::2014-04-10 17:39:31,062::task::579::TaskManager.Task::(_updateState) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::moving from state init -> state preparing
>Thread-2816::INFO::2014-04-10 17:39:31,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2816::DEBUG::2014-04-10 17:39:31,063::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41d02c83-9faa-4d4a-a6aa-58cfe3a61f24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2816::DEBUG::2014-04-10 17:39:31,063::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2816::DEBUG::2014-04-10 17:39:31,063::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2816::DEBUG::2014-04-10 17:39:31,064::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41d02c83-9faa-4d4a-a6aa-58cfe3a61f24`::Granted request
>Thread-2816::DEBUG::2014-04-10 17:39:31,064::task::811::TaskManager.Task::(resourceAcquired) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2816::DEBUG::2014-04-10 17:39:31,064::task::974::TaskManager.Task::(_decref) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::ref 1 aborting False
>Thread-2816::INFO::2014-04-10 17:39:31,066::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2816::DEBUG::2014-04-10 17:39:31,067::task::1168::TaskManager.Task::(prepare) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2816::DEBUG::2014-04-10 17:39:31,067::task::579::TaskManager.Task::(_updateState) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::moving from state preparing -> state finished
>Thread-2816::DEBUG::2014-04-10 17:39:31,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2816::DEBUG::2014-04-10 17:39:31,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2816::DEBUG::2014-04-10 17:39:31,067::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2816::DEBUG::2014-04-10 17:39:31,068::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2816::DEBUG::2014-04-10 17:39:31,068::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2816::DEBUG::2014-04-10 17:39:31,068::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2816::DEBUG::2014-04-10 17:39:31,068::task::974::TaskManager.Task::(_decref) Task=`e6166503-1ca4-41f0-a660-ef46c7de7a5e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:35,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:35,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000401001 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:35,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:35,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330467 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:35,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:35,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462584 s, 796 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:35,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:35,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477088 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2819::DEBUG::2014-04-10 17:39:39,824::task::579::TaskManager.Task::(_updateState) Task=`05634ef3-bb4d-4e53-be0c-fc956e90daeb`::moving from state init -> state preparing
>Thread-2819::INFO::2014-04-10 17:39:39,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2819::INFO::2014-04-10 17:39:39,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477088', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401001', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330467', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462584', 'lastCheck': '3.9', 'valid': True}}
>Thread-2819::DEBUG::2014-04-10 17:39:39,824::task::1168::TaskManager.Task::(prepare) Task=`05634ef3-bb4d-4e53-be0c-fc956e90daeb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477088', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401001', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330467', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462584', 'lastCheck': '3.9', 'valid': True}}
>Thread-2819::DEBUG::2014-04-10 17:39:39,825::task::579::TaskManager.Task::(_updateState) Task=`05634ef3-bb4d-4e53-be0c-fc956e90daeb`::moving from state preparing -> state finished
>Thread-2819::DEBUG::2014-04-10 17:39:39,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2819::DEBUG::2014-04-10 17:39:39,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2819::DEBUG::2014-04-10 17:39:39,825::task::974::TaskManager.Task::(_decref) Task=`05634ef3-bb4d-4e53-be0c-fc956e90daeb`::ref 0 aborting False
>Thread-2821::DEBUG::2014-04-10 17:39:41,162::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2821::DEBUG::2014-04-10 17:39:41,162::task::579::TaskManager.Task::(_updateState) Task=`6802b91a-d611-4a9d-a1f7-2eb7aedd4475`::moving from state init -> state preparing
>Thread-2821::INFO::2014-04-10 17:39:41,163::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2821::INFO::2014-04-10 17:39:41,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2821::DEBUG::2014-04-10 17:39:41,163::task::1168::TaskManager.Task::(prepare) Task=`6802b91a-d611-4a9d-a1f7-2eb7aedd4475`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2821::DEBUG::2014-04-10 17:39:41,163::task::579::TaskManager.Task::(_updateState) Task=`6802b91a-d611-4a9d-a1f7-2eb7aedd4475`::moving from state preparing -> state finished
>Thread-2821::DEBUG::2014-04-10 17:39:41,163::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2821::DEBUG::2014-04-10 17:39:41,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2821::DEBUG::2014-04-10 17:39:41,164::task::974::TaskManager.Task::(_decref) Task=`6802b91a-d611-4a9d-a1f7-2eb7aedd4475`::ref 0 aborting False
>Thread-2822::DEBUG::2014-04-10 17:39:41,170::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2822::DEBUG::2014-04-10 17:39:41,171::task::579::TaskManager.Task::(_updateState) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::moving from state init -> state preparing
>Thread-2822::INFO::2014-04-10 17:39:41,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2822::DEBUG::2014-04-10 17:39:41,171::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae4a0dc7-72b7-42cd-88bb-0bfb2c5ba987`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2822::DEBUG::2014-04-10 17:39:41,172::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2822::DEBUG::2014-04-10 17:39:41,172::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2822::DEBUG::2014-04-10 17:39:41,172::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ae4a0dc7-72b7-42cd-88bb-0bfb2c5ba987`::Granted request
>Thread-2822::DEBUG::2014-04-10 17:39:41,172::task::811::TaskManager.Task::(resourceAcquired) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2822::DEBUG::2014-04-10 17:39:41,172::task::974::TaskManager.Task::(_decref) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::ref 1 aborting False
>Thread-2822::INFO::2014-04-10 17:39:41,174::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2822::DEBUG::2014-04-10 17:39:41,174::task::1168::TaskManager.Task::(prepare) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::task::579::TaskManager.Task::(_updateState) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::moving from state preparing -> state finished
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2822::DEBUG::2014-04-10 17:39:41,175::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2822::DEBUG::2014-04-10 17:39:41,176::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2822::DEBUG::2014-04-10 17:39:41,176::task::974::TaskManager.Task::(_decref) Task=`b8c3e183-6a7b-41ff-8a67-8c0c763f08d8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:45,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:45,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331341 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:45,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:45,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316252 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:45,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:45,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000483049 s, 762 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:45,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:45,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477809 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2826::DEBUG::2014-04-10 17:39:51,259::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2826::DEBUG::2014-04-10 17:39:51,260::task::579::TaskManager.Task::(_updateState) Task=`8fd980fa-51f9-4679-a0a5-6c0e0bb20f4e`::moving from state init -> state preparing
>Thread-2826::INFO::2014-04-10 17:39:51,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2826::INFO::2014-04-10 17:39:51,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2826::DEBUG::2014-04-10 17:39:51,261::task::1168::TaskManager.Task::(prepare) Task=`8fd980fa-51f9-4679-a0a5-6c0e0bb20f4e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2826::DEBUG::2014-04-10 17:39:51,261::task::579::TaskManager.Task::(_updateState) Task=`8fd980fa-51f9-4679-a0a5-6c0e0bb20f4e`::moving from state preparing -> state finished
>Thread-2826::DEBUG::2014-04-10 17:39:51,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2826::DEBUG::2014-04-10 17:39:51,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2826::DEBUG::2014-04-10 17:39:51,261::task::974::TaskManager.Task::(_decref) Task=`8fd980fa-51f9-4679-a0a5-6c0e0bb20f4e`::ref 0 aborting False
>Thread-2827::DEBUG::2014-04-10 17:39:51,269::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2827::DEBUG::2014-04-10 17:39:51,269::task::579::TaskManager.Task::(_updateState) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::moving from state init -> state preparing
>Thread-2827::INFO::2014-04-10 17:39:51,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2827::DEBUG::2014-04-10 17:39:51,270::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`02111e1a-84be-4a09-aec6-103774219c72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2827::DEBUG::2014-04-10 17:39:51,270::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2827::DEBUG::2014-04-10 17:39:51,270::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2827::DEBUG::2014-04-10 17:39:51,270::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`02111e1a-84be-4a09-aec6-103774219c72`::Granted request
>Thread-2827::DEBUG::2014-04-10 17:39:51,271::task::811::TaskManager.Task::(resourceAcquired) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2827::DEBUG::2014-04-10 17:39:51,271::task::974::TaskManager.Task::(_decref) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::ref 1 aborting False
>Thread-2827::INFO::2014-04-10 17:39:51,273::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2827::DEBUG::2014-04-10 17:39:51,273::task::1168::TaskManager.Task::(prepare) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2827::DEBUG::2014-04-10 17:39:51,274::task::579::TaskManager.Task::(_updateState) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::moving from state preparing -> state finished
>Thread-2827::DEBUG::2014-04-10 17:39:51,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2827::DEBUG::2014-04-10 17:39:51,274::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2827::DEBUG::2014-04-10 17:39:51,274::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2827::DEBUG::2014-04-10 17:39:51,274::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2827::DEBUG::2014-04-10 17:39:51,275::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2827::DEBUG::2014-04-10 17:39:51,275::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2827::DEBUG::2014-04-10 17:39:51,275::task::974::TaskManager.Task::(_decref) Task=`4aa6e4f7-2021-4ff6-a40d-c15277e3b7c1`::ref 0 aborting False
>Thread-2829::DEBUG::2014-04-10 17:39:54,989::task::579::TaskManager.Task::(_updateState) Task=`6df490fe-64c9-4f8a-ab9d-2cba9e9235e5`::moving from state init -> state preparing
>Thread-2829::INFO::2014-04-10 17:39:54,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2829::INFO::2014-04-10 17:39:54,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477809', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331341', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316252', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483049', 'lastCheck': '9.0', 'valid': True}}
>Thread-2829::DEBUG::2014-04-10 17:39:54,990::task::1168::TaskManager.Task::(prepare) Task=`6df490fe-64c9-4f8a-ab9d-2cba9e9235e5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477809', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331341', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316252', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483049', 'lastCheck': '9.0', 'valid': True}}
>Thread-2829::DEBUG::2014-04-10 17:39:54,990::task::579::TaskManager.Task::(_updateState) Task=`6df490fe-64c9-4f8a-ab9d-2cba9e9235e5`::moving from state preparing -> state finished
>Thread-2829::DEBUG::2014-04-10 17:39:54,991::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2829::DEBUG::2014-04-10 17:39:54,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2829::DEBUG::2014-04-10 17:39:54,991::task::974::TaskManager.Task::(_decref) Task=`6df490fe-64c9-4f8a-ab9d-2cba9e9235e5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:39:55,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:39:55,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297852 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:39:55,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:39:55,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333063 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:39:55,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:39:56,014::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462778 s, 795 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:39:56,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:39:56,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000492885 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2833::DEBUG::2014-04-10 17:40:01,465::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2833::DEBUG::2014-04-10 17:40:01,466::task::579::TaskManager.Task::(_updateState) Task=`9eea678d-5498-4e89-929b-e9caa59eb014`::moving from state init -> state preparing
>Thread-2833::INFO::2014-04-10 17:40:01,466::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2833::INFO::2014-04-10 17:40:01,466::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2833::DEBUG::2014-04-10 17:40:01,466::task::1168::TaskManager.Task::(prepare) Task=`9eea678d-5498-4e89-929b-e9caa59eb014`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2833::DEBUG::2014-04-10 17:40:01,467::task::579::TaskManager.Task::(_updateState) Task=`9eea678d-5498-4e89-929b-e9caa59eb014`::moving from state preparing -> state finished
>Thread-2833::DEBUG::2014-04-10 17:40:01,467::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2833::DEBUG::2014-04-10 17:40:01,467::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2833::DEBUG::2014-04-10 17:40:01,467::task::974::TaskManager.Task::(_decref) Task=`9eea678d-5498-4e89-929b-e9caa59eb014`::ref 0 aborting False
>Thread-2834::DEBUG::2014-04-10 17:40:01,474::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2834::DEBUG::2014-04-10 17:40:01,474::task::579::TaskManager.Task::(_updateState) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::moving from state init -> state preparing
>Thread-2834::INFO::2014-04-10 17:40:01,475::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2834::DEBUG::2014-04-10 17:40:01,475::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`79cc5e84-1b4d-4024-9ffe-d77d8af61ae9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2834::DEBUG::2014-04-10 17:40:01,475::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2834::DEBUG::2014-04-10 17:40:01,477::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2834::DEBUG::2014-04-10 17:40:01,477::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`79cc5e84-1b4d-4024-9ffe-d77d8af61ae9`::Granted request
>Thread-2834::DEBUG::2014-04-10 17:40:01,477::task::811::TaskManager.Task::(resourceAcquired) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2834::DEBUG::2014-04-10 17:40:01,477::task::974::TaskManager.Task::(_decref) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::ref 1 aborting False
>Thread-2834::INFO::2014-04-10 17:40:01,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2834::DEBUG::2014-04-10 17:40:01,480::task::1168::TaskManager.Task::(prepare) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2834::DEBUG::2014-04-10 17:40:01,480::task::579::TaskManager.Task::(_updateState) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::moving from state preparing -> state finished
>Thread-2834::DEBUG::2014-04-10 17:40:01,480::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2834::DEBUG::2014-04-10 17:40:01,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2834::DEBUG::2014-04-10 17:40:01,481::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2834::DEBUG::2014-04-10 17:40:01,481::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2834::DEBUG::2014-04-10 17:40:01,481::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2834::DEBUG::2014-04-10 17:40:01,481::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2834::DEBUG::2014-04-10 17:40:01,481::task::974::TaskManager.Task::(_decref) Task=`8b98f3bd-def1-4f43-b832-95259cbfcb8a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:05,543::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:05,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276983 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:40:05,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:05,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259748 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:06,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:06,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481293 s, 765 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:06,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:06,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468718 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2837::DEBUG::2014-04-10 17:40:10,159::task::579::TaskManager.Task::(_updateState) Task=`6e5b2d71-2c7a-45d2-a206-faf1cc304f46`::moving from state init -> state preparing
>Thread-2837::INFO::2014-04-10 17:40:10,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2837::INFO::2014-04-10 17:40:10,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468718', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276983', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259748', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481293', 'lastCheck': '4.1', 'valid': True}}
>Thread-2837::DEBUG::2014-04-10 17:40:10,159::task::1168::TaskManager.Task::(prepare) Task=`6e5b2d71-2c7a-45d2-a206-faf1cc304f46`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468718', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276983', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259748', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481293', 'lastCheck': '4.1', 'valid': True}}
>Thread-2837::DEBUG::2014-04-10 17:40:10,160::task::579::TaskManager.Task::(_updateState) Task=`6e5b2d71-2c7a-45d2-a206-faf1cc304f46`::moving from state preparing -> state finished
>Thread-2837::DEBUG::2014-04-10 17:40:10,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2837::DEBUG::2014-04-10 17:40:10,160::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2837::DEBUG::2014-04-10 17:40:10,160::task::974::TaskManager.Task::(_decref) Task=`6e5b2d71-2c7a-45d2-a206-faf1cc304f46`::ref 0 aborting False
>Thread-2839::DEBUG::2014-04-10 17:40:11,555::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-2839::DEBUG::2014-04-10 17:40:11,556::task::579::TaskManager.Task::(_updateState) Task=`0c37c3c4-e2f9-4d3c-813f-70b99ff11e89`::moving from state init -> state preparing
>Thread-2839::INFO::2014-04-10 17:40:11,556::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2839::INFO::2014-04-10 17:40:11,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2839::DEBUG::2014-04-10 17:40:11,556::task::1168::TaskManager.Task::(prepare) Task=`0c37c3c4-e2f9-4d3c-813f-70b99ff11e89`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2839::DEBUG::2014-04-10 17:40:11,556::task::579::TaskManager.Task::(_updateState) Task=`0c37c3c4-e2f9-4d3c-813f-70b99ff11e89`::moving from state preparing -> state finished
>Thread-2839::DEBUG::2014-04-10 17:40:11,557::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2839::DEBUG::2014-04-10 17:40:11,557::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2839::DEBUG::2014-04-10 17:40:11,557::task::974::TaskManager.Task::(_decref) Task=`0c37c3c4-e2f9-4d3c-813f-70b99ff11e89`::ref 0 aborting False
>Thread-2840::DEBUG::2014-04-10 17:40:11,563::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-2840::DEBUG::2014-04-10 17:40:11,564::task::579::TaskManager.Task::(_updateState) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::moving from state init -> state preparing
>Thread-2840::INFO::2014-04-10 17:40:11,564::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2840::DEBUG::2014-04-10 17:40:11,564::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e4bf554-8360-4ca6-aa57-bc4d0fce8969`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2840::DEBUG::2014-04-10 17:40:11,565::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2840::DEBUG::2014-04-10 17:40:11,565::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2840::DEBUG::2014-04-10 17:40:11,565::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e4bf554-8360-4ca6-aa57-bc4d0fce8969`::Granted request
>Thread-2840::DEBUG::2014-04-10 17:40:11,565::task::811::TaskManager.Task::(resourceAcquired) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2840::DEBUG::2014-04-10 17:40:11,565::task::974::TaskManager.Task::(_decref) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::ref 1 aborting False
>Thread-2840::INFO::2014-04-10 17:40:11,567::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2840::DEBUG::2014-04-10 17:40:11,567::task::1168::TaskManager.Task::(prepare) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::task::579::TaskManager.Task::(_updateState) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::moving from state preparing -> state finished
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2840::DEBUG::2014-04-10 17:40:11,568::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2840::DEBUG::2014-04-10 17:40:11,569::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2840::DEBUG::2014-04-10 17:40:11,569::task::974::TaskManager.Task::(_decref) Task=`e1578420-c450-4682-bed2-d5bcea90271e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:15,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:15,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000318884 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:40:15,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:15,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267806 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:16,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:16,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502387 s, 733 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:16,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:16,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000528882 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2844::DEBUG::2014-04-10 17:40:21,646::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2844::DEBUG::2014-04-10 17:40:21,647::task::579::TaskManager.Task::(_updateState) Task=`83e3da61-caa4-40ab-b256-a35e1e2feaa6`::moving from state init -> state preparing
>Thread-2844::INFO::2014-04-10 17:40:21,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2844::INFO::2014-04-10 17:40:21,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2844::DEBUG::2014-04-10 17:40:21,648::task::1168::TaskManager.Task::(prepare) Task=`83e3da61-caa4-40ab-b256-a35e1e2feaa6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2844::DEBUG::2014-04-10 17:40:21,648::task::579::TaskManager.Task::(_updateState) Task=`83e3da61-caa4-40ab-b256-a35e1e2feaa6`::moving from state preparing -> state finished
>Thread-2844::DEBUG::2014-04-10 17:40:21,648::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2844::DEBUG::2014-04-10 17:40:21,648::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2844::DEBUG::2014-04-10 17:40:21,649::task::974::TaskManager.Task::(_decref) Task=`83e3da61-caa4-40ab-b256-a35e1e2feaa6`::ref 0 aborting False
>Thread-2845::DEBUG::2014-04-10 17:40:21,656::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2845::DEBUG::2014-04-10 17:40:21,656::task::579::TaskManager.Task::(_updateState) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::moving from state init -> state preparing
>Thread-2845::INFO::2014-04-10 17:40:21,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2845::DEBUG::2014-04-10 17:40:21,657::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8a0bf978-8067-435e-9998-d1f609a3a0a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2845::DEBUG::2014-04-10 17:40:21,657::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2845::DEBUG::2014-04-10 17:40:21,657::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2845::DEBUG::2014-04-10 17:40:21,657::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8a0bf978-8067-435e-9998-d1f609a3a0a7`::Granted request
>Thread-2845::DEBUG::2014-04-10 17:40:21,658::task::811::TaskManager.Task::(resourceAcquired) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2845::DEBUG::2014-04-10 17:40:21,658::task::974::TaskManager.Task::(_decref) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::ref 1 aborting False
>Thread-2845::INFO::2014-04-10 17:40:21,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2845::DEBUG::2014-04-10 17:40:21,660::task::1168::TaskManager.Task::(prepare) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2845::DEBUG::2014-04-10 17:40:21,660::task::579::TaskManager.Task::(_updateState) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::moving from state preparing -> state finished
>Thread-2845::DEBUG::2014-04-10 17:40:21,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2845::DEBUG::2014-04-10 17:40:21,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2845::DEBUG::2014-04-10 17:40:21,661::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2845::DEBUG::2014-04-10 17:40:21,661::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2845::DEBUG::2014-04-10 17:40:21,661::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2845::DEBUG::2014-04-10 17:40:21,662::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2845::DEBUG::2014-04-10 17:40:21,662::task::974::TaskManager.Task::(_decref) Task=`7f9c2b75-5cde-42c2-82b6-82e412252dfa`::ref 0 aborting False
>Thread-2847::DEBUG::2014-04-10 17:40:25,356::task::579::TaskManager.Task::(_updateState) Task=`b8ec1d66-8690-46c3-bcc4-571adb35fcf5`::moving from state init -> state preparing
>Thread-2847::INFO::2014-04-10 17:40:25,357::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2847::INFO::2014-04-10 17:40:25,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528882', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318884', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267806', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502387', 'lastCheck': '9.3', 'valid': True}}
>Thread-2847::DEBUG::2014-04-10 17:40:25,357::task::1168::TaskManager.Task::(prepare) Task=`b8ec1d66-8690-46c3-bcc4-571adb35fcf5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528882', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318884', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267806', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502387', 'lastCheck': '9.3', 'valid': True}}
>Thread-2847::DEBUG::2014-04-10 17:40:25,357::task::579::TaskManager.Task::(_updateState) Task=`b8ec1d66-8690-46c3-bcc4-571adb35fcf5`::moving from state preparing -> state finished
>Thread-2847::DEBUG::2014-04-10 17:40:25,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2847::DEBUG::2014-04-10 17:40:25,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2847::DEBUG::2014-04-10 17:40:25,358::task::974::TaskManager.Task::(_decref) Task=`b8ec1d66-8690-46c3-bcc4-571adb35fcf5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:25,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:25,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375691 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:40:25,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:25,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329955 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:26,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:26,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000534392 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:26,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:26,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000454642 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2851::DEBUG::2014-04-10 17:40:31,743::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2851::DEBUG::2014-04-10 17:40:31,744::task::579::TaskManager.Task::(_updateState) Task=`082a8b14-4ce5-4056-861c-1234943d130b`::moving from state init -> state preparing
>Thread-2851::INFO::2014-04-10 17:40:31,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2851::INFO::2014-04-10 17:40:31,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2851::DEBUG::2014-04-10 17:40:31,745::task::1168::TaskManager.Task::(prepare) Task=`082a8b14-4ce5-4056-861c-1234943d130b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2851::DEBUG::2014-04-10 17:40:31,745::task::579::TaskManager.Task::(_updateState) Task=`082a8b14-4ce5-4056-861c-1234943d130b`::moving from state preparing -> state finished
>Thread-2851::DEBUG::2014-04-10 17:40:31,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2851::DEBUG::2014-04-10 17:40:31,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2851::DEBUG::2014-04-10 17:40:31,745::task::974::TaskManager.Task::(_decref) Task=`082a8b14-4ce5-4056-861c-1234943d130b`::ref 0 aborting False
>Thread-2852::DEBUG::2014-04-10 17:40:31,751::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2852::DEBUG::2014-04-10 17:40:31,752::task::579::TaskManager.Task::(_updateState) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::moving from state init -> state preparing
>Thread-2852::INFO::2014-04-10 17:40:31,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2852::DEBUG::2014-04-10 17:40:31,752::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d854f231-b5e1-4fd5-967d-877fcf3dbbf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2852::DEBUG::2014-04-10 17:40:31,752::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2852::DEBUG::2014-04-10 17:40:31,753::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2852::DEBUG::2014-04-10 17:40:31,753::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d854f231-b5e1-4fd5-967d-877fcf3dbbf8`::Granted request
>Thread-2852::DEBUG::2014-04-10 17:40:31,753::task::811::TaskManager.Task::(resourceAcquired) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2852::DEBUG::2014-04-10 17:40:31,753::task::974::TaskManager.Task::(_decref) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::ref 1 aborting False
>Thread-2852::INFO::2014-04-10 17:40:31,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2852::DEBUG::2014-04-10 17:40:31,755::task::1168::TaskManager.Task::(prepare) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::task::579::TaskManager.Task::(_updateState) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::moving from state preparing -> state finished
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2852::DEBUG::2014-04-10 17:40:31,756::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2852::DEBUG::2014-04-10 17:40:31,757::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2852::DEBUG::2014-04-10 17:40:31,757::task::974::TaskManager.Task::(_decref) Task=`78369fdc-a093-405b-81cb-962e6caf4af9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:35,584::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:40:35,599::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:40:35,600::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:40:35,605::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:40:35,606::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:40:35,606::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:40:35,607::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:40:35,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:35,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360553 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:40:35,765::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:40:35,780::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:40:35,781::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:40:35,786::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:40:35,787::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:40:35,787::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:40:35,787::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:40:35,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:35,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326432 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:36,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:36,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000497731 s, 739 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:36,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:36,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000424626 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2863::DEBUG::2014-04-10 17:40:40,513::task::579::TaskManager.Task::(_updateState) Task=`5e12cec0-df76-49d0-badc-4d9a7d97cde9`::moving from state init -> state preparing
>Thread-2863::INFO::2014-04-10 17:40:40,513::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2863::INFO::2014-04-10 17:40:40,514::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424626', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360553', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326432', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497731', 'lastCheck': '4.4', 'valid': True}}
>Thread-2863::DEBUG::2014-04-10 17:40:40,514::task::1168::TaskManager.Task::(prepare) Task=`5e12cec0-df76-49d0-badc-4d9a7d97cde9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424626', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360553', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326432', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497731', 'lastCheck': '4.4', 'valid': True}}
>Thread-2863::DEBUG::2014-04-10 17:40:40,514::task::579::TaskManager.Task::(_updateState) Task=`5e12cec0-df76-49d0-badc-4d9a7d97cde9`::moving from state preparing -> state finished
>Thread-2863::DEBUG::2014-04-10 17:40:40,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2863::DEBUG::2014-04-10 17:40:40,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2863::DEBUG::2014-04-10 17:40:40,515::task::974::TaskManager.Task::(_decref) Task=`5e12cec0-df76-49d0-badc-4d9a7d97cde9`::ref 0 aborting False
>Thread-2865::DEBUG::2014-04-10 17:40:41,834::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2865::DEBUG::2014-04-10 17:40:41,835::task::579::TaskManager.Task::(_updateState) Task=`69aee6ac-2e94-4f91-8f39-bfc92dfe3e3d`::moving from state init -> state preparing
>Thread-2865::INFO::2014-04-10 17:40:41,835::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2865::INFO::2014-04-10 17:40:41,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2865::DEBUG::2014-04-10 17:40:41,835::task::1168::TaskManager.Task::(prepare) Task=`69aee6ac-2e94-4f91-8f39-bfc92dfe3e3d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2865::DEBUG::2014-04-10 17:40:41,835::task::579::TaskManager.Task::(_updateState) Task=`69aee6ac-2e94-4f91-8f39-bfc92dfe3e3d`::moving from state preparing -> state finished
>Thread-2865::DEBUG::2014-04-10 17:40:41,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2865::DEBUG::2014-04-10 17:40:41,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2865::DEBUG::2014-04-10 17:40:41,836::task::974::TaskManager.Task::(_decref) Task=`69aee6ac-2e94-4f91-8f39-bfc92dfe3e3d`::ref 0 aborting False
>Thread-2866::DEBUG::2014-04-10 17:40:41,842::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2866::DEBUG::2014-04-10 17:40:41,843::task::579::TaskManager.Task::(_updateState) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::moving from state init -> state preparing
>Thread-2866::INFO::2014-04-10 17:40:41,843::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2866::DEBUG::2014-04-10 17:40:41,843::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9ba3697-3e1f-4b4c-87c6-58a128136dfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2866::DEBUG::2014-04-10 17:40:41,843::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2866::DEBUG::2014-04-10 17:40:41,844::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2866::DEBUG::2014-04-10 17:40:41,844::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9ba3697-3e1f-4b4c-87c6-58a128136dfb`::Granted request
>Thread-2866::DEBUG::2014-04-10 17:40:41,845::task::811::TaskManager.Task::(resourceAcquired) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2866::DEBUG::2014-04-10 17:40:41,845::task::974::TaskManager.Task::(_decref) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::ref 1 aborting False
>Thread-2866::INFO::2014-04-10 17:40:41,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2866::DEBUG::2014-04-10 17:40:41,847::task::1168::TaskManager.Task::(prepare) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2866::DEBUG::2014-04-10 17:40:41,847::task::579::TaskManager.Task::(_updateState) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::moving from state preparing -> state finished
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2866::DEBUG::2014-04-10 17:40:41,848::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2866::DEBUG::2014-04-10 17:40:41,849::task::974::TaskManager.Task::(_decref) Task=`80f38f85-3957-4780-85f5-b4a60695e848`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:45,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:45,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000466324 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:40:45,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:45,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337477 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:46,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:46,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000365753 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:46,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:46,134::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000424788 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2870::DEBUG::2014-04-10 17:40:51,950::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2870::DEBUG::2014-04-10 17:40:51,950::task::579::TaskManager.Task::(_updateState) Task=`ab3315fa-bb1f-4707-a336-d8dcde7b8ed0`::moving from state init -> state preparing
>Thread-2870::INFO::2014-04-10 17:40:51,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2870::INFO::2014-04-10 17:40:51,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2870::DEBUG::2014-04-10 17:40:51,951::task::1168::TaskManager.Task::(prepare) Task=`ab3315fa-bb1f-4707-a336-d8dcde7b8ed0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2870::DEBUG::2014-04-10 17:40:51,951::task::579::TaskManager.Task::(_updateState) Task=`ab3315fa-bb1f-4707-a336-d8dcde7b8ed0`::moving from state preparing -> state finished
>Thread-2870::DEBUG::2014-04-10 17:40:51,952::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2870::DEBUG::2014-04-10 17:40:51,952::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2870::DEBUG::2014-04-10 17:40:51,952::task::974::TaskManager.Task::(_decref) Task=`ab3315fa-bb1f-4707-a336-d8dcde7b8ed0`::ref 0 aborting False
>Thread-2871::DEBUG::2014-04-10 17:40:51,958::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2871::DEBUG::2014-04-10 17:40:51,959::task::579::TaskManager.Task::(_updateState) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::moving from state init -> state preparing
>Thread-2871::INFO::2014-04-10 17:40:51,959::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2871::DEBUG::2014-04-10 17:40:51,960::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7105001d-eeea-45b6-8984-3c9830243ff6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2871::DEBUG::2014-04-10 17:40:51,960::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2871::DEBUG::2014-04-10 17:40:51,960::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2871::DEBUG::2014-04-10 17:40:51,960::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7105001d-eeea-45b6-8984-3c9830243ff6`::Granted request
>Thread-2871::DEBUG::2014-04-10 17:40:51,961::task::811::TaskManager.Task::(resourceAcquired) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2871::DEBUG::2014-04-10 17:40:51,961::task::974::TaskManager.Task::(_decref) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::ref 1 aborting False
>Thread-2871::INFO::2014-04-10 17:40:51,963::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2871::DEBUG::2014-04-10 17:40:51,963::task::1168::TaskManager.Task::(prepare) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2871::DEBUG::2014-04-10 17:40:51,963::task::579::TaskManager.Task::(_updateState) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::moving from state preparing -> state finished
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2871::DEBUG::2014-04-10 17:40:51,964::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2871::DEBUG::2014-04-10 17:40:51,965::task::974::TaskManager.Task::(_decref) Task=`97b7329d-bb34-4138-9f38-e377818c050a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:40:55,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:40:55,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000406518 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2873::DEBUG::2014-04-10 17:40:55,674::task::579::TaskManager.Task::(_updateState) Task=`acb8d31d-c163-4a9e-8087-2ad2cf87dfd6`::moving from state init -> state preparing
>Thread-2873::INFO::2014-04-10 17:40:55,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2873::INFO::2014-04-10 17:40:55,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424788', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406518', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337477', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365753', 'lastCheck': '9.6', 'valid': True}}
>Thread-2873::DEBUG::2014-04-10 17:40:55,675::task::1168::TaskManager.Task::(prepare) Task=`acb8d31d-c163-4a9e-8087-2ad2cf87dfd6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424788', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406518', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337477', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365753', 'lastCheck': '9.6', 'valid': True}}
>Thread-2873::DEBUG::2014-04-10 17:40:55,675::task::579::TaskManager.Task::(_updateState) Task=`acb8d31d-c163-4a9e-8087-2ad2cf87dfd6`::moving from state preparing -> state finished
>Thread-2873::DEBUG::2014-04-10 17:40:55,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2873::DEBUG::2014-04-10 17:40:55,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2873::DEBUG::2014-04-10 17:40:55,676::task::974::TaskManager.Task::(_decref) Task=`acb8d31d-c163-4a9e-8087-2ad2cf87dfd6`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 17:40:55,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:40:55,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336597 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:40:56,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:40:56,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00035507 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:40:56,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:40:56,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464705 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2877::DEBUG::2014-04-10 17:41:02,089::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2877::DEBUG::2014-04-10 17:41:02,089::task::579::TaskManager.Task::(_updateState) Task=`5e6167ae-48d9-438e-aee0-b32ca7ac6ad9`::moving from state init -> state preparing
>Thread-2877::INFO::2014-04-10 17:41:02,090::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2877::INFO::2014-04-10 17:41:02,090::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2877::DEBUG::2014-04-10 17:41:02,090::task::1168::TaskManager.Task::(prepare) Task=`5e6167ae-48d9-438e-aee0-b32ca7ac6ad9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2877::DEBUG::2014-04-10 17:41:02,090::task::579::TaskManager.Task::(_updateState) Task=`5e6167ae-48d9-438e-aee0-b32ca7ac6ad9`::moving from state preparing -> state finished
>Thread-2877::DEBUG::2014-04-10 17:41:02,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2877::DEBUG::2014-04-10 17:41:02,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2877::DEBUG::2014-04-10 17:41:02,091::task::974::TaskManager.Task::(_decref) Task=`5e6167ae-48d9-438e-aee0-b32ca7ac6ad9`::ref 0 aborting False
>Thread-2878::DEBUG::2014-04-10 17:41:02,097::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2878::DEBUG::2014-04-10 17:41:02,097::task::579::TaskManager.Task::(_updateState) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::moving from state init -> state preparing
>Thread-2878::INFO::2014-04-10 17:41:02,097::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2878::DEBUG::2014-04-10 17:41:02,098::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f044fca5-3227-46d1-b717-2a5548b1f171`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2878::DEBUG::2014-04-10 17:41:02,098::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2878::DEBUG::2014-04-10 17:41:02,098::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2878::DEBUG::2014-04-10 17:41:02,098::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f044fca5-3227-46d1-b717-2a5548b1f171`::Granted request
>Thread-2878::DEBUG::2014-04-10 17:41:02,099::task::811::TaskManager.Task::(resourceAcquired) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2878::DEBUG::2014-04-10 17:41:02,099::task::974::TaskManager.Task::(_decref) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::ref 1 aborting False
>Thread-2878::INFO::2014-04-10 17:41:02,101::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2878::DEBUG::2014-04-10 17:41:02,101::task::1168::TaskManager.Task::(prepare) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2878::DEBUG::2014-04-10 17:41:02,101::task::579::TaskManager.Task::(_updateState) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::moving from state preparing -> state finished
>Thread-2878::DEBUG::2014-04-10 17:41:02,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2878::DEBUG::2014-04-10 17:41:02,101::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2878::DEBUG::2014-04-10 17:41:02,102::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2878::DEBUG::2014-04-10 17:41:02,102::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2878::DEBUG::2014-04-10 17:41:02,102::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2878::DEBUG::2014-04-10 17:41:02,102::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2878::DEBUG::2014-04-10 17:41:02,102::task::974::TaskManager.Task::(_decref) Task=`5a29c41f-c6ae-42d1-b65c-e9ed70002ba3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:05,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:05,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000435959 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:05,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:05,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393247 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:06,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:06,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048582 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:06,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:06,173::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000490418 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2881::DEBUG::2014-04-10 17:41:10,858::task::579::TaskManager.Task::(_updateState) Task=`b041705f-1e24-4cba-a469-53d780c0f7b1`::moving from state init -> state preparing
>Thread-2881::INFO::2014-04-10 17:41:10,858::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2881::INFO::2014-04-10 17:41:10,859::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490418', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435959', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393247', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048582', 'lastCheck': '4.7', 'valid': True}}
>Thread-2881::DEBUG::2014-04-10 17:41:10,859::task::1168::TaskManager.Task::(prepare) Task=`b041705f-1e24-4cba-a469-53d780c0f7b1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490418', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435959', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393247', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048582', 'lastCheck': '4.7', 'valid': True}}
>Thread-2881::DEBUG::2014-04-10 17:41:10,859::task::579::TaskManager.Task::(_updateState) Task=`b041705f-1e24-4cba-a469-53d780c0f7b1`::moving from state preparing -> state finished
>Thread-2881::DEBUG::2014-04-10 17:41:10,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2881::DEBUG::2014-04-10 17:41:10,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2881::DEBUG::2014-04-10 17:41:10,859::task::974::TaskManager.Task::(_decref) Task=`b041705f-1e24-4cba-a469-53d780c0f7b1`::ref 0 aborting False
>Thread-2883::DEBUG::2014-04-10 17:41:12,182::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2883::DEBUG::2014-04-10 17:41:12,183::task::579::TaskManager.Task::(_updateState) Task=`84a187b3-234e-400c-811c-d7ed352de136`::moving from state init -> state preparing
>Thread-2883::INFO::2014-04-10 17:41:12,183::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2883::INFO::2014-04-10 17:41:12,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2883::DEBUG::2014-04-10 17:41:12,184::task::1168::TaskManager.Task::(prepare) Task=`84a187b3-234e-400c-811c-d7ed352de136`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2883::DEBUG::2014-04-10 17:41:12,184::task::579::TaskManager.Task::(_updateState) Task=`84a187b3-234e-400c-811c-d7ed352de136`::moving from state preparing -> state finished
>Thread-2883::DEBUG::2014-04-10 17:41:12,185::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2883::DEBUG::2014-04-10 17:41:12,185::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2883::DEBUG::2014-04-10 17:41:12,185::task::974::TaskManager.Task::(_decref) Task=`84a187b3-234e-400c-811c-d7ed352de136`::ref 0 aborting False
>Thread-2884::DEBUG::2014-04-10 17:41:12,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2884::DEBUG::2014-04-10 17:41:12,193::task::579::TaskManager.Task::(_updateState) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::moving from state init -> state preparing
>Thread-2884::INFO::2014-04-10 17:41:12,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2884::DEBUG::2014-04-10 17:41:12,193::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`49bb9c9a-2e92-48d6-a96f-4af1f14c5042`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2884::DEBUG::2014-04-10 17:41:12,193::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2884::DEBUG::2014-04-10 17:41:12,194::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2884::DEBUG::2014-04-10 17:41:12,194::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`49bb9c9a-2e92-48d6-a96f-4af1f14c5042`::Granted request
>Thread-2884::DEBUG::2014-04-10 17:41:12,194::task::811::TaskManager.Task::(resourceAcquired) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2884::DEBUG::2014-04-10 17:41:12,194::task::974::TaskManager.Task::(_decref) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::ref 1 aborting False
>Thread-2884::INFO::2014-04-10 17:41:12,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2884::DEBUG::2014-04-10 17:41:12,196::task::1168::TaskManager.Task::(prepare) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2884::DEBUG::2014-04-10 17:41:12,196::task::579::TaskManager.Task::(_updateState) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::moving from state preparing -> state finished
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2884::DEBUG::2014-04-10 17:41:12,197::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2884::DEBUG::2014-04-10 17:41:12,198::task::974::TaskManager.Task::(_decref) Task=`d18ef18c-d157-4d65-a92e-5269e83cf184`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:15,681::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:15,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376942 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:15,849::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:15,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373696 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:16,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:16,138::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484283 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:16,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:16,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000560279 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2888::DEBUG::2014-04-10 17:41:22,278::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2888::DEBUG::2014-04-10 17:41:22,279::task::579::TaskManager.Task::(_updateState) Task=`de8ca1ca-7f7b-45ba-bc10-8e25cda9eebd`::moving from state init -> state preparing
>Thread-2888::INFO::2014-04-10 17:41:22,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2888::INFO::2014-04-10 17:41:22,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2888::DEBUG::2014-04-10 17:41:22,280::task::1168::TaskManager.Task::(prepare) Task=`de8ca1ca-7f7b-45ba-bc10-8e25cda9eebd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2888::DEBUG::2014-04-10 17:41:22,280::task::579::TaskManager.Task::(_updateState) Task=`de8ca1ca-7f7b-45ba-bc10-8e25cda9eebd`::moving from state preparing -> state finished
>Thread-2888::DEBUG::2014-04-10 17:41:22,280::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2888::DEBUG::2014-04-10 17:41:22,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2888::DEBUG::2014-04-10 17:41:22,280::task::974::TaskManager.Task::(_decref) Task=`de8ca1ca-7f7b-45ba-bc10-8e25cda9eebd`::ref 0 aborting False
>Thread-2889::DEBUG::2014-04-10 17:41:22,287::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2889::DEBUG::2014-04-10 17:41:22,287::task::579::TaskManager.Task::(_updateState) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::moving from state init -> state preparing
>Thread-2889::INFO::2014-04-10 17:41:22,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2889::DEBUG::2014-04-10 17:41:22,288::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d22d022b-7c8c-4445-aed9-ca52070d753d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2889::DEBUG::2014-04-10 17:41:22,288::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2889::DEBUG::2014-04-10 17:41:22,289::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2889::DEBUG::2014-04-10 17:41:22,289::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d22d022b-7c8c-4445-aed9-ca52070d753d`::Granted request
>Thread-2889::DEBUG::2014-04-10 17:41:22,290::task::811::TaskManager.Task::(resourceAcquired) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2889::DEBUG::2014-04-10 17:41:22,290::task::974::TaskManager.Task::(_decref) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::ref 1 aborting False
>Thread-2889::INFO::2014-04-10 17:41:22,292::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2889::DEBUG::2014-04-10 17:41:22,293::task::1168::TaskManager.Task::(prepare) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2889::DEBUG::2014-04-10 17:41:22,293::task::579::TaskManager.Task::(_updateState) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::moving from state preparing -> state finished
>Thread-2889::DEBUG::2014-04-10 17:41:22,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2889::DEBUG::2014-04-10 17:41:22,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2889::DEBUG::2014-04-10 17:41:22,293::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2889::DEBUG::2014-04-10 17:41:22,294::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2889::DEBUG::2014-04-10 17:41:22,294::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2889::DEBUG::2014-04-10 17:41:22,294::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2889::DEBUG::2014-04-10 17:41:22,294::task::974::TaskManager.Task::(_decref) Task=`5647ca2f-e731-4b2b-b454-fcbf83d5e3ff`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:25,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:25,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362062 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:25,862::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:25,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000468113 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:26,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:26,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000343407 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:26,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:26,212::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000438795 s, 1.5 MB/s\n'; <rc> = 0
>Thread-2891::DEBUG::2014-04-10 17:41:26,285::task::579::TaskManager.Task::(_updateState) Task=`fb1b2ad2-c61d-49d8-8680-a0fe87746a71`::moving from state init -> state preparing
>Thread-2891::INFO::2014-04-10 17:41:26,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2891::INFO::2014-04-10 17:41:26,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438795', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362062', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468113', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343407', 'lastCheck': '0.1', 'valid': True}}
>Thread-2891::DEBUG::2014-04-10 17:41:26,286::task::1168::TaskManager.Task::(prepare) Task=`fb1b2ad2-c61d-49d8-8680-a0fe87746a71`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438795', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362062', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468113', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343407', 'lastCheck': '0.1', 'valid': True}}
>Thread-2891::DEBUG::2014-04-10 17:41:26,286::task::579::TaskManager.Task::(_updateState) Task=`fb1b2ad2-c61d-49d8-8680-a0fe87746a71`::moving from state preparing -> state finished
>Thread-2891::DEBUG::2014-04-10 17:41:26,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2891::DEBUG::2014-04-10 17:41:26,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2891::DEBUG::2014-04-10 17:41:26,286::task::974::TaskManager.Task::(_decref) Task=`fb1b2ad2-c61d-49d8-8680-a0fe87746a71`::ref 0 aborting False
>Thread-2894::DEBUG::2014-04-10 17:41:32,369::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2894::DEBUG::2014-04-10 17:41:32,370::task::579::TaskManager.Task::(_updateState) Task=`41a2e3d2-c992-4403-acf0-a70e178a0d5f`::moving from state init -> state preparing
>Thread-2894::INFO::2014-04-10 17:41:32,370::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2894::INFO::2014-04-10 17:41:32,371::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2894::DEBUG::2014-04-10 17:41:32,371::task::1168::TaskManager.Task::(prepare) Task=`41a2e3d2-c992-4403-acf0-a70e178a0d5f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2894::DEBUG::2014-04-10 17:41:32,371::task::579::TaskManager.Task::(_updateState) Task=`41a2e3d2-c992-4403-acf0-a70e178a0d5f`::moving from state preparing -> state finished
>Thread-2894::DEBUG::2014-04-10 17:41:32,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2894::DEBUG::2014-04-10 17:41:32,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2894::DEBUG::2014-04-10 17:41:32,371::task::974::TaskManager.Task::(_decref) Task=`41a2e3d2-c992-4403-acf0-a70e178a0d5f`::ref 0 aborting False
>Thread-2895::DEBUG::2014-04-10 17:41:32,379::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2895::DEBUG::2014-04-10 17:41:32,379::task::579::TaskManager.Task::(_updateState) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::moving from state init -> state preparing
>Thread-2895::INFO::2014-04-10 17:41:32,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2895::DEBUG::2014-04-10 17:41:32,380::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`776c08a2-fbf8-4c37-8ea6-3d28c16f231d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2895::DEBUG::2014-04-10 17:41:32,380::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2895::DEBUG::2014-04-10 17:41:32,380::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2895::DEBUG::2014-04-10 17:41:32,380::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`776c08a2-fbf8-4c37-8ea6-3d28c16f231d`::Granted request
>Thread-2895::DEBUG::2014-04-10 17:41:32,381::task::811::TaskManager.Task::(resourceAcquired) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2895::DEBUG::2014-04-10 17:41:32,381::task::974::TaskManager.Task::(_decref) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::ref 1 aborting False
>Thread-2895::INFO::2014-04-10 17:41:32,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2895::DEBUG::2014-04-10 17:41:32,383::task::1168::TaskManager.Task::(prepare) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2895::DEBUG::2014-04-10 17:41:32,384::task::579::TaskManager.Task::(_updateState) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::moving from state preparing -> state finished
>Thread-2895::DEBUG::2014-04-10 17:41:32,384::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2895::DEBUG::2014-04-10 17:41:32,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2895::DEBUG::2014-04-10 17:41:32,384::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2895::DEBUG::2014-04-10 17:41:32,384::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2895::DEBUG::2014-04-10 17:41:32,385::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2895::DEBUG::2014-04-10 17:41:32,385::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2895::DEBUG::2014-04-10 17:41:32,385::task::974::TaskManager.Task::(_decref) Task=`b9f0afc4-1729-4bf3-a075-42279f96492c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:35,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:35,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000454626 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:35,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:35,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000352847 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:36,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:36,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000467669 s, 787 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:36,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:36,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000570025 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2899::DEBUG::2014-04-10 17:41:41,443::task::579::TaskManager.Task::(_updateState) Task=`10ea5def-816c-4f76-896e-84ac73af3c66`::moving from state init -> state preparing
>Thread-2899::INFO::2014-04-10 17:41:41,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2899::INFO::2014-04-10 17:41:41,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570025', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454626', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352847', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467669', 'lastCheck': '5.3', 'valid': True}}
>Thread-2899::DEBUG::2014-04-10 17:41:41,444::task::1168::TaskManager.Task::(prepare) Task=`10ea5def-816c-4f76-896e-84ac73af3c66`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570025', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454626', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352847', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467669', 'lastCheck': '5.3', 'valid': True}}
>Thread-2899::DEBUG::2014-04-10 17:41:41,444::task::579::TaskManager.Task::(_updateState) Task=`10ea5def-816c-4f76-896e-84ac73af3c66`::moving from state preparing -> state finished
>Thread-2899::DEBUG::2014-04-10 17:41:41,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2899::DEBUG::2014-04-10 17:41:41,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2899::DEBUG::2014-04-10 17:41:41,445::task::974::TaskManager.Task::(_decref) Task=`10ea5def-816c-4f76-896e-84ac73af3c66`::ref 0 aborting False
>Thread-2901::DEBUG::2014-04-10 17:41:42,837::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2901::DEBUG::2014-04-10 17:41:42,838::task::579::TaskManager.Task::(_updateState) Task=`4ecbb492-8184-44c4-8574-e53d8c11327e`::moving from state init -> state preparing
>Thread-2901::INFO::2014-04-10 17:41:42,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2901::INFO::2014-04-10 17:41:42,838::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2901::DEBUG::2014-04-10 17:41:42,839::task::1168::TaskManager.Task::(prepare) Task=`4ecbb492-8184-44c4-8574-e53d8c11327e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2901::DEBUG::2014-04-10 17:41:42,839::task::579::TaskManager.Task::(_updateState) Task=`4ecbb492-8184-44c4-8574-e53d8c11327e`::moving from state preparing -> state finished
>Thread-2901::DEBUG::2014-04-10 17:41:42,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2901::DEBUG::2014-04-10 17:41:42,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2901::DEBUG::2014-04-10 17:41:42,839::task::974::TaskManager.Task::(_decref) Task=`4ecbb492-8184-44c4-8574-e53d8c11327e`::ref 0 aborting False
>Thread-2902::DEBUG::2014-04-10 17:41:42,846::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2902::DEBUG::2014-04-10 17:41:42,846::task::579::TaskManager.Task::(_updateState) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::moving from state init -> state preparing
>Thread-2902::INFO::2014-04-10 17:41:42,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2902::DEBUG::2014-04-10 17:41:42,847::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`60545764-c8fd-485f-b041-738ef7031e07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2902::DEBUG::2014-04-10 17:41:42,847::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2902::DEBUG::2014-04-10 17:41:42,847::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2902::DEBUG::2014-04-10 17:41:42,847::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`60545764-c8fd-485f-b041-738ef7031e07`::Granted request
>Thread-2902::DEBUG::2014-04-10 17:41:42,848::task::811::TaskManager.Task::(resourceAcquired) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2902::DEBUG::2014-04-10 17:41:42,848::task::974::TaskManager.Task::(_decref) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::ref 1 aborting False
>Thread-2902::INFO::2014-04-10 17:41:42,850::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2902::DEBUG::2014-04-10 17:41:42,850::task::1168::TaskManager.Task::(prepare) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2902::DEBUG::2014-04-10 17:41:42,850::task::579::TaskManager.Task::(_updateState) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::moving from state preparing -> state finished
>Thread-2902::DEBUG::2014-04-10 17:41:42,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2902::DEBUG::2014-04-10 17:41:42,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2902::DEBUG::2014-04-10 17:41:42,850::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2902::DEBUG::2014-04-10 17:41:42,851::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2902::DEBUG::2014-04-10 17:41:42,851::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2902::DEBUG::2014-04-10 17:41:42,851::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2902::DEBUG::2014-04-10 17:41:42,851::task::974::TaskManager.Task::(_decref) Task=`8bd8ff9b-92b2-4c9a-a835-874ccf65b376`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:45,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:45,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000460188 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:45,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:45,897::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356212 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:46,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:46,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000521974 s, 705 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:46,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:46,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000342632 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2906::DEBUG::2014-04-10 17:41:52,931::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2906::DEBUG::2014-04-10 17:41:52,941::task::579::TaskManager.Task::(_updateState) Task=`866ee421-a206-4231-956f-f38082589538`::moving from state init -> state preparing
>Thread-2906::INFO::2014-04-10 17:41:52,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2906::INFO::2014-04-10 17:41:52,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2906::DEBUG::2014-04-10 17:41:52,941::task::1168::TaskManager.Task::(prepare) Task=`866ee421-a206-4231-956f-f38082589538`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2906::DEBUG::2014-04-10 17:41:52,942::task::579::TaskManager.Task::(_updateState) Task=`866ee421-a206-4231-956f-f38082589538`::moving from state preparing -> state finished
>Thread-2906::DEBUG::2014-04-10 17:41:52,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2906::DEBUG::2014-04-10 17:41:52,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2906::DEBUG::2014-04-10 17:41:52,942::task::974::TaskManager.Task::(_decref) Task=`866ee421-a206-4231-956f-f38082589538`::ref 0 aborting False
>Thread-2907::DEBUG::2014-04-10 17:41:52,949::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-2907::DEBUG::2014-04-10 17:41:52,950::task::579::TaskManager.Task::(_updateState) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::moving from state init -> state preparing
>Thread-2907::INFO::2014-04-10 17:41:52,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2907::DEBUG::2014-04-10 17:41:52,950::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`265a971c-1681-4b9f-b8d3-323b293a32ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2907::DEBUG::2014-04-10 17:41:52,950::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2907::DEBUG::2014-04-10 17:41:52,951::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2907::DEBUG::2014-04-10 17:41:52,951::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`265a971c-1681-4b9f-b8d3-323b293a32ee`::Granted request
>Thread-2907::DEBUG::2014-04-10 17:41:52,951::task::811::TaskManager.Task::(resourceAcquired) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2907::DEBUG::2014-04-10 17:41:52,951::task::974::TaskManager.Task::(_decref) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::ref 1 aborting False
>Thread-2907::INFO::2014-04-10 17:41:52,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2907::DEBUG::2014-04-10 17:41:52,953::task::1168::TaskManager.Task::(prepare) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::task::579::TaskManager.Task::(_updateState) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::moving from state preparing -> state finished
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2907::DEBUG::2014-04-10 17:41:52,954::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2907::DEBUG::2014-04-10 17:41:52,955::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2907::DEBUG::2014-04-10 17:41:52,955::task::974::TaskManager.Task::(_decref) Task=`47f86015-2658-4128-bb02-a2b0358b4648`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:41:55,748::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:41:55,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000427731 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:41:55,905::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:41:55,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279049 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:41:56,183::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:41:56,199::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:41:56,200::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:41:56,205::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:41:56,207::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:41:56,207::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:41:56,207::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:41:56,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:41:56,219::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493923 s, 745 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:41:56,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:41:56,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410517 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2913::DEBUG::2014-04-10 17:41:56,896::task::579::TaskManager.Task::(_updateState) Task=`c147415e-b0ee-48e7-9241-6f0a90d7bfcb`::moving from state init -> state preparing
>Thread-2913::INFO::2014-04-10 17:41:56,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2913::INFO::2014-04-10 17:41:56,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410517', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427731', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279049', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493923', 'lastCheck': '0.7', 'valid': True}}
>Thread-2913::DEBUG::2014-04-10 17:41:56,897::task::1168::TaskManager.Task::(prepare) Task=`c147415e-b0ee-48e7-9241-6f0a90d7bfcb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410517', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427731', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279049', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493923', 'lastCheck': '0.7', 'valid': True}}
>Thread-2913::DEBUG::2014-04-10 17:41:56,897::task::579::TaskManager.Task::(_updateState) Task=`c147415e-b0ee-48e7-9241-6f0a90d7bfcb`::moving from state preparing -> state finished
>Thread-2913::DEBUG::2014-04-10 17:41:56,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2913::DEBUG::2014-04-10 17:41:56,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2913::DEBUG::2014-04-10 17:41:56,897::task::974::TaskManager.Task::(_decref) Task=`c147415e-b0ee-48e7-9241-6f0a90d7bfcb`::ref 0 aborting False
>Thread-2916::DEBUG::2014-04-10 17:42:03,023::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-2916::DEBUG::2014-04-10 17:42:03,024::task::579::TaskManager.Task::(_updateState) Task=`734ad0de-f49f-4bb8-83a1-f7c1d6e59591`::moving from state init -> state preparing
>Thread-2916::INFO::2014-04-10 17:42:03,024::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2916::INFO::2014-04-10 17:42:03,025::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2916::DEBUG::2014-04-10 17:42:03,025::task::1168::TaskManager.Task::(prepare) Task=`734ad0de-f49f-4bb8-83a1-f7c1d6e59591`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2916::DEBUG::2014-04-10 17:42:03,025::task::579::TaskManager.Task::(_updateState) Task=`734ad0de-f49f-4bb8-83a1-f7c1d6e59591`::moving from state preparing -> state finished
>Thread-2916::DEBUG::2014-04-10 17:42:03,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2916::DEBUG::2014-04-10 17:42:03,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2916::DEBUG::2014-04-10 17:42:03,029::task::974::TaskManager.Task::(_decref) Task=`734ad0de-f49f-4bb8-83a1-f7c1d6e59591`::ref 0 aborting False
>Thread-2918::DEBUG::2014-04-10 17:42:03,036::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-2918::DEBUG::2014-04-10 17:42:03,036::task::579::TaskManager.Task::(_updateState) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::moving from state init -> state preparing
>Thread-2918::INFO::2014-04-10 17:42:03,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2918::DEBUG::2014-04-10 17:42:03,037::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`773a1f14-3c36-4153-8533-8bdd84e10ad5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2918::DEBUG::2014-04-10 17:42:03,037::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2918::DEBUG::2014-04-10 17:42:03,037::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2918::DEBUG::2014-04-10 17:42:03,037::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`773a1f14-3c36-4153-8533-8bdd84e10ad5`::Granted request
>Thread-2918::DEBUG::2014-04-10 17:42:03,038::task::811::TaskManager.Task::(resourceAcquired) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2918::DEBUG::2014-04-10 17:42:03,038::task::974::TaskManager.Task::(_decref) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::ref 1 aborting False
>Thread-2918::INFO::2014-04-10 17:42:03,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2918::DEBUG::2014-04-10 17:42:03,040::task::1168::TaskManager.Task::(prepare) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2918::DEBUG::2014-04-10 17:42:03,040::task::579::TaskManager.Task::(_updateState) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::moving from state preparing -> state finished
>Thread-2918::DEBUG::2014-04-10 17:42:03,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2918::DEBUG::2014-04-10 17:42:03,041::task::974::TaskManager.Task::(_decref) Task=`e240b619-a10c-49f7-a7db-45f10fa575a3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:05,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:05,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346921 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:05,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:05,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377575 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:06,227::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:06,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00046395 s, 793 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:06,288::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:06,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000425063 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2921::DEBUG::2014-04-10 17:42:12,086::task::579::TaskManager.Task::(_updateState) Task=`4564eb9e-af1f-44c4-acc2-c92154b16adc`::moving from state init -> state preparing
>Thread-2921::INFO::2014-04-10 17:42:12,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2921::INFO::2014-04-10 17:42:12,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425063', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346921', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377575', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046395', 'lastCheck': '5.9', 'valid': True}}
>Thread-2921::DEBUG::2014-04-10 17:42:12,087::task::1168::TaskManager.Task::(prepare) Task=`4564eb9e-af1f-44c4-acc2-c92154b16adc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425063', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346921', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377575', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046395', 'lastCheck': '5.9', 'valid': True}}
>Thread-2921::DEBUG::2014-04-10 17:42:12,087::task::579::TaskManager.Task::(_updateState) Task=`4564eb9e-af1f-44c4-acc2-c92154b16adc`::moving from state preparing -> state finished
>Thread-2921::DEBUG::2014-04-10 17:42:12,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2921::DEBUG::2014-04-10 17:42:12,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2921::DEBUG::2014-04-10 17:42:12,088::task::974::TaskManager.Task::(_decref) Task=`4564eb9e-af1f-44c4-acc2-c92154b16adc`::ref 0 aborting False
>Thread-2923::DEBUG::2014-04-10 17:42:13,121::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2923::DEBUG::2014-04-10 17:42:13,122::task::579::TaskManager.Task::(_updateState) Task=`555a634c-99c0-4aeb-8af8-c6fc11c3425d`::moving from state init -> state preparing
>Thread-2923::INFO::2014-04-10 17:42:13,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2923::INFO::2014-04-10 17:42:13,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2923::DEBUG::2014-04-10 17:42:13,122::task::1168::TaskManager.Task::(prepare) Task=`555a634c-99c0-4aeb-8af8-c6fc11c3425d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2923::DEBUG::2014-04-10 17:42:13,122::task::579::TaskManager.Task::(_updateState) Task=`555a634c-99c0-4aeb-8af8-c6fc11c3425d`::moving from state preparing -> state finished
>Thread-2923::DEBUG::2014-04-10 17:42:13,123::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2923::DEBUG::2014-04-10 17:42:13,123::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2923::DEBUG::2014-04-10 17:42:13,123::task::974::TaskManager.Task::(_decref) Task=`555a634c-99c0-4aeb-8af8-c6fc11c3425d`::ref 0 aborting False
>Thread-2924::DEBUG::2014-04-10 17:42:13,129::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2924::DEBUG::2014-04-10 17:42:13,130::task::579::TaskManager.Task::(_updateState) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::moving from state init -> state preparing
>Thread-2924::INFO::2014-04-10 17:42:13,130::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2924::DEBUG::2014-04-10 17:42:13,130::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7617947-525d-4d6c-b77d-47977db8a9d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2924::DEBUG::2014-04-10 17:42:13,130::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2924::DEBUG::2014-04-10 17:42:13,131::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2924::DEBUG::2014-04-10 17:42:13,131::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7617947-525d-4d6c-b77d-47977db8a9d9`::Granted request
>Thread-2924::DEBUG::2014-04-10 17:42:13,131::task::811::TaskManager.Task::(resourceAcquired) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2924::DEBUG::2014-04-10 17:42:13,131::task::974::TaskManager.Task::(_decref) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::ref 1 aborting False
>Thread-2924::INFO::2014-04-10 17:42:13,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2924::DEBUG::2014-04-10 17:42:13,133::task::1168::TaskManager.Task::(prepare) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2924::DEBUG::2014-04-10 17:42:13,133::task::579::TaskManager.Task::(_updateState) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::moving from state preparing -> state finished
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2924::DEBUG::2014-04-10 17:42:13,134::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2924::DEBUG::2014-04-10 17:42:13,135::task::974::TaskManager.Task::(_decref) Task=`9af43317-e82a-4896-a5b7-c7e31a143f42`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:15,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:15,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278888 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:15,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:15,937::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333154 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:16,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:16,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485292 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:16,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:16,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0003501 s, 1.9 MB/s\n'; <rc> = 0
>Thread-2928::DEBUG::2014-04-10 17:42:23,210::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2928::DEBUG::2014-04-10 17:42:23,225::task::579::TaskManager.Task::(_updateState) Task=`dc6f303a-dbf7-4163-be3b-37284d8408ba`::moving from state init -> state preparing
>Thread-2928::INFO::2014-04-10 17:42:23,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2928::INFO::2014-04-10 17:42:23,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2928::DEBUG::2014-04-10 17:42:23,226::task::1168::TaskManager.Task::(prepare) Task=`dc6f303a-dbf7-4163-be3b-37284d8408ba`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2928::DEBUG::2014-04-10 17:42:23,226::task::579::TaskManager.Task::(_updateState) Task=`dc6f303a-dbf7-4163-be3b-37284d8408ba`::moving from state preparing -> state finished
>Thread-2928::DEBUG::2014-04-10 17:42:23,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2928::DEBUG::2014-04-10 17:42:23,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2928::DEBUG::2014-04-10 17:42:23,226::task::974::TaskManager.Task::(_decref) Task=`dc6f303a-dbf7-4163-be3b-37284d8408ba`::ref 0 aborting False
>Thread-2929::DEBUG::2014-04-10 17:42:23,233::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2929::DEBUG::2014-04-10 17:42:23,234::task::579::TaskManager.Task::(_updateState) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::moving from state init -> state preparing
>Thread-2929::INFO::2014-04-10 17:42:23,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2929::DEBUG::2014-04-10 17:42:23,234::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2b2dba9e-e68b-4aca-a71d-b907932681c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2929::DEBUG::2014-04-10 17:42:23,234::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2929::DEBUG::2014-04-10 17:42:23,235::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2929::DEBUG::2014-04-10 17:42:23,235::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2b2dba9e-e68b-4aca-a71d-b907932681c1`::Granted request
>Thread-2929::DEBUG::2014-04-10 17:42:23,235::task::811::TaskManager.Task::(resourceAcquired) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2929::DEBUG::2014-04-10 17:42:23,235::task::974::TaskManager.Task::(_decref) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::ref 1 aborting False
>Thread-2929::INFO::2014-04-10 17:42:23,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2929::DEBUG::2014-04-10 17:42:23,237::task::1168::TaskManager.Task::(prepare) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::task::579::TaskManager.Task::(_updateState) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::moving from state preparing -> state finished
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2929::DEBUG::2014-04-10 17:42:23,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2929::DEBUG::2014-04-10 17:42:23,239::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2929::DEBUG::2014-04-10 17:42:23,239::task::974::TaskManager.Task::(_decref) Task=`60783a44-f82e-4abc-8930-cfd013e353d2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:25,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:25,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361805 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:25,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:25,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325731 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:26,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:26,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000422631 s, 871 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:26,341::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:26,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494614 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2931::DEBUG::2014-04-10 17:42:27,339::task::579::TaskManager.Task::(_updateState) Task=`52543788-4376-4630-b87c-5a3c037e056c`::moving from state init -> state preparing
>Thread-2931::INFO::2014-04-10 17:42:27,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2931::INFO::2014-04-10 17:42:27,339::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494614', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361805', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325731', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422631', 'lastCheck': '1.1', 'valid': True}}
>Thread-2931::DEBUG::2014-04-10 17:42:27,340::task::1168::TaskManager.Task::(prepare) Task=`52543788-4376-4630-b87c-5a3c037e056c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494614', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361805', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325731', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422631', 'lastCheck': '1.1', 'valid': True}}
>Thread-2931::DEBUG::2014-04-10 17:42:27,340::task::579::TaskManager.Task::(_updateState) Task=`52543788-4376-4630-b87c-5a3c037e056c`::moving from state preparing -> state finished
>Thread-2931::DEBUG::2014-04-10 17:42:27,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2931::DEBUG::2014-04-10 17:42:27,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2931::DEBUG::2014-04-10 17:42:27,340::task::974::TaskManager.Task::(_decref) Task=`52543788-4376-4630-b87c-5a3c037e056c`::ref 0 aborting False
>Thread-2934::DEBUG::2014-04-10 17:42:33,368::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2934::DEBUG::2014-04-10 17:42:33,369::task::579::TaskManager.Task::(_updateState) Task=`36f2f582-199b-48cb-9b78-6cd9e1184d2e`::moving from state init -> state preparing
>Thread-2934::INFO::2014-04-10 17:42:33,369::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2934::INFO::2014-04-10 17:42:33,369::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2934::DEBUG::2014-04-10 17:42:33,369::task::1168::TaskManager.Task::(prepare) Task=`36f2f582-199b-48cb-9b78-6cd9e1184d2e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2934::DEBUG::2014-04-10 17:42:33,370::task::579::TaskManager.Task::(_updateState) Task=`36f2f582-199b-48cb-9b78-6cd9e1184d2e`::moving from state preparing -> state finished
>Thread-2934::DEBUG::2014-04-10 17:42:33,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2934::DEBUG::2014-04-10 17:42:33,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2934::DEBUG::2014-04-10 17:42:33,370::task::974::TaskManager.Task::(_decref) Task=`36f2f582-199b-48cb-9b78-6cd9e1184d2e`::ref 0 aborting False
>Thread-2935::DEBUG::2014-04-10 17:42:33,377::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2935::DEBUG::2014-04-10 17:42:33,377::task::579::TaskManager.Task::(_updateState) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::moving from state init -> state preparing
>Thread-2935::INFO::2014-04-10 17:42:33,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2935::DEBUG::2014-04-10 17:42:33,378::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`09eee9ef-7464-4352-b5d7-b2fa1b63ec6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2935::DEBUG::2014-04-10 17:42:33,378::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2935::DEBUG::2014-04-10 17:42:33,378::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2935::DEBUG::2014-04-10 17:42:33,379::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`09eee9ef-7464-4352-b5d7-b2fa1b63ec6f`::Granted request
>Thread-2935::DEBUG::2014-04-10 17:42:33,379::task::811::TaskManager.Task::(resourceAcquired) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2935::DEBUG::2014-04-10 17:42:33,379::task::974::TaskManager.Task::(_decref) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::ref 1 aborting False
>Thread-2935::INFO::2014-04-10 17:42:33,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2935::DEBUG::2014-04-10 17:42:33,381::task::1168::TaskManager.Task::(prepare) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2935::DEBUG::2014-04-10 17:42:33,381::task::579::TaskManager.Task::(_updateState) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::moving from state preparing -> state finished
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2935::DEBUG::2014-04-10 17:42:33,382::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2935::DEBUG::2014-04-10 17:42:33,383::task::974::TaskManager.Task::(_decref) Task=`a4bde484-b4b2-4100-ada3-422541e50e2e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:35,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:35,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361108 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:35,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:35,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266671 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:36,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:36,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470889 s, 782 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:36,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:36,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000399574 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2939::DEBUG::2014-04-10 17:42:42,516::task::579::TaskManager.Task::(_updateState) Task=`f0e6c047-15de-47c8-a186-530ecc169c7f`::moving from state init -> state preparing
>Thread-2939::INFO::2014-04-10 17:42:42,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2939::INFO::2014-04-10 17:42:42,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399574', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361108', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266671', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470889', 'lastCheck': '6.2', 'valid': True}}
>Thread-2939::DEBUG::2014-04-10 17:42:42,517::task::1168::TaskManager.Task::(prepare) Task=`f0e6c047-15de-47c8-a186-530ecc169c7f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399574', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361108', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266671', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470889', 'lastCheck': '6.2', 'valid': True}}
>Thread-2939::DEBUG::2014-04-10 17:42:42,517::task::579::TaskManager.Task::(_updateState) Task=`f0e6c047-15de-47c8-a186-530ecc169c7f`::moving from state preparing -> state finished
>Thread-2939::DEBUG::2014-04-10 17:42:42,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2939::DEBUG::2014-04-10 17:42:42,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2939::DEBUG::2014-04-10 17:42:42,518::task::974::TaskManager.Task::(_decref) Task=`f0e6c047-15de-47c8-a186-530ecc169c7f`::ref 0 aborting False
>Thread-2941::DEBUG::2014-04-10 17:42:43,475::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2941::DEBUG::2014-04-10 17:42:43,475::task::579::TaskManager.Task::(_updateState) Task=`e608d299-d3df-4885-87fe-53a4fba6f752`::moving from state init -> state preparing
>Thread-2941::INFO::2014-04-10 17:42:43,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2941::INFO::2014-04-10 17:42:43,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2941::DEBUG::2014-04-10 17:42:43,476::task::1168::TaskManager.Task::(prepare) Task=`e608d299-d3df-4885-87fe-53a4fba6f752`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2941::DEBUG::2014-04-10 17:42:43,476::task::579::TaskManager.Task::(_updateState) Task=`e608d299-d3df-4885-87fe-53a4fba6f752`::moving from state preparing -> state finished
>Thread-2941::DEBUG::2014-04-10 17:42:43,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2941::DEBUG::2014-04-10 17:42:43,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2941::DEBUG::2014-04-10 17:42:43,477::task::974::TaskManager.Task::(_decref) Task=`e608d299-d3df-4885-87fe-53a4fba6f752`::ref 0 aborting False
>Thread-2942::DEBUG::2014-04-10 17:42:43,483::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2942::DEBUG::2014-04-10 17:42:43,484::task::579::TaskManager.Task::(_updateState) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::moving from state init -> state preparing
>Thread-2942::INFO::2014-04-10 17:42:43,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2942::DEBUG::2014-04-10 17:42:43,484::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`626e1025-30c4-4715-8344-e08254de27b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2942::DEBUG::2014-04-10 17:42:43,484::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2942::DEBUG::2014-04-10 17:42:43,485::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2942::DEBUG::2014-04-10 17:42:43,485::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`626e1025-30c4-4715-8344-e08254de27b8`::Granted request
>Thread-2942::DEBUG::2014-04-10 17:42:43,485::task::811::TaskManager.Task::(resourceAcquired) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2942::DEBUG::2014-04-10 17:42:43,485::task::974::TaskManager.Task::(_decref) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::ref 1 aborting False
>Thread-2942::INFO::2014-04-10 17:42:43,487::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2942::DEBUG::2014-04-10 17:42:43,487::task::1168::TaskManager.Task::(prepare) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::task::579::TaskManager.Task::(_updateState) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::moving from state preparing -> state finished
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2942::DEBUG::2014-04-10 17:42:43,488::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2942::DEBUG::2014-04-10 17:42:43,489::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2942::DEBUG::2014-04-10 17:42:43,489::task::974::TaskManager.Task::(_decref) Task=`68a99992-bf1d-4c97-83f9-dfdb34daf48b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:45,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:45,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289158 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:45,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:45,977::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317638 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:46,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:46,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000531972 s, 692 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:46,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:46,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00038619 s, 1.7 MB/s\n'; <rc> = 0
>Thread-2946::DEBUG::2014-04-10 17:42:53,557::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-2946::DEBUG::2014-04-10 17:42:53,558::task::579::TaskManager.Task::(_updateState) Task=`f0f2814f-5717-492f-bd8a-853795d0c7e8`::moving from state init -> state preparing
>Thread-2946::INFO::2014-04-10 17:42:53,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2946::INFO::2014-04-10 17:42:53,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2946::DEBUG::2014-04-10 17:42:53,559::task::1168::TaskManager.Task::(prepare) Task=`f0f2814f-5717-492f-bd8a-853795d0c7e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2946::DEBUG::2014-04-10 17:42:53,559::task::579::TaskManager.Task::(_updateState) Task=`f0f2814f-5717-492f-bd8a-853795d0c7e8`::moving from state preparing -> state finished
>Thread-2946::DEBUG::2014-04-10 17:42:53,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2946::DEBUG::2014-04-10 17:42:53,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2946::DEBUG::2014-04-10 17:42:53,559::task::974::TaskManager.Task::(_decref) Task=`f0f2814f-5717-492f-bd8a-853795d0c7e8`::ref 0 aborting False
>Thread-2947::DEBUG::2014-04-10 17:42:53,565::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-2947::DEBUG::2014-04-10 17:42:53,566::task::579::TaskManager.Task::(_updateState) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::moving from state init -> state preparing
>Thread-2947::INFO::2014-04-10 17:42:53,566::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2947::DEBUG::2014-04-10 17:42:53,566::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9197f5a-c806-46fa-a061-a04ff955e86a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2947::DEBUG::2014-04-10 17:42:53,566::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2947::DEBUG::2014-04-10 17:42:53,567::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2947::DEBUG::2014-04-10 17:42:53,567::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9197f5a-c806-46fa-a061-a04ff955e86a`::Granted request
>Thread-2947::DEBUG::2014-04-10 17:42:53,567::task::811::TaskManager.Task::(resourceAcquired) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2947::DEBUG::2014-04-10 17:42:53,567::task::974::TaskManager.Task::(_decref) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::ref 1 aborting False
>Thread-2947::INFO::2014-04-10 17:42:53,569::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2947::DEBUG::2014-04-10 17:42:53,569::task::1168::TaskManager.Task::(prepare) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::task::579::TaskManager.Task::(_updateState) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::moving from state preparing -> state finished
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2947::DEBUG::2014-04-10 17:42:53,570::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2947::DEBUG::2014-04-10 17:42:53,571::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2947::DEBUG::2014-04-10 17:42:53,571::task::974::TaskManager.Task::(_decref) Task=`e8590c7b-19db-49a7-83d9-1773d023f783`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:42:55,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:42:55,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313539 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:42:55,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:42:55,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025411 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:42:56,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:42:56,297::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000460171 s, 800 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:42:56,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:42:56,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000504579 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2949::DEBUG::2014-04-10 17:42:57,685::task::579::TaskManager.Task::(_updateState) Task=`63366988-1cf5-4819-a929-1d939a90695d`::moving from state init -> state preparing
>Thread-2949::INFO::2014-04-10 17:42:57,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2949::INFO::2014-04-10 17:42:57,686::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504579', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313539', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025411', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460171', 'lastCheck': '1.4', 'valid': True}}
>Thread-2949::DEBUG::2014-04-10 17:42:57,686::task::1168::TaskManager.Task::(prepare) Task=`63366988-1cf5-4819-a929-1d939a90695d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504579', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313539', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025411', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460171', 'lastCheck': '1.4', 'valid': True}}
>Thread-2949::DEBUG::2014-04-10 17:42:57,686::task::579::TaskManager.Task::(_updateState) Task=`63366988-1cf5-4819-a929-1d939a90695d`::moving from state preparing -> state finished
>Thread-2949::DEBUG::2014-04-10 17:42:57,687::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2949::DEBUG::2014-04-10 17:42:57,687::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2949::DEBUG::2014-04-10 17:42:57,687::task::974::TaskManager.Task::(_decref) Task=`63366988-1cf5-4819-a929-1d939a90695d`::ref 0 aborting False
>Thread-2952::DEBUG::2014-04-10 17:43:03,732::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2952::DEBUG::2014-04-10 17:43:03,733::task::579::TaskManager.Task::(_updateState) Task=`cef92b7b-61f6-4f0a-9537-ad29a149645e`::moving from state init -> state preparing
>Thread-2952::INFO::2014-04-10 17:43:03,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2952::INFO::2014-04-10 17:43:03,733::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2952::DEBUG::2014-04-10 17:43:03,734::task::1168::TaskManager.Task::(prepare) Task=`cef92b7b-61f6-4f0a-9537-ad29a149645e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2952::DEBUG::2014-04-10 17:43:03,734::task::579::TaskManager.Task::(_updateState) Task=`cef92b7b-61f6-4f0a-9537-ad29a149645e`::moving from state preparing -> state finished
>Thread-2952::DEBUG::2014-04-10 17:43:03,734::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2952::DEBUG::2014-04-10 17:43:03,734::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2952::DEBUG::2014-04-10 17:43:03,734::task::974::TaskManager.Task::(_decref) Task=`cef92b7b-61f6-4f0a-9537-ad29a149645e`::ref 0 aborting False
>Thread-2953::DEBUG::2014-04-10 17:43:03,740::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2953::DEBUG::2014-04-10 17:43:03,741::task::579::TaskManager.Task::(_updateState) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::moving from state init -> state preparing
>Thread-2953::INFO::2014-04-10 17:43:03,741::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2953::DEBUG::2014-04-10 17:43:03,741::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e8c9465b-ed7d-4eb2-b2ff-0f0dc52a82e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2953::DEBUG::2014-04-10 17:43:03,741::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2953::DEBUG::2014-04-10 17:43:03,742::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2953::DEBUG::2014-04-10 17:43:03,742::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e8c9465b-ed7d-4eb2-b2ff-0f0dc52a82e3`::Granted request
>Thread-2953::DEBUG::2014-04-10 17:43:03,742::task::811::TaskManager.Task::(resourceAcquired) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2953::DEBUG::2014-04-10 17:43:03,742::task::974::TaskManager.Task::(_decref) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::ref 1 aborting False
>Thread-2953::INFO::2014-04-10 17:43:03,744::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2953::DEBUG::2014-04-10 17:43:03,744::task::1168::TaskManager.Task::(prepare) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2953::DEBUG::2014-04-10 17:43:03,744::task::579::TaskManager.Task::(_updateState) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::moving from state preparing -> state finished
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2953::DEBUG::2014-04-10 17:43:03,745::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2953::DEBUG::2014-04-10 17:43:03,746::task::974::TaskManager.Task::(_decref) Task=`6cd70f8b-7e7d-4264-af38-c0bfa36a6840`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:05,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:05,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300113 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:05,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:06,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000401541 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:06,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:06,310::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000410982 s, 895 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:06,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:06,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000412498 s, 1.6 MB/s\n'; <rc> = 0
>Thread-2957::DEBUG::2014-04-10 17:43:12,866::task::579::TaskManager.Task::(_updateState) Task=`85859c5a-0387-4835-9e46-b7255b884104`::moving from state init -> state preparing
>Thread-2957::INFO::2014-04-10 17:43:12,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2957::INFO::2014-04-10 17:43:12,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412498', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300113', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401541', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410982', 'lastCheck': '6.6', 'valid': True}}
>Thread-2957::DEBUG::2014-04-10 17:43:12,867::task::1168::TaskManager.Task::(prepare) Task=`85859c5a-0387-4835-9e46-b7255b884104`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412498', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300113', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401541', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410982', 'lastCheck': '6.6', 'valid': True}}
>Thread-2957::DEBUG::2014-04-10 17:43:12,867::task::579::TaskManager.Task::(_updateState) Task=`85859c5a-0387-4835-9e46-b7255b884104`::moving from state preparing -> state finished
>Thread-2957::DEBUG::2014-04-10 17:43:12,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2957::DEBUG::2014-04-10 17:43:12,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2957::DEBUG::2014-04-10 17:43:12,868::task::974::TaskManager.Task::(_decref) Task=`85859c5a-0387-4835-9e46-b7255b884104`::ref 0 aborting False
>Thread-2959::DEBUG::2014-04-10 17:43:13,829::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2959::DEBUG::2014-04-10 17:43:13,829::task::579::TaskManager.Task::(_updateState) Task=`b5b0ac2e-0219-4b03-ad2f-9e415e68750d`::moving from state init -> state preparing
>Thread-2959::INFO::2014-04-10 17:43:13,829::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2959::INFO::2014-04-10 17:43:13,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2959::DEBUG::2014-04-10 17:43:13,830::task::1168::TaskManager.Task::(prepare) Task=`b5b0ac2e-0219-4b03-ad2f-9e415e68750d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2959::DEBUG::2014-04-10 17:43:13,830::task::579::TaskManager.Task::(_updateState) Task=`b5b0ac2e-0219-4b03-ad2f-9e415e68750d`::moving from state preparing -> state finished
>Thread-2959::DEBUG::2014-04-10 17:43:13,830::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2959::DEBUG::2014-04-10 17:43:13,830::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2959::DEBUG::2014-04-10 17:43:13,831::task::974::TaskManager.Task::(_decref) Task=`b5b0ac2e-0219-4b03-ad2f-9e415e68750d`::ref 0 aborting False
>Thread-2960::DEBUG::2014-04-10 17:43:13,837::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2960::DEBUG::2014-04-10 17:43:13,837::task::579::TaskManager.Task::(_updateState) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::moving from state init -> state preparing
>Thread-2960::INFO::2014-04-10 17:43:13,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2960::DEBUG::2014-04-10 17:43:13,838::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`986a24cd-56df-47bc-958b-298c0dc82734`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2960::DEBUG::2014-04-10 17:43:13,838::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2960::DEBUG::2014-04-10 17:43:13,838::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2960::DEBUG::2014-04-10 17:43:13,838::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`986a24cd-56df-47bc-958b-298c0dc82734`::Granted request
>Thread-2960::DEBUG::2014-04-10 17:43:13,839::task::811::TaskManager.Task::(resourceAcquired) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2960::DEBUG::2014-04-10 17:43:13,839::task::974::TaskManager.Task::(_decref) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::ref 1 aborting False
>Thread-2960::INFO::2014-04-10 17:43:13,841::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2960::DEBUG::2014-04-10 17:43:13,841::task::1168::TaskManager.Task::(prepare) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2960::DEBUG::2014-04-10 17:43:13,841::task::579::TaskManager.Task::(_updateState) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::moving from state preparing -> state finished
>Thread-2960::DEBUG::2014-04-10 17:43:13,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2960::DEBUG::2014-04-10 17:43:13,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2960::DEBUG::2014-04-10 17:43:13,841::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2960::DEBUG::2014-04-10 17:43:13,842::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2960::DEBUG::2014-04-10 17:43:13,842::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2960::DEBUG::2014-04-10 17:43:13,842::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2960::DEBUG::2014-04-10 17:43:13,842::task::974::TaskManager.Task::(_decref) Task=`8a6f3bf4-6697-4520-ad15-486508dad4a0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:15,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:15,871::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333241 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:16,012::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:16,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00039503 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:16,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:16,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000462602 s, 796 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:16,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:16,464::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000456954 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2964::DEBUG::2014-04-10 17:43:24,010::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2964::DEBUG::2014-04-10 17:43:24,021::task::579::TaskManager.Task::(_updateState) Task=`1f39223f-e506-4ed4-b69e-fed1532d564e`::moving from state init -> state preparing
>Thread-2964::INFO::2014-04-10 17:43:24,021::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2964::INFO::2014-04-10 17:43:24,021::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2964::DEBUG::2014-04-10 17:43:24,021::task::1168::TaskManager.Task::(prepare) Task=`1f39223f-e506-4ed4-b69e-fed1532d564e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2964::DEBUG::2014-04-10 17:43:24,022::task::579::TaskManager.Task::(_updateState) Task=`1f39223f-e506-4ed4-b69e-fed1532d564e`::moving from state preparing -> state finished
>Thread-2964::DEBUG::2014-04-10 17:43:24,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2964::DEBUG::2014-04-10 17:43:24,022::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2964::DEBUG::2014-04-10 17:43:24,022::task::974::TaskManager.Task::(_decref) Task=`1f39223f-e506-4ed4-b69e-fed1532d564e`::ref 0 aborting False
>Thread-2965::DEBUG::2014-04-10 17:43:24,028::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2965::DEBUG::2014-04-10 17:43:24,028::task::579::TaskManager.Task::(_updateState) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::moving from state init -> state preparing
>Thread-2965::INFO::2014-04-10 17:43:24,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2965::DEBUG::2014-04-10 17:43:24,030::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1bbbb29-655c-45f7-85ee-eca55686b02e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2965::DEBUG::2014-04-10 17:43:24,030::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2965::DEBUG::2014-04-10 17:43:24,031::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2965::DEBUG::2014-04-10 17:43:24,031::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1bbbb29-655c-45f7-85ee-eca55686b02e`::Granted request
>Thread-2965::DEBUG::2014-04-10 17:43:24,031::task::811::TaskManager.Task::(resourceAcquired) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2965::DEBUG::2014-04-10 17:43:24,031::task::974::TaskManager.Task::(_decref) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::ref 1 aborting False
>Thread-2965::INFO::2014-04-10 17:43:24,033::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2965::DEBUG::2014-04-10 17:43:24,033::task::1168::TaskManager.Task::(prepare) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2965::DEBUG::2014-04-10 17:43:24,033::task::579::TaskManager.Task::(_updateState) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::moving from state preparing -> state finished
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2965::DEBUG::2014-04-10 17:43:24,034::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2965::DEBUG::2014-04-10 17:43:24,035::task::974::TaskManager.Task::(_decref) Task=`ea0e02b0-a4bf-4c51-a4fb-3bbe4f5f0f31`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:25,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:25,885::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324989 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:26,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:26,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381926 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:26,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:26,338::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0005334 s, 690 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:26,469::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:43:26,493::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:43:26,494::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:43:26,500::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:43:26,501::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:43:26,502::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:43:26,502::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:43:26,507::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:26,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000463749 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2971::DEBUG::2014-04-10 17:43:28,033::task::579::TaskManager.Task::(_updateState) Task=`20b9bd96-835a-4b52-93f8-78176adddf35`::moving from state init -> state preparing
>Thread-2971::INFO::2014-04-10 17:43:28,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2971::INFO::2014-04-10 17:43:28,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463749', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324989', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381926', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005334', 'lastCheck': '1.7', 'valid': True}}
>Thread-2971::DEBUG::2014-04-10 17:43:28,034::task::1168::TaskManager.Task::(prepare) Task=`20b9bd96-835a-4b52-93f8-78176adddf35`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463749', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324989', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381926', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005334', 'lastCheck': '1.7', 'valid': True}}
>Thread-2971::DEBUG::2014-04-10 17:43:28,034::task::579::TaskManager.Task::(_updateState) Task=`20b9bd96-835a-4b52-93f8-78176adddf35`::moving from state preparing -> state finished
>Thread-2971::DEBUG::2014-04-10 17:43:28,034::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2971::DEBUG::2014-04-10 17:43:28,034::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2971::DEBUG::2014-04-10 17:43:28,035::task::974::TaskManager.Task::(_decref) Task=`20b9bd96-835a-4b52-93f8-78176adddf35`::ref 0 aborting False
>Thread-2974::DEBUG::2014-04-10 17:43:34,108::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2974::DEBUG::2014-04-10 17:43:34,108::task::579::TaskManager.Task::(_updateState) Task=`5810ac89-45a7-4414-9580-863cf86ddfd6`::moving from state init -> state preparing
>Thread-2974::INFO::2014-04-10 17:43:34,108::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2974::INFO::2014-04-10 17:43:34,109::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2974::DEBUG::2014-04-10 17:43:34,109::task::1168::TaskManager.Task::(prepare) Task=`5810ac89-45a7-4414-9580-863cf86ddfd6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2974::DEBUG::2014-04-10 17:43:34,109::task::579::TaskManager.Task::(_updateState) Task=`5810ac89-45a7-4414-9580-863cf86ddfd6`::moving from state preparing -> state finished
>Thread-2974::DEBUG::2014-04-10 17:43:34,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2974::DEBUG::2014-04-10 17:43:34,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2974::DEBUG::2014-04-10 17:43:34,110::task::974::TaskManager.Task::(_decref) Task=`5810ac89-45a7-4414-9580-863cf86ddfd6`::ref 0 aborting False
>Thread-2975::DEBUG::2014-04-10 17:43:34,116::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2975::DEBUG::2014-04-10 17:43:34,116::task::579::TaskManager.Task::(_updateState) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::moving from state init -> state preparing
>Thread-2975::INFO::2014-04-10 17:43:34,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2975::DEBUG::2014-04-10 17:43:34,117::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb85db69-02ef-470d-a41f-a1725cc3e8f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2975::DEBUG::2014-04-10 17:43:34,117::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2975::DEBUG::2014-04-10 17:43:34,117::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2975::DEBUG::2014-04-10 17:43:34,117::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb85db69-02ef-470d-a41f-a1725cc3e8f7`::Granted request
>Thread-2975::DEBUG::2014-04-10 17:43:34,118::task::811::TaskManager.Task::(resourceAcquired) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2975::DEBUG::2014-04-10 17:43:34,118::task::974::TaskManager.Task::(_decref) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::ref 1 aborting False
>Thread-2975::INFO::2014-04-10 17:43:34,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2975::DEBUG::2014-04-10 17:43:34,120::task::1168::TaskManager.Task::(prepare) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2975::DEBUG::2014-04-10 17:43:34,120::task::579::TaskManager.Task::(_updateState) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::moving from state preparing -> state finished
>Thread-2975::DEBUG::2014-04-10 17:43:34,120::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2975::DEBUG::2014-04-10 17:43:34,121::task::974::TaskManager.Task::(_decref) Task=`1403bb79-2a9d-49bf-9604-a4cf256c5bc0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:35,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:35,899::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319467 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:36,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:36,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359525 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:36,345::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:36,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000406368 s, 906 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:36,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:36,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000490982 s, 1.3 MB/s\n'; <rc> = 0
>Thread-2979::DEBUG::2014-04-10 17:43:43,209::task::579::TaskManager.Task::(_updateState) Task=`d26210fd-edc0-48d8-ad5d-54a66ad426bc`::moving from state init -> state preparing
>Thread-2979::INFO::2014-04-10 17:43:43,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2979::INFO::2014-04-10 17:43:43,210::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490982', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319467', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359525', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406368', 'lastCheck': '6.9', 'valid': True}}
>Thread-2979::DEBUG::2014-04-10 17:43:43,210::task::1168::TaskManager.Task::(prepare) Task=`d26210fd-edc0-48d8-ad5d-54a66ad426bc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490982', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319467', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359525', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406368', 'lastCheck': '6.9', 'valid': True}}
>Thread-2979::DEBUG::2014-04-10 17:43:43,211::task::579::TaskManager.Task::(_updateState) Task=`d26210fd-edc0-48d8-ad5d-54a66ad426bc`::moving from state preparing -> state finished
>Thread-2979::DEBUG::2014-04-10 17:43:43,211::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2979::DEBUG::2014-04-10 17:43:43,211::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2979::DEBUG::2014-04-10 17:43:43,211::task::974::TaskManager.Task::(_decref) Task=`d26210fd-edc0-48d8-ad5d-54a66ad426bc`::ref 0 aborting False
>Thread-2981::DEBUG::2014-04-10 17:43:44,200::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2981::DEBUG::2014-04-10 17:43:44,200::task::579::TaskManager.Task::(_updateState) Task=`d8b5aa75-cb88-4e2f-ab91-ed0bb352766e`::moving from state init -> state preparing
>Thread-2981::INFO::2014-04-10 17:43:44,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2981::INFO::2014-04-10 17:43:44,201::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2981::DEBUG::2014-04-10 17:43:44,201::task::1168::TaskManager.Task::(prepare) Task=`d8b5aa75-cb88-4e2f-ab91-ed0bb352766e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2981::DEBUG::2014-04-10 17:43:44,201::task::579::TaskManager.Task::(_updateState) Task=`d8b5aa75-cb88-4e2f-ab91-ed0bb352766e`::moving from state preparing -> state finished
>Thread-2981::DEBUG::2014-04-10 17:43:44,201::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2981::DEBUG::2014-04-10 17:43:44,201::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2981::DEBUG::2014-04-10 17:43:44,202::task::974::TaskManager.Task::(_decref) Task=`d8b5aa75-cb88-4e2f-ab91-ed0bb352766e`::ref 0 aborting False
>Thread-2982::DEBUG::2014-04-10 17:43:44,208::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-2982::DEBUG::2014-04-10 17:43:44,208::task::579::TaskManager.Task::(_updateState) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::moving from state init -> state preparing
>Thread-2982::INFO::2014-04-10 17:43:44,209::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2982::DEBUG::2014-04-10 17:43:44,209::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a36659ab-73a6-4622-8c01-2aa8f57add6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2982::DEBUG::2014-04-10 17:43:44,209::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2982::DEBUG::2014-04-10 17:43:44,209::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2982::DEBUG::2014-04-10 17:43:44,210::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a36659ab-73a6-4622-8c01-2aa8f57add6e`::Granted request
>Thread-2982::DEBUG::2014-04-10 17:43:44,210::task::811::TaskManager.Task::(resourceAcquired) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2982::DEBUG::2014-04-10 17:43:44,210::task::974::TaskManager.Task::(_decref) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::ref 1 aborting False
>Thread-2982::INFO::2014-04-10 17:43:44,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2982::DEBUG::2014-04-10 17:43:44,212::task::1168::TaskManager.Task::(prepare) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2982::DEBUG::2014-04-10 17:43:44,212::task::579::TaskManager.Task::(_updateState) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::moving from state preparing -> state finished
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2982::DEBUG::2014-04-10 17:43:44,213::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2982::DEBUG::2014-04-10 17:43:44,214::task::974::TaskManager.Task::(_decref) Task=`8721434c-1600-416a-a0ca-05f4cdb9dad9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:45,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:45,914::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00040592 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:46,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:46,058::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263456 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:46,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:46,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484338 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:46,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:46,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478263 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2986::DEBUG::2014-04-10 17:43:54,290::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-2986::DEBUG::2014-04-10 17:43:54,291::task::579::TaskManager.Task::(_updateState) Task=`8a0d588c-a457-4067-9dbf-c33b65684e12`::moving from state init -> state preparing
>Thread-2986::INFO::2014-04-10 17:43:54,291::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2986::INFO::2014-04-10 17:43:54,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2986::DEBUG::2014-04-10 17:43:54,291::task::1168::TaskManager.Task::(prepare) Task=`8a0d588c-a457-4067-9dbf-c33b65684e12`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2986::DEBUG::2014-04-10 17:43:54,292::task::579::TaskManager.Task::(_updateState) Task=`8a0d588c-a457-4067-9dbf-c33b65684e12`::moving from state preparing -> state finished
>Thread-2986::DEBUG::2014-04-10 17:43:54,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2986::DEBUG::2014-04-10 17:43:54,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2986::DEBUG::2014-04-10 17:43:54,292::task::974::TaskManager.Task::(_decref) Task=`8a0d588c-a457-4067-9dbf-c33b65684e12`::ref 0 aborting False
>Thread-2987::DEBUG::2014-04-10 17:43:54,298::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-2987::DEBUG::2014-04-10 17:43:54,298::task::579::TaskManager.Task::(_updateState) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::moving from state init -> state preparing
>Thread-2987::INFO::2014-04-10 17:43:54,299::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2987::DEBUG::2014-04-10 17:43:54,299::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`387ad00b-513d-4519-b441-0ce17d379f7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2987::DEBUG::2014-04-10 17:43:54,299::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2987::DEBUG::2014-04-10 17:43:54,299::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2987::DEBUG::2014-04-10 17:43:54,300::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`387ad00b-513d-4519-b441-0ce17d379f7c`::Granted request
>Thread-2987::DEBUG::2014-04-10 17:43:54,300::task::811::TaskManager.Task::(resourceAcquired) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2987::DEBUG::2014-04-10 17:43:54,300::task::974::TaskManager.Task::(_decref) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::ref 1 aborting False
>Thread-2987::INFO::2014-04-10 17:43:54,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2987::DEBUG::2014-04-10 17:43:54,302::task::1168::TaskManager.Task::(prepare) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2987::DEBUG::2014-04-10 17:43:54,302::task::579::TaskManager.Task::(_updateState) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::moving from state preparing -> state finished
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2987::DEBUG::2014-04-10 17:43:54,303::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2987::DEBUG::2014-04-10 17:43:54,304::task::974::TaskManager.Task::(_decref) Task=`466f78e0-692f-4708-a037-e8f25c77526d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:43:55,922::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:43:55,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000385361 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:43:56,066::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:43:56,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303955 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:43:56,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:43:56,380::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044339 s, 830 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:43:56,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:43:56,557::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00055176 s, 1.2 MB/s\n'; <rc> = 0
>Thread-2989::DEBUG::2014-04-10 17:43:58,381::task::579::TaskManager.Task::(_updateState) Task=`5645b74a-1ba2-4fbe-a98f-5bf009416493`::moving from state init -> state preparing
>Thread-2989::INFO::2014-04-10 17:43:58,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2989::INFO::2014-04-10 17:43:58,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055176', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385361', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303955', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044339', 'lastCheck': '2.0', 'valid': True}}
>Thread-2989::DEBUG::2014-04-10 17:43:58,382::task::1168::TaskManager.Task::(prepare) Task=`5645b74a-1ba2-4fbe-a98f-5bf009416493`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055176', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385361', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303955', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044339', 'lastCheck': '2.0', 'valid': True}}
>Thread-2989::DEBUG::2014-04-10 17:43:58,382::task::579::TaskManager.Task::(_updateState) Task=`5645b74a-1ba2-4fbe-a98f-5bf009416493`::moving from state preparing -> state finished
>Thread-2989::DEBUG::2014-04-10 17:43:58,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2989::DEBUG::2014-04-10 17:43:58,383::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2989::DEBUG::2014-04-10 17:43:58,383::task::974::TaskManager.Task::(_decref) Task=`5645b74a-1ba2-4fbe-a98f-5bf009416493`::ref 0 aborting False
>Thread-2992::DEBUG::2014-04-10 17:44:04,380::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2992::DEBUG::2014-04-10 17:44:04,380::task::579::TaskManager.Task::(_updateState) Task=`dfaabda7-4b19-4a55-9e5b-d0afd5ddfadb`::moving from state init -> state preparing
>Thread-2992::INFO::2014-04-10 17:44:04,381::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2992::INFO::2014-04-10 17:44:04,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2992::DEBUG::2014-04-10 17:44:04,381::task::1168::TaskManager.Task::(prepare) Task=`dfaabda7-4b19-4a55-9e5b-d0afd5ddfadb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2992::DEBUG::2014-04-10 17:44:04,381::task::579::TaskManager.Task::(_updateState) Task=`dfaabda7-4b19-4a55-9e5b-d0afd5ddfadb`::moving from state preparing -> state finished
>Thread-2992::DEBUG::2014-04-10 17:44:04,382::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2992::DEBUG::2014-04-10 17:44:04,382::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2992::DEBUG::2014-04-10 17:44:04,382::task::974::TaskManager.Task::(_decref) Task=`dfaabda7-4b19-4a55-9e5b-d0afd5ddfadb`::ref 0 aborting False
>Thread-2993::DEBUG::2014-04-10 17:44:04,389::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-2993::DEBUG::2014-04-10 17:44:04,389::task::579::TaskManager.Task::(_updateState) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::moving from state init -> state preparing
>Thread-2993::INFO::2014-04-10 17:44:04,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2993::DEBUG::2014-04-10 17:44:04,390::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8abec2a-73d3-4ffb-aada-df6bbc875952`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-2993::DEBUG::2014-04-10 17:44:04,390::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-2993::DEBUG::2014-04-10 17:44:04,391::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-2993::DEBUG::2014-04-10 17:44:04,391::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8abec2a-73d3-4ffb-aada-df6bbc875952`::Granted request
>Thread-2993::DEBUG::2014-04-10 17:44:04,392::task::811::TaskManager.Task::(resourceAcquired) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-2993::DEBUG::2014-04-10 17:44:04,392::task::974::TaskManager.Task::(_decref) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::ref 1 aborting False
>Thread-2993::INFO::2014-04-10 17:44:04,394::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2993::DEBUG::2014-04-10 17:44:04,394::task::1168::TaskManager.Task::(prepare) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-2993::DEBUG::2014-04-10 17:44:04,394::task::579::TaskManager.Task::(_updateState) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::moving from state preparing -> state finished
>Thread-2993::DEBUG::2014-04-10 17:44:04,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-2993::DEBUG::2014-04-10 17:44:04,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2993::DEBUG::2014-04-10 17:44:04,395::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-2993::DEBUG::2014-04-10 17:44:04,395::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-2993::DEBUG::2014-04-10 17:44:04,395::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-2993::DEBUG::2014-04-10 17:44:04,395::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-2993::DEBUG::2014-04-10 17:44:04,395::task::974::TaskManager.Task::(_decref) Task=`24f97e79-7c0d-4058-8537-30f9564e330f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:05,937::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:05,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000423833 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:06,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:06,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000385495 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:06,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:06,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502141 s, 733 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:06,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:06,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000471942 s, 1.4 MB/s\n'; <rc> = 0
>Thread-2997::DEBUG::2014-04-10 17:44:13,541::task::579::TaskManager.Task::(_updateState) Task=`36815d05-f468-4bf3-857c-20bb6eca90a7`::moving from state init -> state preparing
>Thread-2997::INFO::2014-04-10 17:44:13,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-2997::INFO::2014-04-10 17:44:13,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471942', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423833', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385495', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502141', 'lastCheck': '7.1', 'valid': True}}
>Thread-2997::DEBUG::2014-04-10 17:44:13,542::task::1168::TaskManager.Task::(prepare) Task=`36815d05-f468-4bf3-857c-20bb6eca90a7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471942', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423833', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385495', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502141', 'lastCheck': '7.1', 'valid': True}}
>Thread-2997::DEBUG::2014-04-10 17:44:13,543::task::579::TaskManager.Task::(_updateState) Task=`36815d05-f468-4bf3-857c-20bb6eca90a7`::moving from state preparing -> state finished
>Thread-2997::DEBUG::2014-04-10 17:44:13,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2997::DEBUG::2014-04-10 17:44:13,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2997::DEBUG::2014-04-10 17:44:13,543::task::974::TaskManager.Task::(_decref) Task=`36815d05-f468-4bf3-857c-20bb6eca90a7`::ref 0 aborting False
>Thread-2999::DEBUG::2014-04-10 17:44:14,470::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-2999::DEBUG::2014-04-10 17:44:14,471::task::579::TaskManager.Task::(_updateState) Task=`4a818e7b-e031-4f16-bcb9-00deeb0e398f`::moving from state init -> state preparing
>Thread-2999::INFO::2014-04-10 17:44:14,471::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-2999::INFO::2014-04-10 17:44:14,471::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2999::DEBUG::2014-04-10 17:44:14,471::task::1168::TaskManager.Task::(prepare) Task=`4a818e7b-e031-4f16-bcb9-00deeb0e398f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-2999::DEBUG::2014-04-10 17:44:14,472::task::579::TaskManager.Task::(_updateState) Task=`4a818e7b-e031-4f16-bcb9-00deeb0e398f`::moving from state preparing -> state finished
>Thread-2999::DEBUG::2014-04-10 17:44:14,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-2999::DEBUG::2014-04-10 17:44:14,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-2999::DEBUG::2014-04-10 17:44:14,472::task::974::TaskManager.Task::(_decref) Task=`4a818e7b-e031-4f16-bcb9-00deeb0e398f`::ref 0 aborting False
>Thread-3000::DEBUG::2014-04-10 17:44:14,478::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3000::DEBUG::2014-04-10 17:44:14,478::task::579::TaskManager.Task::(_updateState) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::moving from state init -> state preparing
>Thread-3000::INFO::2014-04-10 17:44:14,479::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3000::DEBUG::2014-04-10 17:44:14,479::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`308a7dcc-06f7-4a25-aedb-d795fd912506`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3000::DEBUG::2014-04-10 17:44:14,479::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3000::DEBUG::2014-04-10 17:44:14,479::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3000::DEBUG::2014-04-10 17:44:14,480::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`308a7dcc-06f7-4a25-aedb-d795fd912506`::Granted request
>Thread-3000::DEBUG::2014-04-10 17:44:14,480::task::811::TaskManager.Task::(resourceAcquired) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3000::DEBUG::2014-04-10 17:44:14,480::task::974::TaskManager.Task::(_decref) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::ref 1 aborting False
>Thread-3000::INFO::2014-04-10 17:44:14,482::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3000::DEBUG::2014-04-10 17:44:14,482::task::1168::TaskManager.Task::(prepare) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3000::DEBUG::2014-04-10 17:44:14,483::task::579::TaskManager.Task::(_updateState) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::moving from state preparing -> state finished
>Thread-3000::DEBUG::2014-04-10 17:44:14,483::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3000::DEBUG::2014-04-10 17:44:14,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3000::DEBUG::2014-04-10 17:44:14,483::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3000::DEBUG::2014-04-10 17:44:14,484::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3000::DEBUG::2014-04-10 17:44:14,484::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3000::DEBUG::2014-04-10 17:44:14,484::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3000::DEBUG::2014-04-10 17:44:14,484::task::974::TaskManager.Task::(_decref) Task=`ccf39b87-b18b-4850-9434-24168450cd62`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:15,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:15,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330264 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:16,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:16,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000413508 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:16,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:16,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485828 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:16,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:16,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000532974 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3004::DEBUG::2014-04-10 17:44:24,585::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3004::DEBUG::2014-04-10 17:44:24,586::task::579::TaskManager.Task::(_updateState) Task=`46d426a7-c987-454c-937a-bc50d0e866b8`::moving from state init -> state preparing
>Thread-3004::INFO::2014-04-10 17:44:24,586::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3004::INFO::2014-04-10 17:44:24,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3004::DEBUG::2014-04-10 17:44:24,587::task::1168::TaskManager.Task::(prepare) Task=`46d426a7-c987-454c-937a-bc50d0e866b8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3004::DEBUG::2014-04-10 17:44:24,587::task::579::TaskManager.Task::(_updateState) Task=`46d426a7-c987-454c-937a-bc50d0e866b8`::moving from state preparing -> state finished
>Thread-3004::DEBUG::2014-04-10 17:44:24,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3004::DEBUG::2014-04-10 17:44:24,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3004::DEBUG::2014-04-10 17:44:24,587::task::974::TaskManager.Task::(_decref) Task=`46d426a7-c987-454c-937a-bc50d0e866b8`::ref 0 aborting False
>Thread-3005::DEBUG::2014-04-10 17:44:24,594::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3005::DEBUG::2014-04-10 17:44:24,594::task::579::TaskManager.Task::(_updateState) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::moving from state init -> state preparing
>Thread-3005::INFO::2014-04-10 17:44:24,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3005::DEBUG::2014-04-10 17:44:24,595::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a76d4ccd-555d-436d-8267-365805e6800b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3005::DEBUG::2014-04-10 17:44:24,595::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3005::DEBUG::2014-04-10 17:44:24,595::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3005::DEBUG::2014-04-10 17:44:24,595::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a76d4ccd-555d-436d-8267-365805e6800b`::Granted request
>Thread-3005::DEBUG::2014-04-10 17:44:24,596::task::811::TaskManager.Task::(resourceAcquired) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3005::DEBUG::2014-04-10 17:44:24,596::task::974::TaskManager.Task::(_decref) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::ref 1 aborting False
>Thread-3005::INFO::2014-04-10 17:44:24,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3005::DEBUG::2014-04-10 17:44:24,598::task::1168::TaskManager.Task::(prepare) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3005::DEBUG::2014-04-10 17:44:24,598::task::579::TaskManager.Task::(_updateState) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::moving from state preparing -> state finished
>Thread-3005::DEBUG::2014-04-10 17:44:24,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3005::DEBUG::2014-04-10 17:44:24,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3005::DEBUG::2014-04-10 17:44:24,599::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3005::DEBUG::2014-04-10 17:44:24,599::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3005::DEBUG::2014-04-10 17:44:24,599::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3005::DEBUG::2014-04-10 17:44:24,599::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3005::DEBUG::2014-04-10 17:44:24,599::task::974::TaskManager.Task::(_decref) Task=`368e066a-a657-4ed4-af1e-53aff568d721`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:25,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:25,971::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000394085 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:26,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:26,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290387 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:26,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:26,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456535 s, 806 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:26,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:26,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470117 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3007::DEBUG::2014-04-10 17:44:28,713::task::579::TaskManager.Task::(_updateState) Task=`769a1dff-6ecb-4ff1-8d11-046f5f6f5a8f`::moving from state init -> state preparing
>Thread-3007::INFO::2014-04-10 17:44:28,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3007::INFO::2014-04-10 17:44:28,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470117', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394085', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290387', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456535', 'lastCheck': '2.3', 'valid': True}}
>Thread-3007::DEBUG::2014-04-10 17:44:28,714::task::1168::TaskManager.Task::(prepare) Task=`769a1dff-6ecb-4ff1-8d11-046f5f6f5a8f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470117', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394085', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290387', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456535', 'lastCheck': '2.3', 'valid': True}}
>Thread-3007::DEBUG::2014-04-10 17:44:28,714::task::579::TaskManager.Task::(_updateState) Task=`769a1dff-6ecb-4ff1-8d11-046f5f6f5a8f`::moving from state preparing -> state finished
>Thread-3007::DEBUG::2014-04-10 17:44:28,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3007::DEBUG::2014-04-10 17:44:28,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3007::DEBUG::2014-04-10 17:44:28,715::task::974::TaskManager.Task::(_decref) Task=`769a1dff-6ecb-4ff1-8d11-046f5f6f5a8f`::ref 0 aborting False
>Thread-3010::DEBUG::2014-04-10 17:44:34,701::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3010::DEBUG::2014-04-10 17:44:34,701::task::579::TaskManager.Task::(_updateState) Task=`c8d34bc1-9196-47be-b319-698343b13158`::moving from state init -> state preparing
>Thread-3010::INFO::2014-04-10 17:44:34,702::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3010::INFO::2014-04-10 17:44:34,702::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3010::DEBUG::2014-04-10 17:44:34,702::task::1168::TaskManager.Task::(prepare) Task=`c8d34bc1-9196-47be-b319-698343b13158`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3010::DEBUG::2014-04-10 17:44:34,702::task::579::TaskManager.Task::(_updateState) Task=`c8d34bc1-9196-47be-b319-698343b13158`::moving from state preparing -> state finished
>Thread-3010::DEBUG::2014-04-10 17:44:34,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3010::DEBUG::2014-04-10 17:44:34,703::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3010::DEBUG::2014-04-10 17:44:34,703::task::974::TaskManager.Task::(_decref) Task=`c8d34bc1-9196-47be-b319-698343b13158`::ref 0 aborting False
>Thread-3011::DEBUG::2014-04-10 17:44:34,709::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3011::DEBUG::2014-04-10 17:44:34,710::task::579::TaskManager.Task::(_updateState) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::moving from state init -> state preparing
>Thread-3011::INFO::2014-04-10 17:44:34,710::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3011::DEBUG::2014-04-10 17:44:34,710::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`395f6157-64ee-4190-97f8-30201643c908`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3011::DEBUG::2014-04-10 17:44:34,711::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3011::DEBUG::2014-04-10 17:44:34,711::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3011::DEBUG::2014-04-10 17:44:34,711::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`395f6157-64ee-4190-97f8-30201643c908`::Granted request
>Thread-3011::DEBUG::2014-04-10 17:44:34,711::task::811::TaskManager.Task::(resourceAcquired) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3011::DEBUG::2014-04-10 17:44:34,712::task::974::TaskManager.Task::(_decref) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::ref 1 aborting False
>Thread-3011::INFO::2014-04-10 17:44:34,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3011::DEBUG::2014-04-10 17:44:34,714::task::1168::TaskManager.Task::(prepare) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3011::DEBUG::2014-04-10 17:44:34,714::task::579::TaskManager.Task::(_updateState) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::moving from state preparing -> state finished
>Thread-3011::DEBUG::2014-04-10 17:44:34,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3011::DEBUG::2014-04-10 17:44:34,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3011::DEBUG::2014-04-10 17:44:34,714::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3011::DEBUG::2014-04-10 17:44:34,715::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3011::DEBUG::2014-04-10 17:44:34,715::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3011::DEBUG::2014-04-10 17:44:34,715::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3011::DEBUG::2014-04-10 17:44:34,715::task::974::TaskManager.Task::(_decref) Task=`4a377bb3-a9fb-4335-bae4-2a880dc7b441`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:35,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:35,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294042 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:36,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:36,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357799 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:36,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:36,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487089 s, 756 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:36,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:36,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458883 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3015::DEBUG::2014-04-10 17:44:43,889::task::579::TaskManager.Task::(_updateState) Task=`89a405d0-0713-4095-8fe1-ddfddbfc157b`::moving from state init -> state preparing
>Thread-3015::INFO::2014-04-10 17:44:43,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3015::INFO::2014-04-10 17:44:43,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458883', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294042', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357799', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487089', 'lastCheck': '7.4', 'valid': True}}
>Thread-3015::DEBUG::2014-04-10 17:44:43,890::task::1168::TaskManager.Task::(prepare) Task=`89a405d0-0713-4095-8fe1-ddfddbfc157b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458883', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294042', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357799', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487089', 'lastCheck': '7.4', 'valid': True}}
>Thread-3015::DEBUG::2014-04-10 17:44:43,890::task::579::TaskManager.Task::(_updateState) Task=`89a405d0-0713-4095-8fe1-ddfddbfc157b`::moving from state preparing -> state finished
>Thread-3015::DEBUG::2014-04-10 17:44:43,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3015::DEBUG::2014-04-10 17:44:43,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3015::DEBUG::2014-04-10 17:44:43,890::task::974::TaskManager.Task::(_decref) Task=`89a405d0-0713-4095-8fe1-ddfddbfc157b`::ref 0 aborting False
>Thread-3017::DEBUG::2014-04-10 17:44:44,791::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3017::DEBUG::2014-04-10 17:44:44,791::task::579::TaskManager.Task::(_updateState) Task=`a10b7a56-e420-4830-8022-fdc793fe2eb9`::moving from state init -> state preparing
>Thread-3017::INFO::2014-04-10 17:44:44,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3017::INFO::2014-04-10 17:44:44,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3017::DEBUG::2014-04-10 17:44:44,792::task::1168::TaskManager.Task::(prepare) Task=`a10b7a56-e420-4830-8022-fdc793fe2eb9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3017::DEBUG::2014-04-10 17:44:44,792::task::579::TaskManager.Task::(_updateState) Task=`a10b7a56-e420-4830-8022-fdc793fe2eb9`::moving from state preparing -> state finished
>Thread-3017::DEBUG::2014-04-10 17:44:44,792::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3017::DEBUG::2014-04-10 17:44:44,792::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3017::DEBUG::2014-04-10 17:44:44,793::task::974::TaskManager.Task::(_decref) Task=`a10b7a56-e420-4830-8022-fdc793fe2eb9`::ref 0 aborting False
>Thread-3018::DEBUG::2014-04-10 17:44:44,799::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3018::DEBUG::2014-04-10 17:44:44,800::task::579::TaskManager.Task::(_updateState) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::moving from state init -> state preparing
>Thread-3018::INFO::2014-04-10 17:44:44,800::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3018::DEBUG::2014-04-10 17:44:44,801::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe497006-96fe-4a97-a3ad-cbf0d7568a52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3018::DEBUG::2014-04-10 17:44:44,801::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3018::DEBUG::2014-04-10 17:44:44,802::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3018::DEBUG::2014-04-10 17:44:44,802::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe497006-96fe-4a97-a3ad-cbf0d7568a52`::Granted request
>Thread-3018::DEBUG::2014-04-10 17:44:44,802::task::811::TaskManager.Task::(resourceAcquired) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3018::DEBUG::2014-04-10 17:44:44,802::task::974::TaskManager.Task::(_decref) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::ref 1 aborting False
>Thread-3018::INFO::2014-04-10 17:44:44,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3018::DEBUG::2014-04-10 17:44:44,804::task::1168::TaskManager.Task::(prepare) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3018::DEBUG::2014-04-10 17:44:44,804::task::579::TaskManager.Task::(_updateState) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::moving from state preparing -> state finished
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3018::DEBUG::2014-04-10 17:44:44,805::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3018::DEBUG::2014-04-10 17:44:44,806::task::974::TaskManager.Task::(_decref) Task=`c880ea1f-6c00-41c7-af73-fb7dbd3d38e2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:45,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:45,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297974 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:46,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:46,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325375 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:46,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:46,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437006 s, 842 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:46,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:46,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000492814 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3022::DEBUG::2014-04-10 17:44:54,880::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3022::DEBUG::2014-04-10 17:44:54,881::task::579::TaskManager.Task::(_updateState) Task=`6c1ddef5-d629-4e8b-ac6d-9ad7265acce4`::moving from state init -> state preparing
>Thread-3022::INFO::2014-04-10 17:44:54,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3022::INFO::2014-04-10 17:44:54,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3022::DEBUG::2014-04-10 17:44:54,882::task::1168::TaskManager.Task::(prepare) Task=`6c1ddef5-d629-4e8b-ac6d-9ad7265acce4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3022::DEBUG::2014-04-10 17:44:54,882::task::579::TaskManager.Task::(_updateState) Task=`6c1ddef5-d629-4e8b-ac6d-9ad7265acce4`::moving from state preparing -> state finished
>Thread-3022::DEBUG::2014-04-10 17:44:54,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3022::DEBUG::2014-04-10 17:44:54,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3022::DEBUG::2014-04-10 17:44:54,882::task::974::TaskManager.Task::(_decref) Task=`6c1ddef5-d629-4e8b-ac6d-9ad7265acce4`::ref 0 aborting False
>Thread-3023::DEBUG::2014-04-10 17:44:54,889::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3023::DEBUG::2014-04-10 17:44:54,889::task::579::TaskManager.Task::(_updateState) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::moving from state init -> state preparing
>Thread-3023::INFO::2014-04-10 17:44:54,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3023::DEBUG::2014-04-10 17:44:54,890::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`be4a5912-4731-40ce-8c48-1eb7cd9dd336`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3023::DEBUG::2014-04-10 17:44:54,890::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3023::DEBUG::2014-04-10 17:44:54,890::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3023::DEBUG::2014-04-10 17:44:54,890::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`be4a5912-4731-40ce-8c48-1eb7cd9dd336`::Granted request
>Thread-3023::DEBUG::2014-04-10 17:44:54,891::task::811::TaskManager.Task::(resourceAcquired) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3023::DEBUG::2014-04-10 17:44:54,891::task::974::TaskManager.Task::(_decref) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::ref 1 aborting False
>Thread-3023::INFO::2014-04-10 17:44:54,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3023::DEBUG::2014-04-10 17:44:54,893::task::1168::TaskManager.Task::(prepare) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3023::DEBUG::2014-04-10 17:44:54,893::task::579::TaskManager.Task::(_updateState) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::moving from state preparing -> state finished
>Thread-3023::DEBUG::2014-04-10 17:44:54,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3023::DEBUG::2014-04-10 17:44:54,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3023::DEBUG::2014-04-10 17:44:54,894::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3023::DEBUG::2014-04-10 17:44:54,894::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3023::DEBUG::2014-04-10 17:44:54,894::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3023::DEBUG::2014-04-10 17:44:54,894::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3023::DEBUG::2014-04-10 17:44:54,894::task::974::TaskManager.Task::(_decref) Task=`897145ce-445e-4aeb-936f-0ff825df7b21`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:44:56,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:44:56,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027205 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:44:56,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:44:56,157::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279549 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:44:56,465::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:44:56,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000382702 s, 962 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:44:56,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:44:56,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000370079 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3025::DEBUG::2014-04-10 17:44:59,048::task::579::TaskManager.Task::(_updateState) Task=`d559d36f-fe1e-4dbe-a0fa-5ee10004e2bf`::moving from state init -> state preparing
>Thread-3025::INFO::2014-04-10 17:44:59,048::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3025::INFO::2014-04-10 17:44:59,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370079', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027205', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279549', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382702', 'lastCheck': '2.6', 'valid': True}}
>Thread-3025::DEBUG::2014-04-10 17:44:59,048::task::1168::TaskManager.Task::(prepare) Task=`d559d36f-fe1e-4dbe-a0fa-5ee10004e2bf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370079', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027205', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279549', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382702', 'lastCheck': '2.6', 'valid': True}}
>Thread-3025::DEBUG::2014-04-10 17:44:59,049::task::579::TaskManager.Task::(_updateState) Task=`d559d36f-fe1e-4dbe-a0fa-5ee10004e2bf`::moving from state preparing -> state finished
>Thread-3025::DEBUG::2014-04-10 17:44:59,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3025::DEBUG::2014-04-10 17:44:59,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3025::DEBUG::2014-04-10 17:44:59,049::task::974::TaskManager.Task::(_decref) Task=`d559d36f-fe1e-4dbe-a0fa-5ee10004e2bf`::ref 0 aborting False
>Thread-3028::DEBUG::2014-04-10 17:45:05,221::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3028::DEBUG::2014-04-10 17:45:05,222::task::579::TaskManager.Task::(_updateState) Task=`0efb50c6-b33a-450b-8b15-c2ee88d9f87b`::moving from state init -> state preparing
>Thread-3028::INFO::2014-04-10 17:45:05,223::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3028::INFO::2014-04-10 17:45:05,224::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3028::DEBUG::2014-04-10 17:45:05,224::task::1168::TaskManager.Task::(prepare) Task=`0efb50c6-b33a-450b-8b15-c2ee88d9f87b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3028::DEBUG::2014-04-10 17:45:05,224::task::579::TaskManager.Task::(_updateState) Task=`0efb50c6-b33a-450b-8b15-c2ee88d9f87b`::moving from state preparing -> state finished
>Thread-3028::DEBUG::2014-04-10 17:45:05,225::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3028::DEBUG::2014-04-10 17:45:05,225::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3028::DEBUG::2014-04-10 17:45:05,225::task::974::TaskManager.Task::(_decref) Task=`0efb50c6-b33a-450b-8b15-c2ee88d9f87b`::ref 0 aborting False
>Thread-3030::DEBUG::2014-04-10 17:45:05,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3030::DEBUG::2014-04-10 17:45:05,234::task::579::TaskManager.Task::(_updateState) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::moving from state init -> state preparing
>Thread-3030::INFO::2014-04-10 17:45:05,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3030::DEBUG::2014-04-10 17:45:05,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`163ccbc6-0c26-4436-8dfa-76609b3313bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3030::DEBUG::2014-04-10 17:45:05,235::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3030::DEBUG::2014-04-10 17:45:05,235::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3030::DEBUG::2014-04-10 17:45:05,235::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`163ccbc6-0c26-4436-8dfa-76609b3313bb`::Granted request
>Thread-3030::DEBUG::2014-04-10 17:45:05,235::task::811::TaskManager.Task::(resourceAcquired) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3030::DEBUG::2014-04-10 17:45:05,236::task::974::TaskManager.Task::(_decref) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::ref 1 aborting False
>Thread-3030::INFO::2014-04-10 17:45:05,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3030::DEBUG::2014-04-10 17:45:05,238::task::1168::TaskManager.Task::(prepare) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3030::DEBUG::2014-04-10 17:45:05,238::task::579::TaskManager.Task::(_updateState) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::moving from state preparing -> state finished
>Thread-3030::DEBUG::2014-04-10 17:45:05,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3030::DEBUG::2014-04-10 17:45:05,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3030::DEBUG::2014-04-10 17:45:05,238::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3030::DEBUG::2014-04-10 17:45:05,239::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3030::DEBUG::2014-04-10 17:45:05,239::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3030::DEBUG::2014-04-10 17:45:05,239::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3030::DEBUG::2014-04-10 17:45:05,239::task::974::TaskManager.Task::(_decref) Task=`165ffcab-7770-4186-8dbe-5ebed0219013`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:06,021::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:06,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:06,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:06,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387568 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:06,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:06,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000424598 s, 867 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:06,657::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:06,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000393301 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3033::DEBUG::2014-04-10 17:45:14,284::task::579::TaskManager.Task::(_updateState) Task=`a1445b69-f7d8-4bc6-adc7-a1a34babbd29`::moving from state init -> state preparing
>Thread-3033::INFO::2014-04-10 17:45:14,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3033::INFO::2014-04-10 17:45:14,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393301', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387568', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424598', 'lastCheck': '7.8', 'valid': True}}
>Thread-3033::DEBUG::2014-04-10 17:45:14,285::task::1168::TaskManager.Task::(prepare) Task=`a1445b69-f7d8-4bc6-adc7-a1a34babbd29`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393301', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387568', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424598', 'lastCheck': '7.8', 'valid': True}}
>Thread-3033::DEBUG::2014-04-10 17:45:14,285::task::579::TaskManager.Task::(_updateState) Task=`a1445b69-f7d8-4bc6-adc7-a1a34babbd29`::moving from state preparing -> state finished
>Thread-3033::DEBUG::2014-04-10 17:45:14,285::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3033::DEBUG::2014-04-10 17:45:14,285::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3033::DEBUG::2014-04-10 17:45:14,286::task::974::TaskManager.Task::(_decref) Task=`a1445b69-f7d8-4bc6-adc7-a1a34babbd29`::ref 0 aborting False
>Thread-3035::DEBUG::2014-04-10 17:45:15,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-3035::DEBUG::2014-04-10 17:45:15,320::task::579::TaskManager.Task::(_updateState) Task=`9528bd89-993f-4e55-b5a6-ea616d417c9c`::moving from state init -> state preparing
>Thread-3035::INFO::2014-04-10 17:45:15,320::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3035::INFO::2014-04-10 17:45:15,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3035::DEBUG::2014-04-10 17:45:15,321::task::1168::TaskManager.Task::(prepare) Task=`9528bd89-993f-4e55-b5a6-ea616d417c9c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3035::DEBUG::2014-04-10 17:45:15,321::task::579::TaskManager.Task::(_updateState) Task=`9528bd89-993f-4e55-b5a6-ea616d417c9c`::moving from state preparing -> state finished
>Thread-3035::DEBUG::2014-04-10 17:45:15,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3035::DEBUG::2014-04-10 17:45:15,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3035::DEBUG::2014-04-10 17:45:15,321::task::974::TaskManager.Task::(_decref) Task=`9528bd89-993f-4e55-b5a6-ea616d417c9c`::ref 0 aborting False
>Thread-3036::DEBUG::2014-04-10 17:45:15,328::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-3036::DEBUG::2014-04-10 17:45:15,328::task::579::TaskManager.Task::(_updateState) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::moving from state init -> state preparing
>Thread-3036::INFO::2014-04-10 17:45:15,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3036::DEBUG::2014-04-10 17:45:15,329::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01a6ffa4-75b6-4e8b-b798-367700426278`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3036::DEBUG::2014-04-10 17:45:15,329::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3036::DEBUG::2014-04-10 17:45:15,329::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3036::DEBUG::2014-04-10 17:45:15,329::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01a6ffa4-75b6-4e8b-b798-367700426278`::Granted request
>Thread-3036::DEBUG::2014-04-10 17:45:15,330::task::811::TaskManager.Task::(resourceAcquired) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3036::DEBUG::2014-04-10 17:45:15,330::task::974::TaskManager.Task::(_decref) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::ref 1 aborting False
>Thread-3036::INFO::2014-04-10 17:45:15,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3036::DEBUG::2014-04-10 17:45:15,332::task::1168::TaskManager.Task::(prepare) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3036::DEBUG::2014-04-10 17:45:15,332::task::579::TaskManager.Task::(_updateState) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::moving from state preparing -> state finished
>Thread-3036::DEBUG::2014-04-10 17:45:15,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3036::DEBUG::2014-04-10 17:45:15,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3036::DEBUG::2014-04-10 17:45:15,332::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3036::DEBUG::2014-04-10 17:45:15,333::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3036::DEBUG::2014-04-10 17:45:15,333::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3036::DEBUG::2014-04-10 17:45:15,333::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3036::DEBUG::2014-04-10 17:45:15,333::task::974::TaskManager.Task::(_decref) Task=`9ca4f389-040e-44a5-a505-356c4e34f042`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:16,035::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:16,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000237282 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:16,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:16,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340615 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:16,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:16,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431384 s, 853 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:16,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:16,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458848 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3040::DEBUG::2014-04-10 17:45:25,408::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3040::DEBUG::2014-04-10 17:45:25,418::task::579::TaskManager.Task::(_updateState) Task=`e2d5c65b-689b-463d-80b9-f204349f9548`::moving from state init -> state preparing
>Thread-3040::INFO::2014-04-10 17:45:25,418::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3040::INFO::2014-04-10 17:45:25,418::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3040::DEBUG::2014-04-10 17:45:25,418::task::1168::TaskManager.Task::(prepare) Task=`e2d5c65b-689b-463d-80b9-f204349f9548`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3040::DEBUG::2014-04-10 17:45:25,419::task::579::TaskManager.Task::(_updateState) Task=`e2d5c65b-689b-463d-80b9-f204349f9548`::moving from state preparing -> state finished
>Thread-3040::DEBUG::2014-04-10 17:45:25,419::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3040::DEBUG::2014-04-10 17:45:25,419::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3040::DEBUG::2014-04-10 17:45:25,419::task::974::TaskManager.Task::(_decref) Task=`e2d5c65b-689b-463d-80b9-f204349f9548`::ref 0 aborting False
>Thread-3041::DEBUG::2014-04-10 17:45:25,426::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3041::DEBUG::2014-04-10 17:45:25,426::task::579::TaskManager.Task::(_updateState) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::moving from state init -> state preparing
>Thread-3041::INFO::2014-04-10 17:45:25,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3041::DEBUG::2014-04-10 17:45:25,427::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2842fdac-7542-41db-ba0c-07704cbaa376`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3041::DEBUG::2014-04-10 17:45:25,427::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3041::DEBUG::2014-04-10 17:45:25,427::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3041::DEBUG::2014-04-10 17:45:25,427::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2842fdac-7542-41db-ba0c-07704cbaa376`::Granted request
>Thread-3041::DEBUG::2014-04-10 17:45:25,428::task::811::TaskManager.Task::(resourceAcquired) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3041::DEBUG::2014-04-10 17:45:25,428::task::974::TaskManager.Task::(_decref) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::ref 1 aborting False
>Thread-3041::INFO::2014-04-10 17:45:25,430::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3041::DEBUG::2014-04-10 17:45:25,430::task::1168::TaskManager.Task::(prepare) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3041::DEBUG::2014-04-10 17:45:25,430::task::579::TaskManager.Task::(_updateState) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::moving from state preparing -> state finished
>Thread-3041::DEBUG::2014-04-10 17:45:25,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3041::DEBUG::2014-04-10 17:45:25,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3041::DEBUG::2014-04-10 17:45:25,431::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3041::DEBUG::2014-04-10 17:45:25,431::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3041::DEBUG::2014-04-10 17:45:25,431::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3041::DEBUG::2014-04-10 17:45:25,431::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3041::DEBUG::2014-04-10 17:45:25,431::task::974::TaskManager.Task::(_decref) Task=`61e04ea8-59a7-4f75-a791-ed5bf162e46e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:26,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:26,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279677 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:26,196::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:26,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361382 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:26,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:26,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00055206 s, 667 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:26,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:26,693::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00046433 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3043::DEBUG::2014-04-10 17:45:29,460::task::579::TaskManager.Task::(_updateState) Task=`7138fd84-aa51-4467-a6c0-cf128e0afc50`::moving from state init -> state preparing
>Thread-3043::INFO::2014-04-10 17:45:29,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3043::INFO::2014-04-10 17:45:29,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046433', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279677', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361382', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055206', 'lastCheck': '2.9', 'valid': True}}
>Thread-3043::DEBUG::2014-04-10 17:45:29,461::task::1168::TaskManager.Task::(prepare) Task=`7138fd84-aa51-4467-a6c0-cf128e0afc50`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046433', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279677', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361382', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055206', 'lastCheck': '2.9', 'valid': True}}
>Thread-3043::DEBUG::2014-04-10 17:45:29,461::task::579::TaskManager.Task::(_updateState) Task=`7138fd84-aa51-4467-a6c0-cf128e0afc50`::moving from state preparing -> state finished
>Thread-3043::DEBUG::2014-04-10 17:45:29,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3043::DEBUG::2014-04-10 17:45:29,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3043::DEBUG::2014-04-10 17:45:29,462::task::974::TaskManager.Task::(_decref) Task=`7138fd84-aa51-4467-a6c0-cf128e0afc50`::ref 0 aborting False
>Thread-3046::DEBUG::2014-04-10 17:45:35,557::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3046::DEBUG::2014-04-10 17:45:35,558::task::579::TaskManager.Task::(_updateState) Task=`97df272e-433c-4777-b1d9-f62949628c91`::moving from state init -> state preparing
>Thread-3046::INFO::2014-04-10 17:45:35,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3046::INFO::2014-04-10 17:45:35,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3046::DEBUG::2014-04-10 17:45:35,559::task::1168::TaskManager.Task::(prepare) Task=`97df272e-433c-4777-b1d9-f62949628c91`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3046::DEBUG::2014-04-10 17:45:35,559::task::579::TaskManager.Task::(_updateState) Task=`97df272e-433c-4777-b1d9-f62949628c91`::moving from state preparing -> state finished
>Thread-3046::DEBUG::2014-04-10 17:45:35,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3046::DEBUG::2014-04-10 17:45:35,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3046::DEBUG::2014-04-10 17:45:35,560::task::974::TaskManager.Task::(_decref) Task=`97df272e-433c-4777-b1d9-f62949628c91`::ref 0 aborting False
>Thread-3048::DEBUG::2014-04-10 17:45:35,567::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3048::DEBUG::2014-04-10 17:45:35,568::task::579::TaskManager.Task::(_updateState) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::moving from state init -> state preparing
>Thread-3048::INFO::2014-04-10 17:45:35,568::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3048::DEBUG::2014-04-10 17:45:35,568::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`62f19051-aa7e-4d02-9bcb-8b90faa2f4e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3048::DEBUG::2014-04-10 17:45:35,569::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3048::DEBUG::2014-04-10 17:45:35,569::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3048::DEBUG::2014-04-10 17:45:35,569::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`62f19051-aa7e-4d02-9bcb-8b90faa2f4e6`::Granted request
>Thread-3048::DEBUG::2014-04-10 17:45:35,569::task::811::TaskManager.Task::(resourceAcquired) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3048::DEBUG::2014-04-10 17:45:35,570::task::974::TaskManager.Task::(_decref) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::ref 1 aborting False
>Thread-3048::INFO::2014-04-10 17:45:35,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3048::DEBUG::2014-04-10 17:45:35,572::task::1168::TaskManager.Task::(prepare) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3048::DEBUG::2014-04-10 17:45:35,572::task::579::TaskManager.Task::(_updateState) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::moving from state preparing -> state finished
>Thread-3048::DEBUG::2014-04-10 17:45:35,572::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3048::DEBUG::2014-04-10 17:45:35,572::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3048::DEBUG::2014-04-10 17:45:35,572::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3048::DEBUG::2014-04-10 17:45:35,573::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3048::DEBUG::2014-04-10 17:45:35,573::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3048::DEBUG::2014-04-10 17:45:35,573::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3048::DEBUG::2014-04-10 17:45:35,573::task::974::TaskManager.Task::(_decref) Task=`1db9077e-9344-4004-b4b6-a12c8007fde6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:36,058::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:45:36,065::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:45:36,066::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:45:36,070::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:45:36,072::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:45:36,072::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:45:36,072::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:45:36,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:36,083::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283669 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:36,204::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:45:36,219::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:45:36,220::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:45:36,225::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:45:36,226::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:45:36,226::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:45:36,226::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:45:36,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:36,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280375 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:36,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:36,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489086 s, 752 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:36,702::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:36,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000405418 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3059::DEBUG::2014-04-10 17:45:44,622::task::579::TaskManager.Task::(_updateState) Task=`13b5a605-d385-40b1-8ca2-a4a09b9cd3d1`::moving from state init -> state preparing
>Thread-3059::INFO::2014-04-10 17:45:44,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3059::INFO::2014-04-10 17:45:44,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405418', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283669', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280375', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489086', 'lastCheck': '8.1', 'valid': True}}
>Thread-3059::DEBUG::2014-04-10 17:45:44,623::task::1168::TaskManager.Task::(prepare) Task=`13b5a605-d385-40b1-8ca2-a4a09b9cd3d1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405418', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283669', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280375', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489086', 'lastCheck': '8.1', 'valid': True}}
>Thread-3059::DEBUG::2014-04-10 17:45:44,623::task::579::TaskManager.Task::(_updateState) Task=`13b5a605-d385-40b1-8ca2-a4a09b9cd3d1`::moving from state preparing -> state finished
>Thread-3059::DEBUG::2014-04-10 17:45:44,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3059::DEBUG::2014-04-10 17:45:44,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3059::DEBUG::2014-04-10 17:45:44,623::task::974::TaskManager.Task::(_decref) Task=`13b5a605-d385-40b1-8ca2-a4a09b9cd3d1`::ref 0 aborting False
>Thread-3061::DEBUG::2014-04-10 17:45:45,649::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3061::DEBUG::2014-04-10 17:45:45,650::task::579::TaskManager.Task::(_updateState) Task=`845d1c6b-0f23-49b0-a460-882cdbe71414`::moving from state init -> state preparing
>Thread-3061::INFO::2014-04-10 17:45:45,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3061::INFO::2014-04-10 17:45:45,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3061::DEBUG::2014-04-10 17:45:45,651::task::1168::TaskManager.Task::(prepare) Task=`845d1c6b-0f23-49b0-a460-882cdbe71414`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3061::DEBUG::2014-04-10 17:45:45,651::task::579::TaskManager.Task::(_updateState) Task=`845d1c6b-0f23-49b0-a460-882cdbe71414`::moving from state preparing -> state finished
>Thread-3061::DEBUG::2014-04-10 17:45:45,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3061::DEBUG::2014-04-10 17:45:45,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3061::DEBUG::2014-04-10 17:45:45,651::task::974::TaskManager.Task::(_decref) Task=`845d1c6b-0f23-49b0-a460-882cdbe71414`::ref 0 aborting False
>Thread-3062::DEBUG::2014-04-10 17:45:45,658::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3062::DEBUG::2014-04-10 17:45:45,658::task::579::TaskManager.Task::(_updateState) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::moving from state init -> state preparing
>Thread-3062::INFO::2014-04-10 17:45:45,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3062::DEBUG::2014-04-10 17:45:45,659::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8d7735bf-c714-471f-bf78-337328410405`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3062::DEBUG::2014-04-10 17:45:45,659::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3062::DEBUG::2014-04-10 17:45:45,659::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3062::DEBUG::2014-04-10 17:45:45,659::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8d7735bf-c714-471f-bf78-337328410405`::Granted request
>Thread-3062::DEBUG::2014-04-10 17:45:45,660::task::811::TaskManager.Task::(resourceAcquired) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3062::DEBUG::2014-04-10 17:45:45,660::task::974::TaskManager.Task::(_decref) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::ref 1 aborting False
>Thread-3062::INFO::2014-04-10 17:45:45,662::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3062::DEBUG::2014-04-10 17:45:45,662::task::1168::TaskManager.Task::(prepare) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3062::DEBUG::2014-04-10 17:45:45,662::task::579::TaskManager.Task::(_updateState) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::moving from state preparing -> state finished
>Thread-3062::DEBUG::2014-04-10 17:45:45,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3062::DEBUG::2014-04-10 17:45:45,662::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3062::DEBUG::2014-04-10 17:45:45,662::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3062::DEBUG::2014-04-10 17:45:45,663::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3062::DEBUG::2014-04-10 17:45:45,663::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3062::DEBUG::2014-04-10 17:45:45,663::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3062::DEBUG::2014-04-10 17:45:45,663::task::974::TaskManager.Task::(_decref) Task=`bb3ba9bb-1789-4cc5-92fc-c6c159d763b6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:46,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:46,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000481256 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:46,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:46,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035636 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:46,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:46,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533389 s, 690 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:46,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:46,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000596273 s, 1.1 MB/s\n'; <rc> = 0
>Thread-3066::DEBUG::2014-04-10 17:45:55,739::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-3066::DEBUG::2014-04-10 17:45:55,749::task::579::TaskManager.Task::(_updateState) Task=`a96bc276-f3b0-41e3-ab7d-0956d7efbb93`::moving from state init -> state preparing
>Thread-3066::INFO::2014-04-10 17:45:55,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3066::INFO::2014-04-10 17:45:55,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3066::DEBUG::2014-04-10 17:45:55,750::task::1168::TaskManager.Task::(prepare) Task=`a96bc276-f3b0-41e3-ab7d-0956d7efbb93`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3066::DEBUG::2014-04-10 17:45:55,750::task::579::TaskManager.Task::(_updateState) Task=`a96bc276-f3b0-41e3-ab7d-0956d7efbb93`::moving from state preparing -> state finished
>Thread-3066::DEBUG::2014-04-10 17:45:55,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3066::DEBUG::2014-04-10 17:45:55,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3066::DEBUG::2014-04-10 17:45:55,751::task::974::TaskManager.Task::(_decref) Task=`a96bc276-f3b0-41e3-ab7d-0956d7efbb93`::ref 0 aborting False
>Thread-3067::DEBUG::2014-04-10 17:45:55,757::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-3067::DEBUG::2014-04-10 17:45:55,758::task::579::TaskManager.Task::(_updateState) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::moving from state init -> state preparing
>Thread-3067::INFO::2014-04-10 17:45:55,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3067::DEBUG::2014-04-10 17:45:55,758::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1d47891c-4af6-4dbf-9d28-5199e83ee14b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3067::DEBUG::2014-04-10 17:45:55,759::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3067::DEBUG::2014-04-10 17:45:55,759::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3067::DEBUG::2014-04-10 17:45:55,759::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1d47891c-4af6-4dbf-9d28-5199e83ee14b`::Granted request
>Thread-3067::DEBUG::2014-04-10 17:45:55,759::task::811::TaskManager.Task::(resourceAcquired) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3067::DEBUG::2014-04-10 17:45:55,759::task::974::TaskManager.Task::(_decref) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::ref 1 aborting False
>Thread-3067::INFO::2014-04-10 17:45:55,761::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::task::1168::TaskManager.Task::(prepare) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::task::579::TaskManager.Task::(_updateState) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::moving from state preparing -> state finished
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3067::DEBUG::2014-04-10 17:45:55,762::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3067::DEBUG::2014-04-10 17:45:55,763::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3067::DEBUG::2014-04-10 17:45:55,763::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3067::DEBUG::2014-04-10 17:45:55,763::task::974::TaskManager.Task::(_decref) Task=`0a1a586b-c3e0-4a98-9b8e-6ffd4096a5ef`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:45:56,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:45:56,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000443059 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:45:56,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:45:56,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313845 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:45:56,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:45:56,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456329 s, 806 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:45:56,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:45:56,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478973 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3069::DEBUG::2014-04-10 17:45:59,786::task::579::TaskManager.Task::(_updateState) Task=`267b76ac-120b-4663-b787-d41ce12a3be8`::moving from state init -> state preparing
>Thread-3069::INFO::2014-04-10 17:45:59,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3069::INFO::2014-04-10 17:45:59,787::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478973', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443059', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313845', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456329', 'lastCheck': '3.2', 'valid': True}}
>Thread-3069::DEBUG::2014-04-10 17:45:59,787::task::1168::TaskManager.Task::(prepare) Task=`267b76ac-120b-4663-b787-d41ce12a3be8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478973', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443059', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313845', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456329', 'lastCheck': '3.2', 'valid': True}}
>Thread-3069::DEBUG::2014-04-10 17:45:59,787::task::579::TaskManager.Task::(_updateState) Task=`267b76ac-120b-4663-b787-d41ce12a3be8`::moving from state preparing -> state finished
>Thread-3069::DEBUG::2014-04-10 17:45:59,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3069::DEBUG::2014-04-10 17:45:59,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3069::DEBUG::2014-04-10 17:45:59,788::task::974::TaskManager.Task::(_decref) Task=`267b76ac-120b-4663-b787-d41ce12a3be8`::ref 0 aborting False
>Thread-3072::DEBUG::2014-04-10 17:46:05,845::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3072::DEBUG::2014-04-10 17:46:05,845::task::579::TaskManager.Task::(_updateState) Task=`6464b0a3-a78f-4ee3-ab2b-49265f48230c`::moving from state init -> state preparing
>Thread-3072::INFO::2014-04-10 17:46:05,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3072::INFO::2014-04-10 17:46:05,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3072::DEBUG::2014-04-10 17:46:05,846::task::1168::TaskManager.Task::(prepare) Task=`6464b0a3-a78f-4ee3-ab2b-49265f48230c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3072::DEBUG::2014-04-10 17:46:05,846::task::579::TaskManager.Task::(_updateState) Task=`6464b0a3-a78f-4ee3-ab2b-49265f48230c`::moving from state preparing -> state finished
>Thread-3072::DEBUG::2014-04-10 17:46:05,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3072::DEBUG::2014-04-10 17:46:05,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3072::DEBUG::2014-04-10 17:46:05,847::task::974::TaskManager.Task::(_decref) Task=`6464b0a3-a78f-4ee3-ab2b-49265f48230c`::ref 0 aborting False
>Thread-3073::DEBUG::2014-04-10 17:46:05,853::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3073::DEBUG::2014-04-10 17:46:05,854::task::579::TaskManager.Task::(_updateState) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::moving from state init -> state preparing
>Thread-3073::INFO::2014-04-10 17:46:05,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3073::DEBUG::2014-04-10 17:46:05,854::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ecee8fd-2c9c-456c-a576-c2d1cbbe748a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3073::DEBUG::2014-04-10 17:46:05,854::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3073::DEBUG::2014-04-10 17:46:05,855::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3073::DEBUG::2014-04-10 17:46:05,855::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ecee8fd-2c9c-456c-a576-c2d1cbbe748a`::Granted request
>Thread-3073::DEBUG::2014-04-10 17:46:05,855::task::811::TaskManager.Task::(resourceAcquired) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3073::DEBUG::2014-04-10 17:46:05,855::task::974::TaskManager.Task::(_decref) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::ref 1 aborting False
>Thread-3073::INFO::2014-04-10 17:46:05,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3073::DEBUG::2014-04-10 17:46:05,857::task::1168::TaskManager.Task::(prepare) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::task::579::TaskManager.Task::(_updateState) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::moving from state preparing -> state finished
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3073::DEBUG::2014-04-10 17:46:05,858::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3073::DEBUG::2014-04-10 17:46:05,859::task::974::TaskManager.Task::(_decref) Task=`c0631ca0-14b9-4058-bfdc-eb570d6d4776`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:46:06,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:06,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325651 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:06,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:06,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272138 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:06,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:06,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474715 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:46:06,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:06,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445688 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3077::DEBUG::2014-04-10 17:46:14,955::task::579::TaskManager.Task::(_updateState) Task=`87c94d1f-b4e2-4ab0-a880-a2c5d7263921`::moving from state init -> state preparing
>Thread-3077::INFO::2014-04-10 17:46:14,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3077::INFO::2014-04-10 17:46:14,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445688', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325651', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272138', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474715', 'lastCheck': '8.4', 'valid': True}}
>Thread-3077::DEBUG::2014-04-10 17:46:14,956::task::1168::TaskManager.Task::(prepare) Task=`87c94d1f-b4e2-4ab0-a880-a2c5d7263921`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445688', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325651', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272138', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474715', 'lastCheck': '8.4', 'valid': True}}
>Thread-3077::DEBUG::2014-04-10 17:46:14,956::task::579::TaskManager.Task::(_updateState) Task=`87c94d1f-b4e2-4ab0-a880-a2c5d7263921`::moving from state preparing -> state finished
>Thread-3077::DEBUG::2014-04-10 17:46:14,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3077::DEBUG::2014-04-10 17:46:14,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3077::DEBUG::2014-04-10 17:46:14,957::task::974::TaskManager.Task::(_decref) Task=`87c94d1f-b4e2-4ab0-a880-a2c5d7263921`::ref 0 aborting False
>Thread-3079::DEBUG::2014-04-10 17:46:15,943::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3079::DEBUG::2014-04-10 17:46:15,944::task::579::TaskManager.Task::(_updateState) Task=`350eb6be-ad23-4862-bcd8-b86ac9882bf8`::moving from state init -> state preparing
>Thread-3079::INFO::2014-04-10 17:46:15,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3079::INFO::2014-04-10 17:46:15,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3079::DEBUG::2014-04-10 17:46:15,945::task::1168::TaskManager.Task::(prepare) Task=`350eb6be-ad23-4862-bcd8-b86ac9882bf8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3079::DEBUG::2014-04-10 17:46:15,945::task::579::TaskManager.Task::(_updateState) Task=`350eb6be-ad23-4862-bcd8-b86ac9882bf8`::moving from state preparing -> state finished
>Thread-3079::DEBUG::2014-04-10 17:46:15,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3079::DEBUG::2014-04-10 17:46:15,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3079::DEBUG::2014-04-10 17:46:15,945::task::974::TaskManager.Task::(_decref) Task=`350eb6be-ad23-4862-bcd8-b86ac9882bf8`::ref 0 aborting False
>Thread-3080::DEBUG::2014-04-10 17:46:15,952::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3080::DEBUG::2014-04-10 17:46:15,952::task::579::TaskManager.Task::(_updateState) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::moving from state init -> state preparing
>Thread-3080::INFO::2014-04-10 17:46:15,953::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3080::DEBUG::2014-04-10 17:46:15,953::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46f1b15e-3571-42a3-9ffb-b369a1fda892`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3080::DEBUG::2014-04-10 17:46:15,953::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3080::DEBUG::2014-04-10 17:46:15,954::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3080::DEBUG::2014-04-10 17:46:15,954::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46f1b15e-3571-42a3-9ffb-b369a1fda892`::Granted request
>Thread-3080::DEBUG::2014-04-10 17:46:15,954::task::811::TaskManager.Task::(resourceAcquired) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3080::DEBUG::2014-04-10 17:46:15,954::task::974::TaskManager.Task::(_decref) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::ref 1 aborting False
>Thread-3080::INFO::2014-04-10 17:46:15,956::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3080::DEBUG::2014-04-10 17:46:15,956::task::1168::TaskManager.Task::(prepare) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3080::DEBUG::2014-04-10 17:46:15,956::task::579::TaskManager.Task::(_updateState) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::moving from state preparing -> state finished
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3080::DEBUG::2014-04-10 17:46:15,957::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3080::DEBUG::2014-04-10 17:46:15,958::task::974::TaskManager.Task::(_decref) Task=`4f8639f6-5a15-4bce-9aab-856241907530`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:46:16,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:16,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414883 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:16,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:16,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272931 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:16,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:16,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474207 s, 776 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:46:16,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:16,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460839 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3084::DEBUG::2014-04-10 17:46:26,025::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3084::DEBUG::2014-04-10 17:46:26,025::task::579::TaskManager.Task::(_updateState) Task=`998c7287-b694-40ad-926f-5aaef38b696f`::moving from state init -> state preparing
>Thread-3084::INFO::2014-04-10 17:46:26,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3084::INFO::2014-04-10 17:46:26,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3084::DEBUG::2014-04-10 17:46:26,026::task::1168::TaskManager.Task::(prepare) Task=`998c7287-b694-40ad-926f-5aaef38b696f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3084::DEBUG::2014-04-10 17:46:26,026::task::579::TaskManager.Task::(_updateState) Task=`998c7287-b694-40ad-926f-5aaef38b696f`::moving from state preparing -> state finished
>Thread-3084::DEBUG::2014-04-10 17:46:26,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3084::DEBUG::2014-04-10 17:46:26,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3084::DEBUG::2014-04-10 17:46:26,027::task::974::TaskManager.Task::(_decref) Task=`998c7287-b694-40ad-926f-5aaef38b696f`::ref 0 aborting False
>Thread-3085::DEBUG::2014-04-10 17:46:26,033::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3085::DEBUG::2014-04-10 17:46:26,034::task::579::TaskManager.Task::(_updateState) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::moving from state init -> state preparing
>Thread-3085::INFO::2014-04-10 17:46:26,034::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3085::DEBUG::2014-04-10 17:46:26,034::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d8fcc87-63dd-4d99-ac67-984c1a7b8c5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3085::DEBUG::2014-04-10 17:46:26,034::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3085::DEBUG::2014-04-10 17:46:26,035::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3085::DEBUG::2014-04-10 17:46:26,035::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d8fcc87-63dd-4d99-ac67-984c1a7b8c5b`::Granted request
>Thread-3085::DEBUG::2014-04-10 17:46:26,035::task::811::TaskManager.Task::(resourceAcquired) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3085::DEBUG::2014-04-10 17:46:26,035::task::974::TaskManager.Task::(_decref) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::ref 1 aborting False
>Thread-3085::INFO::2014-04-10 17:46:26,037::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3085::DEBUG::2014-04-10 17:46:26,037::task::1168::TaskManager.Task::(prepare) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::task::579::TaskManager.Task::(_updateState) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::moving from state preparing -> state finished
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3085::DEBUG::2014-04-10 17:46:26,038::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3085::DEBUG::2014-04-10 17:46:26,039::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3085::DEBUG::2014-04-10 17:46:26,039::task::974::TaskManager.Task::(_decref) Task=`385eaea4-2e04-42c0-84ba-83e14bd7170e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:46:26,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:26,154::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000243118 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:26,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:26,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311951 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:26,607::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:26,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000367474 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:46:26,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:26,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475569 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3087::DEBUG::2014-04-10 17:46:30,114::task::579::TaskManager.Task::(_updateState) Task=`b9086f8d-ecd5-411f-91d8-76474fa282e7`::moving from state init -> state preparing
>Thread-3087::INFO::2014-04-10 17:46:30,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3087::INFO::2014-04-10 17:46:30,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475569', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243118', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311951', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367474', 'lastCheck': '3.5', 'valid': True}}
>Thread-3087::DEBUG::2014-04-10 17:46:30,115::task::1168::TaskManager.Task::(prepare) Task=`b9086f8d-ecd5-411f-91d8-76474fa282e7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475569', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243118', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311951', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367474', 'lastCheck': '3.5', 'valid': True}}
>Thread-3087::DEBUG::2014-04-10 17:46:30,115::task::579::TaskManager.Task::(_updateState) Task=`b9086f8d-ecd5-411f-91d8-76474fa282e7`::moving from state preparing -> state finished
>Thread-3087::DEBUG::2014-04-10 17:46:30,115::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3087::DEBUG::2014-04-10 17:46:30,115::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3087::DEBUG::2014-04-10 17:46:30,115::task::974::TaskManager.Task::(_decref) Task=`b9086f8d-ecd5-411f-91d8-76474fa282e7`::ref 0 aborting False
>Thread-3090::DEBUG::2014-04-10 17:46:36,124::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-3090::DEBUG::2014-04-10 17:46:36,124::task::579::TaskManager.Task::(_updateState) Task=`2e8b77c5-c09e-4119-848d-873e8326ea94`::moving from state init -> state preparing
>Thread-3090::INFO::2014-04-10 17:46:36,124::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3090::INFO::2014-04-10 17:46:36,125::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3090::DEBUG::2014-04-10 17:46:36,125::task::1168::TaskManager.Task::(prepare) Task=`2e8b77c5-c09e-4119-848d-873e8326ea94`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3090::DEBUG::2014-04-10 17:46:36,125::task::579::TaskManager.Task::(_updateState) Task=`2e8b77c5-c09e-4119-848d-873e8326ea94`::moving from state preparing -> state finished
>Thread-3090::DEBUG::2014-04-10 17:46:36,125::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3090::DEBUG::2014-04-10 17:46:36,125::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3090::DEBUG::2014-04-10 17:46:36,125::task::974::TaskManager.Task::(_decref) Task=`2e8b77c5-c09e-4119-848d-873e8326ea94`::ref 0 aborting False
>Thread-3091::DEBUG::2014-04-10 17:46:36,132::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-3091::DEBUG::2014-04-10 17:46:36,133::task::579::TaskManager.Task::(_updateState) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::moving from state init -> state preparing
>Thread-3091::INFO::2014-04-10 17:46:36,133::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3091::DEBUG::2014-04-10 17:46:36,133::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6550b401-111a-4aaa-aa53-53752f886d99`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3091::DEBUG::2014-04-10 17:46:36,133::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3091::DEBUG::2014-04-10 17:46:36,134::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3091::DEBUG::2014-04-10 17:46:36,134::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6550b401-111a-4aaa-aa53-53752f886d99`::Granted request
>Thread-3091::DEBUG::2014-04-10 17:46:36,134::task::811::TaskManager.Task::(resourceAcquired) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3091::DEBUG::2014-04-10 17:46:36,134::task::974::TaskManager.Task::(_decref) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::ref 1 aborting False
>Thread-3091::INFO::2014-04-10 17:46:36,136::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3091::DEBUG::2014-04-10 17:46:36,136::task::1168::TaskManager.Task::(prepare) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::task::579::TaskManager.Task::(_updateState) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::moving from state preparing -> state finished
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3091::DEBUG::2014-04-10 17:46:36,137::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3091::DEBUG::2014-04-10 17:46:36,138::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3091::DEBUG::2014-04-10 17:46:36,138::task::974::TaskManager.Task::(_decref) Task=`41bf0304-6f6b-4d05-96c5-7fd4bc3585e7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:46:36,161::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:36,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338547 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:36,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:36,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313656 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:36,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:36,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000344652 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:46:36,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:36,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000528551 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3095::DEBUG::2014-04-10 17:46:45,277::task::579::TaskManager.Task::(_updateState) Task=`92f82f4e-1973-4303-8c02-34f8417797be`::moving from state init -> state preparing
>Thread-3095::INFO::2014-04-10 17:46:45,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3095::INFO::2014-04-10 17:46:45,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528551', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338547', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313656', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344652', 'lastCheck': '8.7', 'valid': True}}
>Thread-3095::DEBUG::2014-04-10 17:46:45,278::task::1168::TaskManager.Task::(prepare) Task=`92f82f4e-1973-4303-8c02-34f8417797be`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528551', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338547', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313656', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344652', 'lastCheck': '8.7', 'valid': True}}
>Thread-3095::DEBUG::2014-04-10 17:46:45,278::task::579::TaskManager.Task::(_updateState) Task=`92f82f4e-1973-4303-8c02-34f8417797be`::moving from state preparing -> state finished
>Thread-3095::DEBUG::2014-04-10 17:46:45,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3095::DEBUG::2014-04-10 17:46:45,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3095::DEBUG::2014-04-10 17:46:45,278::task::974::TaskManager.Task::(_decref) Task=`92f82f4e-1973-4303-8c02-34f8417797be`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:46:46,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:46,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00030006 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:46,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:46,345::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304911 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:46,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:46,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000390636 s, 942 kB/s\n'; <rc> = 0
>Thread-3097::DEBUG::2014-04-10 17:46:46,700::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-3097::DEBUG::2014-04-10 17:46:46,700::task::579::TaskManager.Task::(_updateState) Task=`2f704ecc-9c97-4313-a2f7-4a3ae37920c7`::moving from state init -> state preparing
>Thread-3097::INFO::2014-04-10 17:46:46,701::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3097::INFO::2014-04-10 17:46:46,701::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3097::DEBUG::2014-04-10 17:46:46,701::task::1168::TaskManager.Task::(prepare) Task=`2f704ecc-9c97-4313-a2f7-4a3ae37920c7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3097::DEBUG::2014-04-10 17:46:46,701::task::579::TaskManager.Task::(_updateState) Task=`2f704ecc-9c97-4313-a2f7-4a3ae37920c7`::moving from state preparing -> state finished
>Thread-3097::DEBUG::2014-04-10 17:46:46,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3097::DEBUG::2014-04-10 17:46:46,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3097::DEBUG::2014-04-10 17:46:46,702::task::974::TaskManager.Task::(_decref) Task=`2f704ecc-9c97-4313-a2f7-4a3ae37920c7`::ref 0 aborting False
>Thread-3098::DEBUG::2014-04-10 17:46:46,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-3098::DEBUG::2014-04-10 17:46:46,720::task::579::TaskManager.Task::(_updateState) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::moving from state init -> state preparing
>Thread-3098::INFO::2014-04-10 17:46:46,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3098::DEBUG::2014-04-10 17:46:46,721::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9428bc62-e588-473c-9155-440cdbead399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3098::DEBUG::2014-04-10 17:46:46,721::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3098::DEBUG::2014-04-10 17:46:46,722::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3098::DEBUG::2014-04-10 17:46:46,722::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9428bc62-e588-473c-9155-440cdbead399`::Granted request
>Thread-3098::DEBUG::2014-04-10 17:46:46,722::task::811::TaskManager.Task::(resourceAcquired) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3098::DEBUG::2014-04-10 17:46:46,722::task::974::TaskManager.Task::(_decref) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::ref 1 aborting False
>Thread-3098::INFO::2014-04-10 17:46:46,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3098::DEBUG::2014-04-10 17:46:46,725::task::1168::TaskManager.Task::(prepare) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3098::DEBUG::2014-04-10 17:46:46,725::task::579::TaskManager.Task::(_updateState) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::moving from state preparing -> state finished
>Thread-3098::DEBUG::2014-04-10 17:46:46,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3098::DEBUG::2014-04-10 17:46:46,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3098::DEBUG::2014-04-10 17:46:46,726::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3098::DEBUG::2014-04-10 17:46:46,726::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3098::DEBUG::2014-04-10 17:46:46,726::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3098::DEBUG::2014-04-10 17:46:46,726::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3098::DEBUG::2014-04-10 17:46:46,726::task::974::TaskManager.Task::(_decref) Task=`ba5d470d-59ff-4931-ac70-0de07a2c9530`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:46:46,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:46,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000396509 s, 1.7 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 17:46:56,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:46:56,195::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340289 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:46:56,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:46:56,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348516 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:46:56,639::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:46:56,655::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:46:56,661::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:46:56,667::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:46:56,668::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:46:56,668::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:46:56,669::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:46:56,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:46:56,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451642 s, 815 kB/s\n'; <rc> = 0
>Thread-3106::DEBUG::2014-04-10 17:46:56,796::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3106::DEBUG::2014-04-10 17:46:56,797::task::579::TaskManager.Task::(_updateState) Task=`7879c8a7-cfa0-4813-aaae-b6be3ac67ec4`::moving from state init -> state preparing
>Thread-3106::INFO::2014-04-10 17:46:56,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3106::INFO::2014-04-10 17:46:56,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3106::DEBUG::2014-04-10 17:46:56,798::task::1168::TaskManager.Task::(prepare) Task=`7879c8a7-cfa0-4813-aaae-b6be3ac67ec4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3106::DEBUG::2014-04-10 17:46:56,798::task::579::TaskManager.Task::(_updateState) Task=`7879c8a7-cfa0-4813-aaae-b6be3ac67ec4`::moving from state preparing -> state finished
>Thread-3106::DEBUG::2014-04-10 17:46:56,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3106::DEBUG::2014-04-10 17:46:56,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3106::DEBUG::2014-04-10 17:46:56,798::task::974::TaskManager.Task::(_decref) Task=`7879c8a7-cfa0-4813-aaae-b6be3ac67ec4`::ref 0 aborting False
>Thread-3107::DEBUG::2014-04-10 17:46:56,805::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3107::DEBUG::2014-04-10 17:46:56,806::task::579::TaskManager.Task::(_updateState) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::moving from state init -> state preparing
>Thread-3107::INFO::2014-04-10 17:46:56,806::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3107::DEBUG::2014-04-10 17:46:56,807::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73e0b558-39dc-4b57-8588-638d5f62eee5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3107::DEBUG::2014-04-10 17:46:56,807::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3107::DEBUG::2014-04-10 17:46:56,807::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3107::DEBUG::2014-04-10 17:46:56,807::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73e0b558-39dc-4b57-8588-638d5f62eee5`::Granted request
>Thread-3107::DEBUG::2014-04-10 17:46:56,808::task::811::TaskManager.Task::(resourceAcquired) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3107::DEBUG::2014-04-10 17:46:56,808::task::974::TaskManager.Task::(_decref) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::ref 1 aborting False
>Thread-3107::INFO::2014-04-10 17:46:56,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3107::DEBUG::2014-04-10 17:46:56,810::task::1168::TaskManager.Task::(prepare) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3107::DEBUG::2014-04-10 17:46:56,810::task::579::TaskManager.Task::(_updateState) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::moving from state preparing -> state finished
>Thread-3107::DEBUG::2014-04-10 17:46:56,811::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3107::DEBUG::2014-04-10 17:46:56,811::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3107::DEBUG::2014-04-10 17:46:56,811::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3107::DEBUG::2014-04-10 17:46:56,811::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3107::DEBUG::2014-04-10 17:46:56,811::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3107::DEBUG::2014-04-10 17:46:56,812::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3107::DEBUG::2014-04-10 17:46:56,812::task::974::TaskManager.Task::(_decref) Task=`ab68fb95-7701-4cef-90cb-5973aa7a8ec3`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:46:56,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:46:56,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494362 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3109::DEBUG::2014-04-10 17:47:00,436::task::579::TaskManager.Task::(_updateState) Task=`be27e747-01ef-4305-b0d3-8a321d462b12`::moving from state init -> state preparing
>Thread-3109::INFO::2014-04-10 17:47:00,436::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3109::INFO::2014-04-10 17:47:00,436::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494362', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340289', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348516', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451642', 'lastCheck': '3.8', 'valid': True}}
>Thread-3109::DEBUG::2014-04-10 17:47:00,437::task::1168::TaskManager.Task::(prepare) Task=`be27e747-01ef-4305-b0d3-8a321d462b12`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494362', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340289', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348516', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451642', 'lastCheck': '3.8', 'valid': True}}
>Thread-3109::DEBUG::2014-04-10 17:47:00,437::task::579::TaskManager.Task::(_updateState) Task=`be27e747-01ef-4305-b0d3-8a321d462b12`::moving from state preparing -> state finished
>Thread-3109::DEBUG::2014-04-10 17:47:00,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3109::DEBUG::2014-04-10 17:47:00,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3109::DEBUG::2014-04-10 17:47:00,437::task::974::TaskManager.Task::(_decref) Task=`be27e747-01ef-4305-b0d3-8a321d462b12`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:06,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:06,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281385 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:06,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:06,375::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284398 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:06,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:06,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000504612 s, 729 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:06,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:06,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000508951 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3113::DEBUG::2014-04-10 17:47:06,887::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3113::DEBUG::2014-04-10 17:47:06,888::task::579::TaskManager.Task::(_updateState) Task=`8b88fec1-d3f9-437d-8274-6537d39adf60`::moving from state init -> state preparing
>Thread-3113::INFO::2014-04-10 17:47:06,888::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3113::INFO::2014-04-10 17:47:06,888::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3113::DEBUG::2014-04-10 17:47:06,888::task::1168::TaskManager.Task::(prepare) Task=`8b88fec1-d3f9-437d-8274-6537d39adf60`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3113::DEBUG::2014-04-10 17:47:06,889::task::579::TaskManager.Task::(_updateState) Task=`8b88fec1-d3f9-437d-8274-6537d39adf60`::moving from state preparing -> state finished
>Thread-3113::DEBUG::2014-04-10 17:47:06,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3113::DEBUG::2014-04-10 17:47:06,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3113::DEBUG::2014-04-10 17:47:06,889::task::974::TaskManager.Task::(_decref) Task=`8b88fec1-d3f9-437d-8274-6537d39adf60`::ref 0 aborting False
>Thread-3114::DEBUG::2014-04-10 17:47:06,896::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3114::DEBUG::2014-04-10 17:47:06,896::task::579::TaskManager.Task::(_updateState) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::moving from state init -> state preparing
>Thread-3114::INFO::2014-04-10 17:47:06,896::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3114::DEBUG::2014-04-10 17:47:06,897::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`82a46d46-f242-447f-8379-2a691523e60b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3114::DEBUG::2014-04-10 17:47:06,897::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3114::DEBUG::2014-04-10 17:47:06,897::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3114::DEBUG::2014-04-10 17:47:06,897::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`82a46d46-f242-447f-8379-2a691523e60b`::Granted request
>Thread-3114::DEBUG::2014-04-10 17:47:06,898::task::811::TaskManager.Task::(resourceAcquired) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3114::DEBUG::2014-04-10 17:47:06,898::task::974::TaskManager.Task::(_decref) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::ref 1 aborting False
>Thread-3114::INFO::2014-04-10 17:47:06,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3114::DEBUG::2014-04-10 17:47:06,900::task::1168::TaskManager.Task::(prepare) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3114::DEBUG::2014-04-10 17:47:06,900::task::579::TaskManager.Task::(_updateState) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::moving from state preparing -> state finished
>Thread-3114::DEBUG::2014-04-10 17:47:06,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3114::DEBUG::2014-04-10 17:47:06,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3114::DEBUG::2014-04-10 17:47:06,901::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3114::DEBUG::2014-04-10 17:47:06,901::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3114::DEBUG::2014-04-10 17:47:06,901::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3114::DEBUG::2014-04-10 17:47:06,902::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3114::DEBUG::2014-04-10 17:47:06,902::task::974::TaskManager.Task::(_decref) Task=`5f132cbc-95eb-43a1-a091-a51dfea78633`::ref 0 aborting False
>Thread-3117::DEBUG::2014-04-10 17:47:15,600::task::579::TaskManager.Task::(_updateState) Task=`fbd313b0-7cd2-466b-a5bb-0fd66af0e29a`::moving from state init -> state preparing
>Thread-3117::INFO::2014-04-10 17:47:15,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3117::INFO::2014-04-10 17:47:15,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508951', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281385', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284398', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504612', 'lastCheck': '8.9', 'valid': True}}
>Thread-3117::DEBUG::2014-04-10 17:47:15,601::task::1168::TaskManager.Task::(prepare) Task=`fbd313b0-7cd2-466b-a5bb-0fd66af0e29a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508951', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281385', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284398', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504612', 'lastCheck': '8.9', 'valid': True}}
>Thread-3117::DEBUG::2014-04-10 17:47:15,601::task::579::TaskManager.Task::(_updateState) Task=`fbd313b0-7cd2-466b-a5bb-0fd66af0e29a`::moving from state preparing -> state finished
>Thread-3117::DEBUG::2014-04-10 17:47:15,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3117::DEBUG::2014-04-10 17:47:15,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3117::DEBUG::2014-04-10 17:47:15,602::task::974::TaskManager.Task::(_decref) Task=`fbd313b0-7cd2-466b-a5bb-0fd66af0e29a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:16,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:16,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000392746 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:16,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:16,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279556 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:16,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:16,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493487 s, 746 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:16,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:16,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000363164 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3119::DEBUG::2014-04-10 17:47:16,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3119::DEBUG::2014-04-10 17:47:16,986::task::579::TaskManager.Task::(_updateState) Task=`adc6a5f4-ddf7-40a8-b40e-adb8ba3dd63e`::moving from state init -> state preparing
>Thread-3119::INFO::2014-04-10 17:47:16,986::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3119::INFO::2014-04-10 17:47:16,987::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3119::DEBUG::2014-04-10 17:47:16,987::task::1168::TaskManager.Task::(prepare) Task=`adc6a5f4-ddf7-40a8-b40e-adb8ba3dd63e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3119::DEBUG::2014-04-10 17:47:16,987::task::579::TaskManager.Task::(_updateState) Task=`adc6a5f4-ddf7-40a8-b40e-adb8ba3dd63e`::moving from state preparing -> state finished
>Thread-3119::DEBUG::2014-04-10 17:47:16,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3119::DEBUG::2014-04-10 17:47:16,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3119::DEBUG::2014-04-10 17:47:16,988::task::974::TaskManager.Task::(_decref) Task=`adc6a5f4-ddf7-40a8-b40e-adb8ba3dd63e`::ref 0 aborting False
>Thread-3120::DEBUG::2014-04-10 17:47:16,994::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3120::DEBUG::2014-04-10 17:47:16,995::task::579::TaskManager.Task::(_updateState) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::moving from state init -> state preparing
>Thread-3120::INFO::2014-04-10 17:47:16,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3120::DEBUG::2014-04-10 17:47:16,995::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ad3af4e-c2de-4b20-931c-7d17eb5f5b3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3120::DEBUG::2014-04-10 17:47:16,995::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3120::DEBUG::2014-04-10 17:47:16,996::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3120::DEBUG::2014-04-10 17:47:16,996::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7ad3af4e-c2de-4b20-931c-7d17eb5f5b3f`::Granted request
>Thread-3120::DEBUG::2014-04-10 17:47:16,996::task::811::TaskManager.Task::(resourceAcquired) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3120::DEBUG::2014-04-10 17:47:16,996::task::974::TaskManager.Task::(_decref) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::ref 1 aborting False
>Thread-3120::INFO::2014-04-10 17:47:16,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3120::DEBUG::2014-04-10 17:47:16,999::task::1168::TaskManager.Task::(prepare) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3120::DEBUG::2014-04-10 17:47:16,999::task::579::TaskManager.Task::(_updateState) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::moving from state preparing -> state finished
>Thread-3120::DEBUG::2014-04-10 17:47:16,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3120::DEBUG::2014-04-10 17:47:16,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3120::DEBUG::2014-04-10 17:47:17,000::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3120::DEBUG::2014-04-10 17:47:17,000::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3120::DEBUG::2014-04-10 17:47:17,000::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3120::DEBUG::2014-04-10 17:47:17,000::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3120::DEBUG::2014-04-10 17:47:17,000::task::974::TaskManager.Task::(_decref) Task=`fd80dd63-ce77-4ef2-b624-1f06a5f37664`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:26,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:26,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321094 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:26,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:26,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000298914 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:26,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:26,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000440664 s, 835 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:26,869::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:26,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00038172 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3124::DEBUG::2014-04-10 17:47:27,075::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3124::DEBUG::2014-04-10 17:47:27,075::task::579::TaskManager.Task::(_updateState) Task=`23df7563-9ce5-4f84-97ec-b8a8c82fd7ae`::moving from state init -> state preparing
>Thread-3124::INFO::2014-04-10 17:47:27,076::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3124::INFO::2014-04-10 17:47:27,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3124::DEBUG::2014-04-10 17:47:27,076::task::1168::TaskManager.Task::(prepare) Task=`23df7563-9ce5-4f84-97ec-b8a8c82fd7ae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3124::DEBUG::2014-04-10 17:47:27,076::task::579::TaskManager.Task::(_updateState) Task=`23df7563-9ce5-4f84-97ec-b8a8c82fd7ae`::moving from state preparing -> state finished
>Thread-3124::DEBUG::2014-04-10 17:47:27,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3124::DEBUG::2014-04-10 17:47:27,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3124::DEBUG::2014-04-10 17:47:27,077::task::974::TaskManager.Task::(_decref) Task=`23df7563-9ce5-4f84-97ec-b8a8c82fd7ae`::ref 0 aborting False
>Thread-3125::DEBUG::2014-04-10 17:47:27,083::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3125::DEBUG::2014-04-10 17:47:27,084::task::579::TaskManager.Task::(_updateState) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::moving from state init -> state preparing
>Thread-3125::INFO::2014-04-10 17:47:27,084::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3125::DEBUG::2014-04-10 17:47:27,086::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ddae781-8acc-4ffb-bd60-d5797f4dd2f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3125::DEBUG::2014-04-10 17:47:27,086::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3125::DEBUG::2014-04-10 17:47:27,086::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3125::DEBUG::2014-04-10 17:47:27,086::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ddae781-8acc-4ffb-bd60-d5797f4dd2f0`::Granted request
>Thread-3125::DEBUG::2014-04-10 17:47:27,087::task::811::TaskManager.Task::(resourceAcquired) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3125::DEBUG::2014-04-10 17:47:27,087::task::974::TaskManager.Task::(_decref) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::ref 1 aborting False
>Thread-3125::INFO::2014-04-10 17:47:27,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3125::DEBUG::2014-04-10 17:47:27,089::task::1168::TaskManager.Task::(prepare) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3125::DEBUG::2014-04-10 17:47:27,089::task::579::TaskManager.Task::(_updateState) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::moving from state preparing -> state finished
>Thread-3125::DEBUG::2014-04-10 17:47:27,089::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3125::DEBUG::2014-04-10 17:47:27,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3125::DEBUG::2014-04-10 17:47:27,090::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3125::DEBUG::2014-04-10 17:47:27,090::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3125::DEBUG::2014-04-10 17:47:27,090::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3125::DEBUG::2014-04-10 17:47:27,090::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3125::DEBUG::2014-04-10 17:47:27,091::task::974::TaskManager.Task::(_decref) Task=`bfcd08f6-010c-4525-87d3-e875ff9d73d0`::ref 0 aborting False
>Thread-3127::DEBUG::2014-04-10 17:47:30,763::task::579::TaskManager.Task::(_updateState) Task=`3c613c87-15ac-4451-b574-0fddfc571e1d`::moving from state init -> state preparing
>Thread-3127::INFO::2014-04-10 17:47:30,763::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3127::INFO::2014-04-10 17:47:30,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038172', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321094', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298914', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440664', 'lastCheck': '4.0', 'valid': True}}
>Thread-3127::DEBUG::2014-04-10 17:47:30,763::task::1168::TaskManager.Task::(prepare) Task=`3c613c87-15ac-4451-b574-0fddfc571e1d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038172', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321094', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000298914', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440664', 'lastCheck': '4.0', 'valid': True}}
>Thread-3127::DEBUG::2014-04-10 17:47:30,763::task::579::TaskManager.Task::(_updateState) Task=`3c613c87-15ac-4451-b574-0fddfc571e1d`::moving from state preparing -> state finished
>Thread-3127::DEBUG::2014-04-10 17:47:30,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3127::DEBUG::2014-04-10 17:47:30,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3127::DEBUG::2014-04-10 17:47:30,764::task::974::TaskManager.Task::(_decref) Task=`3c613c87-15ac-4451-b574-0fddfc571e1d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:36,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:36,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297546 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:36,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:36,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265091 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:36,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:36,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000556124 s, 662 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:36,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:36,889::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406147 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3131::DEBUG::2014-04-10 17:47:37,174::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3131::DEBUG::2014-04-10 17:47:37,175::task::579::TaskManager.Task::(_updateState) Task=`dde700bb-4796-4701-84df-e03ddd3dc1d7`::moving from state init -> state preparing
>Thread-3131::INFO::2014-04-10 17:47:37,175::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3131::INFO::2014-04-10 17:47:37,176::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3131::DEBUG::2014-04-10 17:47:37,176::task::1168::TaskManager.Task::(prepare) Task=`dde700bb-4796-4701-84df-e03ddd3dc1d7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3131::DEBUG::2014-04-10 17:47:37,176::task::579::TaskManager.Task::(_updateState) Task=`dde700bb-4796-4701-84df-e03ddd3dc1d7`::moving from state preparing -> state finished
>Thread-3131::DEBUG::2014-04-10 17:47:37,176::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3131::DEBUG::2014-04-10 17:47:37,176::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3131::DEBUG::2014-04-10 17:47:37,176::task::974::TaskManager.Task::(_decref) Task=`dde700bb-4796-4701-84df-e03ddd3dc1d7`::ref 0 aborting False
>Thread-3132::DEBUG::2014-04-10 17:47:37,183::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3132::DEBUG::2014-04-10 17:47:37,184::task::579::TaskManager.Task::(_updateState) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::moving from state init -> state preparing
>Thread-3132::INFO::2014-04-10 17:47:37,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3132::DEBUG::2014-04-10 17:47:37,185::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed584ee1-12a1-4720-a3f3-2e0e3b538c0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3132::DEBUG::2014-04-10 17:47:37,185::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3132::DEBUG::2014-04-10 17:47:37,185::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3132::DEBUG::2014-04-10 17:47:37,185::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed584ee1-12a1-4720-a3f3-2e0e3b538c0a`::Granted request
>Thread-3132::DEBUG::2014-04-10 17:47:37,186::task::811::TaskManager.Task::(resourceAcquired) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3132::DEBUG::2014-04-10 17:47:37,186::task::974::TaskManager.Task::(_decref) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::ref 1 aborting False
>Thread-3132::INFO::2014-04-10 17:47:37,188::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3132::DEBUG::2014-04-10 17:47:37,188::task::1168::TaskManager.Task::(prepare) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3132::DEBUG::2014-04-10 17:47:37,188::task::579::TaskManager.Task::(_updateState) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::moving from state preparing -> state finished
>Thread-3132::DEBUG::2014-04-10 17:47:37,189::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3132::DEBUG::2014-04-10 17:47:37,189::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3132::DEBUG::2014-04-10 17:47:37,189::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3132::DEBUG::2014-04-10 17:47:37,189::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3132::DEBUG::2014-04-10 17:47:37,189::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3132::DEBUG::2014-04-10 17:47:37,190::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3132::DEBUG::2014-04-10 17:47:37,190::task::974::TaskManager.Task::(_decref) Task=`65e9131f-ba99-4035-849c-259d37c63c6c`::ref 0 aborting False
>Thread-3135::DEBUG::2014-04-10 17:47:45,916::task::579::TaskManager.Task::(_updateState) Task=`c3e9f856-19c9-4038-9fb8-6d621c39517e`::moving from state init -> state preparing
>Thread-3135::INFO::2014-04-10 17:47:45,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3135::INFO::2014-04-10 17:47:45,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406147', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297546', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265091', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556124', 'lastCheck': '9.2', 'valid': True}}
>Thread-3135::DEBUG::2014-04-10 17:47:45,917::task::1168::TaskManager.Task::(prepare) Task=`c3e9f856-19c9-4038-9fb8-6d621c39517e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406147', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297546', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265091', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556124', 'lastCheck': '9.2', 'valid': True}}
>Thread-3135::DEBUG::2014-04-10 17:47:45,917::task::579::TaskManager.Task::(_updateState) Task=`c3e9f856-19c9-4038-9fb8-6d621c39517e`::moving from state preparing -> state finished
>Thread-3135::DEBUG::2014-04-10 17:47:45,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3135::DEBUG::2014-04-10 17:47:45,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3135::DEBUG::2014-04-10 17:47:45,917::task::974::TaskManager.Task::(_decref) Task=`c3e9f856-19c9-4038-9fb8-6d621c39517e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:46,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:46,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000318289 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:46,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:46,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313076 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:46,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:46,759::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000371407 s, 991 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:46,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:46,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000385972 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3137::DEBUG::2014-04-10 17:47:47,274::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3137::DEBUG::2014-04-10 17:47:47,275::task::579::TaskManager.Task::(_updateState) Task=`07b7dc0e-4cae-416e-87f9-2d6222e4f958`::moving from state init -> state preparing
>Thread-3137::INFO::2014-04-10 17:47:47,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3137::INFO::2014-04-10 17:47:47,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3137::DEBUG::2014-04-10 17:47:47,275::task::1168::TaskManager.Task::(prepare) Task=`07b7dc0e-4cae-416e-87f9-2d6222e4f958`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3137::DEBUG::2014-04-10 17:47:47,276::task::579::TaskManager.Task::(_updateState) Task=`07b7dc0e-4cae-416e-87f9-2d6222e4f958`::moving from state preparing -> state finished
>Thread-3137::DEBUG::2014-04-10 17:47:47,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3137::DEBUG::2014-04-10 17:47:47,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3137::DEBUG::2014-04-10 17:47:47,276::task::974::TaskManager.Task::(_decref) Task=`07b7dc0e-4cae-416e-87f9-2d6222e4f958`::ref 0 aborting False
>Thread-3138::DEBUG::2014-04-10 17:47:47,283::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3138::DEBUG::2014-04-10 17:47:47,283::task::579::TaskManager.Task::(_updateState) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::moving from state init -> state preparing
>Thread-3138::INFO::2014-04-10 17:47:47,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3138::DEBUG::2014-04-10 17:47:47,284::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4aaa12f0-c8d2-45bb-9c34-92a76c5021b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3138::DEBUG::2014-04-10 17:47:47,284::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3138::DEBUG::2014-04-10 17:47:47,285::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3138::DEBUG::2014-04-10 17:47:47,285::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4aaa12f0-c8d2-45bb-9c34-92a76c5021b7`::Granted request
>Thread-3138::DEBUG::2014-04-10 17:47:47,285::task::811::TaskManager.Task::(resourceAcquired) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3138::DEBUG::2014-04-10 17:47:47,285::task::974::TaskManager.Task::(_decref) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::ref 1 aborting False
>Thread-3138::INFO::2014-04-10 17:47:47,287::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3138::DEBUG::2014-04-10 17:47:47,287::task::1168::TaskManager.Task::(prepare) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3138::DEBUG::2014-04-10 17:47:47,287::task::579::TaskManager.Task::(_updateState) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::moving from state preparing -> state finished
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3138::DEBUG::2014-04-10 17:47:47,288::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3138::DEBUG::2014-04-10 17:47:47,289::task::974::TaskManager.Task::(_decref) Task=`754e7362-d874-465e-bcb0-40df397e33cc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:47:56,273::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:47:56,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395065 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:47:56,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:47:56,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000251363 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:47:56,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:47:56,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000506221 s, 727 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:47:56,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:47:56,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000522309 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3142::DEBUG::2014-04-10 17:47:57,363::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3142::DEBUG::2014-04-10 17:47:57,364::task::579::TaskManager.Task::(_updateState) Task=`c8a4f78a-0f0b-4ae2-990b-cba963d9c2a1`::moving from state init -> state preparing
>Thread-3142::INFO::2014-04-10 17:47:57,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3142::INFO::2014-04-10 17:47:57,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3142::DEBUG::2014-04-10 17:47:57,365::task::1168::TaskManager.Task::(prepare) Task=`c8a4f78a-0f0b-4ae2-990b-cba963d9c2a1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3142::DEBUG::2014-04-10 17:47:57,365::task::579::TaskManager.Task::(_updateState) Task=`c8a4f78a-0f0b-4ae2-990b-cba963d9c2a1`::moving from state preparing -> state finished
>Thread-3142::DEBUG::2014-04-10 17:47:57,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3142::DEBUG::2014-04-10 17:47:57,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3142::DEBUG::2014-04-10 17:47:57,365::task::974::TaskManager.Task::(_decref) Task=`c8a4f78a-0f0b-4ae2-990b-cba963d9c2a1`::ref 0 aborting False
>Thread-3143::DEBUG::2014-04-10 17:47:57,373::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3143::DEBUG::2014-04-10 17:47:57,373::task::579::TaskManager.Task::(_updateState) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::moving from state init -> state preparing
>Thread-3143::INFO::2014-04-10 17:47:57,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3143::DEBUG::2014-04-10 17:47:57,374::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`951c4555-f44f-4ee8-9133-39523ac8960d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3143::DEBUG::2014-04-10 17:47:57,374::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3143::DEBUG::2014-04-10 17:47:57,374::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3143::DEBUG::2014-04-10 17:47:57,375::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`951c4555-f44f-4ee8-9133-39523ac8960d`::Granted request
>Thread-3143::DEBUG::2014-04-10 17:47:57,375::task::811::TaskManager.Task::(resourceAcquired) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3143::DEBUG::2014-04-10 17:47:57,375::task::974::TaskManager.Task::(_decref) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::ref 1 aborting False
>Thread-3143::INFO::2014-04-10 17:47:57,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3143::DEBUG::2014-04-10 17:47:57,378::task::1168::TaskManager.Task::(prepare) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3143::DEBUG::2014-04-10 17:47:57,378::task::579::TaskManager.Task::(_updateState) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::moving from state preparing -> state finished
>Thread-3143::DEBUG::2014-04-10 17:47:57,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3143::DEBUG::2014-04-10 17:47:57,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3143::DEBUG::2014-04-10 17:47:57,378::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3143::DEBUG::2014-04-10 17:47:57,379::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3143::DEBUG::2014-04-10 17:47:57,379::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3143::DEBUG::2014-04-10 17:47:57,379::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3143::DEBUG::2014-04-10 17:47:57,379::task::974::TaskManager.Task::(_decref) Task=`9b39d84b-36df-479a-9a79-13cd8dc6e085`::ref 0 aborting False
>Thread-3145::DEBUG::2014-04-10 17:48:01,077::task::579::TaskManager.Task::(_updateState) Task=`2c9cb338-aca3-4ed2-8a47-49636afe1e8d`::moving from state init -> state preparing
>Thread-3145::INFO::2014-04-10 17:48:01,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3145::INFO::2014-04-10 17:48:01,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522309', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395065', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251363', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506221', 'lastCheck': '4.3', 'valid': True}}
>Thread-3145::DEBUG::2014-04-10 17:48:01,077::task::1168::TaskManager.Task::(prepare) Task=`2c9cb338-aca3-4ed2-8a47-49636afe1e8d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522309', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395065', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000251363', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506221', 'lastCheck': '4.3', 'valid': True}}
>Thread-3145::DEBUG::2014-04-10 17:48:01,078::task::579::TaskManager.Task::(_updateState) Task=`2c9cb338-aca3-4ed2-8a47-49636afe1e8d`::moving from state preparing -> state finished
>Thread-3145::DEBUG::2014-04-10 17:48:01,078::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3145::DEBUG::2014-04-10 17:48:01,078::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3145::DEBUG::2014-04-10 17:48:01,078::task::974::TaskManager.Task::(_decref) Task=`2c9cb338-aca3-4ed2-8a47-49636afe1e8d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:06,287::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:06,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377027 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:06,459::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:06,465::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028053 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:48:06,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:06,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00040074 s, 918 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:06,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:06,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000476888 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3149::DEBUG::2014-04-10 17:48:07,463::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-3149::DEBUG::2014-04-10 17:48:07,463::task::579::TaskManager.Task::(_updateState) Task=`3094f5ce-81ad-49cd-8701-190ca73c6166`::moving from state init -> state preparing
>Thread-3149::INFO::2014-04-10 17:48:07,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3149::INFO::2014-04-10 17:48:07,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3149::DEBUG::2014-04-10 17:48:07,464::task::1168::TaskManager.Task::(prepare) Task=`3094f5ce-81ad-49cd-8701-190ca73c6166`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3149::DEBUG::2014-04-10 17:48:07,464::task::579::TaskManager.Task::(_updateState) Task=`3094f5ce-81ad-49cd-8701-190ca73c6166`::moving from state preparing -> state finished
>Thread-3149::DEBUG::2014-04-10 17:48:07,465::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3149::DEBUG::2014-04-10 17:48:07,465::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3149::DEBUG::2014-04-10 17:48:07,465::task::974::TaskManager.Task::(_decref) Task=`3094f5ce-81ad-49cd-8701-190ca73c6166`::ref 0 aborting False
>Thread-3150::DEBUG::2014-04-10 17:48:07,472::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-3150::DEBUG::2014-04-10 17:48:07,473::task::579::TaskManager.Task::(_updateState) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::moving from state init -> state preparing
>Thread-3150::INFO::2014-04-10 17:48:07,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3150::DEBUG::2014-04-10 17:48:07,473::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2bdd2832-c7c1-47fd-9bb5-1b7ee5f41420`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3150::DEBUG::2014-04-10 17:48:07,474::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3150::DEBUG::2014-04-10 17:48:07,474::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3150::DEBUG::2014-04-10 17:48:07,474::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2bdd2832-c7c1-47fd-9bb5-1b7ee5f41420`::Granted request
>Thread-3150::DEBUG::2014-04-10 17:48:07,475::task::811::TaskManager.Task::(resourceAcquired) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3150::DEBUG::2014-04-10 17:48:07,476::task::974::TaskManager.Task::(_decref) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::ref 1 aborting False
>Thread-3150::INFO::2014-04-10 17:48:07,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3150::DEBUG::2014-04-10 17:48:07,478::task::1168::TaskManager.Task::(prepare) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3150::DEBUG::2014-04-10 17:48:07,478::task::579::TaskManager.Task::(_updateState) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::moving from state preparing -> state finished
>Thread-3150::DEBUG::2014-04-10 17:48:07,478::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3150::DEBUG::2014-04-10 17:48:07,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3150::DEBUG::2014-04-10 17:48:07,479::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3150::DEBUG::2014-04-10 17:48:07,479::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3150::DEBUG::2014-04-10 17:48:07,479::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3150::DEBUG::2014-04-10 17:48:07,479::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3150::DEBUG::2014-04-10 17:48:07,480::task::974::TaskManager.Task::(_decref) Task=`494b9ede-f214-422a-abf5-ea720ff07877`::ref 0 aborting False
>Thread-3153::DEBUG::2014-04-10 17:48:16,250::task::579::TaskManager.Task::(_updateState) Task=`45520555-58a6-4cf4-9a43-0c55c7048511`::moving from state init -> state preparing
>Thread-3153::INFO::2014-04-10 17:48:16,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3153::INFO::2014-04-10 17:48:16,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476888', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377027', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028053', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040074', 'lastCheck': '9.4', 'valid': True}}
>Thread-3153::DEBUG::2014-04-10 17:48:16,251::task::1168::TaskManager.Task::(prepare) Task=`45520555-58a6-4cf4-9a43-0c55c7048511`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476888', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377027', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028053', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040074', 'lastCheck': '9.4', 'valid': True}}
>Thread-3153::DEBUG::2014-04-10 17:48:16,251::task::579::TaskManager.Task::(_updateState) Task=`45520555-58a6-4cf4-9a43-0c55c7048511`::moving from state preparing -> state finished
>Thread-3153::DEBUG::2014-04-10 17:48:16,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3153::DEBUG::2014-04-10 17:48:16,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3153::DEBUG::2014-04-10 17:48:16,252::task::974::TaskManager.Task::(_decref) Task=`45520555-58a6-4cf4-9a43-0c55c7048511`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:16,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:16,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307986 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:16,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:16,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028964 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:48:16,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:16,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509205 s, 723 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:16,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:16,946::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000394601 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3155::DEBUG::2014-04-10 17:48:17,594::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3155::DEBUG::2014-04-10 17:48:17,595::task::579::TaskManager.Task::(_updateState) Task=`f9f64039-70e7-4ed8-a878-48babff651ac`::moving from state init -> state preparing
>Thread-3155::INFO::2014-04-10 17:48:17,595::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3155::INFO::2014-04-10 17:48:17,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3155::DEBUG::2014-04-10 17:48:17,595::task::1168::TaskManager.Task::(prepare) Task=`f9f64039-70e7-4ed8-a878-48babff651ac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3155::DEBUG::2014-04-10 17:48:17,596::task::579::TaskManager.Task::(_updateState) Task=`f9f64039-70e7-4ed8-a878-48babff651ac`::moving from state preparing -> state finished
>Thread-3155::DEBUG::2014-04-10 17:48:17,596::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3155::DEBUG::2014-04-10 17:48:17,596::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3155::DEBUG::2014-04-10 17:48:17,596::task::974::TaskManager.Task::(_decref) Task=`f9f64039-70e7-4ed8-a878-48babff651ac`::ref 0 aborting False
>Thread-3156::DEBUG::2014-04-10 17:48:17,603::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3156::DEBUG::2014-04-10 17:48:17,603::task::579::TaskManager.Task::(_updateState) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::moving from state init -> state preparing
>Thread-3156::INFO::2014-04-10 17:48:17,604::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3156::DEBUG::2014-04-10 17:48:17,604::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`07dc0a6d-d8c1-4504-9811-69bbc80b451b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3156::DEBUG::2014-04-10 17:48:17,604::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3156::DEBUG::2014-04-10 17:48:17,605::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3156::DEBUG::2014-04-10 17:48:17,605::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`07dc0a6d-d8c1-4504-9811-69bbc80b451b`::Granted request
>Thread-3156::DEBUG::2014-04-10 17:48:17,605::task::811::TaskManager.Task::(resourceAcquired) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3156::DEBUG::2014-04-10 17:48:17,605::task::974::TaskManager.Task::(_decref) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::ref 1 aborting False
>Thread-3156::INFO::2014-04-10 17:48:17,608::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3156::DEBUG::2014-04-10 17:48:17,608::task::1168::TaskManager.Task::(prepare) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3156::DEBUG::2014-04-10 17:48:17,608::task::579::TaskManager.Task::(_updateState) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::moving from state preparing -> state finished
>Thread-3156::DEBUG::2014-04-10 17:48:17,608::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3156::DEBUG::2014-04-10 17:48:17,608::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3156::DEBUG::2014-04-10 17:48:17,609::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3156::DEBUG::2014-04-10 17:48:17,609::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3156::DEBUG::2014-04-10 17:48:17,609::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3156::DEBUG::2014-04-10 17:48:17,609::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3156::DEBUG::2014-04-10 17:48:17,609::task::974::TaskManager.Task::(_decref) Task=`f1488d8a-069f-4671-bb41-7e370206b0ef`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:26,316::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:26,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000392105 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:26,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:26,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353722 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:48:26,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:26,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000434802 s, 846 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:26,949::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:48:26,964::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:48:26,965::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:48:26,971::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:48:26,972::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:48:26,972::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:48:26,973::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:48:26,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:26,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000395104 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3164::DEBUG::2014-04-10 17:48:27,696::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-3164::DEBUG::2014-04-10 17:48:27,700::task::579::TaskManager.Task::(_updateState) Task=`4097a5c4-cfc6-46b2-a6a1-cd5dff35904e`::moving from state init -> state preparing
>Thread-3164::INFO::2014-04-10 17:48:27,702::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3164::INFO::2014-04-10 17:48:27,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3164::DEBUG::2014-04-10 17:48:27,706::task::1168::TaskManager.Task::(prepare) Task=`4097a5c4-cfc6-46b2-a6a1-cd5dff35904e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3164::DEBUG::2014-04-10 17:48:27,708::task::579::TaskManager.Task::(_updateState) Task=`4097a5c4-cfc6-46b2-a6a1-cd5dff35904e`::moving from state preparing -> state finished
>Thread-3164::DEBUG::2014-04-10 17:48:27,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3164::DEBUG::2014-04-10 17:48:27,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3164::DEBUG::2014-04-10 17:48:27,713::task::974::TaskManager.Task::(_decref) Task=`4097a5c4-cfc6-46b2-a6a1-cd5dff35904e`::ref 0 aborting False
>Thread-3165::DEBUG::2014-04-10 17:48:27,727::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-3165::DEBUG::2014-04-10 17:48:27,729::task::579::TaskManager.Task::(_updateState) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::moving from state init -> state preparing
>Thread-3165::INFO::2014-04-10 17:48:27,731::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3165::DEBUG::2014-04-10 17:48:27,735::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`999a8c31-e830-4ca0-ad29-b537dd063280`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3165::DEBUG::2014-04-10 17:48:27,737::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3165::DEBUG::2014-04-10 17:48:27,740::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3165::DEBUG::2014-04-10 17:48:27,741::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`999a8c31-e830-4ca0-ad29-b537dd063280`::Granted request
>Thread-3165::DEBUG::2014-04-10 17:48:27,745::task::811::TaskManager.Task::(resourceAcquired) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3165::DEBUG::2014-04-10 17:48:27,747::task::974::TaskManager.Task::(_decref) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::ref 1 aborting False
>Thread-3165::INFO::2014-04-10 17:48:27,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3165::DEBUG::2014-04-10 17:48:27,769::task::1168::TaskManager.Task::(prepare) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3165::DEBUG::2014-04-10 17:48:27,771::task::579::TaskManager.Task::(_updateState) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::moving from state preparing -> state finished
>Thread-3165::DEBUG::2014-04-10 17:48:27,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3165::DEBUG::2014-04-10 17:48:27,773::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3165::DEBUG::2014-04-10 17:48:27,776::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3165::DEBUG::2014-04-10 17:48:27,779::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3165::DEBUG::2014-04-10 17:48:27,780::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3165::DEBUG::2014-04-10 17:48:27,781::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3165::DEBUG::2014-04-10 17:48:27,784::task::974::TaskManager.Task::(_decref) Task=`48b99cb4-6e40-4f67-b410-f6b1d067553c`::ref 0 aborting False
>Thread-3167::DEBUG::2014-04-10 17:48:31,405::task::579::TaskManager.Task::(_updateState) Task=`3ea27478-519f-495d-8946-4823520c5734`::moving from state init -> state preparing
>Thread-3167::INFO::2014-04-10 17:48:31,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3167::INFO::2014-04-10 17:48:31,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395104', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392105', 'lastCheck': '5.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353722', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434802', 'lastCheck': '4.6', 'valid': True}}
>Thread-3167::DEBUG::2014-04-10 17:48:31,405::task::1168::TaskManager.Task::(prepare) Task=`3ea27478-519f-495d-8946-4823520c5734`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395104', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392105', 'lastCheck': '5.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353722', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434802', 'lastCheck': '4.6', 'valid': True}}
>Thread-3167::DEBUG::2014-04-10 17:48:31,406::task::579::TaskManager.Task::(_updateState) Task=`3ea27478-519f-495d-8946-4823520c5734`::moving from state preparing -> state finished
>Thread-3167::DEBUG::2014-04-10 17:48:31,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3167::DEBUG::2014-04-10 17:48:31,406::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3167::DEBUG::2014-04-10 17:48:31,406::task::974::TaskManager.Task::(_decref) Task=`3ea27478-519f-495d-8946-4823520c5734`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:36,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:36,335::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280199 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:36,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:36,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282215 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:48:36,845::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:36,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00040036 s, 919 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:36,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:36,997::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459482 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3171::DEBUG::2014-04-10 17:48:37,881::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3171::DEBUG::2014-04-10 17:48:37,882::task::579::TaskManager.Task::(_updateState) Task=`15b8bf34-eb25-46bc-91a0-f1445f130471`::moving from state init -> state preparing
>Thread-3171::INFO::2014-04-10 17:48:37,882::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3171::INFO::2014-04-10 17:48:37,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3171::DEBUG::2014-04-10 17:48:37,883::task::1168::TaskManager.Task::(prepare) Task=`15b8bf34-eb25-46bc-91a0-f1445f130471`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3171::DEBUG::2014-04-10 17:48:37,883::task::579::TaskManager.Task::(_updateState) Task=`15b8bf34-eb25-46bc-91a0-f1445f130471`::moving from state preparing -> state finished
>Thread-3171::DEBUG::2014-04-10 17:48:37,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3171::DEBUG::2014-04-10 17:48:37,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3171::DEBUG::2014-04-10 17:48:37,883::task::974::TaskManager.Task::(_decref) Task=`15b8bf34-eb25-46bc-91a0-f1445f130471`::ref 0 aborting False
>Thread-3172::DEBUG::2014-04-10 17:48:37,890::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3172::DEBUG::2014-04-10 17:48:37,890::task::579::TaskManager.Task::(_updateState) Task=`41116958-04e0-4edb-9035-16da348382e5`::moving from state init -> state preparing
>Thread-3172::INFO::2014-04-10 17:48:37,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3172::DEBUG::2014-04-10 17:48:37,891::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895b988f-2aa8-412d-a963-c413abbd4898`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3172::DEBUG::2014-04-10 17:48:37,891::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3172::DEBUG::2014-04-10 17:48:37,891::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3172::DEBUG::2014-04-10 17:48:37,891::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895b988f-2aa8-412d-a963-c413abbd4898`::Granted request
>Thread-3172::DEBUG::2014-04-10 17:48:37,892::task::811::TaskManager.Task::(resourceAcquired) Task=`41116958-04e0-4edb-9035-16da348382e5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3172::DEBUG::2014-04-10 17:48:37,892::task::974::TaskManager.Task::(_decref) Task=`41116958-04e0-4edb-9035-16da348382e5`::ref 1 aborting False
>Thread-3172::INFO::2014-04-10 17:48:37,894::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3172::DEBUG::2014-04-10 17:48:37,894::task::1168::TaskManager.Task::(prepare) Task=`41116958-04e0-4edb-9035-16da348382e5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3172::DEBUG::2014-04-10 17:48:37,894::task::579::TaskManager.Task::(_updateState) Task=`41116958-04e0-4edb-9035-16da348382e5`::moving from state preparing -> state finished
>Thread-3172::DEBUG::2014-04-10 17:48:37,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3172::DEBUG::2014-04-10 17:48:37,895::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3172::DEBUG::2014-04-10 17:48:37,895::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3172::DEBUG::2014-04-10 17:48:37,895::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3172::DEBUG::2014-04-10 17:48:37,895::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3172::DEBUG::2014-04-10 17:48:37,896::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3172::DEBUG::2014-04-10 17:48:37,896::task::974::TaskManager.Task::(_decref) Task=`41116958-04e0-4edb-9035-16da348382e5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:46,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:46,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000384584 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:46,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:46,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282998 s, 2.4 MB/s\n'; <rc> = 0
>Thread-3175::DEBUG::2014-04-10 17:48:46,561::task::579::TaskManager.Task::(_updateState) Task=`e50c33b4-4cfb-4113-98a2-ca93e40dd4e7`::moving from state init -> state preparing
>Thread-3175::INFO::2014-04-10 17:48:46,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3175::INFO::2014-04-10 17:48:46,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459482', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384584', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282998', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040036', 'lastCheck': '9.7', 'valid': True}}
>Thread-3175::DEBUG::2014-04-10 17:48:46,561::task::1168::TaskManager.Task::(prepare) Task=`e50c33b4-4cfb-4113-98a2-ca93e40dd4e7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459482', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384584', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282998', 'lastCheck': '0.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040036', 'lastCheck': '9.7', 'valid': True}}
>Thread-3175::DEBUG::2014-04-10 17:48:46,562::task::579::TaskManager.Task::(_updateState) Task=`e50c33b4-4cfb-4113-98a2-ca93e40dd4e7`::moving from state preparing -> state finished
>Thread-3175::DEBUG::2014-04-10 17:48:46,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3175::DEBUG::2014-04-10 17:48:46,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3175::DEBUG::2014-04-10 17:48:46,562::task::974::TaskManager.Task::(_decref) Task=`e50c33b4-4cfb-4113-98a2-ca93e40dd4e7`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:48:46,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:46,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449017 s, 820 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:47,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:47,016::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000503564 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3177::DEBUG::2014-04-10 17:48:47,975::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3177::DEBUG::2014-04-10 17:48:47,975::task::579::TaskManager.Task::(_updateState) Task=`507de2e1-1f52-4394-8542-e51e18f53bdc`::moving from state init -> state preparing
>Thread-3177::INFO::2014-04-10 17:48:47,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3177::INFO::2014-04-10 17:48:47,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3177::DEBUG::2014-04-10 17:48:47,976::task::1168::TaskManager.Task::(prepare) Task=`507de2e1-1f52-4394-8542-e51e18f53bdc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3177::DEBUG::2014-04-10 17:48:47,976::task::579::TaskManager.Task::(_updateState) Task=`507de2e1-1f52-4394-8542-e51e18f53bdc`::moving from state preparing -> state finished
>Thread-3177::DEBUG::2014-04-10 17:48:47,976::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3177::DEBUG::2014-04-10 17:48:47,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3177::DEBUG::2014-04-10 17:48:47,977::task::974::TaskManager.Task::(_decref) Task=`507de2e1-1f52-4394-8542-e51e18f53bdc`::ref 0 aborting False
>Thread-3178::DEBUG::2014-04-10 17:48:47,983::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3178::DEBUG::2014-04-10 17:48:47,984::task::579::TaskManager.Task::(_updateState) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::moving from state init -> state preparing
>Thread-3178::INFO::2014-04-10 17:48:47,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3178::DEBUG::2014-04-10 17:48:47,984::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f883e5b3-080a-4541-a22e-3affc530bd02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3178::DEBUG::2014-04-10 17:48:47,985::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3178::DEBUG::2014-04-10 17:48:47,985::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3178::DEBUG::2014-04-10 17:48:47,985::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f883e5b3-080a-4541-a22e-3affc530bd02`::Granted request
>Thread-3178::DEBUG::2014-04-10 17:48:47,985::task::811::TaskManager.Task::(resourceAcquired) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3178::DEBUG::2014-04-10 17:48:47,986::task::974::TaskManager.Task::(_decref) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::ref 1 aborting False
>Thread-3178::INFO::2014-04-10 17:48:47,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3178::DEBUG::2014-04-10 17:48:47,988::task::1168::TaskManager.Task::(prepare) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3178::DEBUG::2014-04-10 17:48:47,988::task::579::TaskManager.Task::(_updateState) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::moving from state preparing -> state finished
>Thread-3178::DEBUG::2014-04-10 17:48:47,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3178::DEBUG::2014-04-10 17:48:47,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3178::DEBUG::2014-04-10 17:48:47,989::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3178::DEBUG::2014-04-10 17:48:47,989::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3178::DEBUG::2014-04-10 17:48:47,989::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3178::DEBUG::2014-04-10 17:48:47,989::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3178::DEBUG::2014-04-10 17:48:47,990::task::974::TaskManager.Task::(_decref) Task=`7f9a23c0-f734-4e4e-a0fb-fcb903f8f3d7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:48:56,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:48:56,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339142 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:48:56,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:48:56,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029028 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:48:56,871::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:48:56,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000494612 s, 744 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:48:57,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:48:57,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000560453 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3182::DEBUG::2014-04-10 17:48:58,073::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-3182::DEBUG::2014-04-10 17:48:58,073::task::579::TaskManager.Task::(_updateState) Task=`7fbca782-6623-482c-930b-f9648decef9b`::moving from state init -> state preparing
>Thread-3182::INFO::2014-04-10 17:48:58,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3182::INFO::2014-04-10 17:48:58,074::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3182::DEBUG::2014-04-10 17:48:58,074::task::1168::TaskManager.Task::(prepare) Task=`7fbca782-6623-482c-930b-f9648decef9b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3182::DEBUG::2014-04-10 17:48:58,075::task::579::TaskManager.Task::(_updateState) Task=`7fbca782-6623-482c-930b-f9648decef9b`::moving from state preparing -> state finished
>Thread-3182::DEBUG::2014-04-10 17:48:58,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3182::DEBUG::2014-04-10 17:48:58,075::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3182::DEBUG::2014-04-10 17:48:58,075::task::974::TaskManager.Task::(_decref) Task=`7fbca782-6623-482c-930b-f9648decef9b`::ref 0 aborting False
>Thread-3183::DEBUG::2014-04-10 17:48:58,082::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-3183::DEBUG::2014-04-10 17:48:58,083::task::579::TaskManager.Task::(_updateState) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::moving from state init -> state preparing
>Thread-3183::INFO::2014-04-10 17:48:58,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3183::DEBUG::2014-04-10 17:48:58,083::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad97e904-b695-419b-9cb1-ad861f5a6585`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3183::DEBUG::2014-04-10 17:48:58,084::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3183::DEBUG::2014-04-10 17:48:58,084::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3183::DEBUG::2014-04-10 17:48:58,084::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad97e904-b695-419b-9cb1-ad861f5a6585`::Granted request
>Thread-3183::DEBUG::2014-04-10 17:48:58,084::task::811::TaskManager.Task::(resourceAcquired) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3183::DEBUG::2014-04-10 17:48:58,085::task::974::TaskManager.Task::(_decref) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::ref 1 aborting False
>Thread-3183::INFO::2014-04-10 17:48:58,087::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3183::DEBUG::2014-04-10 17:48:58,087::task::1168::TaskManager.Task::(prepare) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3183::DEBUG::2014-04-10 17:48:58,087::task::579::TaskManager.Task::(_updateState) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::moving from state preparing -> state finished
>Thread-3183::DEBUG::2014-04-10 17:48:58,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3183::DEBUG::2014-04-10 17:48:58,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3183::DEBUG::2014-04-10 17:48:58,088::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3183::DEBUG::2014-04-10 17:48:58,088::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3183::DEBUG::2014-04-10 17:48:58,088::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3183::DEBUG::2014-04-10 17:48:58,088::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3183::DEBUG::2014-04-10 17:48:58,089::task::974::TaskManager.Task::(_decref) Task=`5ed6d534-48c1-4d3b-8110-acb3bbbc3e86`::ref 0 aborting False
>Thread-3185::DEBUG::2014-04-10 17:49:01,720::task::579::TaskManager.Task::(_updateState) Task=`c6571903-ef6d-4b62-bee9-9d624bba290b`::moving from state init -> state preparing
>Thread-3185::INFO::2014-04-10 17:49:01,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3185::INFO::2014-04-10 17:49:01,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560453', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339142', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029028', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494612', 'lastCheck': '4.8', 'valid': True}}
>Thread-3185::DEBUG::2014-04-10 17:49:01,720::task::1168::TaskManager.Task::(prepare) Task=`c6571903-ef6d-4b62-bee9-9d624bba290b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560453', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339142', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029028', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494612', 'lastCheck': '4.8', 'valid': True}}
>Thread-3185::DEBUG::2014-04-10 17:49:01,721::task::579::TaskManager.Task::(_updateState) Task=`c6571903-ef6d-4b62-bee9-9d624bba290b`::moving from state preparing -> state finished
>Thread-3185::DEBUG::2014-04-10 17:49:01,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3185::DEBUG::2014-04-10 17:49:01,721::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3185::DEBUG::2014-04-10 17:49:01,721::task::974::TaskManager.Task::(_decref) Task=`c6571903-ef6d-4b62-bee9-9d624bba290b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:06,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:06,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000404362 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:06,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:06,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373323 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:49:06,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:06,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000539059 s, 683 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:07,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:07,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000529607 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3189::DEBUG::2014-04-10 17:49:08,171::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3189::DEBUG::2014-04-10 17:49:08,172::task::579::TaskManager.Task::(_updateState) Task=`80d32dee-d181-4d25-8c1d-922326e6f55f`::moving from state init -> state preparing
>Thread-3189::INFO::2014-04-10 17:49:08,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3189::INFO::2014-04-10 17:49:08,172::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3189::DEBUG::2014-04-10 17:49:08,172::task::1168::TaskManager.Task::(prepare) Task=`80d32dee-d181-4d25-8c1d-922326e6f55f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3189::DEBUG::2014-04-10 17:49:08,172::task::579::TaskManager.Task::(_updateState) Task=`80d32dee-d181-4d25-8c1d-922326e6f55f`::moving from state preparing -> state finished
>Thread-3189::DEBUG::2014-04-10 17:49:08,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3189::DEBUG::2014-04-10 17:49:08,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3189::DEBUG::2014-04-10 17:49:08,173::task::974::TaskManager.Task::(_decref) Task=`80d32dee-d181-4d25-8c1d-922326e6f55f`::ref 0 aborting False
>Thread-3190::DEBUG::2014-04-10 17:49:08,179::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3190::DEBUG::2014-04-10 17:49:08,180::task::579::TaskManager.Task::(_updateState) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::moving from state init -> state preparing
>Thread-3190::INFO::2014-04-10 17:49:08,180::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3190::DEBUG::2014-04-10 17:49:08,180::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18dca958-1aa2-46df-b28c-c72beb5c9677`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3190::DEBUG::2014-04-10 17:49:08,180::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3190::DEBUG::2014-04-10 17:49:08,181::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3190::DEBUG::2014-04-10 17:49:08,181::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18dca958-1aa2-46df-b28c-c72beb5c9677`::Granted request
>Thread-3190::DEBUG::2014-04-10 17:49:08,181::task::811::TaskManager.Task::(resourceAcquired) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3190::DEBUG::2014-04-10 17:49:08,181::task::974::TaskManager.Task::(_decref) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::ref 1 aborting False
>Thread-3190::INFO::2014-04-10 17:49:08,183::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3190::DEBUG::2014-04-10 17:49:08,183::task::1168::TaskManager.Task::(prepare) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::task::579::TaskManager.Task::(_updateState) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::moving from state preparing -> state finished
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3190::DEBUG::2014-04-10 17:49:08,184::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3190::DEBUG::2014-04-10 17:49:08,185::task::974::TaskManager.Task::(_decref) Task=`fe54a8f6-e7b3-4644-9adc-f96104bb5565`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:16,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:16,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343983 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:16,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:16,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024431 s, 2.7 MB/s\n'; <rc> = 0
>Thread-3193::DEBUG::2014-04-10 17:49:16,889::task::579::TaskManager.Task::(_updateState) Task=`88e9efc6-b5b5-41f9-9716-13ac27863d16`::moving from state init -> state preparing
>Thread-3193::INFO::2014-04-10 17:49:16,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3193::INFO::2014-04-10 17:49:16,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529607', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343983', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024431', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539059', 'lastCheck': '10.0', 'valid': True}}
>Thread-3193::DEBUG::2014-04-10 17:49:16,890::task::1168::TaskManager.Task::(prepare) Task=`88e9efc6-b5b5-41f9-9716-13ac27863d16`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529607', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343983', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00024431', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539059', 'lastCheck': '10.0', 'valid': True}}
>Thread-3193::DEBUG::2014-04-10 17:49:16,890::task::579::TaskManager.Task::(_updateState) Task=`88e9efc6-b5b5-41f9-9716-13ac27863d16`::moving from state preparing -> state finished
>Thread-3193::DEBUG::2014-04-10 17:49:16,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3193::DEBUG::2014-04-10 17:49:16,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3193::DEBUG::2014-04-10 17:49:16,890::task::974::TaskManager.Task::(_decref) Task=`88e9efc6-b5b5-41f9-9716-13ac27863d16`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 17:49:16,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:16,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470111 s, 783 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:17,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:17,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000436221 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3195::DEBUG::2014-04-10 17:49:18,278::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-3195::DEBUG::2014-04-10 17:49:18,278::task::579::TaskManager.Task::(_updateState) Task=`6574d4e8-bb4d-469c-bb61-90ed458d9261`::moving from state init -> state preparing
>Thread-3195::INFO::2014-04-10 17:49:18,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3195::INFO::2014-04-10 17:49:18,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3195::DEBUG::2014-04-10 17:49:18,279::task::1168::TaskManager.Task::(prepare) Task=`6574d4e8-bb4d-469c-bb61-90ed458d9261`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3195::DEBUG::2014-04-10 17:49:18,279::task::579::TaskManager.Task::(_updateState) Task=`6574d4e8-bb4d-469c-bb61-90ed458d9261`::moving from state preparing -> state finished
>Thread-3195::DEBUG::2014-04-10 17:49:18,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3195::DEBUG::2014-04-10 17:49:18,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3195::DEBUG::2014-04-10 17:49:18,280::task::974::TaskManager.Task::(_decref) Task=`6574d4e8-bb4d-469c-bb61-90ed458d9261`::ref 0 aborting False
>Thread-3196::DEBUG::2014-04-10 17:49:18,287::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-3196::DEBUG::2014-04-10 17:49:18,287::task::579::TaskManager.Task::(_updateState) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::moving from state init -> state preparing
>Thread-3196::INFO::2014-04-10 17:49:18,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3196::DEBUG::2014-04-10 17:49:18,288::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6ee16aa-6752-4566-a15a-cd08319bfda1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3196::DEBUG::2014-04-10 17:49:18,288::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3196::DEBUG::2014-04-10 17:49:18,288::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3196::DEBUG::2014-04-10 17:49:18,289::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6ee16aa-6752-4566-a15a-cd08319bfda1`::Granted request
>Thread-3196::DEBUG::2014-04-10 17:49:18,289::task::811::TaskManager.Task::(resourceAcquired) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3196::DEBUG::2014-04-10 17:49:18,289::task::974::TaskManager.Task::(_decref) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::ref 1 aborting False
>Thread-3196::INFO::2014-04-10 17:49:18,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3196::DEBUG::2014-04-10 17:49:18,292::task::1168::TaskManager.Task::(prepare) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3196::DEBUG::2014-04-10 17:49:18,292::task::579::TaskManager.Task::(_updateState) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::moving from state preparing -> state finished
>Thread-3196::DEBUG::2014-04-10 17:49:18,292::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3196::DEBUG::2014-04-10 17:49:18,292::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3196::DEBUG::2014-04-10 17:49:18,292::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3196::DEBUG::2014-04-10 17:49:18,293::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3196::DEBUG::2014-04-10 17:49:18,293::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3196::DEBUG::2014-04-10 17:49:18,293::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3196::DEBUG::2014-04-10 17:49:18,293::task::974::TaskManager.Task::(_decref) Task=`8d92f5b3-c313-48da-9c46-702f3072208c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:26,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:26,407::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281921 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:26,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:26,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244783 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:49:26,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:26,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477444 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:27,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:27,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000443366 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3200::DEBUG::2014-04-10 17:49:28,376::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-3200::DEBUG::2014-04-10 17:49:28,377::task::579::TaskManager.Task::(_updateState) Task=`0a04e528-5f5b-46dc-a730-c9b885a7bddf`::moving from state init -> state preparing
>Thread-3200::INFO::2014-04-10 17:49:28,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3200::INFO::2014-04-10 17:49:28,377::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3200::DEBUG::2014-04-10 17:49:28,377::task::1168::TaskManager.Task::(prepare) Task=`0a04e528-5f5b-46dc-a730-c9b885a7bddf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3200::DEBUG::2014-04-10 17:49:28,378::task::579::TaskManager.Task::(_updateState) Task=`0a04e528-5f5b-46dc-a730-c9b885a7bddf`::moving from state preparing -> state finished
>Thread-3200::DEBUG::2014-04-10 17:49:28,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3200::DEBUG::2014-04-10 17:49:28,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3200::DEBUG::2014-04-10 17:49:28,378::task::974::TaskManager.Task::(_decref) Task=`0a04e528-5f5b-46dc-a730-c9b885a7bddf`::ref 0 aborting False
>Thread-3201::DEBUG::2014-04-10 17:49:28,385::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c8c2c14]
>Thread-3201::DEBUG::2014-04-10 17:49:28,386::task::579::TaskManager.Task::(_updateState) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::moving from state init -> state preparing
>Thread-3201::INFO::2014-04-10 17:49:28,386::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3201::DEBUG::2014-04-10 17:49:28,387::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28657042-a95f-435d-869f-860175a9d668`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3201::DEBUG::2014-04-10 17:49:28,387::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3201::DEBUG::2014-04-10 17:49:28,387::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3201::DEBUG::2014-04-10 17:49:28,387::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`28657042-a95f-435d-869f-860175a9d668`::Granted request
>Thread-3201::DEBUG::2014-04-10 17:49:28,388::task::811::TaskManager.Task::(resourceAcquired) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3201::DEBUG::2014-04-10 17:49:28,388::task::974::TaskManager.Task::(_decref) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::ref 1 aborting False
>Thread-3201::INFO::2014-04-10 17:49:28,390::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3201::DEBUG::2014-04-10 17:49:28,390::task::1168::TaskManager.Task::(prepare) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3201::DEBUG::2014-04-10 17:49:28,391::task::579::TaskManager.Task::(_updateState) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::moving from state preparing -> state finished
>Thread-3201::DEBUG::2014-04-10 17:49:28,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3201::DEBUG::2014-04-10 17:49:28,391::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3201::DEBUG::2014-04-10 17:49:28,391::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3201::DEBUG::2014-04-10 17:49:28,391::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3201::DEBUG::2014-04-10 17:49:28,392::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3201::DEBUG::2014-04-10 17:49:28,392::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3201::DEBUG::2014-04-10 17:49:28,392::task::974::TaskManager.Task::(_decref) Task=`3f2ac104-8db2-42c4-9689-a496bad76e50`::ref 0 aborting False
>Thread-3203::DEBUG::2014-04-10 17:49:32,056::task::579::TaskManager.Task::(_updateState) Task=`4760dbcc-0af8-484d-b17f-c2940abe7f8a`::moving from state init -> state preparing
>Thread-3203::INFO::2014-04-10 17:49:32,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3203::INFO::2014-04-10 17:49:32,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443366', 'lastCheck': '5.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281921', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244783', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477444', 'lastCheck': '5.1', 'valid': True}}
>Thread-3203::DEBUG::2014-04-10 17:49:32,057::task::1168::TaskManager.Task::(prepare) Task=`4760dbcc-0af8-484d-b17f-c2940abe7f8a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443366', 'lastCheck': '5.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281921', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244783', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477444', 'lastCheck': '5.1', 'valid': True}}
>Thread-3203::DEBUG::2014-04-10 17:49:32,057::task::579::TaskManager.Task::(_updateState) Task=`4760dbcc-0af8-484d-b17f-c2940abe7f8a`::moving from state preparing -> state finished
>Thread-3203::DEBUG::2014-04-10 17:49:32,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3203::DEBUG::2014-04-10 17:49:32,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3203::DEBUG::2014-04-10 17:49:32,057::task::974::TaskManager.Task::(_decref) Task=`4760dbcc-0af8-484d-b17f-c2940abe7f8a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:36,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:36,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295211 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:36,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:36,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033464 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:49:36,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:36,956::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045492 s, 809 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:37,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:37,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410937 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3207::DEBUG::2014-04-10 17:49:38,475::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3207::DEBUG::2014-04-10 17:49:38,476::task::579::TaskManager.Task::(_updateState) Task=`3eb2bf3f-92c1-4d9a-ad13-554ade1a2e38`::moving from state init -> state preparing
>Thread-3207::INFO::2014-04-10 17:49:38,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3207::INFO::2014-04-10 17:49:38,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3207::DEBUG::2014-04-10 17:49:38,477::task::1168::TaskManager.Task::(prepare) Task=`3eb2bf3f-92c1-4d9a-ad13-554ade1a2e38`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3207::DEBUG::2014-04-10 17:49:38,477::task::579::TaskManager.Task::(_updateState) Task=`3eb2bf3f-92c1-4d9a-ad13-554ade1a2e38`::moving from state preparing -> state finished
>Thread-3207::DEBUG::2014-04-10 17:49:38,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3207::DEBUG::2014-04-10 17:49:38,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3207::DEBUG::2014-04-10 17:49:38,477::task::974::TaskManager.Task::(_decref) Task=`3eb2bf3f-92c1-4d9a-ad13-554ade1a2e38`::ref 0 aborting False
>Thread-3208::DEBUG::2014-04-10 17:49:38,484::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3208::DEBUG::2014-04-10 17:49:38,484::task::579::TaskManager.Task::(_updateState) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::moving from state init -> state preparing
>Thread-3208::INFO::2014-04-10 17:49:38,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3208::DEBUG::2014-04-10 17:49:38,485::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8b1c4b3b-a435-45de-a3ad-381b2fd0dfbd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3208::DEBUG::2014-04-10 17:49:38,485::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3208::DEBUG::2014-04-10 17:49:38,485::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3208::DEBUG::2014-04-10 17:49:38,485::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8b1c4b3b-a435-45de-a3ad-381b2fd0dfbd`::Granted request
>Thread-3208::DEBUG::2014-04-10 17:49:38,486::task::811::TaskManager.Task::(resourceAcquired) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3208::DEBUG::2014-04-10 17:49:38,486::task::974::TaskManager.Task::(_decref) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::ref 1 aborting False
>Thread-3208::INFO::2014-04-10 17:49:38,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3208::DEBUG::2014-04-10 17:49:38,488::task::1168::TaskManager.Task::(prepare) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3208::DEBUG::2014-04-10 17:49:38,488::task::579::TaskManager.Task::(_updateState) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::moving from state preparing -> state finished
>Thread-3208::DEBUG::2014-04-10 17:49:38,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3208::DEBUG::2014-04-10 17:49:38,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3208::DEBUG::2014-04-10 17:49:38,489::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3208::DEBUG::2014-04-10 17:49:38,489::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3208::DEBUG::2014-04-10 17:49:38,489::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3208::DEBUG::2014-04-10 17:49:38,489::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3208::DEBUG::2014-04-10 17:49:38,489::task::974::TaskManager.Task::(_decref) Task=`c8566b2c-7a93-41c2-aa6f-1e708d63d306`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:46,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:46,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373714 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:46,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:46,616::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274291 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:49:46,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:46,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444648 s, 828 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:47,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:47,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460937 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3211::DEBUG::2014-04-10 17:49:47,222::task::579::TaskManager.Task::(_updateState) Task=`830e085e-f0a4-4520-8b7f-7db3c1900386`::moving from state init -> state preparing
>Thread-3211::INFO::2014-04-10 17:49:47,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3211::INFO::2014-04-10 17:49:47,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460937', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373714', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274291', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444648', 'lastCheck': '0.2', 'valid': True}}
>Thread-3211::DEBUG::2014-04-10 17:49:47,222::task::1168::TaskManager.Task::(prepare) Task=`830e085e-f0a4-4520-8b7f-7db3c1900386`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460937', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373714', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000274291', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444648', 'lastCheck': '0.2', 'valid': True}}
>Thread-3211::DEBUG::2014-04-10 17:49:47,222::task::579::TaskManager.Task::(_updateState) Task=`830e085e-f0a4-4520-8b7f-7db3c1900386`::moving from state preparing -> state finished
>Thread-3211::DEBUG::2014-04-10 17:49:47,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3211::DEBUG::2014-04-10 17:49:47,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3211::DEBUG::2014-04-10 17:49:47,223::task::974::TaskManager.Task::(_decref) Task=`830e085e-f0a4-4520-8b7f-7db3c1900386`::ref 0 aborting False
>Thread-3213::DEBUG::2014-04-10 17:49:48,566::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-3213::DEBUG::2014-04-10 17:49:48,567::task::579::TaskManager.Task::(_updateState) Task=`91b926c7-6df9-489f-98cd-9dc39a981c0f`::moving from state init -> state preparing
>Thread-3213::INFO::2014-04-10 17:49:48,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3213::INFO::2014-04-10 17:49:48,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3213::DEBUG::2014-04-10 17:49:48,568::task::1168::TaskManager.Task::(prepare) Task=`91b926c7-6df9-489f-98cd-9dc39a981c0f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3213::DEBUG::2014-04-10 17:49:48,568::task::579::TaskManager.Task::(_updateState) Task=`91b926c7-6df9-489f-98cd-9dc39a981c0f`::moving from state preparing -> state finished
>Thread-3213::DEBUG::2014-04-10 17:49:48,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3213::DEBUG::2014-04-10 17:49:48,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3213::DEBUG::2014-04-10 17:49:48,568::task::974::TaskManager.Task::(_decref) Task=`91b926c7-6df9-489f-98cd-9dc39a981c0f`::ref 0 aborting False
>Thread-3214::DEBUG::2014-04-10 17:49:48,575::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-3214::DEBUG::2014-04-10 17:49:48,576::task::579::TaskManager.Task::(_updateState) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::moving from state init -> state preparing
>Thread-3214::INFO::2014-04-10 17:49:48,576::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3214::DEBUG::2014-04-10 17:49:48,576::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b34070b-9952-47e7-b9b9-8750b35a9995`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3214::DEBUG::2014-04-10 17:49:48,576::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3214::DEBUG::2014-04-10 17:49:48,577::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3214::DEBUG::2014-04-10 17:49:48,577::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0b34070b-9952-47e7-b9b9-8750b35a9995`::Granted request
>Thread-3214::DEBUG::2014-04-10 17:49:48,577::task::811::TaskManager.Task::(resourceAcquired) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3214::DEBUG::2014-04-10 17:49:48,577::task::974::TaskManager.Task::(_decref) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::ref 1 aborting False
>Thread-3214::INFO::2014-04-10 17:49:48,580::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3214::DEBUG::2014-04-10 17:49:48,580::task::1168::TaskManager.Task::(prepare) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3214::DEBUG::2014-04-10 17:49:48,580::task::579::TaskManager.Task::(_updateState) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::moving from state preparing -> state finished
>Thread-3214::DEBUG::2014-04-10 17:49:48,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3214::DEBUG::2014-04-10 17:49:48,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3214::DEBUG::2014-04-10 17:49:48,581::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3214::DEBUG::2014-04-10 17:49:48,581::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3214::DEBUG::2014-04-10 17:49:48,581::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3214::DEBUG::2014-04-10 17:49:48,581::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3214::DEBUG::2014-04-10 17:49:48,581::task::974::TaskManager.Task::(_decref) Task=`1d712c10-257c-41e1-a946-250f6f0dc2c8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:49:56,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:49:56,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339379 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:49:56,624::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:49:56,631::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276321 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:49:56,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:49:57,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000504314 s, 730 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:49:57,114::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:49:57,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473136 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3218::DEBUG::2014-04-10 17:49:58,663::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3218::DEBUG::2014-04-10 17:49:58,664::task::579::TaskManager.Task::(_updateState) Task=`03c9b3e3-e5cc-402c-89c8-40ea37fa137e`::moving from state init -> state preparing
>Thread-3218::INFO::2014-04-10 17:49:58,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3218::INFO::2014-04-10 17:49:58,664::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3218::DEBUG::2014-04-10 17:49:58,665::task::1168::TaskManager.Task::(prepare) Task=`03c9b3e3-e5cc-402c-89c8-40ea37fa137e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3218::DEBUG::2014-04-10 17:49:58,665::task::579::TaskManager.Task::(_updateState) Task=`03c9b3e3-e5cc-402c-89c8-40ea37fa137e`::moving from state preparing -> state finished
>Thread-3218::DEBUG::2014-04-10 17:49:58,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3218::DEBUG::2014-04-10 17:49:58,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3218::DEBUG::2014-04-10 17:49:58,665::task::974::TaskManager.Task::(_decref) Task=`03c9b3e3-e5cc-402c-89c8-40ea37fa137e`::ref 0 aborting False
>Thread-3219::DEBUG::2014-04-10 17:49:58,672::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3219::DEBUG::2014-04-10 17:49:58,672::task::579::TaskManager.Task::(_updateState) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::moving from state init -> state preparing
>Thread-3219::INFO::2014-04-10 17:49:58,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3219::DEBUG::2014-04-10 17:49:58,673::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20ab4655-3320-4f20-8de6-4689187ada17`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3219::DEBUG::2014-04-10 17:49:58,673::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3219::DEBUG::2014-04-10 17:49:58,674::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3219::DEBUG::2014-04-10 17:49:58,674::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20ab4655-3320-4f20-8de6-4689187ada17`::Granted request
>Thread-3219::DEBUG::2014-04-10 17:49:58,674::task::811::TaskManager.Task::(resourceAcquired) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3219::DEBUG::2014-04-10 17:49:58,674::task::974::TaskManager.Task::(_decref) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::ref 1 aborting False
>Thread-3219::INFO::2014-04-10 17:49:58,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3219::DEBUG::2014-04-10 17:49:58,677::task::1168::TaskManager.Task::(prepare) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3219::DEBUG::2014-04-10 17:49:58,677::task::579::TaskManager.Task::(_updateState) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::moving from state preparing -> state finished
>Thread-3219::DEBUG::2014-04-10 17:49:58,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3219::DEBUG::2014-04-10 17:49:58,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3219::DEBUG::2014-04-10 17:49:58,678::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3219::DEBUG::2014-04-10 17:49:58,678::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3219::DEBUG::2014-04-10 17:49:58,678::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3219::DEBUG::2014-04-10 17:49:58,678::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3219::DEBUG::2014-04-10 17:49:58,678::task::974::TaskManager.Task::(_decref) Task=`c4f97346-1be0-4b91-a0b1-520de9e946fa`::ref 0 aborting False
>Thread-3221::DEBUG::2014-04-10 17:50:02,377::task::579::TaskManager.Task::(_updateState) Task=`26ce38f7-4041-4802-a6b7-4dfe08738dd7`::moving from state init -> state preparing
>Thread-3221::INFO::2014-04-10 17:50:02,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3221::INFO::2014-04-10 17:50:02,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473136', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339379', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276321', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504314', 'lastCheck': '5.4', 'valid': True}}
>Thread-3221::DEBUG::2014-04-10 17:50:02,377::task::1168::TaskManager.Task::(prepare) Task=`26ce38f7-4041-4802-a6b7-4dfe08738dd7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473136', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339379', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276321', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504314', 'lastCheck': '5.4', 'valid': True}}
>Thread-3221::DEBUG::2014-04-10 17:50:02,377::task::579::TaskManager.Task::(_updateState) Task=`26ce38f7-4041-4802-a6b7-4dfe08738dd7`::moving from state preparing -> state finished
>Thread-3221::DEBUG::2014-04-10 17:50:02,378::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3221::DEBUG::2014-04-10 17:50:02,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3221::DEBUG::2014-04-10 17:50:02,378::task::974::TaskManager.Task::(_decref) Task=`26ce38f7-4041-4802-a6b7-4dfe08738dd7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:06,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:06,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259231 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:06,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:06,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289753 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:07,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:07,029::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486494 s, 756 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:07,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:07,134::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000574739 s, 1.1 MB/s\n'; <rc> = 0
>Thread-3225::DEBUG::2014-04-10 17:50:08,777::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-3225::DEBUG::2014-04-10 17:50:08,777::task::579::TaskManager.Task::(_updateState) Task=`8805ae81-0861-4b1a-afef-a0b3f628c433`::moving from state init -> state preparing
>Thread-3225::INFO::2014-04-10 17:50:08,778::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3225::INFO::2014-04-10 17:50:08,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3225::DEBUG::2014-04-10 17:50:08,778::task::1168::TaskManager.Task::(prepare) Task=`8805ae81-0861-4b1a-afef-a0b3f628c433`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3225::DEBUG::2014-04-10 17:50:08,778::task::579::TaskManager.Task::(_updateState) Task=`8805ae81-0861-4b1a-afef-a0b3f628c433`::moving from state preparing -> state finished
>Thread-3225::DEBUG::2014-04-10 17:50:08,778::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3225::DEBUG::2014-04-10 17:50:08,779::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3225::DEBUG::2014-04-10 17:50:08,779::task::974::TaskManager.Task::(_decref) Task=`8805ae81-0861-4b1a-afef-a0b3f628c433`::ref 0 aborting False
>Thread-3226::DEBUG::2014-04-10 17:50:08,784::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-3226::DEBUG::2014-04-10 17:50:08,784::task::579::TaskManager.Task::(_updateState) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::moving from state init -> state preparing
>Thread-3226::INFO::2014-04-10 17:50:08,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3226::DEBUG::2014-04-10 17:50:08,785::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6777bea3-9b8b-48b2-879c-7ce2122d083d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3226::DEBUG::2014-04-10 17:50:08,785::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3226::DEBUG::2014-04-10 17:50:08,785::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3226::DEBUG::2014-04-10 17:50:08,785::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6777bea3-9b8b-48b2-879c-7ce2122d083d`::Granted request
>Thread-3226::DEBUG::2014-04-10 17:50:08,786::task::811::TaskManager.Task::(resourceAcquired) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3226::DEBUG::2014-04-10 17:50:08,786::task::974::TaskManager.Task::(_decref) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::ref 1 aborting False
>Thread-3226::INFO::2014-04-10 17:50:08,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3226::DEBUG::2014-04-10 17:50:08,788::task::1168::TaskManager.Task::(prepare) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3226::DEBUG::2014-04-10 17:50:08,788::task::579::TaskManager.Task::(_updateState) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::moving from state preparing -> state finished
>Thread-3226::DEBUG::2014-04-10 17:50:08,788::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3226::DEBUG::2014-04-10 17:50:08,788::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3226::DEBUG::2014-04-10 17:50:08,788::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3226::DEBUG::2014-04-10 17:50:08,789::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3226::DEBUG::2014-04-10 17:50:08,789::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3226::DEBUG::2014-04-10 17:50:08,789::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3226::DEBUG::2014-04-10 17:50:08,789::task::974::TaskManager.Task::(_decref) Task=`6bd41cc1-d6f9-464c-a0be-3136ad214bbf`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:16,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:16,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000436393 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:16,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:16,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000243929 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:17,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:17,047::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000391998 s, 939 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:17,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:17,149::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000503951 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3229::DEBUG::2014-04-10 17:50:17,848::task::579::TaskManager.Task::(_updateState) Task=`37ed19d3-460e-47dc-825e-2b756056fac1`::moving from state init -> state preparing
>Thread-3229::INFO::2014-04-10 17:50:17,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3229::INFO::2014-04-10 17:50:17,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503951', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436393', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243929', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391998', 'lastCheck': '0.8', 'valid': True}}
>Thread-3229::DEBUG::2014-04-10 17:50:17,849::task::1168::TaskManager.Task::(prepare) Task=`37ed19d3-460e-47dc-825e-2b756056fac1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503951', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436393', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000243929', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391998', 'lastCheck': '0.8', 'valid': True}}
>Thread-3229::DEBUG::2014-04-10 17:50:17,849::task::579::TaskManager.Task::(_updateState) Task=`37ed19d3-460e-47dc-825e-2b756056fac1`::moving from state preparing -> state finished
>Thread-3229::DEBUG::2014-04-10 17:50:17,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3229::DEBUG::2014-04-10 17:50:17,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3229::DEBUG::2014-04-10 17:50:17,850::task::974::TaskManager.Task::(_decref) Task=`37ed19d3-460e-47dc-825e-2b756056fac1`::ref 0 aborting False
>Thread-3231::DEBUG::2014-04-10 17:50:18,905::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3231::DEBUG::2014-04-10 17:50:18,906::task::579::TaskManager.Task::(_updateState) Task=`db8b130e-d823-4f81-a918-643e87a7a0e8`::moving from state init -> state preparing
>Thread-3231::INFO::2014-04-10 17:50:18,906::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3231::INFO::2014-04-10 17:50:18,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3231::DEBUG::2014-04-10 17:50:18,907::task::1168::TaskManager.Task::(prepare) Task=`db8b130e-d823-4f81-a918-643e87a7a0e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3231::DEBUG::2014-04-10 17:50:18,907::task::579::TaskManager.Task::(_updateState) Task=`db8b130e-d823-4f81-a918-643e87a7a0e8`::moving from state preparing -> state finished
>Thread-3231::DEBUG::2014-04-10 17:50:18,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3231::DEBUG::2014-04-10 17:50:18,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3231::DEBUG::2014-04-10 17:50:18,907::task::974::TaskManager.Task::(_decref) Task=`db8b130e-d823-4f81-a918-643e87a7a0e8`::ref 0 aborting False
>Thread-3232::DEBUG::2014-04-10 17:50:18,914::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3232::DEBUG::2014-04-10 17:50:18,915::task::579::TaskManager.Task::(_updateState) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::moving from state init -> state preparing
>Thread-3232::INFO::2014-04-10 17:50:18,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3232::DEBUG::2014-04-10 17:50:18,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`23f7a326-6f55-46c5-bc8c-fa7d331fb77e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3232::DEBUG::2014-04-10 17:50:18,915::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3232::DEBUG::2014-04-10 17:50:18,916::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3232::DEBUG::2014-04-10 17:50:18,916::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`23f7a326-6f55-46c5-bc8c-fa7d331fb77e`::Granted request
>Thread-3232::DEBUG::2014-04-10 17:50:18,916::task::811::TaskManager.Task::(resourceAcquired) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3232::DEBUG::2014-04-10 17:50:18,916::task::974::TaskManager.Task::(_decref) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::ref 1 aborting False
>Thread-3232::INFO::2014-04-10 17:50:18,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3232::DEBUG::2014-04-10 17:50:18,919::task::1168::TaskManager.Task::(prepare) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3232::DEBUG::2014-04-10 17:50:18,919::task::579::TaskManager.Task::(_updateState) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::moving from state preparing -> state finished
>Thread-3232::DEBUG::2014-04-10 17:50:18,919::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3232::DEBUG::2014-04-10 17:50:18,920::task::974::TaskManager.Task::(_decref) Task=`49bfb2be-2f0c-46b8-9965-38d3d91cb85b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:26,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:26,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288814 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:26,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:26,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286997 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:27,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:27,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000422267 s, 871 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:27,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:27,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00047089 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3236::DEBUG::2014-04-10 17:50:29,026::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3236::DEBUG::2014-04-10 17:50:29,027::task::579::TaskManager.Task::(_updateState) Task=`d3941ea8-d480-4488-9cb4-78a5f998b150`::moving from state init -> state preparing
>Thread-3236::INFO::2014-04-10 17:50:29,027::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3236::INFO::2014-04-10 17:50:29,027::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3236::DEBUG::2014-04-10 17:50:29,028::task::1168::TaskManager.Task::(prepare) Task=`d3941ea8-d480-4488-9cb4-78a5f998b150`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3236::DEBUG::2014-04-10 17:50:29,028::task::579::TaskManager.Task::(_updateState) Task=`d3941ea8-d480-4488-9cb4-78a5f998b150`::moving from state preparing -> state finished
>Thread-3236::DEBUG::2014-04-10 17:50:29,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3236::DEBUG::2014-04-10 17:50:29,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3236::DEBUG::2014-04-10 17:50:29,028::task::974::TaskManager.Task::(_decref) Task=`d3941ea8-d480-4488-9cb4-78a5f998b150`::ref 0 aborting False
>Thread-3237::DEBUG::2014-04-10 17:50:29,035::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3237::DEBUG::2014-04-10 17:50:29,036::task::579::TaskManager.Task::(_updateState) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::moving from state init -> state preparing
>Thread-3237::INFO::2014-04-10 17:50:29,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3237::DEBUG::2014-04-10 17:50:29,036::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`775b7c17-fd65-4e41-aef3-b5b54061341c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3237::DEBUG::2014-04-10 17:50:29,037::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3237::DEBUG::2014-04-10 17:50:29,037::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3237::DEBUG::2014-04-10 17:50:29,037::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`775b7c17-fd65-4e41-aef3-b5b54061341c`::Granted request
>Thread-3237::DEBUG::2014-04-10 17:50:29,037::task::811::TaskManager.Task::(resourceAcquired) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3237::DEBUG::2014-04-10 17:50:29,038::task::974::TaskManager.Task::(_decref) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::ref 1 aborting False
>Thread-3237::INFO::2014-04-10 17:50:29,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3237::DEBUG::2014-04-10 17:50:29,040::task::1168::TaskManager.Task::(prepare) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3237::DEBUG::2014-04-10 17:50:29,040::task::579::TaskManager.Task::(_updateState) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::moving from state preparing -> state finished
>Thread-3237::DEBUG::2014-04-10 17:50:29,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3237::DEBUG::2014-04-10 17:50:29,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3237::DEBUG::2014-04-10 17:50:29,041::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3237::DEBUG::2014-04-10 17:50:29,041::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3237::DEBUG::2014-04-10 17:50:29,041::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3237::DEBUG::2014-04-10 17:50:29,041::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3237::DEBUG::2014-04-10 17:50:29,042::task::974::TaskManager.Task::(_decref) Task=`7ac462b1-3788-436f-a9a0-74382cb1575e`::ref 0 aborting False
>Thread-3239::DEBUG::2014-04-10 17:50:33,023::task::579::TaskManager.Task::(_updateState) Task=`b658a9cf-e6b4-4305-a3c8-7680b94bbdec`::moving from state init -> state preparing
>Thread-3239::INFO::2014-04-10 17:50:33,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3239::INFO::2014-04-10 17:50:33,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047089', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288814', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286997', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422267', 'lastCheck': '6.0', 'valid': True}}
>Thread-3239::DEBUG::2014-04-10 17:50:33,024::task::1168::TaskManager.Task::(prepare) Task=`b658a9cf-e6b4-4305-a3c8-7680b94bbdec`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047089', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288814', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000286997', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422267', 'lastCheck': '6.0', 'valid': True}}
>Thread-3239::DEBUG::2014-04-10 17:50:33,024::task::579::TaskManager.Task::(_updateState) Task=`b658a9cf-e6b4-4305-a3c8-7680b94bbdec`::moving from state preparing -> state finished
>Thread-3239::DEBUG::2014-04-10 17:50:33,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3239::DEBUG::2014-04-10 17:50:33,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3239::DEBUG::2014-04-10 17:50:33,024::task::974::TaskManager.Task::(_decref) Task=`b658a9cf-e6b4-4305-a3c8-7680b94bbdec`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:36,498::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:50:36,505::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:50:36,506::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:50:36,510::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:50:36,511::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:50:36,511::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:50:36,512::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:50:36,516::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:36,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277496 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:36,678::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:50:36,694::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:50:36,695::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:50:36,700::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:50:36,701::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:50:36,702::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:50:36,702::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:50:36,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:36,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000224746 s, 3.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:37,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:37,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000538292 s, 684 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:37,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:37,178::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000447675 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3250::DEBUG::2014-04-10 17:50:39,116::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-3250::DEBUG::2014-04-10 17:50:39,116::task::579::TaskManager.Task::(_updateState) Task=`e6399c80-2890-4cd4-8046-178b00d5d8ec`::moving from state init -> state preparing
>Thread-3250::INFO::2014-04-10 17:50:39,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3250::INFO::2014-04-10 17:50:39,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3250::DEBUG::2014-04-10 17:50:39,117::task::1168::TaskManager.Task::(prepare) Task=`e6399c80-2890-4cd4-8046-178b00d5d8ec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3250::DEBUG::2014-04-10 17:50:39,117::task::579::TaskManager.Task::(_updateState) Task=`e6399c80-2890-4cd4-8046-178b00d5d8ec`::moving from state preparing -> state finished
>Thread-3250::DEBUG::2014-04-10 17:50:39,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3250::DEBUG::2014-04-10 17:50:39,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3250::DEBUG::2014-04-10 17:50:39,118::task::974::TaskManager.Task::(_decref) Task=`e6399c80-2890-4cd4-8046-178b00d5d8ec`::ref 0 aborting False
>Thread-3251::DEBUG::2014-04-10 17:50:39,125::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-3251::DEBUG::2014-04-10 17:50:39,125::task::579::TaskManager.Task::(_updateState) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::moving from state init -> state preparing
>Thread-3251::INFO::2014-04-10 17:50:39,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3251::DEBUG::2014-04-10 17:50:39,126::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`936fabfd-be92-4fed-a7b3-ae97f52f930b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3251::DEBUG::2014-04-10 17:50:39,126::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3251::DEBUG::2014-04-10 17:50:39,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3251::DEBUG::2014-04-10 17:50:39,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`936fabfd-be92-4fed-a7b3-ae97f52f930b`::Granted request
>Thread-3251::DEBUG::2014-04-10 17:50:39,127::task::811::TaskManager.Task::(resourceAcquired) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3251::DEBUG::2014-04-10 17:50:39,127::task::974::TaskManager.Task::(_decref) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::ref 1 aborting False
>Thread-3251::INFO::2014-04-10 17:50:39,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3251::DEBUG::2014-04-10 17:50:39,129::task::1168::TaskManager.Task::(prepare) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3251::DEBUG::2014-04-10 17:50:39,129::task::579::TaskManager.Task::(_updateState) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::moving from state preparing -> state finished
>Thread-3251::DEBUG::2014-04-10 17:50:39,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3251::DEBUG::2014-04-10 17:50:39,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3251::DEBUG::2014-04-10 17:50:39,130::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3251::DEBUG::2014-04-10 17:50:39,130::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3251::DEBUG::2014-04-10 17:50:39,130::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3251::DEBUG::2014-04-10 17:50:39,130::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3251::DEBUG::2014-04-10 17:50:39,131::task::974::TaskManager.Task::(_decref) Task=`d5fe505d-7915-4402-b3c5-d0f138b167cd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:46,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:46,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368286 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:46,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:46,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033681 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:47,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:47,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000499851 s, 736 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:47,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:47,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000449228 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3255::DEBUG::2014-04-10 17:50:48,190::task::579::TaskManager.Task::(_updateState) Task=`4107d00e-ecee-4394-9ed3-45cbe7bec43c`::moving from state init -> state preparing
>Thread-3255::INFO::2014-04-10 17:50:48,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3255::INFO::2014-04-10 17:50:48,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449228', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368286', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033681', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499851', 'lastCheck': '1.1', 'valid': True}}
>Thread-3255::DEBUG::2014-04-10 17:50:48,191::task::1168::TaskManager.Task::(prepare) Task=`4107d00e-ecee-4394-9ed3-45cbe7bec43c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449228', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368286', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033681', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499851', 'lastCheck': '1.1', 'valid': True}}
>Thread-3255::DEBUG::2014-04-10 17:50:48,191::task::579::TaskManager.Task::(_updateState) Task=`4107d00e-ecee-4394-9ed3-45cbe7bec43c`::moving from state preparing -> state finished
>Thread-3255::DEBUG::2014-04-10 17:50:48,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3255::DEBUG::2014-04-10 17:50:48,192::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3255::DEBUG::2014-04-10 17:50:48,192::task::974::TaskManager.Task::(_decref) Task=`4107d00e-ecee-4394-9ed3-45cbe7bec43c`::ref 0 aborting False
>Thread-3257::DEBUG::2014-04-10 17:50:49,224::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-3257::DEBUG::2014-04-10 17:50:49,224::task::579::TaskManager.Task::(_updateState) Task=`5fccdc01-4735-4a84-9b9c-7e23d6e3ee24`::moving from state init -> state preparing
>Thread-3257::INFO::2014-04-10 17:50:49,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3257::INFO::2014-04-10 17:50:49,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3257::DEBUG::2014-04-10 17:50:49,225::task::1168::TaskManager.Task::(prepare) Task=`5fccdc01-4735-4a84-9b9c-7e23d6e3ee24`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3257::DEBUG::2014-04-10 17:50:49,225::task::579::TaskManager.Task::(_updateState) Task=`5fccdc01-4735-4a84-9b9c-7e23d6e3ee24`::moving from state preparing -> state finished
>Thread-3257::DEBUG::2014-04-10 17:50:49,226::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3257::DEBUG::2014-04-10 17:50:49,226::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3257::DEBUG::2014-04-10 17:50:49,226::task::974::TaskManager.Task::(_decref) Task=`5fccdc01-4735-4a84-9b9c-7e23d6e3ee24`::ref 0 aborting False
>Thread-3258::DEBUG::2014-04-10 17:50:49,232::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-3258::DEBUG::2014-04-10 17:50:49,233::task::579::TaskManager.Task::(_updateState) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::moving from state init -> state preparing
>Thread-3258::INFO::2014-04-10 17:50:49,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3258::DEBUG::2014-04-10 17:50:49,234::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`07ab6256-6bac-4682-8c91-c7e9acdee571`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3258::DEBUG::2014-04-10 17:50:49,234::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3258::DEBUG::2014-04-10 17:50:49,234::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3258::DEBUG::2014-04-10 17:50:49,234::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`07ab6256-6bac-4682-8c91-c7e9acdee571`::Granted request
>Thread-3258::DEBUG::2014-04-10 17:50:49,235::task::811::TaskManager.Task::(resourceAcquired) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3258::DEBUG::2014-04-10 17:50:49,235::task::974::TaskManager.Task::(_decref) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::ref 1 aborting False
>Thread-3258::INFO::2014-04-10 17:50:49,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3258::DEBUG::2014-04-10 17:50:49,237::task::1168::TaskManager.Task::(prepare) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::task::579::TaskManager.Task::(_updateState) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::moving from state preparing -> state finished
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3258::DEBUG::2014-04-10 17:50:49,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3258::DEBUG::2014-04-10 17:50:49,239::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3258::DEBUG::2014-04-10 17:50:49,239::task::974::TaskManager.Task::(_decref) Task=`022935d1-f6ff-4e24-8944-c19d8c46619f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:50:56,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:50:56,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320736 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:50:56,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:50:56,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397856 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:50:57,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:50:57,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045465 s, 809 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:50:57,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:50:57,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000450627 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3262::DEBUG::2014-04-10 17:50:59,345::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-3262::DEBUG::2014-04-10 17:50:59,346::task::579::TaskManager.Task::(_updateState) Task=`213881cf-0aae-4883-89c2-2c51453d4ce6`::moving from state init -> state preparing
>Thread-3262::INFO::2014-04-10 17:50:59,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3262::INFO::2014-04-10 17:50:59,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3262::DEBUG::2014-04-10 17:50:59,347::task::1168::TaskManager.Task::(prepare) Task=`213881cf-0aae-4883-89c2-2c51453d4ce6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3262::DEBUG::2014-04-10 17:50:59,347::task::579::TaskManager.Task::(_updateState) Task=`213881cf-0aae-4883-89c2-2c51453d4ce6`::moving from state preparing -> state finished
>Thread-3262::DEBUG::2014-04-10 17:50:59,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3262::DEBUG::2014-04-10 17:50:59,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3262::DEBUG::2014-04-10 17:50:59,347::task::974::TaskManager.Task::(_decref) Task=`213881cf-0aae-4883-89c2-2c51453d4ce6`::ref 0 aborting False
>Thread-3263::DEBUG::2014-04-10 17:50:59,354::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-3263::DEBUG::2014-04-10 17:50:59,354::task::579::TaskManager.Task::(_updateState) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::moving from state init -> state preparing
>Thread-3263::INFO::2014-04-10 17:50:59,354::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3263::DEBUG::2014-04-10 17:50:59,355::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`daafa781-7613-4923-bb51-6be6d5b61f3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3263::DEBUG::2014-04-10 17:50:59,355::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3263::DEBUG::2014-04-10 17:50:59,355::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3263::DEBUG::2014-04-10 17:50:59,355::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`daafa781-7613-4923-bb51-6be6d5b61f3f`::Granted request
>Thread-3263::DEBUG::2014-04-10 17:50:59,356::task::811::TaskManager.Task::(resourceAcquired) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3263::DEBUG::2014-04-10 17:50:59,356::task::974::TaskManager.Task::(_decref) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::ref 1 aborting False
>Thread-3263::INFO::2014-04-10 17:50:59,358::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3263::DEBUG::2014-04-10 17:50:59,358::task::1168::TaskManager.Task::(prepare) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3263::DEBUG::2014-04-10 17:50:59,358::task::579::TaskManager.Task::(_updateState) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::moving from state preparing -> state finished
>Thread-3263::DEBUG::2014-04-10 17:50:59,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3263::DEBUG::2014-04-10 17:50:59,359::task::974::TaskManager.Task::(_decref) Task=`d05e3773-d31e-425e-9e27-98c99829289b`::ref 0 aborting False
>Thread-3265::DEBUG::2014-04-10 17:51:03,364::task::579::TaskManager.Task::(_updateState) Task=`1e0f37f7-7691-43e1-892b-bf9cf9b79afb`::moving from state init -> state preparing
>Thread-3265::INFO::2014-04-10 17:51:03,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3265::INFO::2014-04-10 17:51:03,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450627', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320736', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397856', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045465', 'lastCheck': '6.3', 'valid': True}}
>Thread-3265::DEBUG::2014-04-10 17:51:03,365::task::1168::TaskManager.Task::(prepare) Task=`1e0f37f7-7691-43e1-892b-bf9cf9b79afb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450627', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320736', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397856', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045465', 'lastCheck': '6.3', 'valid': True}}
>Thread-3265::DEBUG::2014-04-10 17:51:03,366::task::579::TaskManager.Task::(_updateState) Task=`1e0f37f7-7691-43e1-892b-bf9cf9b79afb`::moving from state preparing -> state finished
>Thread-3265::DEBUG::2014-04-10 17:51:03,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3265::DEBUG::2014-04-10 17:51:03,366::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3265::DEBUG::2014-04-10 17:51:03,366::task::974::TaskManager.Task::(_decref) Task=`1e0f37f7-7691-43e1-892b-bf9cf9b79afb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:06,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:06,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421599 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:06,748::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:06,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329683 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:07,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:07,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000475925 s, 773 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:07,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:07,220::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000392004 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3269::DEBUG::2014-04-10 17:51:09,535::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3269::DEBUG::2014-04-10 17:51:09,535::task::579::TaskManager.Task::(_updateState) Task=`f15fbbb5-23fb-431a-9fc0-23aae6b5e561`::moving from state init -> state preparing
>Thread-3269::INFO::2014-04-10 17:51:09,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3269::INFO::2014-04-10 17:51:09,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3269::DEBUG::2014-04-10 17:51:09,536::task::1168::TaskManager.Task::(prepare) Task=`f15fbbb5-23fb-431a-9fc0-23aae6b5e561`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3269::DEBUG::2014-04-10 17:51:09,536::task::579::TaskManager.Task::(_updateState) Task=`f15fbbb5-23fb-431a-9fc0-23aae6b5e561`::moving from state preparing -> state finished
>Thread-3269::DEBUG::2014-04-10 17:51:09,537::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3269::DEBUG::2014-04-10 17:51:09,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3269::DEBUG::2014-04-10 17:51:09,537::task::974::TaskManager.Task::(_decref) Task=`f15fbbb5-23fb-431a-9fc0-23aae6b5e561`::ref 0 aborting False
>Thread-3270::DEBUG::2014-04-10 17:51:09,544::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3270::DEBUG::2014-04-10 17:51:09,544::task::579::TaskManager.Task::(_updateState) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::moving from state init -> state preparing
>Thread-3270::INFO::2014-04-10 17:51:09,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3270::DEBUG::2014-04-10 17:51:09,545::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cabbc962-36d9-4b1f-9bae-86ac5a393857`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3270::DEBUG::2014-04-10 17:51:09,545::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3270::DEBUG::2014-04-10 17:51:09,545::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3270::DEBUG::2014-04-10 17:51:09,545::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cabbc962-36d9-4b1f-9bae-86ac5a393857`::Granted request
>Thread-3270::DEBUG::2014-04-10 17:51:09,546::task::811::TaskManager.Task::(resourceAcquired) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3270::DEBUG::2014-04-10 17:51:09,546::task::974::TaskManager.Task::(_decref) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::ref 1 aborting False
>Thread-3270::INFO::2014-04-10 17:51:09,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3270::DEBUG::2014-04-10 17:51:09,548::task::1168::TaskManager.Task::(prepare) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3270::DEBUG::2014-04-10 17:51:09,548::task::579::TaskManager.Task::(_updateState) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::moving from state preparing -> state finished
>Thread-3270::DEBUG::2014-04-10 17:51:09,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3270::DEBUG::2014-04-10 17:51:09,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3270::DEBUG::2014-04-10 17:51:09,548::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3270::DEBUG::2014-04-10 17:51:09,549::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3270::DEBUG::2014-04-10 17:51:09,549::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3270::DEBUG::2014-04-10 17:51:09,549::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3270::DEBUG::2014-04-10 17:51:09,549::task::974::TaskManager.Task::(_decref) Task=`a8f9ba18-07ab-47f3-87c7-5a250a4cabfd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:16,584::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:16,590::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000432151 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:16,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:16,767::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308377 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:17,123::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:17,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044891 s, 820 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:17,229::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:17,234::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478188 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3273::DEBUG::2014-04-10 17:51:18,520::task::579::TaskManager.Task::(_updateState) Task=`ad050bfd-19b7-4c03-b25b-79ea97e7389b`::moving from state init -> state preparing
>Thread-3273::INFO::2014-04-10 17:51:18,521::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3273::INFO::2014-04-10 17:51:18,521::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478188', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432151', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308377', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044891', 'lastCheck': '1.4', 'valid': True}}
>Thread-3273::DEBUG::2014-04-10 17:51:18,521::task::1168::TaskManager.Task::(prepare) Task=`ad050bfd-19b7-4c03-b25b-79ea97e7389b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478188', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432151', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308377', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044891', 'lastCheck': '1.4', 'valid': True}}
>Thread-3273::DEBUG::2014-04-10 17:51:18,522::task::579::TaskManager.Task::(_updateState) Task=`ad050bfd-19b7-4c03-b25b-79ea97e7389b`::moving from state preparing -> state finished
>Thread-3273::DEBUG::2014-04-10 17:51:18,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3273::DEBUG::2014-04-10 17:51:18,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3273::DEBUG::2014-04-10 17:51:18,522::task::974::TaskManager.Task::(_decref) Task=`ad050bfd-19b7-4c03-b25b-79ea97e7389b`::ref 0 aborting False
>Thread-3275::DEBUG::2014-04-10 17:51:19,694::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3275::DEBUG::2014-04-10 17:51:19,694::task::579::TaskManager.Task::(_updateState) Task=`6fd0cf83-feec-4d7f-a3bf-8507364d6ea8`::moving from state init -> state preparing
>Thread-3275::INFO::2014-04-10 17:51:19,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3275::INFO::2014-04-10 17:51:19,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3275::DEBUG::2014-04-10 17:51:19,695::task::1168::TaskManager.Task::(prepare) Task=`6fd0cf83-feec-4d7f-a3bf-8507364d6ea8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3275::DEBUG::2014-04-10 17:51:19,695::task::579::TaskManager.Task::(_updateState) Task=`6fd0cf83-feec-4d7f-a3bf-8507364d6ea8`::moving from state preparing -> state finished
>Thread-3275::DEBUG::2014-04-10 17:51:19,695::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3275::DEBUG::2014-04-10 17:51:19,695::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3275::DEBUG::2014-04-10 17:51:19,696::task::974::TaskManager.Task::(_decref) Task=`6fd0cf83-feec-4d7f-a3bf-8507364d6ea8`::ref 0 aborting False
>Thread-3276::DEBUG::2014-04-10 17:51:19,702::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3276::DEBUG::2014-04-10 17:51:19,703::task::579::TaskManager.Task::(_updateState) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::moving from state init -> state preparing
>Thread-3276::INFO::2014-04-10 17:51:19,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3276::DEBUG::2014-04-10 17:51:19,704::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03dcddef-fafb-4f36-a3f8-dd0536f080a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3276::DEBUG::2014-04-10 17:51:19,704::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3276::DEBUG::2014-04-10 17:51:19,704::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3276::DEBUG::2014-04-10 17:51:19,704::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03dcddef-fafb-4f36-a3f8-dd0536f080a0`::Granted request
>Thread-3276::DEBUG::2014-04-10 17:51:19,705::task::811::TaskManager.Task::(resourceAcquired) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3276::DEBUG::2014-04-10 17:51:19,705::task::974::TaskManager.Task::(_decref) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::ref 1 aborting False
>Thread-3276::INFO::2014-04-10 17:51:19,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3276::DEBUG::2014-04-10 17:51:19,707::task::1168::TaskManager.Task::(prepare) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3276::DEBUG::2014-04-10 17:51:19,707::task::579::TaskManager.Task::(_updateState) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::moving from state preparing -> state finished
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3276::DEBUG::2014-04-10 17:51:19,708::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3276::DEBUG::2014-04-10 17:51:19,709::task::974::TaskManager.Task::(_decref) Task=`5efce5d8-00cf-4a7d-8799-07d8653a2e4d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:26,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:26,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000427655 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:26,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:26,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331831 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:27,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:27,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479682 s, 767 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:27,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:27,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000452932 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3280::DEBUG::2014-04-10 17:51:29,783::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-3280::DEBUG::2014-04-10 17:51:29,784::task::579::TaskManager.Task::(_updateState) Task=`ad9858ae-308c-4b29-9ccb-5e14021572a9`::moving from state init -> state preparing
>Thread-3280::INFO::2014-04-10 17:51:29,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3280::INFO::2014-04-10 17:51:29,785::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3280::DEBUG::2014-04-10 17:51:29,785::task::1168::TaskManager.Task::(prepare) Task=`ad9858ae-308c-4b29-9ccb-5e14021572a9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3280::DEBUG::2014-04-10 17:51:29,785::task::579::TaskManager.Task::(_updateState) Task=`ad9858ae-308c-4b29-9ccb-5e14021572a9`::moving from state preparing -> state finished
>Thread-3280::DEBUG::2014-04-10 17:51:29,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3280::DEBUG::2014-04-10 17:51:29,785::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3280::DEBUG::2014-04-10 17:51:29,785::task::974::TaskManager.Task::(_decref) Task=`ad9858ae-308c-4b29-9ccb-5e14021572a9`::ref 0 aborting False
>Thread-3281::DEBUG::2014-04-10 17:51:29,792::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-3281::DEBUG::2014-04-10 17:51:29,792::task::579::TaskManager.Task::(_updateState) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::moving from state init -> state preparing
>Thread-3281::INFO::2014-04-10 17:51:29,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3281::DEBUG::2014-04-10 17:51:29,793::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d583c8d0-8474-41c0-bf40-47959eef7614`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3281::DEBUG::2014-04-10 17:51:29,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3281::DEBUG::2014-04-10 17:51:29,794::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3281::DEBUG::2014-04-10 17:51:29,794::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d583c8d0-8474-41c0-bf40-47959eef7614`::Granted request
>Thread-3281::DEBUG::2014-04-10 17:51:29,794::task::811::TaskManager.Task::(resourceAcquired) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3281::DEBUG::2014-04-10 17:51:29,794::task::974::TaskManager.Task::(_decref) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::ref 1 aborting False
>Thread-3281::INFO::2014-04-10 17:51:29,796::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::task::1168::TaskManager.Task::(prepare) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::task::579::TaskManager.Task::(_updateState) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::moving from state preparing -> state finished
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3281::DEBUG::2014-04-10 17:51:29,797::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3281::DEBUG::2014-04-10 17:51:29,798::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3281::DEBUG::2014-04-10 17:51:29,798::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3281::DEBUG::2014-04-10 17:51:29,798::task::974::TaskManager.Task::(_decref) Task=`17526a93-7d3c-4184-9841-7cbe2e7739e3`::ref 0 aborting False
>Thread-3283::DEBUG::2014-04-10 17:51:33,684::task::579::TaskManager.Task::(_updateState) Task=`f76fd8c7-18ed-4f42-8b3f-589b8abd0180`::moving from state init -> state preparing
>Thread-3283::INFO::2014-04-10 17:51:33,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3283::INFO::2014-04-10 17:51:33,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452932', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427655', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331831', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479682', 'lastCheck': '6.5', 'valid': True}}
>Thread-3283::DEBUG::2014-04-10 17:51:33,685::task::1168::TaskManager.Task::(prepare) Task=`f76fd8c7-18ed-4f42-8b3f-589b8abd0180`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452932', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427655', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331831', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479682', 'lastCheck': '6.5', 'valid': True}}
>Thread-3283::DEBUG::2014-04-10 17:51:33,685::task::579::TaskManager.Task::(_updateState) Task=`f76fd8c7-18ed-4f42-8b3f-589b8abd0180`::moving from state preparing -> state finished
>Thread-3283::DEBUG::2014-04-10 17:51:33,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3283::DEBUG::2014-04-10 17:51:33,686::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3283::DEBUG::2014-04-10 17:51:33,686::task::974::TaskManager.Task::(_decref) Task=`f76fd8c7-18ed-4f42-8b3f-589b8abd0180`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:36,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:36,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349985 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:36,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:36,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255507 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:37,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:37,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048018 s, 766 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:37,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:37,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000506567 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3287::DEBUG::2014-04-10 17:51:39,873::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3287::DEBUG::2014-04-10 17:51:39,874::task::579::TaskManager.Task::(_updateState) Task=`c971d76d-17dd-440f-8619-a2168320387d`::moving from state init -> state preparing
>Thread-3287::INFO::2014-04-10 17:51:39,874::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3287::INFO::2014-04-10 17:51:39,874::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3287::DEBUG::2014-04-10 17:51:39,875::task::1168::TaskManager.Task::(prepare) Task=`c971d76d-17dd-440f-8619-a2168320387d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3287::DEBUG::2014-04-10 17:51:39,875::task::579::TaskManager.Task::(_updateState) Task=`c971d76d-17dd-440f-8619-a2168320387d`::moving from state preparing -> state finished
>Thread-3287::DEBUG::2014-04-10 17:51:39,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3287::DEBUG::2014-04-10 17:51:39,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3287::DEBUG::2014-04-10 17:51:39,875::task::974::TaskManager.Task::(_decref) Task=`c971d76d-17dd-440f-8619-a2168320387d`::ref 0 aborting False
>Thread-3288::DEBUG::2014-04-10 17:51:39,882::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3288::DEBUG::2014-04-10 17:51:39,883::task::579::TaskManager.Task::(_updateState) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::moving from state init -> state preparing
>Thread-3288::INFO::2014-04-10 17:51:39,883::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3288::DEBUG::2014-04-10 17:51:39,883::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`487b7d28-5f47-4879-87ef-de688fad89e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3288::DEBUG::2014-04-10 17:51:39,883::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3288::DEBUG::2014-04-10 17:51:39,884::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3288::DEBUG::2014-04-10 17:51:39,884::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`487b7d28-5f47-4879-87ef-de688fad89e0`::Granted request
>Thread-3288::DEBUG::2014-04-10 17:51:39,884::task::811::TaskManager.Task::(resourceAcquired) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3288::DEBUG::2014-04-10 17:51:39,884::task::974::TaskManager.Task::(_decref) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::ref 1 aborting False
>Thread-3288::INFO::2014-04-10 17:51:39,886::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3288::DEBUG::2014-04-10 17:51:39,886::task::1168::TaskManager.Task::(prepare) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::task::579::TaskManager.Task::(_updateState) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::moving from state preparing -> state finished
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3288::DEBUG::2014-04-10 17:51:39,887::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3288::DEBUG::2014-04-10 17:51:39,888::task::974::TaskManager.Task::(_decref) Task=`82ea954b-30b3-4b90-a584-1ffda27debec`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:46,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:46,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000424921 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:46,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:46,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360028 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:47,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:47,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000396169 s, 929 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:47,274::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:47,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485281 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3291::DEBUG::2014-04-10 17:51:48,849::task::579::TaskManager.Task::(_updateState) Task=`105188c0-4b3b-4a6e-a8f2-578bf2c7f589`::moving from state init -> state preparing
>Thread-3291::INFO::2014-04-10 17:51:48,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3291::INFO::2014-04-10 17:51:48,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485281', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424921', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360028', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396169', 'lastCheck': '1.7', 'valid': True}}
>Thread-3291::DEBUG::2014-04-10 17:51:48,850::task::1168::TaskManager.Task::(prepare) Task=`105188c0-4b3b-4a6e-a8f2-578bf2c7f589`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485281', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424921', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360028', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396169', 'lastCheck': '1.7', 'valid': True}}
>Thread-3291::DEBUG::2014-04-10 17:51:48,851::task::579::TaskManager.Task::(_updateState) Task=`105188c0-4b3b-4a6e-a8f2-578bf2c7f589`::moving from state preparing -> state finished
>Thread-3291::DEBUG::2014-04-10 17:51:48,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3291::DEBUG::2014-04-10 17:51:48,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3291::DEBUG::2014-04-10 17:51:48,851::task::974::TaskManager.Task::(_decref) Task=`105188c0-4b3b-4a6e-a8f2-578bf2c7f589`::ref 0 aborting False
>Thread-3293::DEBUG::2014-04-10 17:51:50,277::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3293::DEBUG::2014-04-10 17:51:50,277::task::579::TaskManager.Task::(_updateState) Task=`33bf20d3-3caa-45ff-9882-15b84ad919e4`::moving from state init -> state preparing
>Thread-3293::INFO::2014-04-10 17:51:50,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3293::INFO::2014-04-10 17:51:50,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3293::DEBUG::2014-04-10 17:51:50,278::task::1168::TaskManager.Task::(prepare) Task=`33bf20d3-3caa-45ff-9882-15b84ad919e4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3293::DEBUG::2014-04-10 17:51:50,278::task::579::TaskManager.Task::(_updateState) Task=`33bf20d3-3caa-45ff-9882-15b84ad919e4`::moving from state preparing -> state finished
>Thread-3293::DEBUG::2014-04-10 17:51:50,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3293::DEBUG::2014-04-10 17:51:50,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3293::DEBUG::2014-04-10 17:51:50,279::task::974::TaskManager.Task::(_decref) Task=`33bf20d3-3caa-45ff-9882-15b84ad919e4`::ref 0 aborting False
>Thread-3294::DEBUG::2014-04-10 17:51:50,286::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3294::DEBUG::2014-04-10 17:51:50,286::task::579::TaskManager.Task::(_updateState) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::moving from state init -> state preparing
>Thread-3294::INFO::2014-04-10 17:51:50,286::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3294::DEBUG::2014-04-10 17:51:50,287::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2087e7c5-ccf7-4544-a024-3cdb922be168`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3294::DEBUG::2014-04-10 17:51:50,287::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3294::DEBUG::2014-04-10 17:51:50,287::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3294::DEBUG::2014-04-10 17:51:50,287::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2087e7c5-ccf7-4544-a024-3cdb922be168`::Granted request
>Thread-3294::DEBUG::2014-04-10 17:51:50,288::task::811::TaskManager.Task::(resourceAcquired) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3294::DEBUG::2014-04-10 17:51:50,288::task::974::TaskManager.Task::(_decref) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::ref 1 aborting False
>Thread-3294::INFO::2014-04-10 17:51:50,290::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3294::DEBUG::2014-04-10 17:51:50,290::task::1168::TaskManager.Task::(prepare) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3294::DEBUG::2014-04-10 17:51:50,290::task::579::TaskManager.Task::(_updateState) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::moving from state preparing -> state finished
>Thread-3294::DEBUG::2014-04-10 17:51:50,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3294::DEBUG::2014-04-10 17:51:50,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3294::DEBUG::2014-04-10 17:51:50,291::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3294::DEBUG::2014-04-10 17:51:50,291::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3294::DEBUG::2014-04-10 17:51:50,291::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3294::DEBUG::2014-04-10 17:51:50,292::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3294::DEBUG::2014-04-10 17:51:50,292::task::974::TaskManager.Task::(_decref) Task=`496e0af6-69c7-4cda-bf62-feeb0c741121`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:51:56,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:51:56,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289373 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:51:56,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:51:56,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319714 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:51:57,176::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:51:57,193::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:51:57,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:51:57,200::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:51:57,201::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:51:57,202::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:51:57,202::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:51:57,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:51:57,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478781 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:51:57,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:51:57,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000462965 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3302::DEBUG::2014-04-10 17:52:00,370::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3302::DEBUG::2014-04-10 17:52:00,371::task::579::TaskManager.Task::(_updateState) Task=`c95c9b24-f0af-487f-b797-00c67ab35386`::moving from state init -> state preparing
>Thread-3302::INFO::2014-04-10 17:52:00,371::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3302::INFO::2014-04-10 17:52:00,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3302::DEBUG::2014-04-10 17:52:00,372::task::1168::TaskManager.Task::(prepare) Task=`c95c9b24-f0af-487f-b797-00c67ab35386`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3302::DEBUG::2014-04-10 17:52:00,372::task::579::TaskManager.Task::(_updateState) Task=`c95c9b24-f0af-487f-b797-00c67ab35386`::moving from state preparing -> state finished
>Thread-3302::DEBUG::2014-04-10 17:52:00,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3302::DEBUG::2014-04-10 17:52:00,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3302::DEBUG::2014-04-10 17:52:00,372::task::974::TaskManager.Task::(_decref) Task=`c95c9b24-f0af-487f-b797-00c67ab35386`::ref 0 aborting False
>Thread-3303::DEBUG::2014-04-10 17:52:00,379::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3303::DEBUG::2014-04-10 17:52:00,379::task::579::TaskManager.Task::(_updateState) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::moving from state init -> state preparing
>Thread-3303::INFO::2014-04-10 17:52:00,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3303::DEBUG::2014-04-10 17:52:00,380::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76140945-e8f6-4e4b-8e35-8706b07f15bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3303::DEBUG::2014-04-10 17:52:00,380::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3303::DEBUG::2014-04-10 17:52:00,380::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3303::DEBUG::2014-04-10 17:52:00,381::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76140945-e8f6-4e4b-8e35-8706b07f15bb`::Granted request
>Thread-3303::DEBUG::2014-04-10 17:52:00,381::task::811::TaskManager.Task::(resourceAcquired) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3303::DEBUG::2014-04-10 17:52:00,381::task::974::TaskManager.Task::(_decref) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::ref 1 aborting False
>Thread-3303::INFO::2014-04-10 17:52:00,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3303::DEBUG::2014-04-10 17:52:00,383::task::1168::TaskManager.Task::(prepare) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3303::DEBUG::2014-04-10 17:52:00,383::task::579::TaskManager.Task::(_updateState) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::moving from state preparing -> state finished
>Thread-3303::DEBUG::2014-04-10 17:52:00,383::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3303::DEBUG::2014-04-10 17:52:00,384::task::974::TaskManager.Task::(_decref) Task=`c9ad2cf5-bcda-4d57-89d4-19611ea9f740`::ref 0 aborting False
>Thread-3305::DEBUG::2014-04-10 17:52:04,028::task::579::TaskManager.Task::(_updateState) Task=`ef738425-2b6c-4363-b65a-d3e02e8a09bd`::moving from state init -> state preparing
>Thread-3305::INFO::2014-04-10 17:52:04,029::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3305::INFO::2014-04-10 17:52:04,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462965', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289373', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319714', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478781', 'lastCheck': '6.8', 'valid': True}}
>Thread-3305::DEBUG::2014-04-10 17:52:04,029::task::1168::TaskManager.Task::(prepare) Task=`ef738425-2b6c-4363-b65a-d3e02e8a09bd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462965', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000289373', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319714', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478781', 'lastCheck': '6.8', 'valid': True}}
>Thread-3305::DEBUG::2014-04-10 17:52:04,030::task::579::TaskManager.Task::(_updateState) Task=`ef738425-2b6c-4363-b65a-d3e02e8a09bd`::moving from state preparing -> state finished
>Thread-3305::DEBUG::2014-04-10 17:52:04,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3305::DEBUG::2014-04-10 17:52:04,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3305::DEBUG::2014-04-10 17:52:04,030::task::974::TaskManager.Task::(_decref) Task=`ef738425-2b6c-4363-b65a-d3e02e8a09bd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:06,655::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:06,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000473259 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:06,845::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:06,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266037 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:07,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:07,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000518134 s, 710 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:07,303::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:07,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000529473 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3309::DEBUG::2014-04-10 17:52:10,459::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-3309::DEBUG::2014-04-10 17:52:10,460::task::579::TaskManager.Task::(_updateState) Task=`034ac9ae-cb6b-4a35-9a4c-144ea3f3c35f`::moving from state init -> state preparing
>Thread-3309::INFO::2014-04-10 17:52:10,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3309::INFO::2014-04-10 17:52:10,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3309::DEBUG::2014-04-10 17:52:10,461::task::1168::TaskManager.Task::(prepare) Task=`034ac9ae-cb6b-4a35-9a4c-144ea3f3c35f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3309::DEBUG::2014-04-10 17:52:10,461::task::579::TaskManager.Task::(_updateState) Task=`034ac9ae-cb6b-4a35-9a4c-144ea3f3c35f`::moving from state preparing -> state finished
>Thread-3309::DEBUG::2014-04-10 17:52:10,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3309::DEBUG::2014-04-10 17:52:10,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3309::DEBUG::2014-04-10 17:52:10,461::task::974::TaskManager.Task::(_decref) Task=`034ac9ae-cb6b-4a35-9a4c-144ea3f3c35f`::ref 0 aborting False
>Thread-3310::DEBUG::2014-04-10 17:52:10,468::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-3310::DEBUG::2014-04-10 17:52:10,468::task::579::TaskManager.Task::(_updateState) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::moving from state init -> state preparing
>Thread-3310::INFO::2014-04-10 17:52:10,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3310::DEBUG::2014-04-10 17:52:10,469::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b26541f2-a3b1-4397-b6c8-e8b778b052aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3310::DEBUG::2014-04-10 17:52:10,469::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3310::DEBUG::2014-04-10 17:52:10,469::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3310::DEBUG::2014-04-10 17:52:10,469::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b26541f2-a3b1-4397-b6c8-e8b778b052aa`::Granted request
>Thread-3310::DEBUG::2014-04-10 17:52:10,470::task::811::TaskManager.Task::(resourceAcquired) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3310::DEBUG::2014-04-10 17:52:10,470::task::974::TaskManager.Task::(_decref) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::ref 1 aborting False
>Thread-3310::INFO::2014-04-10 17:52:10,472::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3310::DEBUG::2014-04-10 17:52:10,472::task::1168::TaskManager.Task::(prepare) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::task::579::TaskManager.Task::(_updateState) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::moving from state preparing -> state finished
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3310::DEBUG::2014-04-10 17:52:10,473::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3310::DEBUG::2014-04-10 17:52:10,474::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3310::DEBUG::2014-04-10 17:52:10,474::task::974::TaskManager.Task::(_decref) Task=`9771c940-0d1a-480a-8dff-2fc2ce84b51b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:16,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:16,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338513 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:16,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:16,864::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323917 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:17,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:17,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000423826 s, 868 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:17,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:17,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000487981 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3313::DEBUG::2014-04-10 17:52:19,199::task::579::TaskManager.Task::(_updateState) Task=`548af974-6339-47c1-8558-150d66f03766`::moving from state init -> state preparing
>Thread-3313::INFO::2014-04-10 17:52:19,199::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3313::INFO::2014-04-10 17:52:19,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487981', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338513', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323917', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423826', 'lastCheck': '2.0', 'valid': True}}
>Thread-3313::DEBUG::2014-04-10 17:52:19,200::task::1168::TaskManager.Task::(prepare) Task=`548af974-6339-47c1-8558-150d66f03766`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487981', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338513', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323917', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423826', 'lastCheck': '2.0', 'valid': True}}
>Thread-3313::DEBUG::2014-04-10 17:52:19,200::task::579::TaskManager.Task::(_updateState) Task=`548af974-6339-47c1-8558-150d66f03766`::moving from state preparing -> state finished
>Thread-3313::DEBUG::2014-04-10 17:52:19,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3313::DEBUG::2014-04-10 17:52:19,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3313::DEBUG::2014-04-10 17:52:19,200::task::974::TaskManager.Task::(_decref) Task=`548af974-6339-47c1-8558-150d66f03766`::ref 0 aborting False
>Thread-3315::DEBUG::2014-04-10 17:52:20,552::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-3315::DEBUG::2014-04-10 17:52:20,553::task::579::TaskManager.Task::(_updateState) Task=`50a8d67a-2c1b-4876-b298-4aad3e696793`::moving from state init -> state preparing
>Thread-3315::INFO::2014-04-10 17:52:20,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3315::INFO::2014-04-10 17:52:20,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3315::DEBUG::2014-04-10 17:52:20,553::task::1168::TaskManager.Task::(prepare) Task=`50a8d67a-2c1b-4876-b298-4aad3e696793`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3315::DEBUG::2014-04-10 17:52:20,553::task::579::TaskManager.Task::(_updateState) Task=`50a8d67a-2c1b-4876-b298-4aad3e696793`::moving from state preparing -> state finished
>Thread-3315::DEBUG::2014-04-10 17:52:20,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3315::DEBUG::2014-04-10 17:52:20,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3315::DEBUG::2014-04-10 17:52:20,554::task::974::TaskManager.Task::(_decref) Task=`50a8d67a-2c1b-4876-b298-4aad3e696793`::ref 0 aborting False
>Thread-3316::DEBUG::2014-04-10 17:52:20,560::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-3316::DEBUG::2014-04-10 17:52:20,560::task::579::TaskManager.Task::(_updateState) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::moving from state init -> state preparing
>Thread-3316::INFO::2014-04-10 17:52:20,560::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3316::DEBUG::2014-04-10 17:52:20,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`77ef5f35-39d8-4ae2-b0de-f2a8cda4ce44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3316::DEBUG::2014-04-10 17:52:20,561::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3316::DEBUG::2014-04-10 17:52:20,561::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3316::DEBUG::2014-04-10 17:52:20,561::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`77ef5f35-39d8-4ae2-b0de-f2a8cda4ce44`::Granted request
>Thread-3316::DEBUG::2014-04-10 17:52:20,562::task::811::TaskManager.Task::(resourceAcquired) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3316::DEBUG::2014-04-10 17:52:20,562::task::974::TaskManager.Task::(_decref) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::ref 1 aborting False
>Thread-3316::INFO::2014-04-10 17:52:20,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3316::DEBUG::2014-04-10 17:52:20,564::task::1168::TaskManager.Task::(prepare) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3316::DEBUG::2014-04-10 17:52:20,564::task::579::TaskManager.Task::(_updateState) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::moving from state preparing -> state finished
>Thread-3316::DEBUG::2014-04-10 17:52:20,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3316::DEBUG::2014-04-10 17:52:20,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3316::DEBUG::2014-04-10 17:52:20,565::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3316::DEBUG::2014-04-10 17:52:20,565::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3316::DEBUG::2014-04-10 17:52:20,565::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3316::DEBUG::2014-04-10 17:52:20,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3316::DEBUG::2014-04-10 17:52:20,565::task::974::TaskManager.Task::(_decref) Task=`f46e34b7-b21e-4110-8186-a0efac0b9e1e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:26,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:26,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339619 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:26,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:26,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391141 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:27,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:27,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477996 s, 770 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:27,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:27,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478379 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3320::DEBUG::2014-04-10 17:52:30,728::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3320::DEBUG::2014-04-10 17:52:30,729::task::579::TaskManager.Task::(_updateState) Task=`2f49cfa3-45b2-48e9-acbf-19314313952c`::moving from state init -> state preparing
>Thread-3320::INFO::2014-04-10 17:52:30,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3320::INFO::2014-04-10 17:52:30,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3320::DEBUG::2014-04-10 17:52:30,730::task::1168::TaskManager.Task::(prepare) Task=`2f49cfa3-45b2-48e9-acbf-19314313952c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3320::DEBUG::2014-04-10 17:52:30,730::task::579::TaskManager.Task::(_updateState) Task=`2f49cfa3-45b2-48e9-acbf-19314313952c`::moving from state preparing -> state finished
>Thread-3320::DEBUG::2014-04-10 17:52:30,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3320::DEBUG::2014-04-10 17:52:30,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3320::DEBUG::2014-04-10 17:52:30,730::task::974::TaskManager.Task::(_decref) Task=`2f49cfa3-45b2-48e9-acbf-19314313952c`::ref 0 aborting False
>Thread-3321::DEBUG::2014-04-10 17:52:30,737::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3321::DEBUG::2014-04-10 17:52:30,737::task::579::TaskManager.Task::(_updateState) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::moving from state init -> state preparing
>Thread-3321::INFO::2014-04-10 17:52:30,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3321::DEBUG::2014-04-10 17:52:30,738::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebc5ff7d-8ebb-42a6-96dc-320c539e848e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3321::DEBUG::2014-04-10 17:52:30,738::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3321::DEBUG::2014-04-10 17:52:30,738::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3321::DEBUG::2014-04-10 17:52:30,738::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ebc5ff7d-8ebb-42a6-96dc-320c539e848e`::Granted request
>Thread-3321::DEBUG::2014-04-10 17:52:30,739::task::811::TaskManager.Task::(resourceAcquired) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3321::DEBUG::2014-04-10 17:52:30,739::task::974::TaskManager.Task::(_decref) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::ref 1 aborting False
>Thread-3321::INFO::2014-04-10 17:52:30,741::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3321::DEBUG::2014-04-10 17:52:30,741::task::1168::TaskManager.Task::(prepare) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3321::DEBUG::2014-04-10 17:52:30,741::task::579::TaskManager.Task::(_updateState) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::moving from state preparing -> state finished
>Thread-3321::DEBUG::2014-04-10 17:52:30,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3321::DEBUG::2014-04-10 17:52:30,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3321::DEBUG::2014-04-10 17:52:30,742::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3321::DEBUG::2014-04-10 17:52:30,742::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3321::DEBUG::2014-04-10 17:52:30,742::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3321::DEBUG::2014-04-10 17:52:30,742::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3321::DEBUG::2014-04-10 17:52:30,742::task::974::TaskManager.Task::(_decref) Task=`ceddcf0b-fa8c-4ce1-a6c4-b58c96ebb441`::ref 0 aborting False
>Thread-3323::DEBUG::2014-04-10 17:52:34,830::task::579::TaskManager.Task::(_updateState) Task=`e446ff27-2875-4f3a-9e96-478b9388c674`::moving from state init -> state preparing
>Thread-3323::INFO::2014-04-10 17:52:34,831::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3323::INFO::2014-04-10 17:52:34,831::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478379', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339619', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391141', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477996', 'lastCheck': '7.6', 'valid': True}}
>Thread-3323::DEBUG::2014-04-10 17:52:34,831::task::1168::TaskManager.Task::(prepare) Task=`e446ff27-2875-4f3a-9e96-478b9388c674`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478379', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339619', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391141', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477996', 'lastCheck': '7.6', 'valid': True}}
>Thread-3323::DEBUG::2014-04-10 17:52:34,831::task::579::TaskManager.Task::(_updateState) Task=`e446ff27-2875-4f3a-9e96-478b9388c674`::moving from state preparing -> state finished
>Thread-3323::DEBUG::2014-04-10 17:52:34,832::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3323::DEBUG::2014-04-10 17:52:34,832::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3323::DEBUG::2014-04-10 17:52:34,832::task::974::TaskManager.Task::(_decref) Task=`e446ff27-2875-4f3a-9e96-478b9388c674`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:36,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:36,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344353 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:36,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:36,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284482 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:37,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:37,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000500276 s, 736 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:37,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:37,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494587 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3326::DEBUG::2014-04-10 17:52:40,832::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3326::DEBUG::2014-04-10 17:52:40,833::task::579::TaskManager.Task::(_updateState) Task=`2ef3b313-2ef3-49fb-9a6d-9a305582e2d8`::moving from state init -> state preparing
>Thread-3326::INFO::2014-04-10 17:52:40,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3326::INFO::2014-04-10 17:52:40,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3326::DEBUG::2014-04-10 17:52:40,834::task::1168::TaskManager.Task::(prepare) Task=`2ef3b313-2ef3-49fb-9a6d-9a305582e2d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3326::DEBUG::2014-04-10 17:52:40,834::task::579::TaskManager.Task::(_updateState) Task=`2ef3b313-2ef3-49fb-9a6d-9a305582e2d8`::moving from state preparing -> state finished
>Thread-3326::DEBUG::2014-04-10 17:52:40,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3326::DEBUG::2014-04-10 17:52:40,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3326::DEBUG::2014-04-10 17:52:40,834::task::974::TaskManager.Task::(_decref) Task=`2ef3b313-2ef3-49fb-9a6d-9a305582e2d8`::ref 0 aborting False
>Thread-3327::DEBUG::2014-04-10 17:52:40,841::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3327::DEBUG::2014-04-10 17:52:40,842::task::579::TaskManager.Task::(_updateState) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::moving from state init -> state preparing
>Thread-3327::INFO::2014-04-10 17:52:40,842::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3327::DEBUG::2014-04-10 17:52:40,842::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f33301cf-80ac-4087-b7ad-233eac544873`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3327::DEBUG::2014-04-10 17:52:40,843::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3327::DEBUG::2014-04-10 17:52:40,843::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3327::DEBUG::2014-04-10 17:52:40,843::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f33301cf-80ac-4087-b7ad-233eac544873`::Granted request
>Thread-3327::DEBUG::2014-04-10 17:52:40,843::task::811::TaskManager.Task::(resourceAcquired) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3327::DEBUG::2014-04-10 17:52:40,844::task::974::TaskManager.Task::(_decref) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::ref 1 aborting False
>Thread-3327::INFO::2014-04-10 17:52:40,846::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3327::DEBUG::2014-04-10 17:52:40,846::task::1168::TaskManager.Task::(prepare) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3327::DEBUG::2014-04-10 17:52:40,846::task::579::TaskManager.Task::(_updateState) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::moving from state preparing -> state finished
>Thread-3327::DEBUG::2014-04-10 17:52:40,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3327::DEBUG::2014-04-10 17:52:40,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3327::DEBUG::2014-04-10 17:52:40,847::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3327::DEBUG::2014-04-10 17:52:40,847::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3327::DEBUG::2014-04-10 17:52:40,847::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3327::DEBUG::2014-04-10 17:52:40,847::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3327::DEBUG::2014-04-10 17:52:40,848::task::974::TaskManager.Task::(_decref) Task=`2027a430-af10-44ba-837c-01a0dd149e5f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:46,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:46,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368557 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:46,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:46,905::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000404357 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:47,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:47,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00052032 s, 707 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:47,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:47,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00055477 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3331::DEBUG::2014-04-10 17:52:49,985::task::579::TaskManager.Task::(_updateState) Task=`ee7b9085-d032-4f6a-8309-21a2e332c902`::moving from state init -> state preparing
>Thread-3331::INFO::2014-04-10 17:52:49,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3331::INFO::2014-04-10 17:52:49,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055477', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368557', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404357', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052032', 'lastCheck': '2.7', 'valid': True}}
>Thread-3331::DEBUG::2014-04-10 17:52:49,986::task::1168::TaskManager.Task::(prepare) Task=`ee7b9085-d032-4f6a-8309-21a2e332c902`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055477', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368557', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404357', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052032', 'lastCheck': '2.7', 'valid': True}}
>Thread-3331::DEBUG::2014-04-10 17:52:49,986::task::579::TaskManager.Task::(_updateState) Task=`ee7b9085-d032-4f6a-8309-21a2e332c902`::moving from state preparing -> state finished
>Thread-3331::DEBUG::2014-04-10 17:52:49,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3331::DEBUG::2014-04-10 17:52:49,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3331::DEBUG::2014-04-10 17:52:49,986::task::974::TaskManager.Task::(_decref) Task=`ee7b9085-d032-4f6a-8309-21a2e332c902`::ref 0 aborting False
>Thread-3333::DEBUG::2014-04-10 17:52:50,922::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3333::DEBUG::2014-04-10 17:52:50,923::task::579::TaskManager.Task::(_updateState) Task=`476561e8-dd95-4598-aca2-d2614bb0201e`::moving from state init -> state preparing
>Thread-3333::INFO::2014-04-10 17:52:50,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3333::INFO::2014-04-10 17:52:50,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3333::DEBUG::2014-04-10 17:52:50,924::task::1168::TaskManager.Task::(prepare) Task=`476561e8-dd95-4598-aca2-d2614bb0201e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3333::DEBUG::2014-04-10 17:52:50,924::task::579::TaskManager.Task::(_updateState) Task=`476561e8-dd95-4598-aca2-d2614bb0201e`::moving from state preparing -> state finished
>Thread-3333::DEBUG::2014-04-10 17:52:50,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3333::DEBUG::2014-04-10 17:52:50,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3333::DEBUG::2014-04-10 17:52:50,924::task::974::TaskManager.Task::(_decref) Task=`476561e8-dd95-4598-aca2-d2614bb0201e`::ref 0 aborting False
>Thread-3334::DEBUG::2014-04-10 17:52:50,931::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3334::DEBUG::2014-04-10 17:52:50,932::task::579::TaskManager.Task::(_updateState) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::moving from state init -> state preparing
>Thread-3334::INFO::2014-04-10 17:52:50,932::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3334::DEBUG::2014-04-10 17:52:50,932::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`af7f7bdb-dfb0-4cfd-9ac8-f702ded21ac4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3334::DEBUG::2014-04-10 17:52:50,932::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3334::DEBUG::2014-04-10 17:52:50,933::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3334::DEBUG::2014-04-10 17:52:50,933::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`af7f7bdb-dfb0-4cfd-9ac8-f702ded21ac4`::Granted request
>Thread-3334::DEBUG::2014-04-10 17:52:50,934::task::811::TaskManager.Task::(resourceAcquired) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3334::DEBUG::2014-04-10 17:52:50,934::task::974::TaskManager.Task::(_decref) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::ref 1 aborting False
>Thread-3334::INFO::2014-04-10 17:52:50,936::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3334::DEBUG::2014-04-10 17:52:50,936::task::1168::TaskManager.Task::(prepare) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3334::DEBUG::2014-04-10 17:52:50,936::task::579::TaskManager.Task::(_updateState) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::moving from state preparing -> state finished
>Thread-3334::DEBUG::2014-04-10 17:52:50,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3334::DEBUG::2014-04-10 17:52:50,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3334::DEBUG::2014-04-10 17:52:50,937::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3334::DEBUG::2014-04-10 17:52:50,937::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3334::DEBUG::2014-04-10 17:52:50,937::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3334::DEBUG::2014-04-10 17:52:50,937::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3334::DEBUG::2014-04-10 17:52:50,937::task::974::TaskManager.Task::(_decref) Task=`9e4d0a20-b42e-4ffd-9805-e1d2a8dc19c5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:52:56,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:52:56,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310715 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:52:56,914::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:52:56,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308057 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:52:57,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:52:57,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000453358 s, 812 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:52:57,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:52:57,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475082 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3338::DEBUG::2014-04-10 17:53:01,011::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3338::DEBUG::2014-04-10 17:53:01,012::task::579::TaskManager.Task::(_updateState) Task=`39c21ac5-b6c9-44c6-b486-6990e213d6e9`::moving from state init -> state preparing
>Thread-3338::INFO::2014-04-10 17:53:01,012::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3338::INFO::2014-04-10 17:53:01,012::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3338::DEBUG::2014-04-10 17:53:01,012::task::1168::TaskManager.Task::(prepare) Task=`39c21ac5-b6c9-44c6-b486-6990e213d6e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3338::DEBUG::2014-04-10 17:53:01,013::task::579::TaskManager.Task::(_updateState) Task=`39c21ac5-b6c9-44c6-b486-6990e213d6e9`::moving from state preparing -> state finished
>Thread-3338::DEBUG::2014-04-10 17:53:01,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3338::DEBUG::2014-04-10 17:53:01,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3338::DEBUG::2014-04-10 17:53:01,013::task::974::TaskManager.Task::(_decref) Task=`39c21ac5-b6c9-44c6-b486-6990e213d6e9`::ref 0 aborting False
>Thread-3339::DEBUG::2014-04-10 17:53:01,019::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3339::DEBUG::2014-04-10 17:53:01,020::task::579::TaskManager.Task::(_updateState) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::moving from state init -> state preparing
>Thread-3339::INFO::2014-04-10 17:53:01,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3339::DEBUG::2014-04-10 17:53:01,021::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eae293e9-f8b4-42a8-b941-40d5203acd4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3339::DEBUG::2014-04-10 17:53:01,021::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3339::DEBUG::2014-04-10 17:53:01,021::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3339::DEBUG::2014-04-10 17:53:01,021::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eae293e9-f8b4-42a8-b941-40d5203acd4a`::Granted request
>Thread-3339::DEBUG::2014-04-10 17:53:01,022::task::811::TaskManager.Task::(resourceAcquired) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3339::DEBUG::2014-04-10 17:53:01,022::task::974::TaskManager.Task::(_decref) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::ref 1 aborting False
>Thread-3339::INFO::2014-04-10 17:53:01,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3339::DEBUG::2014-04-10 17:53:01,024::task::1168::TaskManager.Task::(prepare) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3339::DEBUG::2014-04-10 17:53:01,024::task::579::TaskManager.Task::(_updateState) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::moving from state preparing -> state finished
>Thread-3339::DEBUG::2014-04-10 17:53:01,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3339::DEBUG::2014-04-10 17:53:01,024::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3339::DEBUG::2014-04-10 17:53:01,024::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3339::DEBUG::2014-04-10 17:53:01,025::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3339::DEBUG::2014-04-10 17:53:01,025::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3339::DEBUG::2014-04-10 17:53:01,025::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3339::DEBUG::2014-04-10 17:53:01,025::task::974::TaskManager.Task::(_decref) Task=`4fbe6d33-bdad-4a3b-9477-c83c6d991b70`::ref 0 aborting False
>Thread-3341::DEBUG::2014-04-10 17:53:05,196::task::579::TaskManager.Task::(_updateState) Task=`91277d3b-83ed-48bb-9c15-d32b7e1e4d11`::moving from state init -> state preparing
>Thread-3341::INFO::2014-04-10 17:53:05,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3341::INFO::2014-04-10 17:53:05,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475082', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310715', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308057', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453358', 'lastCheck': '7.9', 'valid': True}}
>Thread-3341::DEBUG::2014-04-10 17:53:05,197::task::1168::TaskManager.Task::(prepare) Task=`91277d3b-83ed-48bb-9c15-d32b7e1e4d11`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475082', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310715', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308057', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453358', 'lastCheck': '7.9', 'valid': True}}
>Thread-3341::DEBUG::2014-04-10 17:53:05,197::task::579::TaskManager.Task::(_updateState) Task=`91277d3b-83ed-48bb-9c15-d32b7e1e4d11`::moving from state preparing -> state finished
>Thread-3341::DEBUG::2014-04-10 17:53:05,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3341::DEBUG::2014-04-10 17:53:05,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3341::DEBUG::2014-04-10 17:53:05,198::task::974::TaskManager.Task::(_decref) Task=`91277d3b-83ed-48bb-9c15-d32b7e1e4d11`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:06,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:06,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373042 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:06,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:06,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277889 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:07,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:07,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000549915 s, 669 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:07,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:07,399::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464986 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3344::DEBUG::2014-04-10 17:53:11,119::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3344::DEBUG::2014-04-10 17:53:11,125::task::579::TaskManager.Task::(_updateState) Task=`4b5af02a-8578-479f-b844-6e5efc41cd85`::moving from state init -> state preparing
>Thread-3344::INFO::2014-04-10 17:53:11,125::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3344::INFO::2014-04-10 17:53:11,126::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3344::DEBUG::2014-04-10 17:53:11,126::task::1168::TaskManager.Task::(prepare) Task=`4b5af02a-8578-479f-b844-6e5efc41cd85`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3344::DEBUG::2014-04-10 17:53:11,126::task::579::TaskManager.Task::(_updateState) Task=`4b5af02a-8578-479f-b844-6e5efc41cd85`::moving from state preparing -> state finished
>Thread-3344::DEBUG::2014-04-10 17:53:11,126::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3344::DEBUG::2014-04-10 17:53:11,126::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3344::DEBUG::2014-04-10 17:53:11,127::task::974::TaskManager.Task::(_decref) Task=`4b5af02a-8578-479f-b844-6e5efc41cd85`::ref 0 aborting False
>Thread-3345::DEBUG::2014-04-10 17:53:11,134::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3345::DEBUG::2014-04-10 17:53:11,134::task::579::TaskManager.Task::(_updateState) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::moving from state init -> state preparing
>Thread-3345::INFO::2014-04-10 17:53:11,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3345::DEBUG::2014-04-10 17:53:11,135::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ecbb5c9b-499e-4864-b820-75f47f1f8c3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3345::DEBUG::2014-04-10 17:53:11,135::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3345::DEBUG::2014-04-10 17:53:11,135::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3345::DEBUG::2014-04-10 17:53:11,135::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ecbb5c9b-499e-4864-b820-75f47f1f8c3f`::Granted request
>Thread-3345::DEBUG::2014-04-10 17:53:11,136::task::811::TaskManager.Task::(resourceAcquired) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3345::DEBUG::2014-04-10 17:53:11,136::task::974::TaskManager.Task::(_decref) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::ref 1 aborting False
>Thread-3345::INFO::2014-04-10 17:53:11,138::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3345::DEBUG::2014-04-10 17:53:11,138::task::1168::TaskManager.Task::(prepare) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3345::DEBUG::2014-04-10 17:53:11,138::task::579::TaskManager.Task::(_updateState) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::moving from state preparing -> state finished
>Thread-3345::DEBUG::2014-04-10 17:53:11,139::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3345::DEBUG::2014-04-10 17:53:11,139::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3345::DEBUG::2014-04-10 17:53:11,139::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3345::DEBUG::2014-04-10 17:53:11,139::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3345::DEBUG::2014-04-10 17:53:11,139::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3345::DEBUG::2014-04-10 17:53:11,140::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3345::DEBUG::2014-04-10 17:53:11,140::task::974::TaskManager.Task::(_decref) Task=`eea0b3f5-720c-421d-973f-6e6ef36b5412`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:16,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:16,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367315 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:16,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:16,946::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000262665 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:17,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:17,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480713 s, 766 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:17,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:17,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000487417 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3349::DEBUG::2014-04-10 17:53:20,414::task::579::TaskManager.Task::(_updateState) Task=`6c0640fb-552a-4878-99e3-c5496f8ec4d3`::moving from state init -> state preparing
>Thread-3349::INFO::2014-04-10 17:53:20,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3349::INFO::2014-04-10 17:53:20,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487417', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367315', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262665', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480713', 'lastCheck': '3.1', 'valid': True}}
>Thread-3349::DEBUG::2014-04-10 17:53:20,415::task::1168::TaskManager.Task::(prepare) Task=`6c0640fb-552a-4878-99e3-c5496f8ec4d3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487417', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367315', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262665', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480713', 'lastCheck': '3.1', 'valid': True}}
>Thread-3349::DEBUG::2014-04-10 17:53:20,415::task::579::TaskManager.Task::(_updateState) Task=`6c0640fb-552a-4878-99e3-c5496f8ec4d3`::moving from state preparing -> state finished
>Thread-3349::DEBUG::2014-04-10 17:53:20,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3349::DEBUG::2014-04-10 17:53:20,415::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3349::DEBUG::2014-04-10 17:53:20,415::task::974::TaskManager.Task::(_decref) Task=`6c0640fb-552a-4878-99e3-c5496f8ec4d3`::ref 0 aborting False
>Thread-3351::DEBUG::2014-04-10 17:53:21,462::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3351::DEBUG::2014-04-10 17:53:21,463::task::579::TaskManager.Task::(_updateState) Task=`561303e9-f01f-48ab-888a-31a8474f3ba9`::moving from state init -> state preparing
>Thread-3351::INFO::2014-04-10 17:53:21,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3351::INFO::2014-04-10 17:53:21,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3351::DEBUG::2014-04-10 17:53:21,463::task::1168::TaskManager.Task::(prepare) Task=`561303e9-f01f-48ab-888a-31a8474f3ba9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3351::DEBUG::2014-04-10 17:53:21,464::task::579::TaskManager.Task::(_updateState) Task=`561303e9-f01f-48ab-888a-31a8474f3ba9`::moving from state preparing -> state finished
>Thread-3351::DEBUG::2014-04-10 17:53:21,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3351::DEBUG::2014-04-10 17:53:21,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3351::DEBUG::2014-04-10 17:53:21,464::task::974::TaskManager.Task::(_decref) Task=`561303e9-f01f-48ab-888a-31a8474f3ba9`::ref 0 aborting False
>Thread-3352::DEBUG::2014-04-10 17:53:21,470::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3352::DEBUG::2014-04-10 17:53:21,470::task::579::TaskManager.Task::(_updateState) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::moving from state init -> state preparing
>Thread-3352::INFO::2014-04-10 17:53:21,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3352::DEBUG::2014-04-10 17:53:21,471::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8994a1d3-8ac7-4669-8298-fe2439c3999c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3352::DEBUG::2014-04-10 17:53:21,471::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3352::DEBUG::2014-04-10 17:53:21,471::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3352::DEBUG::2014-04-10 17:53:21,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8994a1d3-8ac7-4669-8298-fe2439c3999c`::Granted request
>Thread-3352::DEBUG::2014-04-10 17:53:21,472::task::811::TaskManager.Task::(resourceAcquired) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3352::DEBUG::2014-04-10 17:53:21,472::task::974::TaskManager.Task::(_decref) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::ref 1 aborting False
>Thread-3352::INFO::2014-04-10 17:53:21,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3352::DEBUG::2014-04-10 17:53:21,474::task::1168::TaskManager.Task::(prepare) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3352::DEBUG::2014-04-10 17:53:21,474::task::579::TaskManager.Task::(_updateState) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::moving from state preparing -> state finished
>Thread-3352::DEBUG::2014-04-10 17:53:21,474::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3352::DEBUG::2014-04-10 17:53:21,475::task::974::TaskManager.Task::(_decref) Task=`f813b0cb-1ee8-4ec4-8183-965f6d79a152`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:26,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:26,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356859 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:26,954::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:26,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288572 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:27,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:27,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447639 s, 822 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:27,418::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:53:27,433::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:53:27,434::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:53:27,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:53:27,441::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:53:27,441::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:53:27,441::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:53:27,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:27,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000355246 s, 1.9 MB/s\n'; <rc> = 0
>Thread-3360::DEBUG::2014-04-10 17:53:31,556::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3360::DEBUG::2014-04-10 17:53:31,557::task::579::TaskManager.Task::(_updateState) Task=`430a1e4e-b175-4fb9-bedb-41f02f4a9551`::moving from state init -> state preparing
>Thread-3360::INFO::2014-04-10 17:53:31,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3360::INFO::2014-04-10 17:53:31,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3360::DEBUG::2014-04-10 17:53:31,558::task::1168::TaskManager.Task::(prepare) Task=`430a1e4e-b175-4fb9-bedb-41f02f4a9551`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3360::DEBUG::2014-04-10 17:53:31,558::task::579::TaskManager.Task::(_updateState) Task=`430a1e4e-b175-4fb9-bedb-41f02f4a9551`::moving from state preparing -> state finished
>Thread-3360::DEBUG::2014-04-10 17:53:31,558::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3360::DEBUG::2014-04-10 17:53:31,558::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3360::DEBUG::2014-04-10 17:53:31,559::task::974::TaskManager.Task::(_decref) Task=`430a1e4e-b175-4fb9-bedb-41f02f4a9551`::ref 0 aborting False
>Thread-3361::DEBUG::2014-04-10 17:53:31,565::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3361::DEBUG::2014-04-10 17:53:31,565::task::579::TaskManager.Task::(_updateState) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::moving from state init -> state preparing
>Thread-3361::INFO::2014-04-10 17:53:31,566::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3361::DEBUG::2014-04-10 17:53:31,566::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`daf57672-ea50-4a66-8285-07a7503b7baa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3361::DEBUG::2014-04-10 17:53:31,566::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3361::DEBUG::2014-04-10 17:53:31,566::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3361::DEBUG::2014-04-10 17:53:31,567::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`daf57672-ea50-4a66-8285-07a7503b7baa`::Granted request
>Thread-3361::DEBUG::2014-04-10 17:53:31,568::task::811::TaskManager.Task::(resourceAcquired) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3361::DEBUG::2014-04-10 17:53:31,568::task::974::TaskManager.Task::(_decref) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::ref 1 aborting False
>Thread-3361::INFO::2014-04-10 17:53:31,570::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3361::DEBUG::2014-04-10 17:53:31,570::task::1168::TaskManager.Task::(prepare) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3361::DEBUG::2014-04-10 17:53:31,570::task::579::TaskManager.Task::(_updateState) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::moving from state preparing -> state finished
>Thread-3361::DEBUG::2014-04-10 17:53:31,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3361::DEBUG::2014-04-10 17:53:31,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3361::DEBUG::2014-04-10 17:53:31,570::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3361::DEBUG::2014-04-10 17:53:31,571::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3361::DEBUG::2014-04-10 17:53:31,571::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3361::DEBUG::2014-04-10 17:53:31,571::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3361::DEBUG::2014-04-10 17:53:31,571::task::974::TaskManager.Task::(_decref) Task=`68232da8-21d7-4ec7-8052-ac028db8142e`::ref 0 aborting False
>Thread-3363::DEBUG::2014-04-10 17:53:35,589::task::579::TaskManager.Task::(_updateState) Task=`6b8574a6-5c85-4119-b6dc-bd79372f908c`::moving from state init -> state preparing
>Thread-3363::INFO::2014-04-10 17:53:35,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3363::INFO::2014-04-10 17:53:35,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355246', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356859', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288572', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447639', 'lastCheck': '8.2', 'valid': True}}
>Thread-3363::DEBUG::2014-04-10 17:53:35,590::task::1168::TaskManager.Task::(prepare) Task=`6b8574a6-5c85-4119-b6dc-bd79372f908c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355246', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356859', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288572', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447639', 'lastCheck': '8.2', 'valid': True}}
>Thread-3363::DEBUG::2014-04-10 17:53:35,590::task::579::TaskManager.Task::(_updateState) Task=`6b8574a6-5c85-4119-b6dc-bd79372f908c`::moving from state preparing -> state finished
>Thread-3363::DEBUG::2014-04-10 17:53:35,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3363::DEBUG::2014-04-10 17:53:35,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3363::DEBUG::2014-04-10 17:53:35,590::task::974::TaskManager.Task::(_decref) Task=`6b8574a6-5c85-4119-b6dc-bd79372f908c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:36,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:36,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000437898 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:36,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:36,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289013 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:37,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:37,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496093 s, 742 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:37,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:37,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000543429 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3366::DEBUG::2014-04-10 17:53:41,656::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3366::DEBUG::2014-04-10 17:53:41,656::task::579::TaskManager.Task::(_updateState) Task=`00fb28bc-fd73-4c62-800d-1f5fd6b7b2e2`::moving from state init -> state preparing
>Thread-3366::INFO::2014-04-10 17:53:41,657::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3366::INFO::2014-04-10 17:53:41,657::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3366::DEBUG::2014-04-10 17:53:41,657::task::1168::TaskManager.Task::(prepare) Task=`00fb28bc-fd73-4c62-800d-1f5fd6b7b2e2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3366::DEBUG::2014-04-10 17:53:41,657::task::579::TaskManager.Task::(_updateState) Task=`00fb28bc-fd73-4c62-800d-1f5fd6b7b2e2`::moving from state preparing -> state finished
>Thread-3366::DEBUG::2014-04-10 17:53:41,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3366::DEBUG::2014-04-10 17:53:41,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3366::DEBUG::2014-04-10 17:53:41,658::task::974::TaskManager.Task::(_decref) Task=`00fb28bc-fd73-4c62-800d-1f5fd6b7b2e2`::ref 0 aborting False
>Thread-3367::DEBUG::2014-04-10 17:53:41,664::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3367::DEBUG::2014-04-10 17:53:41,665::task::579::TaskManager.Task::(_updateState) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::moving from state init -> state preparing
>Thread-3367::INFO::2014-04-10 17:53:41,665::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3367::DEBUG::2014-04-10 17:53:41,665::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01ff2316-020d-45bf-bba2-76770cc2e433`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3367::DEBUG::2014-04-10 17:53:41,666::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3367::DEBUG::2014-04-10 17:53:41,666::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3367::DEBUG::2014-04-10 17:53:41,666::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01ff2316-020d-45bf-bba2-76770cc2e433`::Granted request
>Thread-3367::DEBUG::2014-04-10 17:53:41,666::task::811::TaskManager.Task::(resourceAcquired) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3367::DEBUG::2014-04-10 17:53:41,666::task::974::TaskManager.Task::(_decref) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::ref 1 aborting False
>Thread-3367::INFO::2014-04-10 17:53:41,668::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::task::1168::TaskManager.Task::(prepare) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::task::579::TaskManager.Task::(_updateState) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::moving from state preparing -> state finished
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3367::DEBUG::2014-04-10 17:53:41,669::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3367::DEBUG::2014-04-10 17:53:41,670::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3367::DEBUG::2014-04-10 17:53:41,670::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3367::DEBUG::2014-04-10 17:53:41,670::task::974::TaskManager.Task::(_decref) Task=`62be00b8-bc2e-4610-abe3-28a206972d16`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:46,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:46,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361485 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:46,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:46,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279668 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:47,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:47,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000540384 s, 681 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:47,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:47,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496115 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3371::DEBUG::2014-04-10 17:53:50,759::task::579::TaskManager.Task::(_updateState) Task=`ab9a2475-ef09-45ee-8ef9-340ba2a8c49f`::moving from state init -> state preparing
>Thread-3371::INFO::2014-04-10 17:53:50,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3371::INFO::2014-04-10 17:53:50,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496115', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361485', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279668', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540384', 'lastCheck': '3.4', 'valid': True}}
>Thread-3371::DEBUG::2014-04-10 17:53:50,760::task::1168::TaskManager.Task::(prepare) Task=`ab9a2475-ef09-45ee-8ef9-340ba2a8c49f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496115', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361485', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279668', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540384', 'lastCheck': '3.4', 'valid': True}}
>Thread-3371::DEBUG::2014-04-10 17:53:50,760::task::579::TaskManager.Task::(_updateState) Task=`ab9a2475-ef09-45ee-8ef9-340ba2a8c49f`::moving from state preparing -> state finished
>Thread-3371::DEBUG::2014-04-10 17:53:50,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3371::DEBUG::2014-04-10 17:53:50,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3371::DEBUG::2014-04-10 17:53:50,761::task::974::TaskManager.Task::(_decref) Task=`ab9a2475-ef09-45ee-8ef9-340ba2a8c49f`::ref 0 aborting False
>Thread-3373::DEBUG::2014-04-10 17:53:51,746::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3373::DEBUG::2014-04-10 17:53:51,747::task::579::TaskManager.Task::(_updateState) Task=`fbe73d28-d801-4a18-8c86-0297f9d75cff`::moving from state init -> state preparing
>Thread-3373::INFO::2014-04-10 17:53:51,747::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3373::INFO::2014-04-10 17:53:51,747::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3373::DEBUG::2014-04-10 17:53:51,748::task::1168::TaskManager.Task::(prepare) Task=`fbe73d28-d801-4a18-8c86-0297f9d75cff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3373::DEBUG::2014-04-10 17:53:51,748::task::579::TaskManager.Task::(_updateState) Task=`fbe73d28-d801-4a18-8c86-0297f9d75cff`::moving from state preparing -> state finished
>Thread-3373::DEBUG::2014-04-10 17:53:51,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3373::DEBUG::2014-04-10 17:53:51,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3373::DEBUG::2014-04-10 17:53:51,748::task::974::TaskManager.Task::(_decref) Task=`fbe73d28-d801-4a18-8c86-0297f9d75cff`::ref 0 aborting False
>Thread-3374::DEBUG::2014-04-10 17:53:51,754::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3374::DEBUG::2014-04-10 17:53:51,755::task::579::TaskManager.Task::(_updateState) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::moving from state init -> state preparing
>Thread-3374::INFO::2014-04-10 17:53:51,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3374::DEBUG::2014-04-10 17:53:51,755::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d2f6729-f0d1-4a1d-bde4-934d4f64c635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3374::DEBUG::2014-04-10 17:53:51,755::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3374::DEBUG::2014-04-10 17:53:51,756::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3374::DEBUG::2014-04-10 17:53:51,756::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d2f6729-f0d1-4a1d-bde4-934d4f64c635`::Granted request
>Thread-3374::DEBUG::2014-04-10 17:53:51,756::task::811::TaskManager.Task::(resourceAcquired) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3374::DEBUG::2014-04-10 17:53:51,756::task::974::TaskManager.Task::(_decref) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::ref 1 aborting False
>Thread-3374::INFO::2014-04-10 17:53:51,758::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3374::DEBUG::2014-04-10 17:53:51,758::task::1168::TaskManager.Task::(prepare) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3374::DEBUG::2014-04-10 17:53:51,758::task::579::TaskManager.Task::(_updateState) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::moving from state preparing -> state finished
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3374::DEBUG::2014-04-10 17:53:51,759::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3374::DEBUG::2014-04-10 17:53:51,760::task::974::TaskManager.Task::(_decref) Task=`705700ab-d2d7-472f-9c95-951888cc16f9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:53:56,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:53:56,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000446132 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:53:56,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:53:57,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000285281 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:53:57,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:53:57,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000524162 s, 702 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:53:57,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:53:57,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000538578 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3378::DEBUG::2014-04-10 17:54:01,869::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3378::DEBUG::2014-04-10 17:54:01,869::task::579::TaskManager.Task::(_updateState) Task=`5c7ebb58-255e-43cb-b8fb-f1dff5e1c713`::moving from state init -> state preparing
>Thread-3378::INFO::2014-04-10 17:54:01,870::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3378::INFO::2014-04-10 17:54:01,870::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3378::DEBUG::2014-04-10 17:54:01,870::task::1168::TaskManager.Task::(prepare) Task=`5c7ebb58-255e-43cb-b8fb-f1dff5e1c713`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3378::DEBUG::2014-04-10 17:54:01,870::task::579::TaskManager.Task::(_updateState) Task=`5c7ebb58-255e-43cb-b8fb-f1dff5e1c713`::moving from state preparing -> state finished
>Thread-3378::DEBUG::2014-04-10 17:54:01,870::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3378::DEBUG::2014-04-10 17:54:01,870::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3378::DEBUG::2014-04-10 17:54:01,871::task::974::TaskManager.Task::(_decref) Task=`5c7ebb58-255e-43cb-b8fb-f1dff5e1c713`::ref 0 aborting False
>Thread-3379::DEBUG::2014-04-10 17:54:01,877::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3379::DEBUG::2014-04-10 17:54:01,878::task::579::TaskManager.Task::(_updateState) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::moving from state init -> state preparing
>Thread-3379::INFO::2014-04-10 17:54:01,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3379::DEBUG::2014-04-10 17:54:01,878::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c9798443-beb7-4eb2-a669-93c4dde44a12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3379::DEBUG::2014-04-10 17:54:01,878::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3379::DEBUG::2014-04-10 17:54:01,879::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3379::DEBUG::2014-04-10 17:54:01,879::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c9798443-beb7-4eb2-a669-93c4dde44a12`::Granted request
>Thread-3379::DEBUG::2014-04-10 17:54:01,879::task::811::TaskManager.Task::(resourceAcquired) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3379::DEBUG::2014-04-10 17:54:01,879::task::974::TaskManager.Task::(_decref) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::ref 1 aborting False
>Thread-3379::INFO::2014-04-10 17:54:01,881::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3379::DEBUG::2014-04-10 17:54:01,881::task::1168::TaskManager.Task::(prepare) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3379::DEBUG::2014-04-10 17:54:01,881::task::579::TaskManager.Task::(_updateState) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::moving from state preparing -> state finished
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3379::DEBUG::2014-04-10 17:54:01,882::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3379::DEBUG::2014-04-10 17:54:01,883::task::974::TaskManager.Task::(_decref) Task=`b63ebaba-c636-4999-a79b-fa451c563e1d`::ref 0 aborting False
>Thread-3381::DEBUG::2014-04-10 17:54:05,927::task::579::TaskManager.Task::(_updateState) Task=`f79858f9-422d-42bd-b3c2-9cc787d4e075`::moving from state init -> state preparing
>Thread-3381::INFO::2014-04-10 17:54:05,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3381::INFO::2014-04-10 17:54:05,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538578', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446132', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285281', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524162', 'lastCheck': '8.5', 'valid': True}}
>Thread-3381::DEBUG::2014-04-10 17:54:05,928::task::1168::TaskManager.Task::(prepare) Task=`f79858f9-422d-42bd-b3c2-9cc787d4e075`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538578', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446132', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285281', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524162', 'lastCheck': '8.5', 'valid': True}}
>Thread-3381::DEBUG::2014-04-10 17:54:05,928::task::579::TaskManager.Task::(_updateState) Task=`f79858f9-422d-42bd-b3c2-9cc787d4e075`::moving from state preparing -> state finished
>Thread-3381::DEBUG::2014-04-10 17:54:05,928::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3381::DEBUG::2014-04-10 17:54:05,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3381::DEBUG::2014-04-10 17:54:05,929::task::974::TaskManager.Task::(_decref) Task=`f79858f9-422d-42bd-b3c2-9cc787d4e075`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:06,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:06,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035842 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:07,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:07,016::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347949 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:07,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:07,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000459792 s, 800 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:07,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:07,511::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000530865 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3384::DEBUG::2014-04-10 17:54:11,977::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3384::DEBUG::2014-04-10 17:54:11,977::task::579::TaskManager.Task::(_updateState) Task=`66b4056e-1a8d-44b5-bac5-31fcc8ea2e7b`::moving from state init -> state preparing
>Thread-3384::INFO::2014-04-10 17:54:11,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3384::INFO::2014-04-10 17:54:11,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3384::DEBUG::2014-04-10 17:54:11,978::task::1168::TaskManager.Task::(prepare) Task=`66b4056e-1a8d-44b5-bac5-31fcc8ea2e7b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3384::DEBUG::2014-04-10 17:54:11,978::task::579::TaskManager.Task::(_updateState) Task=`66b4056e-1a8d-44b5-bac5-31fcc8ea2e7b`::moving from state preparing -> state finished
>Thread-3384::DEBUG::2014-04-10 17:54:11,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3384::DEBUG::2014-04-10 17:54:11,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3384::DEBUG::2014-04-10 17:54:11,979::task::974::TaskManager.Task::(_decref) Task=`66b4056e-1a8d-44b5-bac5-31fcc8ea2e7b`::ref 0 aborting False
>Thread-3385::DEBUG::2014-04-10 17:54:11,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3385::DEBUG::2014-04-10 17:54:11,985::task::579::TaskManager.Task::(_updateState) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::moving from state init -> state preparing
>Thread-3385::INFO::2014-04-10 17:54:11,986::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3385::DEBUG::2014-04-10 17:54:11,986::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f148c93-0ccb-4725-9c01-91a876321b2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3385::DEBUG::2014-04-10 17:54:11,986::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3385::DEBUG::2014-04-10 17:54:11,987::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3385::DEBUG::2014-04-10 17:54:11,987::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f148c93-0ccb-4725-9c01-91a876321b2c`::Granted request
>Thread-3385::DEBUG::2014-04-10 17:54:11,988::task::811::TaskManager.Task::(resourceAcquired) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3385::DEBUG::2014-04-10 17:54:11,988::task::974::TaskManager.Task::(_decref) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::ref 1 aborting False
>Thread-3385::INFO::2014-04-10 17:54:11,990::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3385::DEBUG::2014-04-10 17:54:11,990::task::1168::TaskManager.Task::(prepare) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3385::DEBUG::2014-04-10 17:54:11,990::task::579::TaskManager.Task::(_updateState) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::moving from state preparing -> state finished
>Thread-3385::DEBUG::2014-04-10 17:54:11,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3385::DEBUG::2014-04-10 17:54:11,991::task::974::TaskManager.Task::(_decref) Task=`ee8e68b4-f9ab-4d6e-93a9-4ffdefd35267`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:16,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:16,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343962 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:17,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:17,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358338 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:17,423::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:17,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044959 s, 819 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:17,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:17,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478877 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3389::DEBUG::2014-04-10 17:54:21,076::task::579::TaskManager.Task::(_updateState) Task=`59d294eb-05c5-49b3-8edd-ddb68ae261a3`::moving from state init -> state preparing
>Thread-3389::INFO::2014-04-10 17:54:21,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3389::INFO::2014-04-10 17:54:21,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478877', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343962', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358338', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044959', 'lastCheck': '3.6', 'valid': True}}
>Thread-3389::DEBUG::2014-04-10 17:54:21,077::task::1168::TaskManager.Task::(prepare) Task=`59d294eb-05c5-49b3-8edd-ddb68ae261a3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478877', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343962', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358338', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044959', 'lastCheck': '3.6', 'valid': True}}
>Thread-3389::DEBUG::2014-04-10 17:54:21,077::task::579::TaskManager.Task::(_updateState) Task=`59d294eb-05c5-49b3-8edd-ddb68ae261a3`::moving from state preparing -> state finished
>Thread-3389::DEBUG::2014-04-10 17:54:21,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3389::DEBUG::2014-04-10 17:54:21,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3389::DEBUG::2014-04-10 17:54:21,078::task::974::TaskManager.Task::(_decref) Task=`59d294eb-05c5-49b3-8edd-ddb68ae261a3`::ref 0 aborting False
>Thread-3391::DEBUG::2014-04-10 17:54:22,085::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3391::DEBUG::2014-04-10 17:54:22,092::task::579::TaskManager.Task::(_updateState) Task=`63012d29-92c4-4b5b-9bae-d8ad26ac3322`::moving from state init -> state preparing
>Thread-3391::INFO::2014-04-10 17:54:22,092::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3391::INFO::2014-04-10 17:54:22,092::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3391::DEBUG::2014-04-10 17:54:22,093::task::1168::TaskManager.Task::(prepare) Task=`63012d29-92c4-4b5b-9bae-d8ad26ac3322`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3391::DEBUG::2014-04-10 17:54:22,093::task::579::TaskManager.Task::(_updateState) Task=`63012d29-92c4-4b5b-9bae-d8ad26ac3322`::moving from state preparing -> state finished
>Thread-3391::DEBUG::2014-04-10 17:54:22,093::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3391::DEBUG::2014-04-10 17:54:22,093::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3391::DEBUG::2014-04-10 17:54:22,093::task::974::TaskManager.Task::(_decref) Task=`63012d29-92c4-4b5b-9bae-d8ad26ac3322`::ref 0 aborting False
>Thread-3392::DEBUG::2014-04-10 17:54:22,100::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3392::DEBUG::2014-04-10 17:54:22,100::task::579::TaskManager.Task::(_updateState) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::moving from state init -> state preparing
>Thread-3392::INFO::2014-04-10 17:54:22,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3392::DEBUG::2014-04-10 17:54:22,101::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a4c6137-f229-4933-b05b-398d0a84756b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3392::DEBUG::2014-04-10 17:54:22,101::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3392::DEBUG::2014-04-10 17:54:22,101::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3392::DEBUG::2014-04-10 17:54:22,101::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a4c6137-f229-4933-b05b-398d0a84756b`::Granted request
>Thread-3392::DEBUG::2014-04-10 17:54:22,102::task::811::TaskManager.Task::(resourceAcquired) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3392::DEBUG::2014-04-10 17:54:22,102::task::974::TaskManager.Task::(_decref) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::ref 1 aborting False
>Thread-3392::INFO::2014-04-10 17:54:22,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3392::DEBUG::2014-04-10 17:54:22,104::task::1168::TaskManager.Task::(prepare) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3392::DEBUG::2014-04-10 17:54:22,104::task::579::TaskManager.Task::(_updateState) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::moving from state preparing -> state finished
>Thread-3392::DEBUG::2014-04-10 17:54:22,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3392::DEBUG::2014-04-10 17:54:22,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3392::DEBUG::2014-04-10 17:54:22,104::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3392::DEBUG::2014-04-10 17:54:22,105::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3392::DEBUG::2014-04-10 17:54:22,105::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3392::DEBUG::2014-04-10 17:54:22,105::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3392::DEBUG::2014-04-10 17:54:22,105::task::974::TaskManager.Task::(_decref) Task=`c4322bfe-7e2c-47c4-b13c-195d959997af`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:26,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:26,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341308 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:27,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:27,058::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334623 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:27,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:27,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000455705 s, 808 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:27,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:27,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475521 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3396::DEBUG::2014-04-10 17:54:32,181::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3396::DEBUG::2014-04-10 17:54:32,182::task::579::TaskManager.Task::(_updateState) Task=`f0835cbc-8cd8-4eb4-96d4-52f4b21989b5`::moving from state init -> state preparing
>Thread-3396::INFO::2014-04-10 17:54:32,192::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3396::INFO::2014-04-10 17:54:32,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3396::DEBUG::2014-04-10 17:54:32,192::task::1168::TaskManager.Task::(prepare) Task=`f0835cbc-8cd8-4eb4-96d4-52f4b21989b5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3396::DEBUG::2014-04-10 17:54:32,192::task::579::TaskManager.Task::(_updateState) Task=`f0835cbc-8cd8-4eb4-96d4-52f4b21989b5`::moving from state preparing -> state finished
>Thread-3396::DEBUG::2014-04-10 17:54:32,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3396::DEBUG::2014-04-10 17:54:32,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3396::DEBUG::2014-04-10 17:54:32,193::task::974::TaskManager.Task::(_decref) Task=`f0835cbc-8cd8-4eb4-96d4-52f4b21989b5`::ref 0 aborting False
>Thread-3397::DEBUG::2014-04-10 17:54:32,200::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3397::DEBUG::2014-04-10 17:54:32,200::task::579::TaskManager.Task::(_updateState) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::moving from state init -> state preparing
>Thread-3397::INFO::2014-04-10 17:54:32,200::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3397::DEBUG::2014-04-10 17:54:32,201::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c2ce8c49-cd60-4673-bc4d-09d775a09386`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3397::DEBUG::2014-04-10 17:54:32,201::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3397::DEBUG::2014-04-10 17:54:32,201::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3397::DEBUG::2014-04-10 17:54:32,201::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c2ce8c49-cd60-4673-bc4d-09d775a09386`::Granted request
>Thread-3397::DEBUG::2014-04-10 17:54:32,202::task::811::TaskManager.Task::(resourceAcquired) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3397::DEBUG::2014-04-10 17:54:32,202::task::974::TaskManager.Task::(_decref) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::ref 1 aborting False
>Thread-3397::INFO::2014-04-10 17:54:32,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3397::DEBUG::2014-04-10 17:54:32,204::task::1168::TaskManager.Task::(prepare) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3397::DEBUG::2014-04-10 17:54:32,204::task::579::TaskManager.Task::(_updateState) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::moving from state preparing -> state finished
>Thread-3397::DEBUG::2014-04-10 17:54:32,204::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3397::DEBUG::2014-04-10 17:54:32,204::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3397::DEBUG::2014-04-10 17:54:32,205::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3397::DEBUG::2014-04-10 17:54:32,205::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3397::DEBUG::2014-04-10 17:54:32,205::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3397::DEBUG::2014-04-10 17:54:32,205::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3397::DEBUG::2014-04-10 17:54:32,205::task::974::TaskManager.Task::(_decref) Task=`24058563-c0a4-47fb-937a-29d2786f04c7`::ref 0 aborting False
>Thread-3399::DEBUG::2014-04-10 17:54:36,248::task::579::TaskManager.Task::(_updateState) Task=`143636bb-d90b-4413-91e4-ef762b23911b`::moving from state init -> state preparing
>Thread-3399::INFO::2014-04-10 17:54:36,248::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3399::INFO::2014-04-10 17:54:36,248::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475521', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341308', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334623', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455705', 'lastCheck': '8.8', 'valid': True}}
>Thread-3399::DEBUG::2014-04-10 17:54:36,249::task::1168::TaskManager.Task::(prepare) Task=`143636bb-d90b-4413-91e4-ef762b23911b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475521', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341308', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334623', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455705', 'lastCheck': '8.8', 'valid': True}}
>Thread-3399::DEBUG::2014-04-10 17:54:36,249::task::579::TaskManager.Task::(_updateState) Task=`143636bb-d90b-4413-91e4-ef762b23911b`::moving from state preparing -> state finished
>Thread-3399::DEBUG::2014-04-10 17:54:36,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3399::DEBUG::2014-04-10 17:54:36,249::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3399::DEBUG::2014-04-10 17:54:36,249::task::974::TaskManager.Task::(_decref) Task=`143636bb-d90b-4413-91e4-ef762b23911b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:36,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:36,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370039 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:37,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:37,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397019 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:37,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:37,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533948 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:37,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:37,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00053848 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3402::DEBUG::2014-04-10 17:54:42,280::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3402::DEBUG::2014-04-10 17:54:42,281::task::579::TaskManager.Task::(_updateState) Task=`96c94c11-12a3-49c3-8bfa-1a017ad65623`::moving from state init -> state preparing
>Thread-3402::INFO::2014-04-10 17:54:42,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3402::INFO::2014-04-10 17:54:42,281::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3402::DEBUG::2014-04-10 17:54:42,281::task::1168::TaskManager.Task::(prepare) Task=`96c94c11-12a3-49c3-8bfa-1a017ad65623`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3402::DEBUG::2014-04-10 17:54:42,282::task::579::TaskManager.Task::(_updateState) Task=`96c94c11-12a3-49c3-8bfa-1a017ad65623`::moving from state preparing -> state finished
>Thread-3402::DEBUG::2014-04-10 17:54:42,282::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3402::DEBUG::2014-04-10 17:54:42,282::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3402::DEBUG::2014-04-10 17:54:42,282::task::974::TaskManager.Task::(_decref) Task=`96c94c11-12a3-49c3-8bfa-1a017ad65623`::ref 0 aborting False
>Thread-3403::DEBUG::2014-04-10 17:54:42,288::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3403::DEBUG::2014-04-10 17:54:42,289::task::579::TaskManager.Task::(_updateState) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::moving from state init -> state preparing
>Thread-3403::INFO::2014-04-10 17:54:42,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3403::DEBUG::2014-04-10 17:54:42,289::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5498b402-abb3-429d-9e26-89d1b291b181`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3403::DEBUG::2014-04-10 17:54:42,289::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3403::DEBUG::2014-04-10 17:54:42,290::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3403::DEBUG::2014-04-10 17:54:42,290::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5498b402-abb3-429d-9e26-89d1b291b181`::Granted request
>Thread-3403::DEBUG::2014-04-10 17:54:42,290::task::811::TaskManager.Task::(resourceAcquired) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3403::DEBUG::2014-04-10 17:54:42,290::task::974::TaskManager.Task::(_decref) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::ref 1 aborting False
>Thread-3403::INFO::2014-04-10 17:54:42,292::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3403::DEBUG::2014-04-10 17:54:42,292::task::1168::TaskManager.Task::(prepare) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3403::DEBUG::2014-04-10 17:54:42,292::task::579::TaskManager.Task::(_updateState) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::moving from state preparing -> state finished
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3403::DEBUG::2014-04-10 17:54:42,293::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3403::DEBUG::2014-04-10 17:54:42,294::task::974::TaskManager.Task::(_decref) Task=`10e62e0d-e33e-4925-8f46-d262b2918b09`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:46,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:46,895::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375467 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:47,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:47,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320182 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:47,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:47,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464461 s, 792 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:47,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:47,570::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000481042 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3407::DEBUG::2014-04-10 17:54:51,407::task::579::TaskManager.Task::(_updateState) Task=`be4f9baf-f3d1-4129-ad01-5856fac55e81`::moving from state init -> state preparing
>Thread-3407::INFO::2014-04-10 17:54:51,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3407::INFO::2014-04-10 17:54:51,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481042', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375467', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320182', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464461', 'lastCheck': '3.9', 'valid': True}}
>Thread-3407::DEBUG::2014-04-10 17:54:51,407::task::1168::TaskManager.Task::(prepare) Task=`be4f9baf-f3d1-4129-ad01-5856fac55e81`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481042', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375467', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320182', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464461', 'lastCheck': '3.9', 'valid': True}}
>Thread-3407::DEBUG::2014-04-10 17:54:51,408::task::579::TaskManager.Task::(_updateState) Task=`be4f9baf-f3d1-4129-ad01-5856fac55e81`::moving from state preparing -> state finished
>Thread-3407::DEBUG::2014-04-10 17:54:51,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3407::DEBUG::2014-04-10 17:54:51,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3407::DEBUG::2014-04-10 17:54:51,408::task::974::TaskManager.Task::(_decref) Task=`be4f9baf-f3d1-4129-ad01-5856fac55e81`::ref 0 aborting False
>Thread-3409::DEBUG::2014-04-10 17:54:52,371::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-3409::DEBUG::2014-04-10 17:54:52,371::task::579::TaskManager.Task::(_updateState) Task=`c4141e80-37bb-47ec-aebf-2b64fbb6531d`::moving from state init -> state preparing
>Thread-3409::INFO::2014-04-10 17:54:52,371::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3409::INFO::2014-04-10 17:54:52,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3409::DEBUG::2014-04-10 17:54:52,372::task::1168::TaskManager.Task::(prepare) Task=`c4141e80-37bb-47ec-aebf-2b64fbb6531d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3409::DEBUG::2014-04-10 17:54:52,372::task::579::TaskManager.Task::(_updateState) Task=`c4141e80-37bb-47ec-aebf-2b64fbb6531d`::moving from state preparing -> state finished
>Thread-3409::DEBUG::2014-04-10 17:54:52,372::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3409::DEBUG::2014-04-10 17:54:52,372::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3409::DEBUG::2014-04-10 17:54:52,372::task::974::TaskManager.Task::(_decref) Task=`c4141e80-37bb-47ec-aebf-2b64fbb6531d`::ref 0 aborting False
>Thread-3410::DEBUG::2014-04-10 17:54:52,379::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-3410::DEBUG::2014-04-10 17:54:52,379::task::579::TaskManager.Task::(_updateState) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::moving from state init -> state preparing
>Thread-3410::INFO::2014-04-10 17:54:52,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3410::DEBUG::2014-04-10 17:54:52,380::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbad6a28-0858-4418-a44e-d11bb3889d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3410::DEBUG::2014-04-10 17:54:52,380::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3410::DEBUG::2014-04-10 17:54:52,380::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3410::DEBUG::2014-04-10 17:54:52,380::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbad6a28-0858-4418-a44e-d11bb3889d50`::Granted request
>Thread-3410::DEBUG::2014-04-10 17:54:52,405::task::811::TaskManager.Task::(resourceAcquired) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3410::DEBUG::2014-04-10 17:54:52,405::task::974::TaskManager.Task::(_decref) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::ref 1 aborting False
>Thread-3410::INFO::2014-04-10 17:54:52,407::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3410::DEBUG::2014-04-10 17:54:52,407::task::1168::TaskManager.Task::(prepare) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3410::DEBUG::2014-04-10 17:54:52,407::task::579::TaskManager.Task::(_updateState) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::moving from state preparing -> state finished
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3410::DEBUG::2014-04-10 17:54:52,408::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3410::DEBUG::2014-04-10 17:54:52,409::task::974::TaskManager.Task::(_decref) Task=`99e101f4-9d13-4447-b61c-95bbb395fa9c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:54:56,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:54:56,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420068 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:54:57,096::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:54:57,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348356 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:54:57,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:54:57,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000567598 s, 648 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:54:57,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:54:57,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468101 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3414::DEBUG::2014-04-10 17:55:02,477::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3414::DEBUG::2014-04-10 17:55:02,478::task::579::TaskManager.Task::(_updateState) Task=`46661ce1-7adf-4d57-a847-ce5d55de6941`::moving from state init -> state preparing
>Thread-3414::INFO::2014-04-10 17:55:02,478::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3414::INFO::2014-04-10 17:55:02,479::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3414::DEBUG::2014-04-10 17:55:02,479::task::1168::TaskManager.Task::(prepare) Task=`46661ce1-7adf-4d57-a847-ce5d55de6941`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3414::DEBUG::2014-04-10 17:55:02,479::task::579::TaskManager.Task::(_updateState) Task=`46661ce1-7adf-4d57-a847-ce5d55de6941`::moving from state preparing -> state finished
>Thread-3414::DEBUG::2014-04-10 17:55:02,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3414::DEBUG::2014-04-10 17:55:02,479::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3414::DEBUG::2014-04-10 17:55:02,479::task::974::TaskManager.Task::(_decref) Task=`46661ce1-7adf-4d57-a847-ce5d55de6941`::ref 0 aborting False
>Thread-3415::DEBUG::2014-04-10 17:55:02,485::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3415::DEBUG::2014-04-10 17:55:02,486::task::579::TaskManager.Task::(_updateState) Task=`263ac063-16e0-46d1-9154-705fa1393744`::moving from state init -> state preparing
>Thread-3415::INFO::2014-04-10 17:55:02,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3415::DEBUG::2014-04-10 17:55:02,486::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8109ff13-4145-4916-bbc9-8a20a13192f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3415::DEBUG::2014-04-10 17:55:02,487::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3415::DEBUG::2014-04-10 17:55:02,487::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3415::DEBUG::2014-04-10 17:55:02,487::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8109ff13-4145-4916-bbc9-8a20a13192f3`::Granted request
>Thread-3415::DEBUG::2014-04-10 17:55:02,487::task::811::TaskManager.Task::(resourceAcquired) Task=`263ac063-16e0-46d1-9154-705fa1393744`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3415::DEBUG::2014-04-10 17:55:02,487::task::974::TaskManager.Task::(_decref) Task=`263ac063-16e0-46d1-9154-705fa1393744`::ref 1 aborting False
>Thread-3415::INFO::2014-04-10 17:55:02,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3415::DEBUG::2014-04-10 17:55:02,489::task::1168::TaskManager.Task::(prepare) Task=`263ac063-16e0-46d1-9154-705fa1393744`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3415::DEBUG::2014-04-10 17:55:02,490::task::579::TaskManager.Task::(_updateState) Task=`263ac063-16e0-46d1-9154-705fa1393744`::moving from state preparing -> state finished
>Thread-3415::DEBUG::2014-04-10 17:55:02,490::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3415::DEBUG::2014-04-10 17:55:02,490::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3415::DEBUG::2014-04-10 17:55:02,490::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3415::DEBUG::2014-04-10 17:55:02,490::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3415::DEBUG::2014-04-10 17:55:02,491::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3415::DEBUG::2014-04-10 17:55:02,491::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3415::DEBUG::2014-04-10 17:55:02,491::task::974::TaskManager.Task::(_decref) Task=`263ac063-16e0-46d1-9154-705fa1393744`::ref 0 aborting False
>Thread-3417::DEBUG::2014-04-10 17:55:06,578::task::579::TaskManager.Task::(_updateState) Task=`3d05852f-e3c7-4e52-a972-dc2c5b2b89fe`::moving from state init -> state preparing
>Thread-3417::INFO::2014-04-10 17:55:06,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3417::INFO::2014-04-10 17:55:06,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468101', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420068', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348356', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567598', 'lastCheck': '9.1', 'valid': True}}
>Thread-3417::DEBUG::2014-04-10 17:55:06,578::task::1168::TaskManager.Task::(prepare) Task=`3d05852f-e3c7-4e52-a972-dc2c5b2b89fe`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468101', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420068', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348356', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567598', 'lastCheck': '9.1', 'valid': True}}
>Thread-3417::DEBUG::2014-04-10 17:55:06,579::task::579::TaskManager.Task::(_updateState) Task=`3d05852f-e3c7-4e52-a972-dc2c5b2b89fe`::moving from state preparing -> state finished
>Thread-3417::DEBUG::2014-04-10 17:55:06,579::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3417::DEBUG::2014-04-10 17:55:06,579::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3417::DEBUG::2014-04-10 17:55:06,579::task::974::TaskManager.Task::(_decref) Task=`3d05852f-e3c7-4e52-a972-dc2c5b2b89fe`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:06,920::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:06,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393873 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:07,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:07,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000441354 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:07,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:07,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000428619 s, 859 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:55:07,593::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:07,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000505259 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3420::DEBUG::2014-04-10 17:55:12,610::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3420::DEBUG::2014-04-10 17:55:12,615::task::579::TaskManager.Task::(_updateState) Task=`11e77cd1-70f2-413c-94f3-7948831e5fc8`::moving from state init -> state preparing
>Thread-3420::INFO::2014-04-10 17:55:12,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3420::INFO::2014-04-10 17:55:12,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3420::DEBUG::2014-04-10 17:55:12,616::task::1168::TaskManager.Task::(prepare) Task=`11e77cd1-70f2-413c-94f3-7948831e5fc8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3420::DEBUG::2014-04-10 17:55:12,616::task::579::TaskManager.Task::(_updateState) Task=`11e77cd1-70f2-413c-94f3-7948831e5fc8`::moving from state preparing -> state finished
>Thread-3420::DEBUG::2014-04-10 17:55:12,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3420::DEBUG::2014-04-10 17:55:12,616::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3420::DEBUG::2014-04-10 17:55:12,616::task::974::TaskManager.Task::(_decref) Task=`11e77cd1-70f2-413c-94f3-7948831e5fc8`::ref 0 aborting False
>Thread-3421::DEBUG::2014-04-10 17:55:12,623::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3421::DEBUG::2014-04-10 17:55:12,623::task::579::TaskManager.Task::(_updateState) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::moving from state init -> state preparing
>Thread-3421::INFO::2014-04-10 17:55:12,624::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3421::DEBUG::2014-04-10 17:55:12,624::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9c0296b8-71d2-4d8a-a1a4-c379fa7f7985`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3421::DEBUG::2014-04-10 17:55:12,624::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3421::DEBUG::2014-04-10 17:55:12,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3421::DEBUG::2014-04-10 17:55:12,625::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9c0296b8-71d2-4d8a-a1a4-c379fa7f7985`::Granted request
>Thread-3421::DEBUG::2014-04-10 17:55:12,625::task::811::TaskManager.Task::(resourceAcquired) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3421::DEBUG::2014-04-10 17:55:12,625::task::974::TaskManager.Task::(_decref) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::ref 1 aborting False
>Thread-3421::INFO::2014-04-10 17:55:12,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3421::DEBUG::2014-04-10 17:55:12,627::task::1168::TaskManager.Task::(prepare) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3421::DEBUG::2014-04-10 17:55:12,627::task::579::TaskManager.Task::(_updateState) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::moving from state preparing -> state finished
>Thread-3421::DEBUG::2014-04-10 17:55:12,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3421::DEBUG::2014-04-10 17:55:12,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3421::DEBUG::2014-04-10 17:55:12,628::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3421::DEBUG::2014-04-10 17:55:12,628::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3421::DEBUG::2014-04-10 17:55:12,628::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3421::DEBUG::2014-04-10 17:55:12,628::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3421::DEBUG::2014-04-10 17:55:12,629::task::974::TaskManager.Task::(_decref) Task=`54626b5d-14c8-4e7c-ac34-d7501b04d4d2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:16,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:16,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373859 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:17,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:17,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368184 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:17,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:17,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478366 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:55:17,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:17,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480726 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3425::DEBUG::2014-04-10 17:55:22,429::task::579::TaskManager.Task::(_updateState) Task=`e4197fbd-fe90-4d6a-930e-76440a408cdd`::moving from state init -> state preparing
>Thread-3425::INFO::2014-04-10 17:55:22,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3425::INFO::2014-04-10 17:55:22,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480726', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373859', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368184', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478366', 'lastCheck': '4.9', 'valid': True}}
>Thread-3425::DEBUG::2014-04-10 17:55:22,430::task::1168::TaskManager.Task::(prepare) Task=`e4197fbd-fe90-4d6a-930e-76440a408cdd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480726', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373859', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368184', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478366', 'lastCheck': '4.9', 'valid': True}}
>Thread-3425::DEBUG::2014-04-10 17:55:22,430::task::579::TaskManager.Task::(_updateState) Task=`e4197fbd-fe90-4d6a-930e-76440a408cdd`::moving from state preparing -> state finished
>Thread-3425::DEBUG::2014-04-10 17:55:22,430::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3425::DEBUG::2014-04-10 17:55:22,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3425::DEBUG::2014-04-10 17:55:22,431::task::974::TaskManager.Task::(_decref) Task=`e4197fbd-fe90-4d6a-930e-76440a408cdd`::ref 0 aborting False
>Thread-3427::DEBUG::2014-04-10 17:55:22,724::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-3427::DEBUG::2014-04-10 17:55:22,724::task::579::TaskManager.Task::(_updateState) Task=`acd366da-b9bd-4f0d-a781-d1dcd3959c5e`::moving from state init -> state preparing
>Thread-3427::INFO::2014-04-10 17:55:22,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3427::INFO::2014-04-10 17:55:22,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3427::DEBUG::2014-04-10 17:55:22,725::task::1168::TaskManager.Task::(prepare) Task=`acd366da-b9bd-4f0d-a781-d1dcd3959c5e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3427::DEBUG::2014-04-10 17:55:22,725::task::579::TaskManager.Task::(_updateState) Task=`acd366da-b9bd-4f0d-a781-d1dcd3959c5e`::moving from state preparing -> state finished
>Thread-3427::DEBUG::2014-04-10 17:55:22,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3427::DEBUG::2014-04-10 17:55:22,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3427::DEBUG::2014-04-10 17:55:22,725::task::974::TaskManager.Task::(_decref) Task=`acd366da-b9bd-4f0d-a781-d1dcd3959c5e`::ref 0 aborting False
>Thread-3428::DEBUG::2014-04-10 17:55:22,732::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-3428::DEBUG::2014-04-10 17:55:22,732::task::579::TaskManager.Task::(_updateState) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::moving from state init -> state preparing
>Thread-3428::INFO::2014-04-10 17:55:22,732::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3428::DEBUG::2014-04-10 17:55:22,733::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e1559b2-33eb-43a4-bc51-5cc47bc42879`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3428::DEBUG::2014-04-10 17:55:22,733::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3428::DEBUG::2014-04-10 17:55:22,733::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3428::DEBUG::2014-04-10 17:55:22,733::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e1559b2-33eb-43a4-bc51-5cc47bc42879`::Granted request
>Thread-3428::DEBUG::2014-04-10 17:55:22,734::task::811::TaskManager.Task::(resourceAcquired) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3428::DEBUG::2014-04-10 17:55:22,734::task::974::TaskManager.Task::(_decref) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::ref 1 aborting False
>Thread-3428::INFO::2014-04-10 17:55:22,736::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3428::DEBUG::2014-04-10 17:55:22,736::task::1168::TaskManager.Task::(prepare) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3428::DEBUG::2014-04-10 17:55:22,736::task::579::TaskManager.Task::(_updateState) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::moving from state preparing -> state finished
>Thread-3428::DEBUG::2014-04-10 17:55:22,736::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3428::DEBUG::2014-04-10 17:55:22,736::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3428::DEBUG::2014-04-10 17:55:22,736::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3428::DEBUG::2014-04-10 17:55:22,737::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3428::DEBUG::2014-04-10 17:55:22,737::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3428::DEBUG::2014-04-10 17:55:22,737::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3428::DEBUG::2014-04-10 17:55:22,737::task::974::TaskManager.Task::(_decref) Task=`d18aac76-0733-4518-9ffd-186546e4e626`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:26,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:26,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370417 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:27,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:27,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341797 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:27,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:27,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000438697 s, 839 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:55:27,624::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:27,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000535645 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3432::DEBUG::2014-04-10 17:55:32,807::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3432::DEBUG::2014-04-10 17:55:32,807::task::579::TaskManager.Task::(_updateState) Task=`34bd2e61-9084-4692-b15c-d086ed028262`::moving from state init -> state preparing
>Thread-3432::INFO::2014-04-10 17:55:32,808::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3432::INFO::2014-04-10 17:55:32,808::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3432::DEBUG::2014-04-10 17:55:32,808::task::1168::TaskManager.Task::(prepare) Task=`34bd2e61-9084-4692-b15c-d086ed028262`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3432::DEBUG::2014-04-10 17:55:32,808::task::579::TaskManager.Task::(_updateState) Task=`34bd2e61-9084-4692-b15c-d086ed028262`::moving from state preparing -> state finished
>Thread-3432::DEBUG::2014-04-10 17:55:32,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3432::DEBUG::2014-04-10 17:55:32,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3432::DEBUG::2014-04-10 17:55:32,809::task::974::TaskManager.Task::(_decref) Task=`34bd2e61-9084-4692-b15c-d086ed028262`::ref 0 aborting False
>Thread-3433::DEBUG::2014-04-10 17:55:32,815::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3433::DEBUG::2014-04-10 17:55:32,815::task::579::TaskManager.Task::(_updateState) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::moving from state init -> state preparing
>Thread-3433::INFO::2014-04-10 17:55:32,816::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3433::DEBUG::2014-04-10 17:55:32,816::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e2680bd-d988-4548-b02b-8a765d7c7be3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3433::DEBUG::2014-04-10 17:55:32,816::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3433::DEBUG::2014-04-10 17:55:32,816::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3433::DEBUG::2014-04-10 17:55:32,817::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e2680bd-d988-4548-b02b-8a765d7c7be3`::Granted request
>Thread-3433::DEBUG::2014-04-10 17:55:32,817::task::811::TaskManager.Task::(resourceAcquired) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3433::DEBUG::2014-04-10 17:55:32,817::task::974::TaskManager.Task::(_decref) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::ref 1 aborting False
>Thread-3433::INFO::2014-04-10 17:55:32,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3433::DEBUG::2014-04-10 17:55:32,819::task::1168::TaskManager.Task::(prepare) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3433::DEBUG::2014-04-10 17:55:32,819::task::579::TaskManager.Task::(_updateState) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::moving from state preparing -> state finished
>Thread-3433::DEBUG::2014-04-10 17:55:32,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3433::DEBUG::2014-04-10 17:55:32,820::task::974::TaskManager.Task::(_decref) Task=`f2d1a92e-fa5e-42d4-9b1d-b7545f2539f2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:36,961::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:55:36,968::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 17:55:36,973::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 17:55:36,977::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 17:55:36,979::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 17:55:36,979::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 17:55:36,979::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 17:55:36,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:36,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344899 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:37,147::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:55:37,161::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 17:55:37,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 17:55:37,167::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 17:55:37,169::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 17:55:37,169::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 17:55:37,169::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 17:55:37,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:37,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307777 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:37,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:37,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000527168 s, 698 kB/s\n'; <rc> = 0
>Thread-3443::DEBUG::2014-04-10 17:55:37,584::task::579::TaskManager.Task::(_updateState) Task=`9cadfef6-9ee3-494f-a827-3dfb64432e1c`::moving from state init -> state preparing
>Thread-3443::INFO::2014-04-10 17:55:37,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3443::INFO::2014-04-10 17:55:37,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535645', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344899', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307777', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527168', 'lastCheck': '0.0', 'valid': True}}
>Thread-3443::DEBUG::2014-04-10 17:55:37,585::task::1168::TaskManager.Task::(prepare) Task=`9cadfef6-9ee3-494f-a827-3dfb64432e1c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535645', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344899', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307777', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527168', 'lastCheck': '0.0', 'valid': True}}
>Thread-3443::DEBUG::2014-04-10 17:55:37,585::task::579::TaskManager.Task::(_updateState) Task=`9cadfef6-9ee3-494f-a827-3dfb64432e1c`::moving from state preparing -> state finished
>Thread-3443::DEBUG::2014-04-10 17:55:37,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3443::DEBUG::2014-04-10 17:55:37,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3443::DEBUG::2014-04-10 17:55:37,586::task::974::TaskManager.Task::(_decref) Task=`9cadfef6-9ee3-494f-a827-3dfb64432e1c`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 17:55:37,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:37,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00047913 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3446::DEBUG::2014-04-10 17:55:42,937::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3446::DEBUG::2014-04-10 17:55:42,937::task::579::TaskManager.Task::(_updateState) Task=`3b064e7a-5b55-4190-81f8-a92361363d49`::moving from state init -> state preparing
>Thread-3446::INFO::2014-04-10 17:55:42,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3446::INFO::2014-04-10 17:55:42,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3446::DEBUG::2014-04-10 17:55:42,938::task::1168::TaskManager.Task::(prepare) Task=`3b064e7a-5b55-4190-81f8-a92361363d49`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3446::DEBUG::2014-04-10 17:55:42,938::task::579::TaskManager.Task::(_updateState) Task=`3b064e7a-5b55-4190-81f8-a92361363d49`::moving from state preparing -> state finished
>Thread-3446::DEBUG::2014-04-10 17:55:42,938::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3446::DEBUG::2014-04-10 17:55:42,938::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3446::DEBUG::2014-04-10 17:55:42,939::task::974::TaskManager.Task::(_decref) Task=`3b064e7a-5b55-4190-81f8-a92361363d49`::ref 0 aborting False
>Thread-3447::DEBUG::2014-04-10 17:55:42,945::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3447::DEBUG::2014-04-10 17:55:42,946::task::579::TaskManager.Task::(_updateState) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::moving from state init -> state preparing
>Thread-3447::INFO::2014-04-10 17:55:42,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3447::DEBUG::2014-04-10 17:55:42,946::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db43e326-ac2d-41db-8c6e-b54fd9462cff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3447::DEBUG::2014-04-10 17:55:42,946::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3447::DEBUG::2014-04-10 17:55:42,947::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3447::DEBUG::2014-04-10 17:55:42,947::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db43e326-ac2d-41db-8c6e-b54fd9462cff`::Granted request
>Thread-3447::DEBUG::2014-04-10 17:55:42,947::task::811::TaskManager.Task::(resourceAcquired) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3447::DEBUG::2014-04-10 17:55:42,947::task::974::TaskManager.Task::(_decref) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::ref 1 aborting False
>Thread-3447::INFO::2014-04-10 17:55:42,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3447::DEBUG::2014-04-10 17:55:42,949::task::1168::TaskManager.Task::(prepare) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::task::579::TaskManager.Task::(_updateState) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::moving from state preparing -> state finished
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3447::DEBUG::2014-04-10 17:55:42,950::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3447::DEBUG::2014-04-10 17:55:42,951::task::974::TaskManager.Task::(_decref) Task=`eaf06b88-64a8-4497-a97d-611d655065c1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:46,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:47,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396543 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:47,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:47,196::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000212628 s, 3.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:47,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:47,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451553 s, 815 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:55:47,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:47,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479622 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3451::DEBUG::2014-04-10 17:55:52,759::task::579::TaskManager.Task::(_updateState) Task=`811f78c9-eec7-4bdf-b984-b57e8cbee2b8`::moving from state init -> state preparing
>Thread-3451::INFO::2014-04-10 17:55:52,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3451::INFO::2014-04-10 17:55:52,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479622', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396543', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212628', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451553', 'lastCheck': '5.2', 'valid': True}}
>Thread-3451::DEBUG::2014-04-10 17:55:52,760::task::1168::TaskManager.Task::(prepare) Task=`811f78c9-eec7-4bdf-b984-b57e8cbee2b8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479622', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396543', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000212628', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451553', 'lastCheck': '5.2', 'valid': True}}
>Thread-3451::DEBUG::2014-04-10 17:55:52,760::task::579::TaskManager.Task::(_updateState) Task=`811f78c9-eec7-4bdf-b984-b57e8cbee2b8`::moving from state preparing -> state finished
>Thread-3451::DEBUG::2014-04-10 17:55:52,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3451::DEBUG::2014-04-10 17:55:52,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3451::DEBUG::2014-04-10 17:55:52,761::task::974::TaskManager.Task::(_decref) Task=`811f78c9-eec7-4bdf-b984-b57e8cbee2b8`::ref 0 aborting False
>Thread-3453::DEBUG::2014-04-10 17:55:53,029::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3453::DEBUG::2014-04-10 17:55:53,030::task::579::TaskManager.Task::(_updateState) Task=`27d20486-b02a-4b13-ada7-0b4bac7448dc`::moving from state init -> state preparing
>Thread-3453::INFO::2014-04-10 17:55:53,030::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3453::INFO::2014-04-10 17:55:53,030::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3453::DEBUG::2014-04-10 17:55:53,030::task::1168::TaskManager.Task::(prepare) Task=`27d20486-b02a-4b13-ada7-0b4bac7448dc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3453::DEBUG::2014-04-10 17:55:53,030::task::579::TaskManager.Task::(_updateState) Task=`27d20486-b02a-4b13-ada7-0b4bac7448dc`::moving from state preparing -> state finished
>Thread-3453::DEBUG::2014-04-10 17:55:53,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3453::DEBUG::2014-04-10 17:55:53,031::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3453::DEBUG::2014-04-10 17:55:53,031::task::974::TaskManager.Task::(_decref) Task=`27d20486-b02a-4b13-ada7-0b4bac7448dc`::ref 0 aborting False
>Thread-3454::DEBUG::2014-04-10 17:55:53,038::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3454::DEBUG::2014-04-10 17:55:53,038::task::579::TaskManager.Task::(_updateState) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::moving from state init -> state preparing
>Thread-3454::INFO::2014-04-10 17:55:53,038::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3454::DEBUG::2014-04-10 17:55:53,039::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e99d64bb-cc1a-4007-85a4-ca370875813e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3454::DEBUG::2014-04-10 17:55:53,039::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3454::DEBUG::2014-04-10 17:55:53,039::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3454::DEBUG::2014-04-10 17:55:53,039::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e99d64bb-cc1a-4007-85a4-ca370875813e`::Granted request
>Thread-3454::DEBUG::2014-04-10 17:55:53,039::task::811::TaskManager.Task::(resourceAcquired) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3454::DEBUG::2014-04-10 17:55:53,040::task::974::TaskManager.Task::(_decref) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::ref 1 aborting False
>Thread-3454::INFO::2014-04-10 17:55:53,041::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3454::DEBUG::2014-04-10 17:55:53,042::task::1168::TaskManager.Task::(prepare) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3454::DEBUG::2014-04-10 17:55:53,042::task::579::TaskManager.Task::(_updateState) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::moving from state preparing -> state finished
>Thread-3454::DEBUG::2014-04-10 17:55:53,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3454::DEBUG::2014-04-10 17:55:53,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3454::DEBUG::2014-04-10 17:55:53,042::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3454::DEBUG::2014-04-10 17:55:53,043::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3454::DEBUG::2014-04-10 17:55:53,043::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3454::DEBUG::2014-04-10 17:55:53,043::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3454::DEBUG::2014-04-10 17:55:53,043::task::974::TaskManager.Task::(_decref) Task=`6b8a4044-50c6-4339-a944-d8d5e197491d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:55:57,014::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:55:57,021::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000236932 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:55:57,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:55:57,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000243045 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:55:57,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:55:57,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485556 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:55:57,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:55:57,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410303 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3458::DEBUG::2014-04-10 17:56:03,111::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3458::DEBUG::2014-04-10 17:56:03,112::task::579::TaskManager.Task::(_updateState) Task=`417ced04-0797-4543-8c53-02df3937596d`::moving from state init -> state preparing
>Thread-3458::INFO::2014-04-10 17:56:03,112::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3458::INFO::2014-04-10 17:56:03,113::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3458::DEBUG::2014-04-10 17:56:03,113::task::1168::TaskManager.Task::(prepare) Task=`417ced04-0797-4543-8c53-02df3937596d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3458::DEBUG::2014-04-10 17:56:03,113::task::579::TaskManager.Task::(_updateState) Task=`417ced04-0797-4543-8c53-02df3937596d`::moving from state preparing -> state finished
>Thread-3458::DEBUG::2014-04-10 17:56:03,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3458::DEBUG::2014-04-10 17:56:03,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3458::DEBUG::2014-04-10 17:56:03,113::task::974::TaskManager.Task::(_decref) Task=`417ced04-0797-4543-8c53-02df3937596d`::ref 0 aborting False
>Thread-3459::DEBUG::2014-04-10 17:56:03,120::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3459::DEBUG::2014-04-10 17:56:03,120::task::579::TaskManager.Task::(_updateState) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::moving from state init -> state preparing
>Thread-3459::INFO::2014-04-10 17:56:03,120::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3459::DEBUG::2014-04-10 17:56:03,121::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3f5ebb8-ad97-417e-8c97-aa08dbc24746`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3459::DEBUG::2014-04-10 17:56:03,121::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3459::DEBUG::2014-04-10 17:56:03,121::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3459::DEBUG::2014-04-10 17:56:03,121::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f3f5ebb8-ad97-417e-8c97-aa08dbc24746`::Granted request
>Thread-3459::DEBUG::2014-04-10 17:56:03,122::task::811::TaskManager.Task::(resourceAcquired) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3459::DEBUG::2014-04-10 17:56:03,122::task::974::TaskManager.Task::(_decref) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::ref 1 aborting False
>Thread-3459::INFO::2014-04-10 17:56:03,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3459::DEBUG::2014-04-10 17:56:03,124::task::1168::TaskManager.Task::(prepare) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3459::DEBUG::2014-04-10 17:56:03,124::task::579::TaskManager.Task::(_updateState) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::moving from state preparing -> state finished
>Thread-3459::DEBUG::2014-04-10 17:56:03,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3459::DEBUG::2014-04-10 17:56:03,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3459::DEBUG::2014-04-10 17:56:03,125::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3459::DEBUG::2014-04-10 17:56:03,125::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3459::DEBUG::2014-04-10 17:56:03,125::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3459::DEBUG::2014-04-10 17:56:03,125::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3459::DEBUG::2014-04-10 17:56:03,125::task::974::TaskManager.Task::(_decref) Task=`3aeb20f0-d1e3-497b-b67c-a0493dba87c3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:07,029::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:07,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028012 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:07,219::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:07,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000417592 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:07,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:07,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478044 s, 770 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:07,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:07,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000514962 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3461::DEBUG::2014-04-10 17:56:07,915::task::579::TaskManager.Task::(_updateState) Task=`63698c97-4029-492b-a293-448faa5b77f8`::moving from state init -> state preparing
>Thread-3461::INFO::2014-04-10 17:56:07,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3461::INFO::2014-04-10 17:56:07,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514962', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028012', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417592', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478044', 'lastCheck': '0.3', 'valid': True}}
>Thread-3461::DEBUG::2014-04-10 17:56:07,916::task::1168::TaskManager.Task::(prepare) Task=`63698c97-4029-492b-a293-448faa5b77f8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514962', 'lastCheck': '0.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028012', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417592', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478044', 'lastCheck': '0.3', 'valid': True}}
>Thread-3461::DEBUG::2014-04-10 17:56:07,916::task::579::TaskManager.Task::(_updateState) Task=`63698c97-4029-492b-a293-448faa5b77f8`::moving from state preparing -> state finished
>Thread-3461::DEBUG::2014-04-10 17:56:07,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3461::DEBUG::2014-04-10 17:56:07,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3461::DEBUG::2014-04-10 17:56:07,917::task::974::TaskManager.Task::(_decref) Task=`63698c97-4029-492b-a293-448faa5b77f8`::ref 0 aborting False
>Thread-3464::DEBUG::2014-04-10 17:56:13,216::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-3464::DEBUG::2014-04-10 17:56:13,217::task::579::TaskManager.Task::(_updateState) Task=`b3290a44-de46-4c43-9e9c-c9615a12c643`::moving from state init -> state preparing
>Thread-3464::INFO::2014-04-10 17:56:13,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3464::INFO::2014-04-10 17:56:13,217::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3464::DEBUG::2014-04-10 17:56:13,218::task::1168::TaskManager.Task::(prepare) Task=`b3290a44-de46-4c43-9e9c-c9615a12c643`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3464::DEBUG::2014-04-10 17:56:13,218::task::579::TaskManager.Task::(_updateState) Task=`b3290a44-de46-4c43-9e9c-c9615a12c643`::moving from state preparing -> state finished
>Thread-3464::DEBUG::2014-04-10 17:56:13,218::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3464::DEBUG::2014-04-10 17:56:13,218::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3464::DEBUG::2014-04-10 17:56:13,218::task::974::TaskManager.Task::(_decref) Task=`b3290a44-de46-4c43-9e9c-c9615a12c643`::ref 0 aborting False
>Thread-3465::DEBUG::2014-04-10 17:56:13,225::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-3465::DEBUG::2014-04-10 17:56:13,225::task::579::TaskManager.Task::(_updateState) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::moving from state init -> state preparing
>Thread-3465::INFO::2014-04-10 17:56:13,225::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3465::DEBUG::2014-04-10 17:56:13,226::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`903367ce-9d60-486a-abc8-53fd6a8967b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3465::DEBUG::2014-04-10 17:56:13,226::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3465::DEBUG::2014-04-10 17:56:13,226::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3465::DEBUG::2014-04-10 17:56:13,226::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`903367ce-9d60-486a-abc8-53fd6a8967b7`::Granted request
>Thread-3465::DEBUG::2014-04-10 17:56:13,227::task::811::TaskManager.Task::(resourceAcquired) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3465::DEBUG::2014-04-10 17:56:13,227::task::974::TaskManager.Task::(_decref) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::ref 1 aborting False
>Thread-3465::INFO::2014-04-10 17:56:13,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3465::DEBUG::2014-04-10 17:56:13,229::task::1168::TaskManager.Task::(prepare) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3465::DEBUG::2014-04-10 17:56:13,229::task::579::TaskManager.Task::(_updateState) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::moving from state preparing -> state finished
>Thread-3465::DEBUG::2014-04-10 17:56:13,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3465::DEBUG::2014-04-10 17:56:13,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3465::DEBUG::2014-04-10 17:56:13,230::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3465::DEBUG::2014-04-10 17:56:13,230::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3465::DEBUG::2014-04-10 17:56:13,230::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3465::DEBUG::2014-04-10 17:56:13,230::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3465::DEBUG::2014-04-10 17:56:13,230::task::974::TaskManager.Task::(_decref) Task=`6811f669-c5c7-4c55-b7cd-1b05be9796ee`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:17,047::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:17,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390349 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:17,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:17,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364774 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:17,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:17,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00037996 s, 969 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:17,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:17,703::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455338 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3469::DEBUG::2014-04-10 17:56:23,082::task::579::TaskManager.Task::(_updateState) Task=`80acf524-0c4f-4cc7-a519-8946bfb7644f`::moving from state init -> state preparing
>Thread-3469::INFO::2014-04-10 17:56:23,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3469::INFO::2014-04-10 17:56:23,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455338', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390349', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364774', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037996', 'lastCheck': '5.5', 'valid': True}}
>Thread-3469::DEBUG::2014-04-10 17:56:23,083::task::1168::TaskManager.Task::(prepare) Task=`80acf524-0c4f-4cc7-a519-8946bfb7644f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455338', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390349', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364774', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037996', 'lastCheck': '5.5', 'valid': True}}
>Thread-3469::DEBUG::2014-04-10 17:56:23,083::task::579::TaskManager.Task::(_updateState) Task=`80acf524-0c4f-4cc7-a519-8946bfb7644f`::moving from state preparing -> state finished
>Thread-3469::DEBUG::2014-04-10 17:56:23,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3469::DEBUG::2014-04-10 17:56:23,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3469::DEBUG::2014-04-10 17:56:23,083::task::974::TaskManager.Task::(_decref) Task=`80acf524-0c4f-4cc7-a519-8946bfb7644f`::ref 0 aborting False
>Thread-3471::DEBUG::2014-04-10 17:56:23,357::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3471::DEBUG::2014-04-10 17:56:23,357::task::579::TaskManager.Task::(_updateState) Task=`fedc0d48-7b8d-4391-a9b2-9b8a53bbc158`::moving from state init -> state preparing
>Thread-3471::INFO::2014-04-10 17:56:23,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3471::INFO::2014-04-10 17:56:23,358::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3471::DEBUG::2014-04-10 17:56:23,358::task::1168::TaskManager.Task::(prepare) Task=`fedc0d48-7b8d-4391-a9b2-9b8a53bbc158`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3471::DEBUG::2014-04-10 17:56:23,358::task::579::TaskManager.Task::(_updateState) Task=`fedc0d48-7b8d-4391-a9b2-9b8a53bbc158`::moving from state preparing -> state finished
>Thread-3471::DEBUG::2014-04-10 17:56:23,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3471::DEBUG::2014-04-10 17:56:23,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3471::DEBUG::2014-04-10 17:56:23,358::task::974::TaskManager.Task::(_decref) Task=`fedc0d48-7b8d-4391-a9b2-9b8a53bbc158`::ref 0 aborting False
>Thread-3472::DEBUG::2014-04-10 17:56:23,365::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3472::DEBUG::2014-04-10 17:56:23,365::task::579::TaskManager.Task::(_updateState) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::moving from state init -> state preparing
>Thread-3472::INFO::2014-04-10 17:56:23,366::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3472::DEBUG::2014-04-10 17:56:23,366::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2abd415-795f-448b-a21b-69b125f207e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3472::DEBUG::2014-04-10 17:56:23,366::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3472::DEBUG::2014-04-10 17:56:23,367::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3472::DEBUG::2014-04-10 17:56:23,367::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2abd415-795f-448b-a21b-69b125f207e9`::Granted request
>Thread-3472::DEBUG::2014-04-10 17:56:23,367::task::811::TaskManager.Task::(resourceAcquired) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3472::DEBUG::2014-04-10 17:56:23,367::task::974::TaskManager.Task::(_decref) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::ref 1 aborting False
>Thread-3472::INFO::2014-04-10 17:56:23,369::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3472::DEBUG::2014-04-10 17:56:23,369::task::1168::TaskManager.Task::(prepare) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3472::DEBUG::2014-04-10 17:56:23,369::task::579::TaskManager.Task::(_updateState) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::moving from state preparing -> state finished
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3472::DEBUG::2014-04-10 17:56:23,370::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3472::DEBUG::2014-04-10 17:56:23,371::task::974::TaskManager.Task::(_decref) Task=`e134dd3b-82b0-4e5d-a524-df13d04bdf4f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:27,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:27,068::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370002 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:27,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:27,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348115 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:27,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:27,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437966 s, 840 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:27,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:27,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000506603 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3476::DEBUG::2014-04-10 17:56:33,440::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3476::DEBUG::2014-04-10 17:56:33,440::task::579::TaskManager.Task::(_updateState) Task=`d94d517c-bc66-4550-8c25-711456d339e9`::moving from state init -> state preparing
>Thread-3476::INFO::2014-04-10 17:56:33,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3476::INFO::2014-04-10 17:56:33,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3476::DEBUG::2014-04-10 17:56:33,441::task::1168::TaskManager.Task::(prepare) Task=`d94d517c-bc66-4550-8c25-711456d339e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3476::DEBUG::2014-04-10 17:56:33,441::task::579::TaskManager.Task::(_updateState) Task=`d94d517c-bc66-4550-8c25-711456d339e9`::moving from state preparing -> state finished
>Thread-3476::DEBUG::2014-04-10 17:56:33,441::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3476::DEBUG::2014-04-10 17:56:33,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3476::DEBUG::2014-04-10 17:56:33,442::task::974::TaskManager.Task::(_decref) Task=`d94d517c-bc66-4550-8c25-711456d339e9`::ref 0 aborting False
>Thread-3477::DEBUG::2014-04-10 17:56:33,448::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3477::DEBUG::2014-04-10 17:56:33,448::task::579::TaskManager.Task::(_updateState) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::moving from state init -> state preparing
>Thread-3477::INFO::2014-04-10 17:56:33,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3477::DEBUG::2014-04-10 17:56:33,449::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f5e489-f511-41f2-8f5d-ca20e8714025`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3477::DEBUG::2014-04-10 17:56:33,449::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3477::DEBUG::2014-04-10 17:56:33,449::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3477::DEBUG::2014-04-10 17:56:33,449::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f5e489-f511-41f2-8f5d-ca20e8714025`::Granted request
>Thread-3477::DEBUG::2014-04-10 17:56:33,450::task::811::TaskManager.Task::(resourceAcquired) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3477::DEBUG::2014-04-10 17:56:33,450::task::974::TaskManager.Task::(_decref) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::ref 1 aborting False
>Thread-3477::INFO::2014-04-10 17:56:33,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3477::DEBUG::2014-04-10 17:56:33,452::task::1168::TaskManager.Task::(prepare) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3477::DEBUG::2014-04-10 17:56:33,452::task::579::TaskManager.Task::(_updateState) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::moving from state preparing -> state finished
>Thread-3477::DEBUG::2014-04-10 17:56:33,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3477::DEBUG::2014-04-10 17:56:33,453::task::974::TaskManager.Task::(_decref) Task=`868e5ea1-2a1f-4c7e-849a-19c62ace47c5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:37,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:37,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000443841 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:37,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:37,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263022 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:37,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:37,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533173 s, 690 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:37,727::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:37,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000471797 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3479::DEBUG::2014-04-10 17:56:38,252::task::579::TaskManager.Task::(_updateState) Task=`e70b4070-1fb9-4c33-9ff1-1ab8a35a1210`::moving from state init -> state preparing
>Thread-3479::INFO::2014-04-10 17:56:38,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3479::INFO::2014-04-10 17:56:38,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471797', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443841', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263022', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533173', 'lastCheck': '0.6', 'valid': True}}
>Thread-3479::DEBUG::2014-04-10 17:56:38,252::task::1168::TaskManager.Task::(prepare) Task=`e70b4070-1fb9-4c33-9ff1-1ab8a35a1210`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471797', 'lastCheck': '0.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443841', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263022', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533173', 'lastCheck': '0.6', 'valid': True}}
>Thread-3479::DEBUG::2014-04-10 17:56:38,253::task::579::TaskManager.Task::(_updateState) Task=`e70b4070-1fb9-4c33-9ff1-1ab8a35a1210`::moving from state preparing -> state finished
>Thread-3479::DEBUG::2014-04-10 17:56:38,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3479::DEBUG::2014-04-10 17:56:38,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3479::DEBUG::2014-04-10 17:56:38,253::task::974::TaskManager.Task::(_decref) Task=`e70b4070-1fb9-4c33-9ff1-1ab8a35a1210`::ref 0 aborting False
>Thread-3482::DEBUG::2014-04-10 17:56:43,538::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3482::DEBUG::2014-04-10 17:56:43,539::task::579::TaskManager.Task::(_updateState) Task=`2d6af9ec-cf2e-4184-b2fb-406f0bd97e86`::moving from state init -> state preparing
>Thread-3482::INFO::2014-04-10 17:56:43,539::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3482::INFO::2014-04-10 17:56:43,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3482::DEBUG::2014-04-10 17:56:43,540::task::1168::TaskManager.Task::(prepare) Task=`2d6af9ec-cf2e-4184-b2fb-406f0bd97e86`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3482::DEBUG::2014-04-10 17:56:43,540::task::579::TaskManager.Task::(_updateState) Task=`2d6af9ec-cf2e-4184-b2fb-406f0bd97e86`::moving from state preparing -> state finished
>Thread-3482::DEBUG::2014-04-10 17:56:43,540::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3482::DEBUG::2014-04-10 17:56:43,540::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3482::DEBUG::2014-04-10 17:56:43,540::task::974::TaskManager.Task::(_decref) Task=`2d6af9ec-cf2e-4184-b2fb-406f0bd97e86`::ref 0 aborting False
>Thread-3483::DEBUG::2014-04-10 17:56:43,547::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3483::DEBUG::2014-04-10 17:56:43,547::task::579::TaskManager.Task::(_updateState) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::moving from state init -> state preparing
>Thread-3483::INFO::2014-04-10 17:56:43,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3483::DEBUG::2014-04-10 17:56:43,548::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97648bb9-a51e-424b-b950-965cadb6caff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3483::DEBUG::2014-04-10 17:56:43,548::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3483::DEBUG::2014-04-10 17:56:43,548::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3483::DEBUG::2014-04-10 17:56:43,548::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97648bb9-a51e-424b-b950-965cadb6caff`::Granted request
>Thread-3483::DEBUG::2014-04-10 17:56:43,549::task::811::TaskManager.Task::(resourceAcquired) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3483::DEBUG::2014-04-10 17:56:43,549::task::974::TaskManager.Task::(_decref) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::ref 1 aborting False
>Thread-3483::INFO::2014-04-10 17:56:43,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3483::DEBUG::2014-04-10 17:56:43,551::task::1168::TaskManager.Task::(prepare) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3483::DEBUG::2014-04-10 17:56:43,551::task::579::TaskManager.Task::(_updateState) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::moving from state preparing -> state finished
>Thread-3483::DEBUG::2014-04-10 17:56:43,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3483::DEBUG::2014-04-10 17:56:43,552::task::974::TaskManager.Task::(_decref) Task=`b4f36bbb-3938-4da9-a940-87c44c503b3e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:47,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:47,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370086 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:47,280::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:47,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00046307 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:47,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:47,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000571141 s, 644 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:47,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:47,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000522051 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3487::DEBUG::2014-04-10 17:56:53,871::task::579::TaskManager.Task::(_updateState) Task=`ed7e1c08-65c3-4278-a577-ea79cd6e9596`::moving from state init -> state preparing
>Thread-3487::INFO::2014-04-10 17:56:53,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3487::INFO::2014-04-10 17:56:53,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522051', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370086', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046307', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571141', 'lastCheck': '6.2', 'valid': True}}
>Thread-3488::DEBUG::2014-04-10 17:56:53,873::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3487::DEBUG::2014-04-10 17:56:53,873::task::1168::TaskManager.Task::(prepare) Task=`ed7e1c08-65c3-4278-a577-ea79cd6e9596`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522051', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370086', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046307', 'lastCheck': '6.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571141', 'lastCheck': '6.2', 'valid': True}}
>Thread-3487::DEBUG::2014-04-10 17:56:53,874::task::579::TaskManager.Task::(_updateState) Task=`ed7e1c08-65c3-4278-a577-ea79cd6e9596`::moving from state preparing -> state finished
>Thread-3488::DEBUG::2014-04-10 17:56:53,874::task::579::TaskManager.Task::(_updateState) Task=`d52d55c1-6b6e-43cc-b810-15f8e0637c82`::moving from state init -> state preparing
>Thread-3487::DEBUG::2014-04-10 17:56:53,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3488::INFO::2014-04-10 17:56:53,875::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3487::DEBUG::2014-04-10 17:56:53,875::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3488::INFO::2014-04-10 17:56:53,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3487::DEBUG::2014-04-10 17:56:53,876::task::974::TaskManager.Task::(_decref) Task=`ed7e1c08-65c3-4278-a577-ea79cd6e9596`::ref 0 aborting False
>Thread-3488::DEBUG::2014-04-10 17:56:53,877::task::1168::TaskManager.Task::(prepare) Task=`d52d55c1-6b6e-43cc-b810-15f8e0637c82`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3488::DEBUG::2014-04-10 17:56:53,877::task::579::TaskManager.Task::(_updateState) Task=`d52d55c1-6b6e-43cc-b810-15f8e0637c82`::moving from state preparing -> state finished
>Thread-3488::DEBUG::2014-04-10 17:56:53,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3488::DEBUG::2014-04-10 17:56:53,878::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3488::DEBUG::2014-04-10 17:56:53,879::task::974::TaskManager.Task::(_decref) Task=`d52d55c1-6b6e-43cc-b810-15f8e0637c82`::ref 0 aborting False
>Thread-3489::DEBUG::2014-04-10 17:56:53,889::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3489::DEBUG::2014-04-10 17:56:53,889::task::579::TaskManager.Task::(_updateState) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::moving from state init -> state preparing
>Thread-3489::INFO::2014-04-10 17:56:53,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3489::DEBUG::2014-04-10 17:56:53,890::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`45d02240-9732-4df5-aac6-16a2b86fbd9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3489::DEBUG::2014-04-10 17:56:53,890::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3489::DEBUG::2014-04-10 17:56:53,890::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3489::DEBUG::2014-04-10 17:56:53,891::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`45d02240-9732-4df5-aac6-16a2b86fbd9c`::Granted request
>Thread-3489::DEBUG::2014-04-10 17:56:53,891::task::811::TaskManager.Task::(resourceAcquired) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3489::DEBUG::2014-04-10 17:56:53,891::task::974::TaskManager.Task::(_decref) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::ref 1 aborting False
>Thread-3489::INFO::2014-04-10 17:56:53,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3489::DEBUG::2014-04-10 17:56:53,893::task::1168::TaskManager.Task::(prepare) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3489::DEBUG::2014-04-10 17:56:53,893::task::579::TaskManager.Task::(_updateState) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::moving from state preparing -> state finished
>Thread-3489::DEBUG::2014-04-10 17:56:53,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3489::DEBUG::2014-04-10 17:56:53,894::task::974::TaskManager.Task::(_decref) Task=`54464ed1-8319-4f7e-ae2f-dd9add123ef5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:56:57,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:56:57,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373125 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:56:57,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:56:57,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350368 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:56:57,652::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:56:57,667::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 17:56:57,668::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 17:56:57,674::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 17:56:57,676::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 17:56:57,676::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 17:56:57,676::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 17:56:57,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:56:57,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448341 s, 821 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:56:57,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:56:57,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000546556 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3498::DEBUG::2014-04-10 17:57:04,009::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3498::DEBUG::2014-04-10 17:57:04,010::task::579::TaskManager.Task::(_updateState) Task=`bb2b52d1-6b99-49f8-8d62-a9160c2529b7`::moving from state init -> state preparing
>Thread-3498::INFO::2014-04-10 17:57:04,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3498::INFO::2014-04-10 17:57:04,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3498::DEBUG::2014-04-10 17:57:04,011::task::1168::TaskManager.Task::(prepare) Task=`bb2b52d1-6b99-49f8-8d62-a9160c2529b7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3498::DEBUG::2014-04-10 17:57:04,011::task::579::TaskManager.Task::(_updateState) Task=`bb2b52d1-6b99-49f8-8d62-a9160c2529b7`::moving from state preparing -> state finished
>Thread-3498::DEBUG::2014-04-10 17:57:04,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3498::DEBUG::2014-04-10 17:57:04,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3498::DEBUG::2014-04-10 17:57:04,011::task::974::TaskManager.Task::(_decref) Task=`bb2b52d1-6b99-49f8-8d62-a9160c2529b7`::ref 0 aborting False
>Thread-3499::DEBUG::2014-04-10 17:57:04,018::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3499::DEBUG::2014-04-10 17:57:04,018::task::579::TaskManager.Task::(_updateState) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::moving from state init -> state preparing
>Thread-3499::INFO::2014-04-10 17:57:04,019::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3499::DEBUG::2014-04-10 17:57:04,019::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9a69104a-71e8-444f-a78f-7f9d9f2ca924`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3499::DEBUG::2014-04-10 17:57:04,019::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3499::DEBUG::2014-04-10 17:57:04,019::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3499::DEBUG::2014-04-10 17:57:04,020::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9a69104a-71e8-444f-a78f-7f9d9f2ca924`::Granted request
>Thread-3499::DEBUG::2014-04-10 17:57:04,020::task::811::TaskManager.Task::(resourceAcquired) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3499::DEBUG::2014-04-10 17:57:04,020::task::974::TaskManager.Task::(_decref) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::ref 1 aborting False
>Thread-3499::INFO::2014-04-10 17:57:04,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3499::DEBUG::2014-04-10 17:57:04,022::task::1168::TaskManager.Task::(prepare) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3499::DEBUG::2014-04-10 17:57:04,022::task::579::TaskManager.Task::(_updateState) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::moving from state preparing -> state finished
>Thread-3499::DEBUG::2014-04-10 17:57:04,022::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3499::DEBUG::2014-04-10 17:57:04,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3499::DEBUG::2014-04-10 17:57:04,023::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3499::DEBUG::2014-04-10 17:57:04,023::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3499::DEBUG::2014-04-10 17:57:04,023::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3499::DEBUG::2014-04-10 17:57:04,023::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3499::DEBUG::2014-04-10 17:57:04,024::task::974::TaskManager.Task::(_decref) Task=`3a757211-b4c6-4ad8-a12b-ee85795cfaa3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:07,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:07,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000246595 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:07,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:07,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279349 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:07,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:07,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000599694 s, 614 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:07,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:07,778::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000511057 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3501::DEBUG::2014-04-10 17:57:09,061::task::579::TaskManager.Task::(_updateState) Task=`d7332413-f609-4eb1-901f-d1f76e22e213`::moving from state init -> state preparing
>Thread-3501::INFO::2014-04-10 17:57:09,061::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3501::INFO::2014-04-10 17:57:09,062::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511057', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246595', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279349', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599694', 'lastCheck': '1.4', 'valid': True}}
>Thread-3501::DEBUG::2014-04-10 17:57:09,062::task::1168::TaskManager.Task::(prepare) Task=`d7332413-f609-4eb1-901f-d1f76e22e213`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511057', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000246595', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279349', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599694', 'lastCheck': '1.4', 'valid': True}}
>Thread-3501::DEBUG::2014-04-10 17:57:09,062::task::579::TaskManager.Task::(_updateState) Task=`d7332413-f609-4eb1-901f-d1f76e22e213`::moving from state preparing -> state finished
>Thread-3501::DEBUG::2014-04-10 17:57:09,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3501::DEBUG::2014-04-10 17:57:09,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3501::DEBUG::2014-04-10 17:57:09,062::task::974::TaskManager.Task::(_decref) Task=`d7332413-f609-4eb1-901f-d1f76e22e213`::ref 0 aborting False
>Thread-3504::DEBUG::2014-04-10 17:57:14,109::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3504::DEBUG::2014-04-10 17:57:14,116::task::579::TaskManager.Task::(_updateState) Task=`efe327ad-b6fb-4933-83c5-af64a399e11b`::moving from state init -> state preparing
>Thread-3504::INFO::2014-04-10 17:57:14,116::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3504::INFO::2014-04-10 17:57:14,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3504::DEBUG::2014-04-10 17:57:14,117::task::1168::TaskManager.Task::(prepare) Task=`efe327ad-b6fb-4933-83c5-af64a399e11b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3504::DEBUG::2014-04-10 17:57:14,117::task::579::TaskManager.Task::(_updateState) Task=`efe327ad-b6fb-4933-83c5-af64a399e11b`::moving from state preparing -> state finished
>Thread-3504::DEBUG::2014-04-10 17:57:14,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3504::DEBUG::2014-04-10 17:57:14,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3504::DEBUG::2014-04-10 17:57:14,118::task::974::TaskManager.Task::(_decref) Task=`efe327ad-b6fb-4933-83c5-af64a399e11b`::ref 0 aborting False
>Thread-3505::DEBUG::2014-04-10 17:57:14,124::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3505::DEBUG::2014-04-10 17:57:14,125::task::579::TaskManager.Task::(_updateState) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::moving from state init -> state preparing
>Thread-3505::INFO::2014-04-10 17:57:14,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3505::DEBUG::2014-04-10 17:57:14,126::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06712a54-87a8-43f0-9ed9-45fe69836a19`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3505::DEBUG::2014-04-10 17:57:14,126::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3505::DEBUG::2014-04-10 17:57:14,126::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3505::DEBUG::2014-04-10 17:57:14,126::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06712a54-87a8-43f0-9ed9-45fe69836a19`::Granted request
>Thread-3505::DEBUG::2014-04-10 17:57:14,126::task::811::TaskManager.Task::(resourceAcquired) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3505::DEBUG::2014-04-10 17:57:14,127::task::974::TaskManager.Task::(_decref) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::ref 1 aborting False
>Thread-3505::INFO::2014-04-10 17:57:14,129::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3505::DEBUG::2014-04-10 17:57:14,129::task::1168::TaskManager.Task::(prepare) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3505::DEBUG::2014-04-10 17:57:14,129::task::579::TaskManager.Task::(_updateState) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::moving from state preparing -> state finished
>Thread-3505::DEBUG::2014-04-10 17:57:14,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3505::DEBUG::2014-04-10 17:57:14,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3505::DEBUG::2014-04-10 17:57:14,130::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3505::DEBUG::2014-04-10 17:57:14,130::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3505::DEBUG::2014-04-10 17:57:14,130::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3505::DEBUG::2014-04-10 17:57:14,130::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3505::DEBUG::2014-04-10 17:57:14,130::task::974::TaskManager.Task::(_decref) Task=`86f1d09e-91ec-4494-a82f-1aa0d2e030b3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:17,134::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:17,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326143 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:17,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:17,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270171 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:17,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:17,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000452604 s, 813 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:17,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:17,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000526244 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3509::DEBUG::2014-04-10 17:57:24,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3509::DEBUG::2014-04-10 17:57:24,234::task::579::TaskManager.Task::(_updateState) Task=`8bf57f45-1225-4da1-9202-22bb4837eb57`::moving from state init -> state preparing
>Thread-3509::INFO::2014-04-10 17:57:24,234::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3509::INFO::2014-04-10 17:57:24,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3509::DEBUG::2014-04-10 17:57:24,235::task::1168::TaskManager.Task::(prepare) Task=`8bf57f45-1225-4da1-9202-22bb4837eb57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3509::DEBUG::2014-04-10 17:57:24,235::task::579::TaskManager.Task::(_updateState) Task=`8bf57f45-1225-4da1-9202-22bb4837eb57`::moving from state preparing -> state finished
>Thread-3509::DEBUG::2014-04-10 17:57:24,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3509::DEBUG::2014-04-10 17:57:24,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3509::DEBUG::2014-04-10 17:57:24,236::task::974::TaskManager.Task::(_decref) Task=`8bf57f45-1225-4da1-9202-22bb4837eb57`::ref 0 aborting False
>Thread-3510::DEBUG::2014-04-10 17:57:24,242::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3510::DEBUG::2014-04-10 17:57:24,242::task::579::TaskManager.Task::(_updateState) Task=`1a10939b-1507-4bef-8939-db95e452c825`::moving from state init -> state preparing
>Thread-3510::INFO::2014-04-10 17:57:24,243::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3510::DEBUG::2014-04-10 17:57:24,243::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3d5eea1-5ebe-4b6d-be43-4d9d530e911a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3510::DEBUG::2014-04-10 17:57:24,243::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3510::DEBUG::2014-04-10 17:57:24,243::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3510::DEBUG::2014-04-10 17:57:24,244::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3d5eea1-5ebe-4b6d-be43-4d9d530e911a`::Granted request
>Thread-3510::DEBUG::2014-04-10 17:57:24,244::task::811::TaskManager.Task::(resourceAcquired) Task=`1a10939b-1507-4bef-8939-db95e452c825`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3510::DEBUG::2014-04-10 17:57:24,244::task::974::TaskManager.Task::(_decref) Task=`1a10939b-1507-4bef-8939-db95e452c825`::ref 1 aborting False
>Thread-3510::INFO::2014-04-10 17:57:24,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3510::DEBUG::2014-04-10 17:57:24,246::task::1168::TaskManager.Task::(prepare) Task=`1a10939b-1507-4bef-8939-db95e452c825`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3510::DEBUG::2014-04-10 17:57:24,246::task::579::TaskManager.Task::(_updateState) Task=`1a10939b-1507-4bef-8939-db95e452c825`::moving from state preparing -> state finished
>Thread-3510::DEBUG::2014-04-10 17:57:24,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3510::DEBUG::2014-04-10 17:57:24,247::task::974::TaskManager.Task::(_decref) Task=`1a10939b-1507-4bef-8939-db95e452c825`::ref 0 aborting False
>Thread-3511::DEBUG::2014-04-10 17:57:24,259::task::579::TaskManager.Task::(_updateState) Task=`6a94bd1c-6c5b-4dc2-bddb-3b16e91b4c5b`::moving from state init -> state preparing
>Thread-3511::INFO::2014-04-10 17:57:24,260::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3511::INFO::2014-04-10 17:57:24,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526244', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326143', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270171', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452604', 'lastCheck': '6.5', 'valid': True}}
>Thread-3511::DEBUG::2014-04-10 17:57:24,260::task::1168::TaskManager.Task::(prepare) Task=`6a94bd1c-6c5b-4dc2-bddb-3b16e91b4c5b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526244', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326143', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270171', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452604', 'lastCheck': '6.5', 'valid': True}}
>Thread-3511::DEBUG::2014-04-10 17:57:24,260::task::579::TaskManager.Task::(_updateState) Task=`6a94bd1c-6c5b-4dc2-bddb-3b16e91b4c5b`::moving from state preparing -> state finished
>Thread-3511::DEBUG::2014-04-10 17:57:24,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3511::DEBUG::2014-04-10 17:57:24,261::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3511::DEBUG::2014-04-10 17:57:24,261::task::974::TaskManager.Task::(_decref) Task=`6a94bd1c-6c5b-4dc2-bddb-3b16e91b4c5b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:27,149::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:27,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282345 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:27,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:27,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323817 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:27,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:27,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451954 s, 814 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:27,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:27,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458353 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3516::DEBUG::2014-04-10 17:57:34,363::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3516::DEBUG::2014-04-10 17:57:34,363::task::579::TaskManager.Task::(_updateState) Task=`b32e6d92-567e-49e1-857e-52590f46582e`::moving from state init -> state preparing
>Thread-3516::INFO::2014-04-10 17:57:34,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3516::INFO::2014-04-10 17:57:34,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3516::DEBUG::2014-04-10 17:57:34,364::task::1168::TaskManager.Task::(prepare) Task=`b32e6d92-567e-49e1-857e-52590f46582e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3516::DEBUG::2014-04-10 17:57:34,364::task::579::TaskManager.Task::(_updateState) Task=`b32e6d92-567e-49e1-857e-52590f46582e`::moving from state preparing -> state finished
>Thread-3516::DEBUG::2014-04-10 17:57:34,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3516::DEBUG::2014-04-10 17:57:34,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3516::DEBUG::2014-04-10 17:57:34,365::task::974::TaskManager.Task::(_decref) Task=`b32e6d92-567e-49e1-857e-52590f46582e`::ref 0 aborting False
>Thread-3517::DEBUG::2014-04-10 17:57:34,371::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3517::DEBUG::2014-04-10 17:57:34,371::task::579::TaskManager.Task::(_updateState) Task=`f162b682-0e96-454f-9608-33f69557de1f`::moving from state init -> state preparing
>Thread-3517::INFO::2014-04-10 17:57:34,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3517::DEBUG::2014-04-10 17:57:34,373::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`94200834-af26-4557-bc7a-fb4a992eb0fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3517::DEBUG::2014-04-10 17:57:34,373::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3517::DEBUG::2014-04-10 17:57:34,373::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3517::DEBUG::2014-04-10 17:57:34,374::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`94200834-af26-4557-bc7a-fb4a992eb0fa`::Granted request
>Thread-3517::DEBUG::2014-04-10 17:57:34,374::task::811::TaskManager.Task::(resourceAcquired) Task=`f162b682-0e96-454f-9608-33f69557de1f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3517::DEBUG::2014-04-10 17:57:34,374::task::974::TaskManager.Task::(_decref) Task=`f162b682-0e96-454f-9608-33f69557de1f`::ref 1 aborting False
>Thread-3517::INFO::2014-04-10 17:57:34,376::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3517::DEBUG::2014-04-10 17:57:34,376::task::1168::TaskManager.Task::(prepare) Task=`f162b682-0e96-454f-9608-33f69557de1f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3517::DEBUG::2014-04-10 17:57:34,376::task::579::TaskManager.Task::(_updateState) Task=`f162b682-0e96-454f-9608-33f69557de1f`::moving from state preparing -> state finished
>Thread-3517::DEBUG::2014-04-10 17:57:34,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3517::DEBUG::2014-04-10 17:57:34,377::task::974::TaskManager.Task::(_decref) Task=`f162b682-0e96-454f-9608-33f69557de1f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:37,162::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:37,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000403414 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:37,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:37,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000204238 s, 3.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:37,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:37,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000564573 s, 652 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:37,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:37,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000524031 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3519::DEBUG::2014-04-10 17:57:39,430::task::579::TaskManager.Task::(_updateState) Task=`9b709fc2-413f-40ad-801b-59e376d44847`::moving from state init -> state preparing
>Thread-3519::INFO::2014-04-10 17:57:39,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3519::INFO::2014-04-10 17:57:39,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524031', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403414', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204238', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564573', 'lastCheck': '1.7', 'valid': True}}
>Thread-3519::DEBUG::2014-04-10 17:57:39,430::task::1168::TaskManager.Task::(prepare) Task=`9b709fc2-413f-40ad-801b-59e376d44847`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524031', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403414', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000204238', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564573', 'lastCheck': '1.7', 'valid': True}}
>Thread-3519::DEBUG::2014-04-10 17:57:39,431::task::579::TaskManager.Task::(_updateState) Task=`9b709fc2-413f-40ad-801b-59e376d44847`::moving from state preparing -> state finished
>Thread-3519::DEBUG::2014-04-10 17:57:39,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3519::DEBUG::2014-04-10 17:57:39,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3519::DEBUG::2014-04-10 17:57:39,431::task::974::TaskManager.Task::(_decref) Task=`9b709fc2-413f-40ad-801b-59e376d44847`::ref 0 aborting False
>Thread-3522::DEBUG::2014-04-10 17:57:44,497::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3522::DEBUG::2014-04-10 17:57:44,505::task::579::TaskManager.Task::(_updateState) Task=`e3520aca-40de-46d2-a65f-976d0ca3014d`::moving from state init -> state preparing
>Thread-3522::INFO::2014-04-10 17:57:44,505::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3522::INFO::2014-04-10 17:57:44,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3522::DEBUG::2014-04-10 17:57:44,506::task::1168::TaskManager.Task::(prepare) Task=`e3520aca-40de-46d2-a65f-976d0ca3014d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3522::DEBUG::2014-04-10 17:57:44,506::task::579::TaskManager.Task::(_updateState) Task=`e3520aca-40de-46d2-a65f-976d0ca3014d`::moving from state preparing -> state finished
>Thread-3522::DEBUG::2014-04-10 17:57:44,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3522::DEBUG::2014-04-10 17:57:44,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3522::DEBUG::2014-04-10 17:57:44,506::task::974::TaskManager.Task::(_decref) Task=`e3520aca-40de-46d2-a65f-976d0ca3014d`::ref 0 aborting False
>Thread-3523::DEBUG::2014-04-10 17:57:44,513::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3523::DEBUG::2014-04-10 17:57:44,513::task::579::TaskManager.Task::(_updateState) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::moving from state init -> state preparing
>Thread-3523::INFO::2014-04-10 17:57:44,514::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3523::DEBUG::2014-04-10 17:57:44,514::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf53832e-bfa8-431b-983d-dd55fc5985e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3523::DEBUG::2014-04-10 17:57:44,514::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3523::DEBUG::2014-04-10 17:57:44,514::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3523::DEBUG::2014-04-10 17:57:44,515::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bf53832e-bfa8-431b-983d-dd55fc5985e1`::Granted request
>Thread-3523::DEBUG::2014-04-10 17:57:44,515::task::811::TaskManager.Task::(resourceAcquired) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3523::DEBUG::2014-04-10 17:57:44,515::task::974::TaskManager.Task::(_decref) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::ref 1 aborting False
>Thread-3523::INFO::2014-04-10 17:57:44,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3523::DEBUG::2014-04-10 17:57:44,517::task::1168::TaskManager.Task::(prepare) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3523::DEBUG::2014-04-10 17:57:44,517::task::579::TaskManager.Task::(_updateState) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::moving from state preparing -> state finished
>Thread-3523::DEBUG::2014-04-10 17:57:44,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3523::DEBUG::2014-04-10 17:57:44,518::task::974::TaskManager.Task::(_decref) Task=`bafdc541-2157-46e6-931b-5fa2cae08c68`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:47,178::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:47,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239325 s, 2.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:47,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:47,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393355 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:47,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:47,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000475097 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:47,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:47,841::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000554829 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3527::DEBUG::2014-04-10 17:57:54,618::task::579::TaskManager.Task::(_updateState) Task=`5e301888-c72d-4766-9ff8-694e125a0463`::moving from state init -> state preparing
>Thread-3527::INFO::2014-04-10 17:57:54,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3527::INFO::2014-04-10 17:57:54,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554829', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239325', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393355', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475097', 'lastCheck': '6.9', 'valid': True}}
>Thread-3527::DEBUG::2014-04-10 17:57:54,619::task::1168::TaskManager.Task::(prepare) Task=`5e301888-c72d-4766-9ff8-694e125a0463`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554829', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239325', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393355', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475097', 'lastCheck': '6.9', 'valid': True}}
>Thread-3527::DEBUG::2014-04-10 17:57:54,619::task::579::TaskManager.Task::(_updateState) Task=`5e301888-c72d-4766-9ff8-694e125a0463`::moving from state preparing -> state finished
>Thread-3527::DEBUG::2014-04-10 17:57:54,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3527::DEBUG::2014-04-10 17:57:54,619::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3527::DEBUG::2014-04-10 17:57:54,619::task::974::TaskManager.Task::(_decref) Task=`5e301888-c72d-4766-9ff8-694e125a0463`::ref 0 aborting False
>Thread-3529::DEBUG::2014-04-10 17:57:54,644::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3529::DEBUG::2014-04-10 17:57:54,645::task::579::TaskManager.Task::(_updateState) Task=`d6ad1fb1-f274-4410-8bc7-7c09f15f1518`::moving from state init -> state preparing
>Thread-3529::INFO::2014-04-10 17:57:54,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3529::INFO::2014-04-10 17:57:54,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3529::DEBUG::2014-04-10 17:57:54,646::task::1168::TaskManager.Task::(prepare) Task=`d6ad1fb1-f274-4410-8bc7-7c09f15f1518`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3529::DEBUG::2014-04-10 17:57:54,646::task::579::TaskManager.Task::(_updateState) Task=`d6ad1fb1-f274-4410-8bc7-7c09f15f1518`::moving from state preparing -> state finished
>Thread-3529::DEBUG::2014-04-10 17:57:54,646::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3529::DEBUG::2014-04-10 17:57:54,646::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3529::DEBUG::2014-04-10 17:57:54,646::task::974::TaskManager.Task::(_decref) Task=`d6ad1fb1-f274-4410-8bc7-7c09f15f1518`::ref 0 aborting False
>Thread-3530::DEBUG::2014-04-10 17:57:54,653::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3530::DEBUG::2014-04-10 17:57:54,653::task::579::TaskManager.Task::(_updateState) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::moving from state init -> state preparing
>Thread-3530::INFO::2014-04-10 17:57:54,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3530::DEBUG::2014-04-10 17:57:54,654::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d8c06021-2bf1-4fbe-9971-60b5088f0f5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3530::DEBUG::2014-04-10 17:57:54,654::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3530::DEBUG::2014-04-10 17:57:54,654::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3530::DEBUG::2014-04-10 17:57:54,654::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d8c06021-2bf1-4fbe-9971-60b5088f0f5e`::Granted request
>Thread-3530::DEBUG::2014-04-10 17:57:54,655::task::811::TaskManager.Task::(resourceAcquired) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3530::DEBUG::2014-04-10 17:57:54,655::task::974::TaskManager.Task::(_decref) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::ref 1 aborting False
>Thread-3530::INFO::2014-04-10 17:57:54,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3530::DEBUG::2014-04-10 17:57:54,657::task::1168::TaskManager.Task::(prepare) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3530::DEBUG::2014-04-10 17:57:54,657::task::579::TaskManager.Task::(_updateState) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::moving from state preparing -> state finished
>Thread-3530::DEBUG::2014-04-10 17:57:54,657::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3530::DEBUG::2014-04-10 17:57:54,657::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3530::DEBUG::2014-04-10 17:57:54,658::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3530::DEBUG::2014-04-10 17:57:54,658::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3530::DEBUG::2014-04-10 17:57:54,658::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3530::DEBUG::2014-04-10 17:57:54,658::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3530::DEBUG::2014-04-10 17:57:54,658::task::974::TaskManager.Task::(_decref) Task=`34acb75c-2cfe-4c08-8cb5-caf171c554f6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:57:57,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:57:57,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000450605 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:57:57,375::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:57:57,380::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233715 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:57:57,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:57:57,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000548308 s, 671 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:57:57,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:57:57,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000469999 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3534::DEBUG::2014-04-10 17:58:04,743::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3534::DEBUG::2014-04-10 17:58:04,744::task::579::TaskManager.Task::(_updateState) Task=`a15a73fc-7d8e-4abb-87e7-82708978cf39`::moving from state init -> state preparing
>Thread-3534::INFO::2014-04-10 17:58:04,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3534::INFO::2014-04-10 17:58:04,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3534::DEBUG::2014-04-10 17:58:04,745::task::1168::TaskManager.Task::(prepare) Task=`a15a73fc-7d8e-4abb-87e7-82708978cf39`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3534::DEBUG::2014-04-10 17:58:04,745::task::579::TaskManager.Task::(_updateState) Task=`a15a73fc-7d8e-4abb-87e7-82708978cf39`::moving from state preparing -> state finished
>Thread-3534::DEBUG::2014-04-10 17:58:04,745::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3534::DEBUG::2014-04-10 17:58:04,745::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3534::DEBUG::2014-04-10 17:58:04,745::task::974::TaskManager.Task::(_decref) Task=`a15a73fc-7d8e-4abb-87e7-82708978cf39`::ref 0 aborting False
>Thread-3535::DEBUG::2014-04-10 17:58:04,752::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3535::DEBUG::2014-04-10 17:58:04,752::task::579::TaskManager.Task::(_updateState) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::moving from state init -> state preparing
>Thread-3535::INFO::2014-04-10 17:58:04,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3535::DEBUG::2014-04-10 17:58:04,753::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe52f98e-ca11-4a00-bc7f-715b316a0fdc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3535::DEBUG::2014-04-10 17:58:04,753::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3535::DEBUG::2014-04-10 17:58:04,753::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3535::DEBUG::2014-04-10 17:58:04,754::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe52f98e-ca11-4a00-bc7f-715b316a0fdc`::Granted request
>Thread-3535::DEBUG::2014-04-10 17:58:04,754::task::811::TaskManager.Task::(resourceAcquired) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3535::DEBUG::2014-04-10 17:58:04,754::task::974::TaskManager.Task::(_decref) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::ref 1 aborting False
>Thread-3535::INFO::2014-04-10 17:58:04,756::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3535::DEBUG::2014-04-10 17:58:04,756::task::1168::TaskManager.Task::(prepare) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3535::DEBUG::2014-04-10 17:58:04,756::task::579::TaskManager.Task::(_updateState) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::moving from state preparing -> state finished
>Thread-3535::DEBUG::2014-04-10 17:58:04,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3535::DEBUG::2014-04-10 17:58:04,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3535::DEBUG::2014-04-10 17:58:04,757::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3535::DEBUG::2014-04-10 17:58:04,757::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3535::DEBUG::2014-04-10 17:58:04,757::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3535::DEBUG::2014-04-10 17:58:04,757::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3535::DEBUG::2014-04-10 17:58:04,758::task::974::TaskManager.Task::(_decref) Task=`57ccccde-6678-46c2-8b74-967218569d5f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:07,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:07,212::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270504 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:07,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:07,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000431331 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:07,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:07,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000512585 s, 718 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:07,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:07,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000538978 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3537::DEBUG::2014-04-10 17:58:09,783::task::579::TaskManager.Task::(_updateState) Task=`f597310f-364d-4a6d-ae4f-99af868e1fd3`::moving from state init -> state preparing
>Thread-3537::INFO::2014-04-10 17:58:09,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3537::INFO::2014-04-10 17:58:09,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538978', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270504', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431331', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512585', 'lastCheck': '2.0', 'valid': True}}
>Thread-3537::DEBUG::2014-04-10 17:58:09,784::task::1168::TaskManager.Task::(prepare) Task=`f597310f-364d-4a6d-ae4f-99af868e1fd3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538978', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270504', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431331', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512585', 'lastCheck': '2.0', 'valid': True}}
>Thread-3537::DEBUG::2014-04-10 17:58:09,784::task::579::TaskManager.Task::(_updateState) Task=`f597310f-364d-4a6d-ae4f-99af868e1fd3`::moving from state preparing -> state finished
>Thread-3537::DEBUG::2014-04-10 17:58:09,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3537::DEBUG::2014-04-10 17:58:09,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3537::DEBUG::2014-04-10 17:58:09,784::task::974::TaskManager.Task::(_decref) Task=`f597310f-364d-4a6d-ae4f-99af868e1fd3`::ref 0 aborting False
>Thread-3540::DEBUG::2014-04-10 17:58:14,842::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-3540::DEBUG::2014-04-10 17:58:14,855::task::579::TaskManager.Task::(_updateState) Task=`3c04836e-03be-44b6-a522-5eae94690487`::moving from state init -> state preparing
>Thread-3540::INFO::2014-04-10 17:58:14,855::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3540::INFO::2014-04-10 17:58:14,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3540::DEBUG::2014-04-10 17:58:14,856::task::1168::TaskManager.Task::(prepare) Task=`3c04836e-03be-44b6-a522-5eae94690487`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3540::DEBUG::2014-04-10 17:58:14,856::task::579::TaskManager.Task::(_updateState) Task=`3c04836e-03be-44b6-a522-5eae94690487`::moving from state preparing -> state finished
>Thread-3540::DEBUG::2014-04-10 17:58:14,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3540::DEBUG::2014-04-10 17:58:14,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3540::DEBUG::2014-04-10 17:58:14,856::task::974::TaskManager.Task::(_decref) Task=`3c04836e-03be-44b6-a522-5eae94690487`::ref 0 aborting False
>Thread-3541::DEBUG::2014-04-10 17:58:14,863::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-3541::DEBUG::2014-04-10 17:58:14,863::task::579::TaskManager.Task::(_updateState) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::moving from state init -> state preparing
>Thread-3541::INFO::2014-04-10 17:58:14,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3541::DEBUG::2014-04-10 17:58:14,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6367aaf-d87b-4256-9d0f-377dc7a59eb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3541::DEBUG::2014-04-10 17:58:14,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3541::DEBUG::2014-04-10 17:58:14,864::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3541::DEBUG::2014-04-10 17:58:14,864::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6367aaf-d87b-4256-9d0f-377dc7a59eb9`::Granted request
>Thread-3541::DEBUG::2014-04-10 17:58:14,865::task::811::TaskManager.Task::(resourceAcquired) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3541::DEBUG::2014-04-10 17:58:14,865::task::974::TaskManager.Task::(_decref) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::ref 1 aborting False
>Thread-3541::INFO::2014-04-10 17:58:14,867::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3541::DEBUG::2014-04-10 17:58:14,867::task::1168::TaskManager.Task::(prepare) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3541::DEBUG::2014-04-10 17:58:14,868::task::579::TaskManager.Task::(_updateState) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::moving from state preparing -> state finished
>Thread-3541::DEBUG::2014-04-10 17:58:14,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3541::DEBUG::2014-04-10 17:58:14,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3541::DEBUG::2014-04-10 17:58:14,868::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3541::DEBUG::2014-04-10 17:58:14,868::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3541::DEBUG::2014-04-10 17:58:14,869::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3541::DEBUG::2014-04-10 17:58:14,869::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3541::DEBUG::2014-04-10 17:58:14,869::task::974::TaskManager.Task::(_decref) Task=`8d2fc82f-2ae7-4613-819a-6eea201624b9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:17,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:17,228::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260826 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:17,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:17,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347895 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:17,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:17,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000625749 s, 588 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:17,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:17,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398006 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3545::DEBUG::2014-04-10 17:58:24,956::task::579::TaskManager.Task::(_updateState) Task=`0294f717-2dfa-414a-84f0-3cb4649f7f70`::moving from state init -> state preparing
>Thread-3545::INFO::2014-04-10 17:58:24,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3545::INFO::2014-04-10 17:58:24,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398006', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260826', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347895', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625749', 'lastCheck': '7.1', 'valid': True}}
>Thread-3545::DEBUG::2014-04-10 17:58:24,957::task::1168::TaskManager.Task::(prepare) Task=`0294f717-2dfa-414a-84f0-3cb4649f7f70`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398006', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260826', 'lastCheck': '7.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347895', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625749', 'lastCheck': '7.1', 'valid': True}}
>Thread-3545::DEBUG::2014-04-10 17:58:24,957::task::579::TaskManager.Task::(_updateState) Task=`0294f717-2dfa-414a-84f0-3cb4649f7f70`::moving from state preparing -> state finished
>Thread-3545::DEBUG::2014-04-10 17:58:24,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3545::DEBUG::2014-04-10 17:58:24,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3545::DEBUG::2014-04-10 17:58:24,957::task::974::TaskManager.Task::(_decref) Task=`0294f717-2dfa-414a-84f0-3cb4649f7f70`::ref 0 aborting False
>Thread-3547::DEBUG::2014-04-10 17:58:25,006::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3547::DEBUG::2014-04-10 17:58:25,006::task::579::TaskManager.Task::(_updateState) Task=`12e5b4b1-2387-42b0-94b6-1ee18653ee91`::moving from state init -> state preparing
>Thread-3547::INFO::2014-04-10 17:58:25,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3547::INFO::2014-04-10 17:58:25,007::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3547::DEBUG::2014-04-10 17:58:25,007::task::1168::TaskManager.Task::(prepare) Task=`12e5b4b1-2387-42b0-94b6-1ee18653ee91`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3547::DEBUG::2014-04-10 17:58:25,007::task::579::TaskManager.Task::(_updateState) Task=`12e5b4b1-2387-42b0-94b6-1ee18653ee91`::moving from state preparing -> state finished
>Thread-3547::DEBUG::2014-04-10 17:58:25,007::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3547::DEBUG::2014-04-10 17:58:25,007::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3547::DEBUG::2014-04-10 17:58:25,008::task::974::TaskManager.Task::(_decref) Task=`12e5b4b1-2387-42b0-94b6-1ee18653ee91`::ref 0 aborting False
>Thread-3548::DEBUG::2014-04-10 17:58:25,014::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3548::DEBUG::2014-04-10 17:58:25,014::task::579::TaskManager.Task::(_updateState) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::moving from state init -> state preparing
>Thread-3548::INFO::2014-04-10 17:58:25,014::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3548::DEBUG::2014-04-10 17:58:25,015::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5e8fded5-51f4-4fd8-a928-948f2587f82b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3548::DEBUG::2014-04-10 17:58:25,015::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3548::DEBUG::2014-04-10 17:58:25,015::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3548::DEBUG::2014-04-10 17:58:25,015::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5e8fded5-51f4-4fd8-a928-948f2587f82b`::Granted request
>Thread-3548::DEBUG::2014-04-10 17:58:25,016::task::811::TaskManager.Task::(resourceAcquired) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3548::DEBUG::2014-04-10 17:58:25,016::task::974::TaskManager.Task::(_decref) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::ref 1 aborting False
>Thread-3548::INFO::2014-04-10 17:58:25,018::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3548::DEBUG::2014-04-10 17:58:25,018::task::1168::TaskManager.Task::(prepare) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3548::DEBUG::2014-04-10 17:58:25,018::task::579::TaskManager.Task::(_updateState) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::moving from state preparing -> state finished
>Thread-3548::DEBUG::2014-04-10 17:58:25,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3548::DEBUG::2014-04-10 17:58:25,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3548::DEBUG::2014-04-10 17:58:25,019::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3548::DEBUG::2014-04-10 17:58:25,019::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3548::DEBUG::2014-04-10 17:58:25,019::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3548::DEBUG::2014-04-10 17:58:25,019::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3548::DEBUG::2014-04-10 17:58:25,019::task::974::TaskManager.Task::(_decref) Task=`9e08e9c0-fe4c-4ff1-9e0b-77c4216fbd43`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:27,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:27,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277526 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:27,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:27,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000401725 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:27,821::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:27,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478317 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:27,900::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:58:27,914::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 17:58:27,916::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 17:58:27,921::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 17:58:27,923::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 17:58:27,923::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 17:58:27,923::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 17:58:27,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:27,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000392021 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3556::DEBUG::2014-04-10 17:58:35,088::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3556::DEBUG::2014-04-10 17:58:35,089::task::579::TaskManager.Task::(_updateState) Task=`3c88b0a1-c1dd-45d7-9beb-b70c56791094`::moving from state init -> state preparing
>Thread-3556::INFO::2014-04-10 17:58:35,089::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3556::INFO::2014-04-10 17:58:35,090::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3556::DEBUG::2014-04-10 17:58:35,090::task::1168::TaskManager.Task::(prepare) Task=`3c88b0a1-c1dd-45d7-9beb-b70c56791094`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3556::DEBUG::2014-04-10 17:58:35,090::task::579::TaskManager.Task::(_updateState) Task=`3c88b0a1-c1dd-45d7-9beb-b70c56791094`::moving from state preparing -> state finished
>Thread-3556::DEBUG::2014-04-10 17:58:35,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3556::DEBUG::2014-04-10 17:58:35,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3556::DEBUG::2014-04-10 17:58:35,090::task::974::TaskManager.Task::(_decref) Task=`3c88b0a1-c1dd-45d7-9beb-b70c56791094`::ref 0 aborting False
>Thread-3557::DEBUG::2014-04-10 17:58:35,097::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3557::DEBUG::2014-04-10 17:58:35,097::task::579::TaskManager.Task::(_updateState) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::moving from state init -> state preparing
>Thread-3557::INFO::2014-04-10 17:58:35,098::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3557::DEBUG::2014-04-10 17:58:35,098::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`319e6394-0b57-4bdb-9606-0bd39b1d4aa1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3557::DEBUG::2014-04-10 17:58:35,098::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3557::DEBUG::2014-04-10 17:58:35,098::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3557::DEBUG::2014-04-10 17:58:35,099::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`319e6394-0b57-4bdb-9606-0bd39b1d4aa1`::Granted request
>Thread-3557::DEBUG::2014-04-10 17:58:35,099::task::811::TaskManager.Task::(resourceAcquired) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3557::DEBUG::2014-04-10 17:58:35,099::task::974::TaskManager.Task::(_decref) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::ref 1 aborting False
>Thread-3557::INFO::2014-04-10 17:58:35,101::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3557::DEBUG::2014-04-10 17:58:35,101::task::1168::TaskManager.Task::(prepare) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3557::DEBUG::2014-04-10 17:58:35,101::task::579::TaskManager.Task::(_updateState) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::moving from state preparing -> state finished
>Thread-3557::DEBUG::2014-04-10 17:58:35,101::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3557::DEBUG::2014-04-10 17:58:35,102::task::974::TaskManager.Task::(_decref) Task=`b7a1f89f-002d-4dc0-818e-afe07aaffb07`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:37,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:37,256::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346599 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:37,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:37,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334589 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:37,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:37,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000548553 s, 671 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:37,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:37,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000532574 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3559::DEBUG::2014-04-10 17:58:40,116::task::579::TaskManager.Task::(_updateState) Task=`43df4270-397b-40d4-970b-210ebe4c95f1`::moving from state init -> state preparing
>Thread-3559::INFO::2014-04-10 17:58:40,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3559::INFO::2014-04-10 17:58:40,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532574', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346599', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334589', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548553', 'lastCheck': '2.3', 'valid': True}}
>Thread-3559::DEBUG::2014-04-10 17:58:40,117::task::1168::TaskManager.Task::(prepare) Task=`43df4270-397b-40d4-970b-210ebe4c95f1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532574', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346599', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334589', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548553', 'lastCheck': '2.3', 'valid': True}}
>Thread-3559::DEBUG::2014-04-10 17:58:40,117::task::579::TaskManager.Task::(_updateState) Task=`43df4270-397b-40d4-970b-210ebe4c95f1`::moving from state preparing -> state finished
>Thread-3559::DEBUG::2014-04-10 17:58:40,117::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3559::DEBUG::2014-04-10 17:58:40,117::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3559::DEBUG::2014-04-10 17:58:40,117::task::974::TaskManager.Task::(_decref) Task=`43df4270-397b-40d4-970b-210ebe4c95f1`::ref 0 aborting False
>Thread-3562::DEBUG::2014-04-10 17:58:45,178::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3562::DEBUG::2014-04-10 17:58:45,178::task::579::TaskManager.Task::(_updateState) Task=`78b4eabd-b17e-4d17-b4cc-930d41959aca`::moving from state init -> state preparing
>Thread-3562::INFO::2014-04-10 17:58:45,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3562::INFO::2014-04-10 17:58:45,179::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3562::DEBUG::2014-04-10 17:58:45,179::task::1168::TaskManager.Task::(prepare) Task=`78b4eabd-b17e-4d17-b4cc-930d41959aca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3562::DEBUG::2014-04-10 17:58:45,179::task::579::TaskManager.Task::(_updateState) Task=`78b4eabd-b17e-4d17-b4cc-930d41959aca`::moving from state preparing -> state finished
>Thread-3562::DEBUG::2014-04-10 17:58:45,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3562::DEBUG::2014-04-10 17:58:45,179::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3562::DEBUG::2014-04-10 17:58:45,180::task::974::TaskManager.Task::(_decref) Task=`78b4eabd-b17e-4d17-b4cc-930d41959aca`::ref 0 aborting False
>Thread-3563::DEBUG::2014-04-10 17:58:45,186::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3563::DEBUG::2014-04-10 17:58:45,186::task::579::TaskManager.Task::(_updateState) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::moving from state init -> state preparing
>Thread-3563::INFO::2014-04-10 17:58:45,187::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3563::DEBUG::2014-04-10 17:58:45,187::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c6217b2-4c20-41f8-b324-2ff6b4f37f58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3563::DEBUG::2014-04-10 17:58:45,187::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3563::DEBUG::2014-04-10 17:58:45,187::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3563::DEBUG::2014-04-10 17:58:45,188::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c6217b2-4c20-41f8-b324-2ff6b4f37f58`::Granted request
>Thread-3563::DEBUG::2014-04-10 17:58:45,188::task::811::TaskManager.Task::(resourceAcquired) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3563::DEBUG::2014-04-10 17:58:45,188::task::974::TaskManager.Task::(_decref) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::ref 1 aborting False
>Thread-3563::INFO::2014-04-10 17:58:45,190::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3563::DEBUG::2014-04-10 17:58:45,190::task::1168::TaskManager.Task::(prepare) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3563::DEBUG::2014-04-10 17:58:45,190::task::579::TaskManager.Task::(_updateState) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::moving from state preparing -> state finished
>Thread-3563::DEBUG::2014-04-10 17:58:45,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3563::DEBUG::2014-04-10 17:58:45,191::task::974::TaskManager.Task::(_decref) Task=`40cc6fbd-9bc2-449d-8991-d2adbfd73d30`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:47,265::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:47,271::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027923 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:47,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:47,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380029 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:47,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:47,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000568962 s, 647 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:47,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:47,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000532652 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3567::DEBUG::2014-04-10 17:58:55,293::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-3567::DEBUG::2014-04-10 17:58:55,295::task::579::TaskManager.Task::(_updateState) Task=`a5938ccd-364f-4b23-8e49-25a20f84f4b5`::moving from state init -> state preparing
>Thread-3567::INFO::2014-04-10 17:58:55,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3567::INFO::2014-04-10 17:58:55,296::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3567::DEBUG::2014-04-10 17:58:55,296::task::1168::TaskManager.Task::(prepare) Task=`a5938ccd-364f-4b23-8e49-25a20f84f4b5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3567::DEBUG::2014-04-10 17:58:55,296::task::579::TaskManager.Task::(_updateState) Task=`a5938ccd-364f-4b23-8e49-25a20f84f4b5`::moving from state preparing -> state finished
>Thread-3567::DEBUG::2014-04-10 17:58:55,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3567::DEBUG::2014-04-10 17:58:55,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3567::DEBUG::2014-04-10 17:58:55,303::task::974::TaskManager.Task::(_decref) Task=`a5938ccd-364f-4b23-8e49-25a20f84f4b5`::ref 0 aborting False
>Thread-3568::DEBUG::2014-04-10 17:58:55,306::task::579::TaskManager.Task::(_updateState) Task=`1e8b6a96-79d9-4037-ac86-dd4b417f865a`::moving from state init -> state preparing
>Thread-3568::INFO::2014-04-10 17:58:55,308::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3568::INFO::2014-04-10 17:58:55,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532652', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027923', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380029', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568962', 'lastCheck': '7.5', 'valid': True}}
>Thread-3568::DEBUG::2014-04-10 17:58:55,310::task::1168::TaskManager.Task::(prepare) Task=`1e8b6a96-79d9-4037-ac86-dd4b417f865a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532652', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027923', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380029', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568962', 'lastCheck': '7.5', 'valid': True}}
>Thread-3568::DEBUG::2014-04-10 17:58:55,311::task::579::TaskManager.Task::(_updateState) Task=`1e8b6a96-79d9-4037-ac86-dd4b417f865a`::moving from state preparing -> state finished
>Thread-3568::DEBUG::2014-04-10 17:58:55,311::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3568::DEBUG::2014-04-10 17:58:55,311::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3568::DEBUG::2014-04-10 17:58:55,311::task::974::TaskManager.Task::(_decref) Task=`1e8b6a96-79d9-4037-ac86-dd4b417f865a`::ref 0 aborting False
>Thread-3569::DEBUG::2014-04-10 17:58:55,320::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-3569::DEBUG::2014-04-10 17:58:55,321::task::579::TaskManager.Task::(_updateState) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::moving from state init -> state preparing
>Thread-3569::INFO::2014-04-10 17:58:55,321::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3569::DEBUG::2014-04-10 17:58:55,322::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c71813d3-6a39-4644-ba4b-c4cce657db7d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3569::DEBUG::2014-04-10 17:58:55,322::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3569::DEBUG::2014-04-10 17:58:55,322::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3569::DEBUG::2014-04-10 17:58:55,322::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c71813d3-6a39-4644-ba4b-c4cce657db7d`::Granted request
>Thread-3569::DEBUG::2014-04-10 17:58:55,323::task::811::TaskManager.Task::(resourceAcquired) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3569::DEBUG::2014-04-10 17:58:55,323::task::974::TaskManager.Task::(_decref) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::ref 1 aborting False
>Thread-3569::INFO::2014-04-10 17:58:55,325::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3569::DEBUG::2014-04-10 17:58:55,325::task::1168::TaskManager.Task::(prepare) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3569::DEBUG::2014-04-10 17:58:55,325::task::579::TaskManager.Task::(_updateState) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::moving from state preparing -> state finished
>Thread-3569::DEBUG::2014-04-10 17:58:55,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3569::DEBUG::2014-04-10 17:58:55,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3569::DEBUG::2014-04-10 17:58:55,326::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3569::DEBUG::2014-04-10 17:58:55,326::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3569::DEBUG::2014-04-10 17:58:55,326::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3569::DEBUG::2014-04-10 17:58:55,327::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3569::DEBUG::2014-04-10 17:58:55,327::task::974::TaskManager.Task::(_decref) Task=`a9cd7b98-d94e-445a-a135-dad77799a65f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:58:57,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:58:57,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267542 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:58:57,458::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:58:57,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273727 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:58:57,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:58:57,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047496 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:58:57,974::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:58:57,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000439409 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3574::DEBUG::2014-04-10 17:59:05,435::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3574::DEBUG::2014-04-10 17:59:05,436::task::579::TaskManager.Task::(_updateState) Task=`9504d0ab-5ab2-45cb-850a-bf16c908e457`::moving from state init -> state preparing
>Thread-3574::INFO::2014-04-10 17:59:05,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3574::INFO::2014-04-10 17:59:05,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3574::DEBUG::2014-04-10 17:59:05,436::task::1168::TaskManager.Task::(prepare) Task=`9504d0ab-5ab2-45cb-850a-bf16c908e457`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3574::DEBUG::2014-04-10 17:59:05,437::task::579::TaskManager.Task::(_updateState) Task=`9504d0ab-5ab2-45cb-850a-bf16c908e457`::moving from state preparing -> state finished
>Thread-3574::DEBUG::2014-04-10 17:59:05,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3574::DEBUG::2014-04-10 17:59:05,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3574::DEBUG::2014-04-10 17:59:05,437::task::974::TaskManager.Task::(_decref) Task=`9504d0ab-5ab2-45cb-850a-bf16c908e457`::ref 0 aborting False
>Thread-3575::DEBUG::2014-04-10 17:59:05,444::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3575::DEBUG::2014-04-10 17:59:05,444::task::579::TaskManager.Task::(_updateState) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::moving from state init -> state preparing
>Thread-3575::INFO::2014-04-10 17:59:05,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3575::DEBUG::2014-04-10 17:59:05,445::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3db8230-2cb2-4716-a91a-7140779da10b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3575::DEBUG::2014-04-10 17:59:05,445::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3575::DEBUG::2014-04-10 17:59:05,446::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3575::DEBUG::2014-04-10 17:59:05,446::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c3db8230-2cb2-4716-a91a-7140779da10b`::Granted request
>Thread-3575::DEBUG::2014-04-10 17:59:05,446::task::811::TaskManager.Task::(resourceAcquired) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3575::DEBUG::2014-04-10 17:59:05,446::task::974::TaskManager.Task::(_decref) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::ref 1 aborting False
>Thread-3575::INFO::2014-04-10 17:59:05,449::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3575::DEBUG::2014-04-10 17:59:05,449::task::1168::TaskManager.Task::(prepare) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3575::DEBUG::2014-04-10 17:59:05,449::task::579::TaskManager.Task::(_updateState) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::moving from state preparing -> state finished
>Thread-3575::DEBUG::2014-04-10 17:59:05,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3575::DEBUG::2014-04-10 17:59:05,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3575::DEBUG::2014-04-10 17:59:05,450::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3575::DEBUG::2014-04-10 17:59:05,450::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3575::DEBUG::2014-04-10 17:59:05,450::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3575::DEBUG::2014-04-10 17:59:05,450::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3575::DEBUG::2014-04-10 17:59:05,450::task::974::TaskManager.Task::(_decref) Task=`a93cf683-8820-4d74-abcd-75efab8f4309`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:07,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:07,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373715 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:07,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:07,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349693 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:07,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:07,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000503906 s, 730 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:07,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:07,994::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000452003 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3577::DEBUG::2014-04-10 17:59:10,500::task::579::TaskManager.Task::(_updateState) Task=`d7ef240b-9d7e-44b0-8f6f-c104018defe9`::moving from state init -> state preparing
>Thread-3577::INFO::2014-04-10 17:59:10,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3577::INFO::2014-04-10 17:59:10,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452003', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373715', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349693', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503906', 'lastCheck': '2.6', 'valid': True}}
>Thread-3577::DEBUG::2014-04-10 17:59:10,502::task::1168::TaskManager.Task::(prepare) Task=`d7ef240b-9d7e-44b0-8f6f-c104018defe9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452003', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373715', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349693', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503906', 'lastCheck': '2.6', 'valid': True}}
>Thread-3577::DEBUG::2014-04-10 17:59:10,502::task::579::TaskManager.Task::(_updateState) Task=`d7ef240b-9d7e-44b0-8f6f-c104018defe9`::moving from state preparing -> state finished
>Thread-3577::DEBUG::2014-04-10 17:59:10,502::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3577::DEBUG::2014-04-10 17:59:10,502::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3577::DEBUG::2014-04-10 17:59:10,502::task::974::TaskManager.Task::(_decref) Task=`d7ef240b-9d7e-44b0-8f6f-c104018defe9`::ref 0 aborting False
>Thread-3580::DEBUG::2014-04-10 17:59:15,524::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3580::DEBUG::2014-04-10 17:59:15,530::task::579::TaskManager.Task::(_updateState) Task=`fea66d35-7bd0-4ddc-941e-944d5cd7006c`::moving from state init -> state preparing
>Thread-3580::INFO::2014-04-10 17:59:15,531::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3580::INFO::2014-04-10 17:59:15,531::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3580::DEBUG::2014-04-10 17:59:15,531::task::1168::TaskManager.Task::(prepare) Task=`fea66d35-7bd0-4ddc-941e-944d5cd7006c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3580::DEBUG::2014-04-10 17:59:15,531::task::579::TaskManager.Task::(_updateState) Task=`fea66d35-7bd0-4ddc-941e-944d5cd7006c`::moving from state preparing -> state finished
>Thread-3580::DEBUG::2014-04-10 17:59:15,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3580::DEBUG::2014-04-10 17:59:15,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3580::DEBUG::2014-04-10 17:59:15,532::task::974::TaskManager.Task::(_decref) Task=`fea66d35-7bd0-4ddc-941e-944d5cd7006c`::ref 0 aborting False
>Thread-3581::DEBUG::2014-04-10 17:59:15,538::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3581::DEBUG::2014-04-10 17:59:15,539::task::579::TaskManager.Task::(_updateState) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::moving from state init -> state preparing
>Thread-3581::INFO::2014-04-10 17:59:15,539::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3581::DEBUG::2014-04-10 17:59:15,539::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ecfd2629-7ea9-47a8-a14d-80624a3c4994`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3581::DEBUG::2014-04-10 17:59:15,540::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3581::DEBUG::2014-04-10 17:59:15,540::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3581::DEBUG::2014-04-10 17:59:15,540::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ecfd2629-7ea9-47a8-a14d-80624a3c4994`::Granted request
>Thread-3581::DEBUG::2014-04-10 17:59:15,541::task::811::TaskManager.Task::(resourceAcquired) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3581::DEBUG::2014-04-10 17:59:15,541::task::974::TaskManager.Task::(_decref) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::ref 1 aborting False
>Thread-3581::INFO::2014-04-10 17:59:15,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3581::DEBUG::2014-04-10 17:59:15,543::task::1168::TaskManager.Task::(prepare) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3581::DEBUG::2014-04-10 17:59:15,543::task::579::TaskManager.Task::(_updateState) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::moving from state preparing -> state finished
>Thread-3581::DEBUG::2014-04-10 17:59:15,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3581::DEBUG::2014-04-10 17:59:15,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3581::DEBUG::2014-04-10 17:59:15,544::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3581::DEBUG::2014-04-10 17:59:15,544::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3581::DEBUG::2014-04-10 17:59:15,544::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3581::DEBUG::2014-04-10 17:59:15,544::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3581::DEBUG::2014-04-10 17:59:15,545::task::974::TaskManager.Task::(_decref) Task=`12d1c68f-ea2f-4b26-ada3-d17296ee69f7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:17,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:17,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354928 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:17,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:17,500::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000262649 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:17,897::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:17,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000439279 s, 838 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:18,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:18,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000460785 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3585::DEBUG::2014-04-10 17:59:25,675::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3585::DEBUG::2014-04-10 17:59:25,675::task::579::TaskManager.Task::(_updateState) Task=`9ca589c7-ad76-4127-ac26-e9c44aba75fc`::moving from state init -> state preparing
>Thread-3585::INFO::2014-04-10 17:59:25,676::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3585::INFO::2014-04-10 17:59:25,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3585::DEBUG::2014-04-10 17:59:25,676::task::1168::TaskManager.Task::(prepare) Task=`9ca589c7-ad76-4127-ac26-e9c44aba75fc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3585::DEBUG::2014-04-10 17:59:25,676::task::579::TaskManager.Task::(_updateState) Task=`9ca589c7-ad76-4127-ac26-e9c44aba75fc`::moving from state preparing -> state finished
>Thread-3585::DEBUG::2014-04-10 17:59:25,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3585::DEBUG::2014-04-10 17:59:25,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3585::DEBUG::2014-04-10 17:59:25,677::task::974::TaskManager.Task::(_decref) Task=`9ca589c7-ad76-4127-ac26-e9c44aba75fc`::ref 0 aborting False
>Thread-3586::DEBUG::2014-04-10 17:59:25,684::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3586::DEBUG::2014-04-10 17:59:25,684::task::579::TaskManager.Task::(_updateState) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::moving from state init -> state preparing
>Thread-3586::INFO::2014-04-10 17:59:25,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3586::DEBUG::2014-04-10 17:59:25,685::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b0007bc8-27c8-408d-b2da-1921fb9793b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3586::DEBUG::2014-04-10 17:59:25,685::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3586::DEBUG::2014-04-10 17:59:25,685::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3586::DEBUG::2014-04-10 17:59:25,685::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b0007bc8-27c8-408d-b2da-1921fb9793b9`::Granted request
>Thread-3586::DEBUG::2014-04-10 17:59:25,686::task::811::TaskManager.Task::(resourceAcquired) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3586::DEBUG::2014-04-10 17:59:25,686::task::974::TaskManager.Task::(_decref) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::ref 1 aborting False
>Thread-3586::INFO::2014-04-10 17:59:25,688::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3586::DEBUG::2014-04-10 17:59:25,688::task::1168::TaskManager.Task::(prepare) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3586::DEBUG::2014-04-10 17:59:25,689::task::579::TaskManager.Task::(_updateState) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::moving from state preparing -> state finished
>Thread-3586::DEBUG::2014-04-10 17:59:25,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3586::DEBUG::2014-04-10 17:59:25,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3586::DEBUG::2014-04-10 17:59:25,689::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3586::DEBUG::2014-04-10 17:59:25,689::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3586::DEBUG::2014-04-10 17:59:25,690::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3586::DEBUG::2014-04-10 17:59:25,690::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3586::DEBUG::2014-04-10 17:59:25,690::task::974::TaskManager.Task::(_decref) Task=`706dbc19-8377-497b-91f3-22e2da86149c`::ref 0 aborting False
>Thread-3587::DEBUG::2014-04-10 17:59:25,717::task::579::TaskManager.Task::(_updateState) Task=`54b3c39c-8172-4762-b0dc-44519e3ff747`::moving from state init -> state preparing
>Thread-3587::INFO::2014-04-10 17:59:25,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3587::INFO::2014-04-10 17:59:25,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460785', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354928', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262649', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439279', 'lastCheck': '7.8', 'valid': True}}
>Thread-3587::DEBUG::2014-04-10 17:59:25,718::task::1168::TaskManager.Task::(prepare) Task=`54b3c39c-8172-4762-b0dc-44519e3ff747`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460785', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354928', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262649', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439279', 'lastCheck': '7.8', 'valid': True}}
>Thread-3587::DEBUG::2014-04-10 17:59:25,718::task::579::TaskManager.Task::(_updateState) Task=`54b3c39c-8172-4762-b0dc-44519e3ff747`::moving from state preparing -> state finished
>Thread-3587::DEBUG::2014-04-10 17:59:25,718::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3587::DEBUG::2014-04-10 17:59:25,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3587::DEBUG::2014-04-10 17:59:25,719::task::974::TaskManager.Task::(_decref) Task=`54b3c39c-8172-4762-b0dc-44519e3ff747`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:27,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:27,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284767 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:27,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:27,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331715 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:27,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:27,920::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000551573 s, 667 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:28,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:28,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000463438 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3592::DEBUG::2014-04-10 17:59:35,780::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3592::DEBUG::2014-04-10 17:59:35,781::task::579::TaskManager.Task::(_updateState) Task=`cb7283b9-1ea4-4c15-9c82-80745a993f60`::moving from state init -> state preparing
>Thread-3592::INFO::2014-04-10 17:59:35,781::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3592::INFO::2014-04-10 17:59:35,781::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3592::DEBUG::2014-04-10 17:59:35,781::task::1168::TaskManager.Task::(prepare) Task=`cb7283b9-1ea4-4c15-9c82-80745a993f60`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3592::DEBUG::2014-04-10 17:59:35,782::task::579::TaskManager.Task::(_updateState) Task=`cb7283b9-1ea4-4c15-9c82-80745a993f60`::moving from state preparing -> state finished
>Thread-3592::DEBUG::2014-04-10 17:59:35,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3592::DEBUG::2014-04-10 17:59:35,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3592::DEBUG::2014-04-10 17:59:35,782::task::974::TaskManager.Task::(_decref) Task=`cb7283b9-1ea4-4c15-9c82-80745a993f60`::ref 0 aborting False
>Thread-3593::DEBUG::2014-04-10 17:59:35,789::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3593::DEBUG::2014-04-10 17:59:35,789::task::579::TaskManager.Task::(_updateState) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::moving from state init -> state preparing
>Thread-3593::INFO::2014-04-10 17:59:35,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3593::DEBUG::2014-04-10 17:59:35,791::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b2fce1cc-f8a1-4557-abef-3b23c1164bb1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3593::DEBUG::2014-04-10 17:59:35,791::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3593::DEBUG::2014-04-10 17:59:35,791::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3593::DEBUG::2014-04-10 17:59:35,792::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b2fce1cc-f8a1-4557-abef-3b23c1164bb1`::Granted request
>Thread-3593::DEBUG::2014-04-10 17:59:35,792::task::811::TaskManager.Task::(resourceAcquired) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3593::DEBUG::2014-04-10 17:59:35,792::task::974::TaskManager.Task::(_decref) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::ref 1 aborting False
>Thread-3593::INFO::2014-04-10 17:59:35,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3593::DEBUG::2014-04-10 17:59:35,795::task::1168::TaskManager.Task::(prepare) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3593::DEBUG::2014-04-10 17:59:35,795::task::579::TaskManager.Task::(_updateState) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::moving from state preparing -> state finished
>Thread-3593::DEBUG::2014-04-10 17:59:35,795::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3593::DEBUG::2014-04-10 17:59:35,795::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3593::DEBUG::2014-04-10 17:59:35,795::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3593::DEBUG::2014-04-10 17:59:35,796::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3593::DEBUG::2014-04-10 17:59:35,796::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3593::DEBUG::2014-04-10 17:59:35,796::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3593::DEBUG::2014-04-10 17:59:35,796::task::974::TaskManager.Task::(_decref) Task=`fc137d68-3d1c-49bd-b697-96c084446896`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:37,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:37,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000378365 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:37,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:37,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391302 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:37,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:37,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486308 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:38,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:38,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000490626 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3595::DEBUG::2014-04-10 17:59:40,905::task::579::TaskManager.Task::(_updateState) Task=`69c6a633-4ff4-4232-b995-974d30a96fab`::moving from state init -> state preparing
>Thread-3595::INFO::2014-04-10 17:59:40,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3595::INFO::2014-04-10 17:59:40,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490626', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378365', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391302', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486308', 'lastCheck': '3.0', 'valid': True}}
>Thread-3595::DEBUG::2014-04-10 17:59:40,906::task::1168::TaskManager.Task::(prepare) Task=`69c6a633-4ff4-4232-b995-974d30a96fab`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490626', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378365', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391302', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486308', 'lastCheck': '3.0', 'valid': True}}
>Thread-3595::DEBUG::2014-04-10 17:59:40,906::task::579::TaskManager.Task::(_updateState) Task=`69c6a633-4ff4-4232-b995-974d30a96fab`::moving from state preparing -> state finished
>Thread-3595::DEBUG::2014-04-10 17:59:40,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3595::DEBUG::2014-04-10 17:59:40,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3595::DEBUG::2014-04-10 17:59:40,907::task::974::TaskManager.Task::(_decref) Task=`69c6a633-4ff4-4232-b995-974d30a96fab`::ref 0 aborting False
>Thread-3598::DEBUG::2014-04-10 17:59:45,878::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3598::DEBUG::2014-04-10 17:59:45,879::task::579::TaskManager.Task::(_updateState) Task=`de4f8afd-1752-4b24-b9fc-25cab86a42d5`::moving from state init -> state preparing
>Thread-3598::INFO::2014-04-10 17:59:45,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3598::INFO::2014-04-10 17:59:45,879::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3598::DEBUG::2014-04-10 17:59:45,879::task::1168::TaskManager.Task::(prepare) Task=`de4f8afd-1752-4b24-b9fc-25cab86a42d5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3598::DEBUG::2014-04-10 17:59:45,880::task::579::TaskManager.Task::(_updateState) Task=`de4f8afd-1752-4b24-b9fc-25cab86a42d5`::moving from state preparing -> state finished
>Thread-3598::DEBUG::2014-04-10 17:59:45,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3598::DEBUG::2014-04-10 17:59:45,880::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3598::DEBUG::2014-04-10 17:59:45,880::task::974::TaskManager.Task::(_decref) Task=`de4f8afd-1752-4b24-b9fc-25cab86a42d5`::ref 0 aborting False
>Thread-3599::DEBUG::2014-04-10 17:59:45,887::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3599::DEBUG::2014-04-10 17:59:45,888::task::579::TaskManager.Task::(_updateState) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::moving from state init -> state preparing
>Thread-3599::INFO::2014-04-10 17:59:45,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3599::DEBUG::2014-04-10 17:59:45,888::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c6bead5a-c972-45af-997b-6e34f3923982`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3599::DEBUG::2014-04-10 17:59:45,889::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3599::DEBUG::2014-04-10 17:59:45,889::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3599::DEBUG::2014-04-10 17:59:45,889::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c6bead5a-c972-45af-997b-6e34f3923982`::Granted request
>Thread-3599::DEBUG::2014-04-10 17:59:45,889::task::811::TaskManager.Task::(resourceAcquired) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3599::DEBUG::2014-04-10 17:59:45,890::task::974::TaskManager.Task::(_decref) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::ref 1 aborting False
>Thread-3599::INFO::2014-04-10 17:59:45,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3599::DEBUG::2014-04-10 17:59:45,892::task::1168::TaskManager.Task::(prepare) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3599::DEBUG::2014-04-10 17:59:45,892::task::579::TaskManager.Task::(_updateState) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::moving from state preparing -> state finished
>Thread-3599::DEBUG::2014-04-10 17:59:45,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3599::DEBUG::2014-04-10 17:59:45,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3599::DEBUG::2014-04-10 17:59:45,893::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3599::DEBUG::2014-04-10 17:59:45,893::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3599::DEBUG::2014-04-10 17:59:45,893::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3599::DEBUG::2014-04-10 17:59:45,893::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3599::DEBUG::2014-04-10 17:59:45,894::task::974::TaskManager.Task::(_decref) Task=`ca868896-e081-46ff-99aa-d287cafb1423`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:47,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:47,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269723 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:47,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:47,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348112 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:47,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:47,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047847 s, 769 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:48,050::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:48,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000407545 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3603::DEBUG::2014-04-10 17:59:56,045::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3603::DEBUG::2014-04-10 17:59:56,046::task::579::TaskManager.Task::(_updateState) Task=`44194bba-f73a-4149-9071-c849390d4b7f`::moving from state init -> state preparing
>Thread-3603::INFO::2014-04-10 17:59:56,046::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3603::INFO::2014-04-10 17:59:56,046::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3603::DEBUG::2014-04-10 17:59:56,047::task::1168::TaskManager.Task::(prepare) Task=`44194bba-f73a-4149-9071-c849390d4b7f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3603::DEBUG::2014-04-10 17:59:56,047::task::579::TaskManager.Task::(_updateState) Task=`44194bba-f73a-4149-9071-c849390d4b7f`::moving from state preparing -> state finished
>Thread-3603::DEBUG::2014-04-10 17:59:56,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3603::DEBUG::2014-04-10 17:59:56,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3603::DEBUG::2014-04-10 17:59:56,047::task::974::TaskManager.Task::(_decref) Task=`44194bba-f73a-4149-9071-c849390d4b7f`::ref 0 aborting False
>Thread-3604::DEBUG::2014-04-10 17:59:56,054::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3604::DEBUG::2014-04-10 17:59:56,055::task::579::TaskManager.Task::(_updateState) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::moving from state init -> state preparing
>Thread-3604::INFO::2014-04-10 17:59:56,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3604::DEBUG::2014-04-10 17:59:56,056::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d1ff15b-75f5-473e-bca1-ea9754692bdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3604::DEBUG::2014-04-10 17:59:56,056::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3604::DEBUG::2014-04-10 17:59:56,056::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3604::DEBUG::2014-04-10 17:59:56,056::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d1ff15b-75f5-473e-bca1-ea9754692bdb`::Granted request
>Thread-3604::DEBUG::2014-04-10 17:59:56,057::task::811::TaskManager.Task::(resourceAcquired) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3604::DEBUG::2014-04-10 17:59:56,057::task::974::TaskManager.Task::(_decref) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::ref 1 aborting False
>Thread-3604::INFO::2014-04-10 17:59:56,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3604::DEBUG::2014-04-10 17:59:56,059::task::1168::TaskManager.Task::(prepare) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3604::DEBUG::2014-04-10 17:59:56,059::task::579::TaskManager.Task::(_updateState) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::moving from state preparing -> state finished
>Thread-3604::DEBUG::2014-04-10 17:59:56,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3604::DEBUG::2014-04-10 17:59:56,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3604::DEBUG::2014-04-10 17:59:56,060::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3604::DEBUG::2014-04-10 17:59:56,060::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3604::DEBUG::2014-04-10 17:59:56,060::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3604::DEBUG::2014-04-10 17:59:56,061::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3604::DEBUG::2014-04-10 17:59:56,061::task::974::TaskManager.Task::(_decref) Task=`3a9e014f-c72f-4519-9f56-822adcb9c071`::ref 0 aborting False
>Thread-3605::DEBUG::2014-04-10 17:59:56,090::task::579::TaskManager.Task::(_updateState) Task=`cc1cc450-3c4f-42fa-b64a-5bd4c72507ac`::moving from state init -> state preparing
>Thread-3605::INFO::2014-04-10 17:59:56,090::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3605::INFO::2014-04-10 17:59:56,090::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407545', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269723', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348112', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047847', 'lastCheck': '8.1', 'valid': True}}
>Thread-3605::DEBUG::2014-04-10 17:59:56,090::task::1168::TaskManager.Task::(prepare) Task=`cc1cc450-3c4f-42fa-b64a-5bd4c72507ac`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407545', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269723', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348112', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047847', 'lastCheck': '8.1', 'valid': True}}
>Thread-3605::DEBUG::2014-04-10 17:59:56,091::task::579::TaskManager.Task::(_updateState) Task=`cc1cc450-3c4f-42fa-b64a-5bd4c72507ac`::moving from state preparing -> state finished
>Thread-3605::DEBUG::2014-04-10 17:59:56,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3605::DEBUG::2014-04-10 17:59:56,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3605::DEBUG::2014-04-10 17:59:56,091::task::974::TaskManager.Task::(_decref) Task=`cc1cc450-3c4f-42fa-b64a-5bd4c72507ac`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 17:59:57,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 17:59:57,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356636 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 17:59:57,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 17:59:57,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233414 s, 2.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 17:59:57,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 17:59:57,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000549762 s, 669 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 17:59:58,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 17:59:58,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000570504 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3610::DEBUG::2014-04-10 18:00:06,150::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3610::DEBUG::2014-04-10 18:00:06,150::task::579::TaskManager.Task::(_updateState) Task=`f1f00362-1e0d-4a88-97eb-2f2d4fe40d29`::moving from state init -> state preparing
>Thread-3610::INFO::2014-04-10 18:00:06,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3610::INFO::2014-04-10 18:00:06,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3610::DEBUG::2014-04-10 18:00:06,151::task::1168::TaskManager.Task::(prepare) Task=`f1f00362-1e0d-4a88-97eb-2f2d4fe40d29`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3610::DEBUG::2014-04-10 18:00:06,151::task::579::TaskManager.Task::(_updateState) Task=`f1f00362-1e0d-4a88-97eb-2f2d4fe40d29`::moving from state preparing -> state finished
>Thread-3610::DEBUG::2014-04-10 18:00:06,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3610::DEBUG::2014-04-10 18:00:06,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3610::DEBUG::2014-04-10 18:00:06,152::task::974::TaskManager.Task::(_decref) Task=`f1f00362-1e0d-4a88-97eb-2f2d4fe40d29`::ref 0 aborting False
>Thread-3611::DEBUG::2014-04-10 18:00:06,159::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3611::DEBUG::2014-04-10 18:00:06,159::task::579::TaskManager.Task::(_updateState) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::moving from state init -> state preparing
>Thread-3611::INFO::2014-04-10 18:00:06,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3611::DEBUG::2014-04-10 18:00:06,160::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b087f911-2b4c-4a09-9429-0a4445f7bcaf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3611::DEBUG::2014-04-10 18:00:06,160::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3611::DEBUG::2014-04-10 18:00:06,160::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3611::DEBUG::2014-04-10 18:00:06,160::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b087f911-2b4c-4a09-9429-0a4445f7bcaf`::Granted request
>Thread-3611::DEBUG::2014-04-10 18:00:06,161::task::811::TaskManager.Task::(resourceAcquired) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3611::DEBUG::2014-04-10 18:00:06,161::task::974::TaskManager.Task::(_decref) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::ref 1 aborting False
>Thread-3611::INFO::2014-04-10 18:00:06,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3611::DEBUG::2014-04-10 18:00:06,163::task::1168::TaskManager.Task::(prepare) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3611::DEBUG::2014-04-10 18:00:06,163::task::579::TaskManager.Task::(_updateState) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::moving from state preparing -> state finished
>Thread-3611::DEBUG::2014-04-10 18:00:06,163::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3611::DEBUG::2014-04-10 18:00:06,164::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3611::DEBUG::2014-04-10 18:00:06,164::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3611::DEBUG::2014-04-10 18:00:06,164::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3611::DEBUG::2014-04-10 18:00:06,164::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3611::DEBUG::2014-04-10 18:00:06,164::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3611::DEBUG::2014-04-10 18:00:06,165::task::974::TaskManager.Task::(_decref) Task=`b3c3daa1-03ea-4811-93a7-5d2f0cd513f6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:07,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:07,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272078 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:07,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:07,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358905 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:07,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:07,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485809 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:08,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:08,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000476692 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3613::DEBUG::2014-04-10 18:00:11,250::task::579::TaskManager.Task::(_updateState) Task=`a1a91f59-9fcb-4d03-9baa-e07a86238222`::moving from state init -> state preparing
>Thread-3613::INFO::2014-04-10 18:00:11,250::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3613::INFO::2014-04-10 18:00:11,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476692', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272078', 'lastCheck': '3.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358905', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485809', 'lastCheck': '3.3', 'valid': True}}
>Thread-3613::DEBUG::2014-04-10 18:00:11,251::task::1168::TaskManager.Task::(prepare) Task=`a1a91f59-9fcb-4d03-9baa-e07a86238222`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476692', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272078', 'lastCheck': '3.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358905', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485809', 'lastCheck': '3.3', 'valid': True}}
>Thread-3613::DEBUG::2014-04-10 18:00:11,251::task::579::TaskManager.Task::(_updateState) Task=`a1a91f59-9fcb-4d03-9baa-e07a86238222`::moving from state preparing -> state finished
>Thread-3613::DEBUG::2014-04-10 18:00:11,251::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3613::DEBUG::2014-04-10 18:00:11,251::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3613::DEBUG::2014-04-10 18:00:11,252::task::974::TaskManager.Task::(_decref) Task=`a1a91f59-9fcb-4d03-9baa-e07a86238222`::ref 0 aborting False
>Thread-3616::DEBUG::2014-04-10 18:00:16,257::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3616::DEBUG::2014-04-10 18:00:16,258::task::579::TaskManager.Task::(_updateState) Task=`5487f5f7-1337-4533-b146-464a16e9133a`::moving from state init -> state preparing
>Thread-3616::INFO::2014-04-10 18:00:16,258::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3616::INFO::2014-04-10 18:00:16,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3616::DEBUG::2014-04-10 18:00:16,259::task::1168::TaskManager.Task::(prepare) Task=`5487f5f7-1337-4533-b146-464a16e9133a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3616::DEBUG::2014-04-10 18:00:16,259::task::579::TaskManager.Task::(_updateState) Task=`5487f5f7-1337-4533-b146-464a16e9133a`::moving from state preparing -> state finished
>Thread-3616::DEBUG::2014-04-10 18:00:16,259::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3616::DEBUG::2014-04-10 18:00:16,259::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3616::DEBUG::2014-04-10 18:00:16,259::task::974::TaskManager.Task::(_decref) Task=`5487f5f7-1337-4533-b146-464a16e9133a`::ref 0 aborting False
>Thread-3617::DEBUG::2014-04-10 18:00:16,266::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3617::DEBUG::2014-04-10 18:00:16,267::task::579::TaskManager.Task::(_updateState) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::moving from state init -> state preparing
>Thread-3617::INFO::2014-04-10 18:00:16,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3617::DEBUG::2014-04-10 18:00:16,267::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`48d88ba2-28b5-4073-860b-7fe63cd99a2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3617::DEBUG::2014-04-10 18:00:16,268::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3617::DEBUG::2014-04-10 18:00:16,268::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3617::DEBUG::2014-04-10 18:00:16,268::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`48d88ba2-28b5-4073-860b-7fe63cd99a2f`::Granted request
>Thread-3617::DEBUG::2014-04-10 18:00:16,269::task::811::TaskManager.Task::(resourceAcquired) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3617::DEBUG::2014-04-10 18:00:16,270::task::974::TaskManager.Task::(_decref) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::ref 1 aborting False
>Thread-3617::INFO::2014-04-10 18:00:16,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3617::DEBUG::2014-04-10 18:00:16,272::task::1168::TaskManager.Task::(prepare) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3617::DEBUG::2014-04-10 18:00:16,272::task::579::TaskManager.Task::(_updateState) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::moving from state preparing -> state finished
>Thread-3617::DEBUG::2014-04-10 18:00:16,272::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3617::DEBUG::2014-04-10 18:00:16,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3617::DEBUG::2014-04-10 18:00:16,273::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3617::DEBUG::2014-04-10 18:00:16,273::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3617::DEBUG::2014-04-10 18:00:16,273::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3617::DEBUG::2014-04-10 18:00:16,273::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3617::DEBUG::2014-04-10 18:00:16,274::task::974::TaskManager.Task::(_decref) Task=`b2961ecf-de9a-4afb-9a7d-816a46679cfd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:17,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:17,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391662 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:17,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:17,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267136 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:17,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:17,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496883 s, 741 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:18,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:18,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477429 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3621::DEBUG::2014-04-10 18:00:26,390::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3621::DEBUG::2014-04-10 18:00:26,390::task::579::TaskManager.Task::(_updateState) Task=`5c0d52e4-0a85-495a-945a-4804d8a6d0db`::moving from state init -> state preparing
>Thread-3621::INFO::2014-04-10 18:00:26,391::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3621::INFO::2014-04-10 18:00:26,391::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3621::DEBUG::2014-04-10 18:00:26,391::task::1168::TaskManager.Task::(prepare) Task=`5c0d52e4-0a85-495a-945a-4804d8a6d0db`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3621::DEBUG::2014-04-10 18:00:26,391::task::579::TaskManager.Task::(_updateState) Task=`5c0d52e4-0a85-495a-945a-4804d8a6d0db`::moving from state preparing -> state finished
>Thread-3621::DEBUG::2014-04-10 18:00:26,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3621::DEBUG::2014-04-10 18:00:26,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3621::DEBUG::2014-04-10 18:00:26,392::task::974::TaskManager.Task::(_decref) Task=`5c0d52e4-0a85-495a-945a-4804d8a6d0db`::ref 0 aborting False
>Thread-3622::DEBUG::2014-04-10 18:00:26,399::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3622::DEBUG::2014-04-10 18:00:26,399::task::579::TaskManager.Task::(_updateState) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::moving from state init -> state preparing
>Thread-3622::INFO::2014-04-10 18:00:26,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3622::DEBUG::2014-04-10 18:00:26,400::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dd191509-055a-4ad2-a8cd-8c5640ab8e3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3622::DEBUG::2014-04-10 18:00:26,400::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3622::DEBUG::2014-04-10 18:00:26,400::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3622::DEBUG::2014-04-10 18:00:26,400::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dd191509-055a-4ad2-a8cd-8c5640ab8e3c`::Granted request
>Thread-3622::DEBUG::2014-04-10 18:00:26,401::task::811::TaskManager.Task::(resourceAcquired) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3622::DEBUG::2014-04-10 18:00:26,401::task::974::TaskManager.Task::(_decref) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::ref 1 aborting False
>Thread-3622::INFO::2014-04-10 18:00:26,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3622::DEBUG::2014-04-10 18:00:26,403::task::1168::TaskManager.Task::(prepare) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3622::DEBUG::2014-04-10 18:00:26,404::task::579::TaskManager.Task::(_updateState) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::moving from state preparing -> state finished
>Thread-3622::DEBUG::2014-04-10 18:00:26,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3622::DEBUG::2014-04-10 18:00:26,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3622::DEBUG::2014-04-10 18:00:26,404::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3622::DEBUG::2014-04-10 18:00:26,404::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3622::DEBUG::2014-04-10 18:00:26,405::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3622::DEBUG::2014-04-10 18:00:26,405::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3622::DEBUG::2014-04-10 18:00:26,405::task::974::TaskManager.Task::(_decref) Task=`4a71384d-d7e7-4eb4-8794-3684495a74d1`::ref 0 aborting False
>Thread-3623::DEBUG::2014-04-10 18:00:26,474::task::579::TaskManager.Task::(_updateState) Task=`77303d5f-8475-4022-8ff9-a8c3459458c0`::moving from state init -> state preparing
>Thread-3623::INFO::2014-04-10 18:00:26,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3623::INFO::2014-04-10 18:00:26,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477429', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391662', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267136', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496883', 'lastCheck': '8.5', 'valid': True}}
>Thread-3623::DEBUG::2014-04-10 18:00:26,475::task::1168::TaskManager.Task::(prepare) Task=`77303d5f-8475-4022-8ff9-a8c3459458c0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477429', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391662', 'lastCheck': '9.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267136', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496883', 'lastCheck': '8.5', 'valid': True}}
>Thread-3623::DEBUG::2014-04-10 18:00:26,475::task::579::TaskManager.Task::(_updateState) Task=`77303d5f-8475-4022-8ff9-a8c3459458c0`::moving from state preparing -> state finished
>Thread-3623::DEBUG::2014-04-10 18:00:26,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3623::DEBUG::2014-04-10 18:00:26,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3623::DEBUG::2014-04-10 18:00:26,475::task::974::TaskManager.Task::(_decref) Task=`77303d5f-8475-4022-8ff9-a8c3459458c0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:27,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:27,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000327308 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:27,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:27,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303141 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:28,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:28,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000392742 s, 937 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:28,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:28,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000456432 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3628::DEBUG::2014-04-10 18:00:36,494::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3628::DEBUG::2014-04-10 18:00:36,494::task::579::TaskManager.Task::(_updateState) Task=`fa1747db-8ffb-4cd0-ae6c-072d6acba855`::moving from state init -> state preparing
>Thread-3628::INFO::2014-04-10 18:00:36,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3628::INFO::2014-04-10 18:00:36,495::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3628::DEBUG::2014-04-10 18:00:36,495::task::1168::TaskManager.Task::(prepare) Task=`fa1747db-8ffb-4cd0-ae6c-072d6acba855`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3628::DEBUG::2014-04-10 18:00:36,495::task::579::TaskManager.Task::(_updateState) Task=`fa1747db-8ffb-4cd0-ae6c-072d6acba855`::moving from state preparing -> state finished
>Thread-3628::DEBUG::2014-04-10 18:00:36,495::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3628::DEBUG::2014-04-10 18:00:36,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3628::DEBUG::2014-04-10 18:00:36,496::task::974::TaskManager.Task::(_decref) Task=`fa1747db-8ffb-4cd0-ae6c-072d6acba855`::ref 0 aborting False
>Thread-3629::DEBUG::2014-04-10 18:00:36,503::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3629::DEBUG::2014-04-10 18:00:36,503::task::579::TaskManager.Task::(_updateState) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::moving from state init -> state preparing
>Thread-3629::INFO::2014-04-10 18:00:36,503::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3629::DEBUG::2014-04-10 18:00:36,504::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e51048c7-c317-4afa-b0e2-bcbf63efa755`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3629::DEBUG::2014-04-10 18:00:36,504::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3629::DEBUG::2014-04-10 18:00:36,504::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3629::DEBUG::2014-04-10 18:00:36,504::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e51048c7-c317-4afa-b0e2-bcbf63efa755`::Granted request
>Thread-3629::DEBUG::2014-04-10 18:00:36,505::task::811::TaskManager.Task::(resourceAcquired) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3629::DEBUG::2014-04-10 18:00:36,505::task::974::TaskManager.Task::(_decref) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::ref 1 aborting False
>Thread-3629::INFO::2014-04-10 18:00:36,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3629::DEBUG::2014-04-10 18:00:36,507::task::1168::TaskManager.Task::(prepare) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3629::DEBUG::2014-04-10 18:00:36,507::task::579::TaskManager.Task::(_updateState) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::moving from state preparing -> state finished
>Thread-3629::DEBUG::2014-04-10 18:00:36,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3629::DEBUG::2014-04-10 18:00:36,508::task::974::TaskManager.Task::(_decref) Task=`b07d8fa5-5fbe-4653-a9f5-14b12ead079f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:37,413::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:00:37,420::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:00:37,421::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:00:37,425::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:00:37,426::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:00:37,427::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:00:37,427::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:00:37,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:37,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248092 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:37,605::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:00:37,621::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:00:37,622::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:00:37,626::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:00:37,628::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:00:37,628::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:00:37,628::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:00:37,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:37,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254924 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:38,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:38,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000392899 s, 937 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:38,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:38,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000396946 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3639::DEBUG::2014-04-10 18:00:41,636::task::579::TaskManager.Task::(_updateState) Task=`9124d390-71a4-4648-91a0-cf9aa78d45d2`::moving from state init -> state preparing
>Thread-3639::INFO::2014-04-10 18:00:41,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3639::INFO::2014-04-10 18:00:41,637::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396946', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248092', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254924', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392899', 'lastCheck': '3.6', 'valid': True}}
>Thread-3639::DEBUG::2014-04-10 18:00:41,637::task::1168::TaskManager.Task::(prepare) Task=`9124d390-71a4-4648-91a0-cf9aa78d45d2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396946', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248092', 'lastCheck': '4.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254924', 'lastCheck': '4.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392899', 'lastCheck': '3.6', 'valid': True}}
>Thread-3639::DEBUG::2014-04-10 18:00:41,637::task::579::TaskManager.Task::(_updateState) Task=`9124d390-71a4-4648-91a0-cf9aa78d45d2`::moving from state preparing -> state finished
>Thread-3639::DEBUG::2014-04-10 18:00:41,637::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3639::DEBUG::2014-04-10 18:00:41,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3639::DEBUG::2014-04-10 18:00:41,638::task::974::TaskManager.Task::(_decref) Task=`9124d390-71a4-4648-91a0-cf9aa78d45d2`::ref 0 aborting False
>Thread-3642::DEBUG::2014-04-10 18:00:46,603::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3642::DEBUG::2014-04-10 18:00:46,603::task::579::TaskManager.Task::(_updateState) Task=`7c832952-da96-4e0b-959d-b8d12a8a7593`::moving from state init -> state preparing
>Thread-3642::INFO::2014-04-10 18:00:46,604::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3642::INFO::2014-04-10 18:00:46,604::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3642::DEBUG::2014-04-10 18:00:46,604::task::1168::TaskManager.Task::(prepare) Task=`7c832952-da96-4e0b-959d-b8d12a8a7593`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3642::DEBUG::2014-04-10 18:00:46,604::task::579::TaskManager.Task::(_updateState) Task=`7c832952-da96-4e0b-959d-b8d12a8a7593`::moving from state preparing -> state finished
>Thread-3642::DEBUG::2014-04-10 18:00:46,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3642::DEBUG::2014-04-10 18:00:46,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3642::DEBUG::2014-04-10 18:00:46,605::task::974::TaskManager.Task::(_decref) Task=`7c832952-da96-4e0b-959d-b8d12a8a7593`::ref 0 aborting False
>Thread-3643::DEBUG::2014-04-10 18:00:46,612::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3643::DEBUG::2014-04-10 18:00:46,612::task::579::TaskManager.Task::(_updateState) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::moving from state init -> state preparing
>Thread-3643::INFO::2014-04-10 18:00:46,612::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3643::DEBUG::2014-04-10 18:00:46,613::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b907c609-3ada-46d8-840a-195d9411eead`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3643::DEBUG::2014-04-10 18:00:46,613::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3643::DEBUG::2014-04-10 18:00:46,613::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3643::DEBUG::2014-04-10 18:00:46,613::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b907c609-3ada-46d8-840a-195d9411eead`::Granted request
>Thread-3643::DEBUG::2014-04-10 18:00:46,614::task::811::TaskManager.Task::(resourceAcquired) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3643::DEBUG::2014-04-10 18:00:46,614::task::974::TaskManager.Task::(_decref) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::ref 1 aborting False
>Thread-3643::INFO::2014-04-10 18:00:46,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3643::DEBUG::2014-04-10 18:00:46,617::task::1168::TaskManager.Task::(prepare) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3643::DEBUG::2014-04-10 18:00:46,617::task::579::TaskManager.Task::(_updateState) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::moving from state preparing -> state finished
>Thread-3643::DEBUG::2014-04-10 18:00:46,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3643::DEBUG::2014-04-10 18:00:46,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3643::DEBUG::2014-04-10 18:00:46,618::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3643::DEBUG::2014-04-10 18:00:46,618::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3643::DEBUG::2014-04-10 18:00:46,618::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3643::DEBUG::2014-04-10 18:00:46,618::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3643::DEBUG::2014-04-10 18:00:46,618::task::974::TaskManager.Task::(_decref) Task=`7f33a330-0596-44f2-b79f-c93e34a8d547`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:47,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:47,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278189 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:47,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:47,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000262234 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:48,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:48,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047819 s, 770 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:48,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:48,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000365561 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3647::DEBUG::2014-04-10 18:00:56,694::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3647::DEBUG::2014-04-10 18:00:56,695::task::579::TaskManager.Task::(_updateState) Task=`1d67fbd2-e050-4833-8438-10a779f02543`::moving from state init -> state preparing
>Thread-3647::INFO::2014-04-10 18:00:56,695::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3647::INFO::2014-04-10 18:00:56,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3647::DEBUG::2014-04-10 18:00:56,695::task::1168::TaskManager.Task::(prepare) Task=`1d67fbd2-e050-4833-8438-10a779f02543`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3647::DEBUG::2014-04-10 18:00:56,696::task::579::TaskManager.Task::(_updateState) Task=`1d67fbd2-e050-4833-8438-10a779f02543`::moving from state preparing -> state finished
>Thread-3647::DEBUG::2014-04-10 18:00:56,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3647::DEBUG::2014-04-10 18:00:56,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3647::DEBUG::2014-04-10 18:00:56,696::task::974::TaskManager.Task::(_decref) Task=`1d67fbd2-e050-4833-8438-10a779f02543`::ref 0 aborting False
>Thread-3648::DEBUG::2014-04-10 18:00:56,703::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3648::DEBUG::2014-04-10 18:00:56,703::task::579::TaskManager.Task::(_updateState) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::moving from state init -> state preparing
>Thread-3648::INFO::2014-04-10 18:00:56,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3648::DEBUG::2014-04-10 18:00:56,704::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a82d0111-3808-4fba-b038-8efbc21f699c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3648::DEBUG::2014-04-10 18:00:56,704::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3648::DEBUG::2014-04-10 18:00:56,704::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3648::DEBUG::2014-04-10 18:00:56,704::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a82d0111-3808-4fba-b038-8efbc21f699c`::Granted request
>Thread-3648::DEBUG::2014-04-10 18:00:56,706::task::811::TaskManager.Task::(resourceAcquired) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3648::DEBUG::2014-04-10 18:00:56,706::task::974::TaskManager.Task::(_decref) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::ref 1 aborting False
>Thread-3648::INFO::2014-04-10 18:00:56,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3648::DEBUG::2014-04-10 18:00:56,708::task::1168::TaskManager.Task::(prepare) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::task::579::TaskManager.Task::(_updateState) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::moving from state preparing -> state finished
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3648::DEBUG::2014-04-10 18:00:56,709::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3648::DEBUG::2014-04-10 18:00:56,710::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3648::DEBUG::2014-04-10 18:00:56,710::task::974::TaskManager.Task::(_decref) Task=`bdfb1870-d705-4363-98f6-0b06071ace5c`::ref 0 aborting False
>Thread-3649::DEBUG::2014-04-10 18:00:56,803::task::579::TaskManager.Task::(_updateState) Task=`86eca70c-455d-4f6c-a871-c503a2c753a3`::moving from state init -> state preparing
>Thread-3649::INFO::2014-04-10 18:00:56,804::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3649::INFO::2014-04-10 18:00:56,804::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365561', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278189', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262234', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047819', 'lastCheck': '8.8', 'valid': True}}
>Thread-3649::DEBUG::2014-04-10 18:00:56,804::task::1168::TaskManager.Task::(prepare) Task=`86eca70c-455d-4f6c-a871-c503a2c753a3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365561', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278189', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262234', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047819', 'lastCheck': '8.8', 'valid': True}}
>Thread-3649::DEBUG::2014-04-10 18:00:56,804::task::579::TaskManager.Task::(_updateState) Task=`86eca70c-455d-4f6c-a871-c503a2c753a3`::moving from state preparing -> state finished
>Thread-3649::DEBUG::2014-04-10 18:00:56,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3649::DEBUG::2014-04-10 18:00:56,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3649::DEBUG::2014-04-10 18:00:56,805::task::974::TaskManager.Task::(_decref) Task=`86eca70c-455d-4f6c-a871-c503a2c753a3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:00:57,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:00:57,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365918 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:00:57,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:00:57,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000419657 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:00:58,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:00:58,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000394953 s, 932 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:00:58,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:00:58,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000407931 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3654::DEBUG::2014-04-10 18:01:06,791::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3654::DEBUG::2014-04-10 18:01:06,791::task::579::TaskManager.Task::(_updateState) Task=`dfa4fa3e-6796-41ce-a830-beeaa9f8ece4`::moving from state init -> state preparing
>Thread-3654::INFO::2014-04-10 18:01:06,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3654::INFO::2014-04-10 18:01:06,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3654::DEBUG::2014-04-10 18:01:06,792::task::1168::TaskManager.Task::(prepare) Task=`dfa4fa3e-6796-41ce-a830-beeaa9f8ece4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3654::DEBUG::2014-04-10 18:01:06,792::task::579::TaskManager.Task::(_updateState) Task=`dfa4fa3e-6796-41ce-a830-beeaa9f8ece4`::moving from state preparing -> state finished
>Thread-3654::DEBUG::2014-04-10 18:01:06,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3654::DEBUG::2014-04-10 18:01:06,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3654::DEBUG::2014-04-10 18:01:06,793::task::974::TaskManager.Task::(_decref) Task=`dfa4fa3e-6796-41ce-a830-beeaa9f8ece4`::ref 0 aborting False
>Thread-3655::DEBUG::2014-04-10 18:01:06,800::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3655::DEBUG::2014-04-10 18:01:06,800::task::579::TaskManager.Task::(_updateState) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::moving from state init -> state preparing
>Thread-3655::INFO::2014-04-10 18:01:06,801::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3655::DEBUG::2014-04-10 18:01:06,801::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7b583f8-4e8a-4361-bb4e-f2cfddfeca74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3655::DEBUG::2014-04-10 18:01:06,801::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3655::DEBUG::2014-04-10 18:01:06,802::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3655::DEBUG::2014-04-10 18:01:06,802::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7b583f8-4e8a-4361-bb4e-f2cfddfeca74`::Granted request
>Thread-3655::DEBUG::2014-04-10 18:01:06,802::task::811::TaskManager.Task::(resourceAcquired) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3655::DEBUG::2014-04-10 18:01:06,802::task::974::TaskManager.Task::(_decref) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::ref 1 aborting False
>Thread-3655::INFO::2014-04-10 18:01:06,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3655::DEBUG::2014-04-10 18:01:06,805::task::1168::TaskManager.Task::(prepare) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3655::DEBUG::2014-04-10 18:01:06,805::task::579::TaskManager.Task::(_updateState) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::moving from state preparing -> state finished
>Thread-3655::DEBUG::2014-04-10 18:01:06,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3655::DEBUG::2014-04-10 18:01:06,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3655::DEBUG::2014-04-10 18:01:06,806::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3655::DEBUG::2014-04-10 18:01:06,806::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3655::DEBUG::2014-04-10 18:01:06,806::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3655::DEBUG::2014-04-10 18:01:06,806::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3655::DEBUG::2014-04-10 18:01:06,806::task::974::TaskManager.Task::(_decref) Task=`b9883eb2-353f-44c1-87d8-df5ee505351b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:01:07,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:07,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044121 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:01:07,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:07,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273263 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:08,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:08,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000399876 s, 920 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:01:08,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:08,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000509925 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3657::DEBUG::2014-04-10 18:01:12,194::task::579::TaskManager.Task::(_updateState) Task=`5e6910ff-40c2-417e-86a3-71544767d7a6`::moving from state init -> state preparing
>Thread-3657::INFO::2014-04-10 18:01:12,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3657::INFO::2014-04-10 18:01:12,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509925', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044121', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273263', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399876', 'lastCheck': '4.1', 'valid': True}}
>Thread-3657::DEBUG::2014-04-10 18:01:12,194::task::1168::TaskManager.Task::(prepare) Task=`5e6910ff-40c2-417e-86a3-71544767d7a6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509925', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044121', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273263', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399876', 'lastCheck': '4.1', 'valid': True}}
>Thread-3657::DEBUG::2014-04-10 18:01:12,195::task::579::TaskManager.Task::(_updateState) Task=`5e6910ff-40c2-417e-86a3-71544767d7a6`::moving from state preparing -> state finished
>Thread-3657::DEBUG::2014-04-10 18:01:12,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3657::DEBUG::2014-04-10 18:01:12,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3657::DEBUG::2014-04-10 18:01:12,195::task::974::TaskManager.Task::(_decref) Task=`5e6910ff-40c2-417e-86a3-71544767d7a6`::ref 0 aborting False
>Thread-3660::DEBUG::2014-04-10 18:01:16,906::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3660::DEBUG::2014-04-10 18:01:16,907::task::579::TaskManager.Task::(_updateState) Task=`febb0ad2-5cb0-41d0-8c2d-86cd47419712`::moving from state init -> state preparing
>Thread-3660::INFO::2014-04-10 18:01:16,907::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3660::INFO::2014-04-10 18:01:16,908::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3660::DEBUG::2014-04-10 18:01:16,908::task::1168::TaskManager.Task::(prepare) Task=`febb0ad2-5cb0-41d0-8c2d-86cd47419712`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3660::DEBUG::2014-04-10 18:01:16,908::task::579::TaskManager.Task::(_updateState) Task=`febb0ad2-5cb0-41d0-8c2d-86cd47419712`::moving from state preparing -> state finished
>Thread-3660::DEBUG::2014-04-10 18:01:16,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3660::DEBUG::2014-04-10 18:01:16,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3660::DEBUG::2014-04-10 18:01:16,909::task::974::TaskManager.Task::(_decref) Task=`febb0ad2-5cb0-41d0-8c2d-86cd47419712`::ref 0 aborting False
>Thread-3661::DEBUG::2014-04-10 18:01:16,915::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3661::DEBUG::2014-04-10 18:01:16,916::task::579::TaskManager.Task::(_updateState) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::moving from state init -> state preparing
>Thread-3661::INFO::2014-04-10 18:01:16,916::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3661::DEBUG::2014-04-10 18:01:16,916::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2626ddbe-05c8-44b5-bb6d-b43a7a938877`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3661::DEBUG::2014-04-10 18:01:16,917::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3661::DEBUG::2014-04-10 18:01:16,917::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3661::DEBUG::2014-04-10 18:01:16,917::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2626ddbe-05c8-44b5-bb6d-b43a7a938877`::Granted request
>Thread-3661::DEBUG::2014-04-10 18:01:16,917::task::811::TaskManager.Task::(resourceAcquired) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3661::DEBUG::2014-04-10 18:01:16,918::task::974::TaskManager.Task::(_decref) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::ref 1 aborting False
>Thread-3661::INFO::2014-04-10 18:01:16,920::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3661::DEBUG::2014-04-10 18:01:16,920::task::1168::TaskManager.Task::(prepare) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3661::DEBUG::2014-04-10 18:01:16,920::task::579::TaskManager.Task::(_updateState) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::moving from state preparing -> state finished
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3661::DEBUG::2014-04-10 18:01:16,921::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3661::DEBUG::2014-04-10 18:01:16,922::task::974::TaskManager.Task::(_decref) Task=`2d3a261d-d423-4830-8743-b243d2b3e535`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:01:17,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:17,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377532 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:01:17,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:17,693::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331995 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:18,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:18,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431905 s, 852 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:01:18,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:18,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00035483 s, 1.9 MB/s\n'; <rc> = 0
>Thread-3665::DEBUG::2014-04-10 18:01:26,997::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-3665::DEBUG::2014-04-10 18:01:26,998::task::579::TaskManager.Task::(_updateState) Task=`1e7f8c79-f7a4-40f3-aef7-c16d2d191d32`::moving from state init -> state preparing
>Thread-3665::INFO::2014-04-10 18:01:26,998::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3665::INFO::2014-04-10 18:01:26,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3665::DEBUG::2014-04-10 18:01:26,999::task::1168::TaskManager.Task::(prepare) Task=`1e7f8c79-f7a4-40f3-aef7-c16d2d191d32`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3665::DEBUG::2014-04-10 18:01:26,999::task::579::TaskManager.Task::(_updateState) Task=`1e7f8c79-f7a4-40f3-aef7-c16d2d191d32`::moving from state preparing -> state finished
>Thread-3665::DEBUG::2014-04-10 18:01:26,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3665::DEBUG::2014-04-10 18:01:26,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3665::DEBUG::2014-04-10 18:01:26,999::task::974::TaskManager.Task::(_decref) Task=`1e7f8c79-f7a4-40f3-aef7-c16d2d191d32`::ref 0 aborting False
>Thread-3666::DEBUG::2014-04-10 18:01:27,006::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-3666::DEBUG::2014-04-10 18:01:27,006::task::579::TaskManager.Task::(_updateState) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::moving from state init -> state preparing
>Thread-3666::INFO::2014-04-10 18:01:27,006::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3666::DEBUG::2014-04-10 18:01:27,007::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a5c7d552-cc87-4c35-89a5-b698eb911623`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3666::DEBUG::2014-04-10 18:01:27,007::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3666::DEBUG::2014-04-10 18:01:27,007::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3666::DEBUG::2014-04-10 18:01:27,007::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a5c7d552-cc87-4c35-89a5-b698eb911623`::Granted request
>Thread-3666::DEBUG::2014-04-10 18:01:27,008::task::811::TaskManager.Task::(resourceAcquired) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3666::DEBUG::2014-04-10 18:01:27,008::task::974::TaskManager.Task::(_decref) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::ref 1 aborting False
>Thread-3666::INFO::2014-04-10 18:01:27,010::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3666::DEBUG::2014-04-10 18:01:27,010::task::1168::TaskManager.Task::(prepare) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3666::DEBUG::2014-04-10 18:01:27,010::task::579::TaskManager.Task::(_updateState) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::moving from state preparing -> state finished
>Thread-3666::DEBUG::2014-04-10 18:01:27,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3666::DEBUG::2014-04-10 18:01:27,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3666::DEBUG::2014-04-10 18:01:27,011::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3666::DEBUG::2014-04-10 18:01:27,011::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3666::DEBUG::2014-04-10 18:01:27,011::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3666::DEBUG::2014-04-10 18:01:27,011::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3666::DEBUG::2014-04-10 18:01:27,011::task::974::TaskManager.Task::(_decref) Task=`92cd454c-be4d-46cf-bc32-3fdc99a88ff7`::ref 0 aborting False
>Thread-3667::DEBUG::2014-04-10 18:01:27,374::task::579::TaskManager.Task::(_updateState) Task=`f751a865-c9bc-4247-99fb-4f48abf02280`::moving from state init -> state preparing
>Thread-3667::INFO::2014-04-10 18:01:27,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3667::INFO::2014-04-10 18:01:27,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035483', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377532', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331995', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431905', 'lastCheck': '9.3', 'valid': True}}
>Thread-3667::DEBUG::2014-04-10 18:01:27,375::task::1168::TaskManager.Task::(prepare) Task=`f751a865-c9bc-4247-99fb-4f48abf02280`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035483', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377532', 'lastCheck': '9.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331995', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431905', 'lastCheck': '9.3', 'valid': True}}
>Thread-3667::DEBUG::2014-04-10 18:01:27,375::task::579::TaskManager.Task::(_updateState) Task=`f751a865-c9bc-4247-99fb-4f48abf02280`::moving from state preparing -> state finished
>Thread-3667::DEBUG::2014-04-10 18:01:27,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3667::DEBUG::2014-04-10 18:01:27,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3667::DEBUG::2014-04-10 18:01:27,375::task::974::TaskManager.Task::(_decref) Task=`f751a865-c9bc-4247-99fb-4f48abf02280`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:01:27,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:27,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261528 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:01:27,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:27,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000220914 s, 3.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:28,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:28,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000549393 s, 670 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:01:28,195::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:28,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445744 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3672::DEBUG::2014-04-10 18:01:37,094::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3672::DEBUG::2014-04-10 18:01:37,094::task::579::TaskManager.Task::(_updateState) Task=`4275a5fb-46f6-4c4c-b99f-264211fea1de`::moving from state init -> state preparing
>Thread-3672::INFO::2014-04-10 18:01:37,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3672::INFO::2014-04-10 18:01:37,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3672::DEBUG::2014-04-10 18:01:37,095::task::1168::TaskManager.Task::(prepare) Task=`4275a5fb-46f6-4c4c-b99f-264211fea1de`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3672::DEBUG::2014-04-10 18:01:37,095::task::579::TaskManager.Task::(_updateState) Task=`4275a5fb-46f6-4c4c-b99f-264211fea1de`::moving from state preparing -> state finished
>Thread-3672::DEBUG::2014-04-10 18:01:37,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3672::DEBUG::2014-04-10 18:01:37,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3672::DEBUG::2014-04-10 18:01:37,096::task::974::TaskManager.Task::(_decref) Task=`4275a5fb-46f6-4c4c-b99f-264211fea1de`::ref 0 aborting False
>Thread-3673::DEBUG::2014-04-10 18:01:37,101::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3673::DEBUG::2014-04-10 18:01:37,102::task::579::TaskManager.Task::(_updateState) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::moving from state init -> state preparing
>Thread-3673::INFO::2014-04-10 18:01:37,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3673::DEBUG::2014-04-10 18:01:37,102::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3c49529d-39bd-460f-ad5f-4e1179f96e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3673::DEBUG::2014-04-10 18:01:37,102::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3673::DEBUG::2014-04-10 18:01:37,104::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3673::DEBUG::2014-04-10 18:01:37,104::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3c49529d-39bd-460f-ad5f-4e1179f96e1b`::Granted request
>Thread-3673::DEBUG::2014-04-10 18:01:37,104::task::811::TaskManager.Task::(resourceAcquired) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3673::DEBUG::2014-04-10 18:01:37,104::task::974::TaskManager.Task::(_decref) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::ref 1 aborting False
>Thread-3673::INFO::2014-04-10 18:01:37,107::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3673::DEBUG::2014-04-10 18:01:37,107::task::1168::TaskManager.Task::(prepare) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3673::DEBUG::2014-04-10 18:01:37,107::task::579::TaskManager.Task::(_updateState) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::moving from state preparing -> state finished
>Thread-3673::DEBUG::2014-04-10 18:01:37,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3673::DEBUG::2014-04-10 18:01:37,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3673::DEBUG::2014-04-10 18:01:37,108::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3673::DEBUG::2014-04-10 18:01:37,108::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3673::DEBUG::2014-04-10 18:01:37,108::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3673::DEBUG::2014-04-10 18:01:37,108::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3673::DEBUG::2014-04-10 18:01:37,108::task::974::TaskManager.Task::(_decref) Task=`812ca544-fbbb-447c-8cb7-6a4e3be96e36`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:01:37,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:37,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398777 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:01:37,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:37,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339657 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:38,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:38,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000376541 s, 977 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:01:38,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:38,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000356405 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3675::DEBUG::2014-04-10 18:01:42,538::task::579::TaskManager.Task::(_updateState) Task=`77296240-ece1-4127-87da-b10cb7468c64`::moving from state init -> state preparing
>Thread-3675::INFO::2014-04-10 18:01:42,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3675::INFO::2014-04-10 18:01:42,539::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356405', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398777', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339657', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376541', 'lastCheck': '4.4', 'valid': True}}
>Thread-3675::DEBUG::2014-04-10 18:01:42,539::task::1168::TaskManager.Task::(prepare) Task=`77296240-ece1-4127-87da-b10cb7468c64`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356405', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398777', 'lastCheck': '5.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339657', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376541', 'lastCheck': '4.4', 'valid': True}}
>Thread-3675::DEBUG::2014-04-10 18:01:42,539::task::579::TaskManager.Task::(_updateState) Task=`77296240-ece1-4127-87da-b10cb7468c64`::moving from state preparing -> state finished
>Thread-3675::DEBUG::2014-04-10 18:01:42,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3675::DEBUG::2014-04-10 18:01:42,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3675::DEBUG::2014-04-10 18:01:42,539::task::974::TaskManager.Task::(_decref) Task=`77296240-ece1-4127-87da-b10cb7468c64`::ref 0 aborting False
>Thread-3678::DEBUG::2014-04-10 18:01:47,185::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3678::DEBUG::2014-04-10 18:01:47,186::task::579::TaskManager.Task::(_updateState) Task=`b2791287-1f0e-4370-95d0-7b326ae0453a`::moving from state init -> state preparing
>Thread-3678::INFO::2014-04-10 18:01:47,186::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3678::INFO::2014-04-10 18:01:47,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3678::DEBUG::2014-04-10 18:01:47,187::task::1168::TaskManager.Task::(prepare) Task=`b2791287-1f0e-4370-95d0-7b326ae0453a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3678::DEBUG::2014-04-10 18:01:47,187::task::579::TaskManager.Task::(_updateState) Task=`b2791287-1f0e-4370-95d0-7b326ae0453a`::moving from state preparing -> state finished
>Thread-3678::DEBUG::2014-04-10 18:01:47,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3678::DEBUG::2014-04-10 18:01:47,187::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3678::DEBUG::2014-04-10 18:01:47,187::task::974::TaskManager.Task::(_decref) Task=`b2791287-1f0e-4370-95d0-7b326ae0453a`::ref 0 aborting False
>Thread-3679::DEBUG::2014-04-10 18:01:47,194::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3679::DEBUG::2014-04-10 18:01:47,194::task::579::TaskManager.Task::(_updateState) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::moving from state init -> state preparing
>Thread-3679::INFO::2014-04-10 18:01:47,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3679::DEBUG::2014-04-10 18:01:47,195::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25739dea-20b8-4389-8ae4-fa7d06e0c0fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3679::DEBUG::2014-04-10 18:01:47,195::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3679::DEBUG::2014-04-10 18:01:47,195::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3679::DEBUG::2014-04-10 18:01:47,196::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25739dea-20b8-4389-8ae4-fa7d06e0c0fd`::Granted request
>Thread-3679::DEBUG::2014-04-10 18:01:47,196::task::811::TaskManager.Task::(resourceAcquired) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3679::DEBUG::2014-04-10 18:01:47,196::task::974::TaskManager.Task::(_decref) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::ref 1 aborting False
>Thread-3679::INFO::2014-04-10 18:01:47,199::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3679::DEBUG::2014-04-10 18:01:47,199::task::1168::TaskManager.Task::(prepare) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3679::DEBUG::2014-04-10 18:01:47,199::task::579::TaskManager.Task::(_updateState) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::moving from state preparing -> state finished
>Thread-3679::DEBUG::2014-04-10 18:01:47,199::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3679::DEBUG::2014-04-10 18:01:47,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3679::DEBUG::2014-04-10 18:01:47,200::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3679::DEBUG::2014-04-10 18:01:47,200::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3679::DEBUG::2014-04-10 18:01:47,200::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3679::DEBUG::2014-04-10 18:01:47,200::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3679::DEBUG::2014-04-10 18:01:47,201::task::974::TaskManager.Task::(_decref) Task=`eb808450-51bd-4ca3-a5d3-7599f4bb3ab3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:01:47,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:47,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000322916 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:01:47,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:47,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252894 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:48,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:48,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000443856 s, 829 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:01:48,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:48,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000400015 s, 1.6 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:01:57,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:01:57,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000445877 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3683::DEBUG::2014-04-10 18:01:57,588::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3683::DEBUG::2014-04-10 18:01:57,596::task::579::TaskManager.Task::(_updateState) Task=`770a1d60-48ea-4845-90d8-fe0b979241be`::moving from state init -> state preparing
>Thread-3683::INFO::2014-04-10 18:01:57,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3683::INFO::2014-04-10 18:01:57,596::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3683::DEBUG::2014-04-10 18:01:57,597::task::1168::TaskManager.Task::(prepare) Task=`770a1d60-48ea-4845-90d8-fe0b979241be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3683::DEBUG::2014-04-10 18:01:57,597::task::579::TaskManager.Task::(_updateState) Task=`770a1d60-48ea-4845-90d8-fe0b979241be`::moving from state preparing -> state finished
>Thread-3683::DEBUG::2014-04-10 18:01:57,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3683::DEBUG::2014-04-10 18:01:57,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3683::DEBUG::2014-04-10 18:01:57,597::task::974::TaskManager.Task::(_decref) Task=`770a1d60-48ea-4845-90d8-fe0b979241be`::ref 0 aborting False
>Thread-3684::DEBUG::2014-04-10 18:01:57,604::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3684::DEBUG::2014-04-10 18:01:57,605::task::579::TaskManager.Task::(_updateState) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::moving from state init -> state preparing
>Thread-3684::INFO::2014-04-10 18:01:57,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3684::DEBUG::2014-04-10 18:01:57,605::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`64468d30-0a5f-40ab-be56-b1a660c6741d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3684::DEBUG::2014-04-10 18:01:57,606::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3684::DEBUG::2014-04-10 18:01:57,606::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3684::DEBUG::2014-04-10 18:01:57,606::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`64468d30-0a5f-40ab-be56-b1a660c6741d`::Granted request
>Thread-3684::DEBUG::2014-04-10 18:01:57,606::task::811::TaskManager.Task::(resourceAcquired) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3684::DEBUG::2014-04-10 18:01:57,607::task::974::TaskManager.Task::(_decref) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::ref 1 aborting False
>Thread-3684::INFO::2014-04-10 18:01:57,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3684::DEBUG::2014-04-10 18:01:57,609::task::1168::TaskManager.Task::(prepare) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3684::DEBUG::2014-04-10 18:01:57,609::task::579::TaskManager.Task::(_updateState) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::moving from state preparing -> state finished
>Thread-3684::DEBUG::2014-04-10 18:01:57,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3684::DEBUG::2014-04-10 18:01:57,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3684::DEBUG::2014-04-10 18:01:57,610::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3684::DEBUG::2014-04-10 18:01:57,610::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3684::DEBUG::2014-04-10 18:01:57,610::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3684::DEBUG::2014-04-10 18:01:57,610::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3684::DEBUG::2014-04-10 18:01:57,611::task::974::TaskManager.Task::(_decref) Task=`5acfa931-bd6c-4804-bcd2-27ece6794b50`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:01:57,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:01:57,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239031 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:01:58,110::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:01:58,126::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:01:58,127::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:01:58,133::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:01:58,134::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:01:58,134::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:01:58,135::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:01:58,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:01:58,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000446951 s, 823 kB/s\n'; <rc> = 0
>Thread-3689::DEBUG::2014-04-10 18:01:58,229::task::579::TaskManager.Task::(_updateState) Task=`f656ba02-019d-49f0-b002-21c4bfd0b14a`::moving from state init -> state preparing
>Thread-3689::INFO::2014-04-10 18:01:58,230::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3689::INFO::2014-04-10 18:01:58,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400015', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445877', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239031', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446951', 'lastCheck': '0.1', 'valid': True}}
>Thread-3689::DEBUG::2014-04-10 18:01:58,230::task::1168::TaskManager.Task::(prepare) Task=`f656ba02-019d-49f0-b002-21c4bfd0b14a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400015', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445877', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239031', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446951', 'lastCheck': '0.1', 'valid': True}}
>Thread-3689::DEBUG::2014-04-10 18:01:58,230::task::579::TaskManager.Task::(_updateState) Task=`f656ba02-019d-49f0-b002-21c4bfd0b14a`::moving from state preparing -> state finished
>Thread-3689::DEBUG::2014-04-10 18:01:58,231::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3689::DEBUG::2014-04-10 18:01:58,231::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3689::DEBUG::2014-04-10 18:01:58,231::task::974::TaskManager.Task::(_decref) Task=`f656ba02-019d-49f0-b002-21c4bfd0b14a`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:01:58,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:01:58,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464913 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:02:07,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:07,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027317 s, 2.5 MB/s\n'; <rc> = 0
>Thread-3694::DEBUG::2014-04-10 18:02:07,690::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3694::DEBUG::2014-04-10 18:02:07,691::task::579::TaskManager.Task::(_updateState) Task=`3e36b94a-6e83-40fa-ba3c-19c53a50d3d8`::moving from state init -> state preparing
>Thread-3694::INFO::2014-04-10 18:02:07,691::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3694::INFO::2014-04-10 18:02:07,691::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3694::DEBUG::2014-04-10 18:02:07,692::task::1168::TaskManager.Task::(prepare) Task=`3e36b94a-6e83-40fa-ba3c-19c53a50d3d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3694::DEBUG::2014-04-10 18:02:07,692::task::579::TaskManager.Task::(_updateState) Task=`3e36b94a-6e83-40fa-ba3c-19c53a50d3d8`::moving from state preparing -> state finished
>Thread-3694::DEBUG::2014-04-10 18:02:07,692::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3694::DEBUG::2014-04-10 18:02:07,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3694::DEBUG::2014-04-10 18:02:07,692::task::974::TaskManager.Task::(_decref) Task=`3e36b94a-6e83-40fa-ba3c-19c53a50d3d8`::ref 0 aborting False
>Thread-3695::DEBUG::2014-04-10 18:02:07,699::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3695::DEBUG::2014-04-10 18:02:07,699::task::579::TaskManager.Task::(_updateState) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::moving from state init -> state preparing
>Thread-3695::INFO::2014-04-10 18:02:07,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3695::DEBUG::2014-04-10 18:02:07,700::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`54ce9059-26db-4ea9-ba77-5f9ea25fcb97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3695::DEBUG::2014-04-10 18:02:07,700::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3695::DEBUG::2014-04-10 18:02:07,700::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3695::DEBUG::2014-04-10 18:02:07,701::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`54ce9059-26db-4ea9-ba77-5f9ea25fcb97`::Granted request
>Thread-3695::DEBUG::2014-04-10 18:02:07,701::task::811::TaskManager.Task::(resourceAcquired) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3695::DEBUG::2014-04-10 18:02:07,701::task::974::TaskManager.Task::(_decref) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::ref 1 aborting False
>Thread-3695::INFO::2014-04-10 18:02:07,703::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3695::DEBUG::2014-04-10 18:02:07,704::task::1168::TaskManager.Task::(prepare) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3695::DEBUG::2014-04-10 18:02:07,704::task::579::TaskManager.Task::(_updateState) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::moving from state preparing -> state finished
>Thread-3695::DEBUG::2014-04-10 18:02:07,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3695::DEBUG::2014-04-10 18:02:07,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3695::DEBUG::2014-04-10 18:02:07,704::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3695::DEBUG::2014-04-10 18:02:07,705::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3695::DEBUG::2014-04-10 18:02:07,705::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3695::DEBUG::2014-04-10 18:02:07,705::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3695::DEBUG::2014-04-10 18:02:07,705::task::974::TaskManager.Task::(_decref) Task=`a5d103a3-094d-4a6a-8980-9bb7f160e0e2`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:02:07,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:07,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288391 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:02:08,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:08,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000388969 s, 946 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:08,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:08,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000397289 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3697::DEBUG::2014-04-10 18:02:13,575::task::579::TaskManager.Task::(_updateState) Task=`2664e9e4-c02b-4457-bd1f-bbdb5254011e`::moving from state init -> state preparing
>Thread-3697::INFO::2014-04-10 18:02:13,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3697::INFO::2014-04-10 18:02:13,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397289', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027317', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288391', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388969', 'lastCheck': '5.4', 'valid': True}}
>Thread-3697::DEBUG::2014-04-10 18:02:13,576::task::1168::TaskManager.Task::(prepare) Task=`2664e9e4-c02b-4457-bd1f-bbdb5254011e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397289', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027317', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288391', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388969', 'lastCheck': '5.4', 'valid': True}}
>Thread-3697::DEBUG::2014-04-10 18:02:13,576::task::579::TaskManager.Task::(_updateState) Task=`2664e9e4-c02b-4457-bd1f-bbdb5254011e`::moving from state preparing -> state finished
>Thread-3697::DEBUG::2014-04-10 18:02:13,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3697::DEBUG::2014-04-10 18:02:13,577::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3697::DEBUG::2014-04-10 18:02:13,577::task::974::TaskManager.Task::(_decref) Task=`2664e9e4-c02b-4457-bd1f-bbdb5254011e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:02:17,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:17,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391858 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:02:17,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:17,775::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255758 s, 2.6 MB/s\n'; <rc> = 0
>Thread-3700::DEBUG::2014-04-10 18:02:17,781::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3700::DEBUG::2014-04-10 18:02:17,782::task::579::TaskManager.Task::(_updateState) Task=`fdb56684-60fb-47a4-aa27-fc004ca76883`::moving from state init -> state preparing
>Thread-3700::INFO::2014-04-10 18:02:17,782::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3700::INFO::2014-04-10 18:02:17,782::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3700::DEBUG::2014-04-10 18:02:17,782::task::1168::TaskManager.Task::(prepare) Task=`fdb56684-60fb-47a4-aa27-fc004ca76883`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3700::DEBUG::2014-04-10 18:02:17,783::task::579::TaskManager.Task::(_updateState) Task=`fdb56684-60fb-47a4-aa27-fc004ca76883`::moving from state preparing -> state finished
>Thread-3700::DEBUG::2014-04-10 18:02:17,783::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3700::DEBUG::2014-04-10 18:02:17,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3700::DEBUG::2014-04-10 18:02:17,783::task::974::TaskManager.Task::(_decref) Task=`fdb56684-60fb-47a4-aa27-fc004ca76883`::ref 0 aborting False
>Thread-3701::DEBUG::2014-04-10 18:02:17,790::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3701::DEBUG::2014-04-10 18:02:17,790::task::579::TaskManager.Task::(_updateState) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::moving from state init -> state preparing
>Thread-3701::INFO::2014-04-10 18:02:17,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3701::DEBUG::2014-04-10 18:02:17,791::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b71f89e-fac1-4e22-afe3-8b897edf76f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3701::DEBUG::2014-04-10 18:02:17,791::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3701::DEBUG::2014-04-10 18:02:17,791::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3701::DEBUG::2014-04-10 18:02:17,792::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b71f89e-fac1-4e22-afe3-8b897edf76f3`::Granted request
>Thread-3701::DEBUG::2014-04-10 18:02:17,793::task::811::TaskManager.Task::(resourceAcquired) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3701::DEBUG::2014-04-10 18:02:17,793::task::974::TaskManager.Task::(_decref) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::ref 1 aborting False
>Thread-3701::INFO::2014-04-10 18:02:17,795::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3701::DEBUG::2014-04-10 18:02:17,795::task::1168::TaskManager.Task::(prepare) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::task::579::TaskManager.Task::(_updateState) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::moving from state preparing -> state finished
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3701::DEBUG::2014-04-10 18:02:17,796::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3701::DEBUG::2014-04-10 18:02:17,797::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3701::DEBUG::2014-04-10 18:02:17,797::task::974::TaskManager.Task::(_decref) Task=`0a9fbbdd-b853-4f00-b91a-dfc7d3051def`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:02:18,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:18,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517745 s, 711 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:18,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:18,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000387591 s, 1.7 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:02:27,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:27,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000450066 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:02:27,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:27,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000413326 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3705::DEBUG::2014-04-10 18:02:27,888::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3705::DEBUG::2014-04-10 18:02:27,889::task::579::TaskManager.Task::(_updateState) Task=`dad2d6a3-dd8d-4552-b048-2e5f4e70c5cf`::moving from state init -> state preparing
>Thread-3705::INFO::2014-04-10 18:02:27,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3705::INFO::2014-04-10 18:02:27,890::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3705::DEBUG::2014-04-10 18:02:27,890::task::1168::TaskManager.Task::(prepare) Task=`dad2d6a3-dd8d-4552-b048-2e5f4e70c5cf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3705::DEBUG::2014-04-10 18:02:27,890::task::579::TaskManager.Task::(_updateState) Task=`dad2d6a3-dd8d-4552-b048-2e5f4e70c5cf`::moving from state preparing -> state finished
>Thread-3705::DEBUG::2014-04-10 18:02:27,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3705::DEBUG::2014-04-10 18:02:27,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3705::DEBUG::2014-04-10 18:02:27,890::task::974::TaskManager.Task::(_decref) Task=`dad2d6a3-dd8d-4552-b048-2e5f4e70c5cf`::ref 0 aborting False
>Thread-3706::DEBUG::2014-04-10 18:02:27,897::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3706::DEBUG::2014-04-10 18:02:27,898::task::579::TaskManager.Task::(_updateState) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::moving from state init -> state preparing
>Thread-3706::INFO::2014-04-10 18:02:27,898::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3706::DEBUG::2014-04-10 18:02:27,898::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46a36082-264e-4902-b39c-5069c2c6da33`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3706::DEBUG::2014-04-10 18:02:27,899::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3706::DEBUG::2014-04-10 18:02:27,899::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3706::DEBUG::2014-04-10 18:02:27,899::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`46a36082-264e-4902-b39c-5069c2c6da33`::Granted request
>Thread-3706::DEBUG::2014-04-10 18:02:27,899::task::811::TaskManager.Task::(resourceAcquired) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3706::DEBUG::2014-04-10 18:02:27,900::task::974::TaskManager.Task::(_decref) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::ref 1 aborting False
>Thread-3706::INFO::2014-04-10 18:02:27,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3706::DEBUG::2014-04-10 18:02:27,902::task::1168::TaskManager.Task::(prepare) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3706::DEBUG::2014-04-10 18:02:27,902::task::579::TaskManager.Task::(_updateState) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::moving from state preparing -> state finished
>Thread-3706::DEBUG::2014-04-10 18:02:27,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3706::DEBUG::2014-04-10 18:02:27,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3706::DEBUG::2014-04-10 18:02:27,903::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3706::DEBUG::2014-04-10 18:02:27,903::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3706::DEBUG::2014-04-10 18:02:27,903::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3706::DEBUG::2014-04-10 18:02:27,903::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3706::DEBUG::2014-04-10 18:02:27,904::task::974::TaskManager.Task::(_decref) Task=`eca0a966-2ee7-4570-8399-42d2cdf2e59b`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:02:28,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:28,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000418223 s, 880 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:28,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:28,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000372758 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3707::DEBUG::2014-04-10 18:02:28,735::task::579::TaskManager.Task::(_updateState) Task=`084d39ce-f323-468f-9cfa-7a2b387add77`::moving from state init -> state preparing
>Thread-3707::INFO::2014-04-10 18:02:28,736::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3707::INFO::2014-04-10 18:02:28,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372758', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450066', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413326', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418223', 'lastCheck': '0.5', 'valid': True}}
>Thread-3707::DEBUG::2014-04-10 18:02:28,736::task::1168::TaskManager.Task::(prepare) Task=`084d39ce-f323-468f-9cfa-7a2b387add77`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372758', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450066', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413326', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418223', 'lastCheck': '0.5', 'valid': True}}
>Thread-3707::DEBUG::2014-04-10 18:02:28,737::task::579::TaskManager.Task::(_updateState) Task=`084d39ce-f323-468f-9cfa-7a2b387add77`::moving from state preparing -> state finished
>Thread-3707::DEBUG::2014-04-10 18:02:28,737::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3707::DEBUG::2014-04-10 18:02:28,737::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3707::DEBUG::2014-04-10 18:02:28,737::task::974::TaskManager.Task::(_decref) Task=`084d39ce-f323-468f-9cfa-7a2b387add77`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:02:37,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:37,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372162 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:02:37,808::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:37,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254734 s, 2.6 MB/s\n'; <rc> = 0
>Thread-3712::DEBUG::2014-04-10 18:02:37,994::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3712::DEBUG::2014-04-10 18:02:37,995::task::579::TaskManager.Task::(_updateState) Task=`efd7a19f-c5c5-4b37-8a43-d7a88cf8b8cb`::moving from state init -> state preparing
>Thread-3712::INFO::2014-04-10 18:02:37,995::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3712::INFO::2014-04-10 18:02:37,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3712::DEBUG::2014-04-10 18:02:37,996::task::1168::TaskManager.Task::(prepare) Task=`efd7a19f-c5c5-4b37-8a43-d7a88cf8b8cb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3712::DEBUG::2014-04-10 18:02:37,996::task::579::TaskManager.Task::(_updateState) Task=`efd7a19f-c5c5-4b37-8a43-d7a88cf8b8cb`::moving from state preparing -> state finished
>Thread-3712::DEBUG::2014-04-10 18:02:37,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3712::DEBUG::2014-04-10 18:02:37,996::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3712::DEBUG::2014-04-10 18:02:37,996::task::974::TaskManager.Task::(_decref) Task=`efd7a19f-c5c5-4b37-8a43-d7a88cf8b8cb`::ref 0 aborting False
>Thread-3713::DEBUG::2014-04-10 18:02:38,003::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3713::DEBUG::2014-04-10 18:02:38,003::task::579::TaskManager.Task::(_updateState) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::moving from state init -> state preparing
>Thread-3713::INFO::2014-04-10 18:02:38,003::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3713::DEBUG::2014-04-10 18:02:38,004::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`658509e5-742b-442c-bc83-13c887f2fef0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3713::DEBUG::2014-04-10 18:02:38,004::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3713::DEBUG::2014-04-10 18:02:38,004::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3713::DEBUG::2014-04-10 18:02:38,004::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`658509e5-742b-442c-bc83-13c887f2fef0`::Granted request
>Thread-3713::DEBUG::2014-04-10 18:02:38,005::task::811::TaskManager.Task::(resourceAcquired) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3713::DEBUG::2014-04-10 18:02:38,005::task::974::TaskManager.Task::(_decref) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::ref 1 aborting False
>Thread-3713::INFO::2014-04-10 18:02:38,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3713::DEBUG::2014-04-10 18:02:38,007::task::1168::TaskManager.Task::(prepare) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3713::DEBUG::2014-04-10 18:02:38,008::task::579::TaskManager.Task::(_updateState) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::moving from state preparing -> state finished
>Thread-3713::DEBUG::2014-04-10 18:02:38,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3713::DEBUG::2014-04-10 18:02:38,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3713::DEBUG::2014-04-10 18:02:38,008::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3713::DEBUG::2014-04-10 18:02:38,008::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3713::DEBUG::2014-04-10 18:02:38,009::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3713::DEBUG::2014-04-10 18:02:38,009::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3713::DEBUG::2014-04-10 18:02:38,009::task::974::TaskManager.Task::(_decref) Task=`ba2ebf45-11f5-4bd7-b456-ca51064b26c1`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:02:38,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:38,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000361683 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:38,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:38,303::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000379178 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3715::DEBUG::2014-04-10 18:02:43,974::task::579::TaskManager.Task::(_updateState) Task=`93e65670-bf7f-4133-bf33-258560595335`::moving from state init -> state preparing
>Thread-3715::INFO::2014-04-10 18:02:43,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3715::INFO::2014-04-10 18:02:43,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379178', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372162', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254734', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361683', 'lastCheck': '5.8', 'valid': True}}
>Thread-3715::DEBUG::2014-04-10 18:02:43,974::task::1168::TaskManager.Task::(prepare) Task=`93e65670-bf7f-4133-bf33-258560595335`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379178', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372162', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254734', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361683', 'lastCheck': '5.8', 'valid': True}}
>Thread-3715::DEBUG::2014-04-10 18:02:43,975::task::579::TaskManager.Task::(_updateState) Task=`93e65670-bf7f-4133-bf33-258560595335`::moving from state preparing -> state finished
>Thread-3715::DEBUG::2014-04-10 18:02:43,975::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3715::DEBUG::2014-04-10 18:02:43,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3715::DEBUG::2014-04-10 18:02:43,975::task::974::TaskManager.Task::(_decref) Task=`93e65670-bf7f-4133-bf33-258560595335`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:02:47,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:47,624::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000264898 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:02:47,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:47,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000219479 s, 3.1 MB/s\n'; <rc> = 0
>Thread-3718::DEBUG::2014-04-10 18:02:48,101::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-3718::DEBUG::2014-04-10 18:02:48,101::task::579::TaskManager.Task::(_updateState) Task=`0e6c94e3-03bb-4185-8807-ed5a97c56690`::moving from state init -> state preparing
>Thread-3718::INFO::2014-04-10 18:02:48,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3718::INFO::2014-04-10 18:02:48,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3718::DEBUG::2014-04-10 18:02:48,102::task::1168::TaskManager.Task::(prepare) Task=`0e6c94e3-03bb-4185-8807-ed5a97c56690`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3718::DEBUG::2014-04-10 18:02:48,102::task::579::TaskManager.Task::(_updateState) Task=`0e6c94e3-03bb-4185-8807-ed5a97c56690`::moving from state preparing -> state finished
>Thread-3718::DEBUG::2014-04-10 18:02:48,102::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3718::DEBUG::2014-04-10 18:02:48,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3718::DEBUG::2014-04-10 18:02:48,102::task::974::TaskManager.Task::(_decref) Task=`0e6c94e3-03bb-4185-8807-ed5a97c56690`::ref 0 aborting False
>Thread-3719::DEBUG::2014-04-10 18:02:48,109::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-3719::DEBUG::2014-04-10 18:02:48,109::task::579::TaskManager.Task::(_updateState) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::moving from state init -> state preparing
>Thread-3719::INFO::2014-04-10 18:02:48,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3719::DEBUG::2014-04-10 18:02:48,110::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed941fd2-f5dc-45ac-90a7-6d3723fe5473`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3719::DEBUG::2014-04-10 18:02:48,110::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3719::DEBUG::2014-04-10 18:02:48,110::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3719::DEBUG::2014-04-10 18:02:48,110::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ed941fd2-f5dc-45ac-90a7-6d3723fe5473`::Granted request
>Thread-3719::DEBUG::2014-04-10 18:02:48,110::task::811::TaskManager.Task::(resourceAcquired) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3719::DEBUG::2014-04-10 18:02:48,111::task::974::TaskManager.Task::(_decref) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::ref 1 aborting False
>Thread-3719::INFO::2014-04-10 18:02:48,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3719::DEBUG::2014-04-10 18:02:48,112::task::1168::TaskManager.Task::(prepare) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3719::DEBUG::2014-04-10 18:02:48,113::task::579::TaskManager.Task::(_updateState) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::moving from state preparing -> state finished
>Thread-3719::DEBUG::2014-04-10 18:02:48,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3719::DEBUG::2014-04-10 18:02:48,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3719::DEBUG::2014-04-10 18:02:48,113::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3719::DEBUG::2014-04-10 18:02:48,113::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3719::DEBUG::2014-04-10 18:02:48,114::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3719::DEBUG::2014-04-10 18:02:48,114::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3719::DEBUG::2014-04-10 18:02:48,114::task::974::TaskManager.Task::(_decref) Task=`4b5f1ff4-fe29-4636-a58c-abee4db3dfaf`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:02:48,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:48,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449822 s, 818 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:48,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:48,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000481027 s, 1.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:02:57,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:02:57,638::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000275852 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:02:57,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:02:57,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000253922 s, 2.6 MB/s\n'; <rc> = 0
>Thread-3723::DEBUG::2014-04-10 18:02:58,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3723::DEBUG::2014-04-10 18:02:58,193::task::579::TaskManager.Task::(_updateState) Task=`438cab53-0534-41b9-9bf2-3d3af7ec8141`::moving from state init -> state preparing
>Thread-3723::INFO::2014-04-10 18:02:58,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3723::INFO::2014-04-10 18:02:58,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3723::DEBUG::2014-04-10 18:02:58,193::task::1168::TaskManager.Task::(prepare) Task=`438cab53-0534-41b9-9bf2-3d3af7ec8141`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3723::DEBUG::2014-04-10 18:02:58,194::task::579::TaskManager.Task::(_updateState) Task=`438cab53-0534-41b9-9bf2-3d3af7ec8141`::moving from state preparing -> state finished
>Thread-3723::DEBUG::2014-04-10 18:02:58,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3723::DEBUG::2014-04-10 18:02:58,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3723::DEBUG::2014-04-10 18:02:58,194::task::974::TaskManager.Task::(_decref) Task=`438cab53-0534-41b9-9bf2-3d3af7ec8141`::ref 0 aborting False
>Thread-3724::DEBUG::2014-04-10 18:02:58,201::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3724::DEBUG::2014-04-10 18:02:58,201::task::579::TaskManager.Task::(_updateState) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::moving from state init -> state preparing
>Thread-3724::INFO::2014-04-10 18:02:58,201::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3724::DEBUG::2014-04-10 18:02:58,203::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32b79775-39d7-4c43-94f3-e4cf7b5c6c4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3724::DEBUG::2014-04-10 18:02:58,203::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3724::DEBUG::2014-04-10 18:02:58,203::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3724::DEBUG::2014-04-10 18:02:58,203::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32b79775-39d7-4c43-94f3-e4cf7b5c6c4c`::Granted request
>Thread-3724::DEBUG::2014-04-10 18:02:58,204::task::811::TaskManager.Task::(resourceAcquired) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3724::DEBUG::2014-04-10 18:02:58,204::task::974::TaskManager.Task::(_decref) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::ref 1 aborting False
>Thread-3724::INFO::2014-04-10 18:02:58,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3724::DEBUG::2014-04-10 18:02:58,206::task::1168::TaskManager.Task::(prepare) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3724::DEBUG::2014-04-10 18:02:58,206::task::579::TaskManager.Task::(_updateState) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::moving from state preparing -> state finished
>Thread-3724::DEBUG::2014-04-10 18:02:58,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3724::DEBUG::2014-04-10 18:02:58,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3724::DEBUG::2014-04-10 18:02:58,207::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3724::DEBUG::2014-04-10 18:02:58,207::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3724::DEBUG::2014-04-10 18:02:58,207::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3724::DEBUG::2014-04-10 18:02:58,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3724::DEBUG::2014-04-10 18:02:58,208::task::974::TaskManager.Task::(_decref) Task=`ab0a9c03-0841-4b4a-ba6f-efb48f64e63d`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:02:58,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:02:58,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000374712 s, 982 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:02:58,326::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:02:58,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000394053 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3725::DEBUG::2014-04-10 18:02:59,168::task::579::TaskManager.Task::(_updateState) Task=`bbc5dd77-d532-4158-9001-d947415a73d4`::moving from state init -> state preparing
>Thread-3725::INFO::2014-04-10 18:02:59,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3725::INFO::2014-04-10 18:02:59,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394053', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275852', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253922', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374712', 'lastCheck': '0.9', 'valid': True}}
>Thread-3725::DEBUG::2014-04-10 18:02:59,169::task::1168::TaskManager.Task::(prepare) Task=`bbc5dd77-d532-4158-9001-d947415a73d4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394053', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275852', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000253922', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374712', 'lastCheck': '0.9', 'valid': True}}
>Thread-3725::DEBUG::2014-04-10 18:02:59,170::task::579::TaskManager.Task::(_updateState) Task=`bbc5dd77-d532-4158-9001-d947415a73d4`::moving from state preparing -> state finished
>Thread-3725::DEBUG::2014-04-10 18:02:59,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3725::DEBUG::2014-04-10 18:02:59,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3725::DEBUG::2014-04-10 18:02:59,170::task::974::TaskManager.Task::(_decref) Task=`bbc5dd77-d532-4158-9001-d947415a73d4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:07,647::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:07,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037249 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:07,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:07,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266799 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:08,229::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:08,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366552 s, 1.0 MB/s\n'; <rc> = 0
>Thread-3729::DEBUG::2014-04-10 18:03:08,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-3729::DEBUG::2014-04-10 18:03:08,322::task::579::TaskManager.Task::(_updateState) Task=`f62be845-522a-4d73-967c-c138e3a23682`::moving from state init -> state preparing
>Thread-3729::INFO::2014-04-10 18:03:08,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3729::INFO::2014-04-10 18:03:08,326::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3729::DEBUG::2014-04-10 18:03:08,327::task::1168::TaskManager.Task::(prepare) Task=`f62be845-522a-4d73-967c-c138e3a23682`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3729::DEBUG::2014-04-10 18:03:08,327::task::579::TaskManager.Task::(_updateState) Task=`f62be845-522a-4d73-967c-c138e3a23682`::moving from state preparing -> state finished
>Thread-3729::DEBUG::2014-04-10 18:03:08,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3729::DEBUG::2014-04-10 18:03:08,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3729::DEBUG::2014-04-10 18:03:08,327::task::974::TaskManager.Task::(_decref) Task=`f62be845-522a-4d73-967c-c138e3a23682`::ref 0 aborting False
>Thread-3731::DEBUG::2014-04-10 18:03:08,334::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-3731::DEBUG::2014-04-10 18:03:08,336::task::579::TaskManager.Task::(_updateState) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::moving from state init -> state preparing
>Thread-3731::INFO::2014-04-10 18:03:08,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3731::DEBUG::2014-04-10 18:03:08,343::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe004d0a-0f34-4fe4-b17a-f5abb044c83a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3731::DEBUG::2014-04-10 18:03:08,345::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3731::DEBUG::2014-04-10 18:03:08,348::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3731::DEBUG::2014-04-10 18:03:08,350::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fe004d0a-0f34-4fe4-b17a-f5abb044c83a`::Granted request
>Thread-3731::DEBUG::2014-04-10 18:03:08,352::task::811::TaskManager.Task::(resourceAcquired) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3731::DEBUG::2014-04-10 18:03:08,352::task::974::TaskManager.Task::(_decref) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::ref 1 aborting False
>Thread-3731::INFO::2014-04-10 18:03:08,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3731::DEBUG::2014-04-10 18:03:08,381::task::1168::TaskManager.Task::(prepare) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3731::DEBUG::2014-04-10 18:03:08,384::task::579::TaskManager.Task::(_updateState) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::moving from state preparing -> state finished
>Thread-3731::DEBUG::2014-04-10 18:03:08,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3731::DEBUG::2014-04-10 18:03:08,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3731::DEBUG::2014-04-10 18:03:08,391::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3731::DEBUG::2014-04-10 18:03:08,393::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-467::DEBUG::2014-04-10 18:03:08,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-3731::DEBUG::2014-04-10 18:03:08,395::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3731::DEBUG::2014-04-10 18:03:08,401::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3731::DEBUG::2014-04-10 18:03:08,404::task::974::TaskManager.Task::(_decref) Task=`83b32bff-406c-489b-b292-3dde6cfd5cd5`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:03:08,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000362234 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3733::DEBUG::2014-04-10 18:03:14,360::task::579::TaskManager.Task::(_updateState) Task=`d685acb0-3432-421f-9201-a78c7e5673f6`::moving from state init -> state preparing
>Thread-3733::INFO::2014-04-10 18:03:14,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3733::INFO::2014-04-10 18:03:14,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362234', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037249', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266799', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366552', 'lastCheck': '6.1', 'valid': True}}
>Thread-3733::DEBUG::2014-04-10 18:03:14,361::task::1168::TaskManager.Task::(prepare) Task=`d685acb0-3432-421f-9201-a78c7e5673f6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362234', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037249', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266799', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366552', 'lastCheck': '6.1', 'valid': True}}
>Thread-3733::DEBUG::2014-04-10 18:03:14,361::task::579::TaskManager.Task::(_updateState) Task=`d685acb0-3432-421f-9201-a78c7e5673f6`::moving from state preparing -> state finished
>Thread-3733::DEBUG::2014-04-10 18:03:14,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3733::DEBUG::2014-04-10 18:03:14,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3733::DEBUG::2014-04-10 18:03:14,361::task::974::TaskManager.Task::(_decref) Task=`d685acb0-3432-421f-9201-a78c7e5673f6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:17,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:17,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000431144 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:17,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:17,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000423953 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:18,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:18,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509001 s, 723 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:03:18,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:03:18,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448022 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3736::DEBUG::2014-04-10 18:03:18,506::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3736::DEBUG::2014-04-10 18:03:18,506::task::579::TaskManager.Task::(_updateState) Task=`1a741433-4768-4e7b-87ed-ac7e3ee917fe`::moving from state init -> state preparing
>Thread-3736::INFO::2014-04-10 18:03:18,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3736::INFO::2014-04-10 18:03:18,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3736::DEBUG::2014-04-10 18:03:18,507::task::1168::TaskManager.Task::(prepare) Task=`1a741433-4768-4e7b-87ed-ac7e3ee917fe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3736::DEBUG::2014-04-10 18:03:18,507::task::579::TaskManager.Task::(_updateState) Task=`1a741433-4768-4e7b-87ed-ac7e3ee917fe`::moving from state preparing -> state finished
>Thread-3736::DEBUG::2014-04-10 18:03:18,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3736::DEBUG::2014-04-10 18:03:18,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3736::DEBUG::2014-04-10 18:03:18,508::task::974::TaskManager.Task::(_decref) Task=`1a741433-4768-4e7b-87ed-ac7e3ee917fe`::ref 0 aborting False
>Thread-3737::DEBUG::2014-04-10 18:03:18,514::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3737::DEBUG::2014-04-10 18:03:18,515::task::579::TaskManager.Task::(_updateState) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::moving from state init -> state preparing
>Thread-3737::INFO::2014-04-10 18:03:18,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3737::DEBUG::2014-04-10 18:03:18,515::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31fb4c9b-6d37-48a3-835f-f9105cdea140`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3737::DEBUG::2014-04-10 18:03:18,515::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3737::DEBUG::2014-04-10 18:03:18,516::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3737::DEBUG::2014-04-10 18:03:18,516::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31fb4c9b-6d37-48a3-835f-f9105cdea140`::Granted request
>Thread-3737::DEBUG::2014-04-10 18:03:18,516::task::811::TaskManager.Task::(resourceAcquired) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3737::DEBUG::2014-04-10 18:03:18,517::task::974::TaskManager.Task::(_decref) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::ref 1 aborting False
>Thread-3737::INFO::2014-04-10 18:03:18,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3737::DEBUG::2014-04-10 18:03:18,519::task::1168::TaskManager.Task::(prepare) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3737::DEBUG::2014-04-10 18:03:18,519::task::579::TaskManager.Task::(_updateState) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::moving from state preparing -> state finished
>Thread-3737::DEBUG::2014-04-10 18:03:18,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3737::DEBUG::2014-04-10 18:03:18,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3737::DEBUG::2014-04-10 18:03:18,520::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3737::DEBUG::2014-04-10 18:03:18,520::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3737::DEBUG::2014-04-10 18:03:18,520::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3737::DEBUG::2014-04-10 18:03:18,520::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3737::DEBUG::2014-04-10 18:03:18,520::task::974::TaskManager.Task::(_decref) Task=`f2702bec-7d5f-4f18-a582-aba68d14b39d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:27,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:27,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000257672 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:27,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:27,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244022 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:28,257::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:28,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487309 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:03:28,433::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:03:28,448::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:03:28,449::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:03:28,455::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:03:28,456::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:03:28,457::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:03:28,457::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:03:28,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:03:28,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000384075 s, 1.7 MB/s\n'; <rc> = 0
>Thread-3745::DEBUG::2014-04-10 18:03:28,604::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3745::DEBUG::2014-04-10 18:03:28,619::task::579::TaskManager.Task::(_updateState) Task=`f4b595a8-3e36-43e8-8709-478ac3054ecc`::moving from state init -> state preparing
>Thread-3745::INFO::2014-04-10 18:03:28,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3745::INFO::2014-04-10 18:03:28,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3745::DEBUG::2014-04-10 18:03:28,620::task::1168::TaskManager.Task::(prepare) Task=`f4b595a8-3e36-43e8-8709-478ac3054ecc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3745::DEBUG::2014-04-10 18:03:28,620::task::579::TaskManager.Task::(_updateState) Task=`f4b595a8-3e36-43e8-8709-478ac3054ecc`::moving from state preparing -> state finished
>Thread-3745::DEBUG::2014-04-10 18:03:28,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3745::DEBUG::2014-04-10 18:03:28,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3745::DEBUG::2014-04-10 18:03:28,621::task::974::TaskManager.Task::(_decref) Task=`f4b595a8-3e36-43e8-8709-478ac3054ecc`::ref 0 aborting False
>Thread-3746::DEBUG::2014-04-10 18:03:28,628::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3746::DEBUG::2014-04-10 18:03:28,628::task::579::TaskManager.Task::(_updateState) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::moving from state init -> state preparing
>Thread-3746::INFO::2014-04-10 18:03:28,629::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3746::DEBUG::2014-04-10 18:03:28,629::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f617205d-39dc-4771-a05a-dfbce356cfc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3746::DEBUG::2014-04-10 18:03:28,629::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3746::DEBUG::2014-04-10 18:03:28,630::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3746::DEBUG::2014-04-10 18:03:28,630::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f617205d-39dc-4771-a05a-dfbce356cfc2`::Granted request
>Thread-3746::DEBUG::2014-04-10 18:03:28,630::task::811::TaskManager.Task::(resourceAcquired) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3746::DEBUG::2014-04-10 18:03:28,630::task::974::TaskManager.Task::(_decref) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::ref 1 aborting False
>Thread-3746::INFO::2014-04-10 18:03:28,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3746::DEBUG::2014-04-10 18:03:28,633::task::1168::TaskManager.Task::(prepare) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3746::DEBUG::2014-04-10 18:03:28,633::task::579::TaskManager.Task::(_updateState) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::moving from state preparing -> state finished
>Thread-3746::DEBUG::2014-04-10 18:03:28,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3746::DEBUG::2014-04-10 18:03:28,633::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3746::DEBUG::2014-04-10 18:03:28,634::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3746::DEBUG::2014-04-10 18:03:28,634::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3746::DEBUG::2014-04-10 18:03:28,634::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3746::DEBUG::2014-04-10 18:03:28,634::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3746::DEBUG::2014-04-10 18:03:28,634::task::974::TaskManager.Task::(_decref) Task=`10e3bb98-40f2-49a0-bd29-c9b55c1b262e`::ref 0 aborting False
>Thread-3747::DEBUG::2014-04-10 18:03:29,516::task::579::TaskManager.Task::(_updateState) Task=`a3aa91c8-cd78-4701-ae9a-09198ab85929`::moving from state init -> state preparing
>Thread-3747::INFO::2014-04-10 18:03:29,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3747::INFO::2014-04-10 18:03:29,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384075', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257672', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244022', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487309', 'lastCheck': '1.3', 'valid': True}}
>Thread-3747::DEBUG::2014-04-10 18:03:29,517::task::1168::TaskManager.Task::(prepare) Task=`a3aa91c8-cd78-4701-ae9a-09198ab85929`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384075', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257672', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244022', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487309', 'lastCheck': '1.3', 'valid': True}}
>Thread-3747::DEBUG::2014-04-10 18:03:29,517::task::579::TaskManager.Task::(_updateState) Task=`a3aa91c8-cd78-4701-ae9a-09198ab85929`::moving from state preparing -> state finished
>Thread-3747::DEBUG::2014-04-10 18:03:29,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3747::DEBUG::2014-04-10 18:03:29,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3747::DEBUG::2014-04-10 18:03:29,518::task::974::TaskManager.Task::(_decref) Task=`a3aa91c8-cd78-4701-ae9a-09198ab85929`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:37,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:37,702::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000579745 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:37,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:37,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000657883 s, 1.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:38,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:38,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000602667 s, 611 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:03:38,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:03:38,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000616218 s, 1.1 MB/s\n'; <rc> = 0
>Thread-3752::DEBUG::2014-04-10 18:03:38,753::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3752::DEBUG::2014-04-10 18:03:38,754::task::579::TaskManager.Task::(_updateState) Task=`30384f54-d9ac-4100-a381-16ec4d3b2632`::moving from state init -> state preparing
>Thread-3752::INFO::2014-04-10 18:03:38,754::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3752::INFO::2014-04-10 18:03:38,755::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3752::DEBUG::2014-04-10 18:03:38,755::task::1168::TaskManager.Task::(prepare) Task=`30384f54-d9ac-4100-a381-16ec4d3b2632`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3752::DEBUG::2014-04-10 18:03:38,755::task::579::TaskManager.Task::(_updateState) Task=`30384f54-d9ac-4100-a381-16ec4d3b2632`::moving from state preparing -> state finished
>Thread-3752::DEBUG::2014-04-10 18:03:38,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3752::DEBUG::2014-04-10 18:03:38,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3752::DEBUG::2014-04-10 18:03:38,756::task::974::TaskManager.Task::(_decref) Task=`30384f54-d9ac-4100-a381-16ec4d3b2632`::ref 0 aborting False
>Thread-3753::DEBUG::2014-04-10 18:03:38,761::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3753::DEBUG::2014-04-10 18:03:38,761::task::579::TaskManager.Task::(_updateState) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::moving from state init -> state preparing
>Thread-3753::INFO::2014-04-10 18:03:38,761::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3753::DEBUG::2014-04-10 18:03:38,762::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff448b3d-d8ea-4ce4-aed0-d03b05a6905b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3753::DEBUG::2014-04-10 18:03:38,762::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3753::DEBUG::2014-04-10 18:03:38,762::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3753::DEBUG::2014-04-10 18:03:38,763::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff448b3d-d8ea-4ce4-aed0-d03b05a6905b`::Granted request
>Thread-3753::DEBUG::2014-04-10 18:03:38,764::task::811::TaskManager.Task::(resourceAcquired) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3753::DEBUG::2014-04-10 18:03:38,764::task::974::TaskManager.Task::(_decref) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::ref 1 aborting False
>Thread-3753::INFO::2014-04-10 18:03:38,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3753::DEBUG::2014-04-10 18:03:38,767::task::1168::TaskManager.Task::(prepare) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3753::DEBUG::2014-04-10 18:03:38,767::task::579::TaskManager.Task::(_updateState) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::moving from state preparing -> state finished
>Thread-3753::DEBUG::2014-04-10 18:03:38,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3753::DEBUG::2014-04-10 18:03:38,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3753::DEBUG::2014-04-10 18:03:38,767::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3753::DEBUG::2014-04-10 18:03:38,768::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3753::DEBUG::2014-04-10 18:03:38,768::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3753::DEBUG::2014-04-10 18:03:38,768::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3753::DEBUG::2014-04-10 18:03:38,768::task::974::TaskManager.Task::(_decref) Task=`748ef9bd-1229-4eae-a2ef-7e8afa40d4e1`::ref 0 aborting False
>Thread-3755::DEBUG::2014-04-10 18:03:44,775::task::579::TaskManager.Task::(_updateState) Task=`77ca1cc6-ec97-4040-ad3a-d7c97848eaa1`::moving from state init -> state preparing
>Thread-3755::INFO::2014-04-10 18:03:44,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3755::INFO::2014-04-10 18:03:44,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616218', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579745', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657883', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602667', 'lastCheck': '6.5', 'valid': True}}
>Thread-3755::DEBUG::2014-04-10 18:03:44,776::task::1168::TaskManager.Task::(prepare) Task=`77ca1cc6-ec97-4040-ad3a-d7c97848eaa1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616218', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579745', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657883', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602667', 'lastCheck': '6.5', 'valid': True}}
>Thread-3755::DEBUG::2014-04-10 18:03:44,776::task::579::TaskManager.Task::(_updateState) Task=`77ca1cc6-ec97-4040-ad3a-d7c97848eaa1`::moving from state preparing -> state finished
>Thread-3755::DEBUG::2014-04-10 18:03:44,777::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3755::DEBUG::2014-04-10 18:03:44,777::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3755::DEBUG::2014-04-10 18:03:44,777::task::974::TaskManager.Task::(_decref) Task=`77ca1cc6-ec97-4040-ad3a-d7c97848eaa1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:47,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:47,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353981 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:47,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:47,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242645 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:48,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:48,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000524117 s, 702 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:03:48,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:03:48,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470022 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3758::DEBUG::2014-04-10 18:03:48,875::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3758::DEBUG::2014-04-10 18:03:48,876::task::579::TaskManager.Task::(_updateState) Task=`8c0cf5bf-4683-47c7-8d09-1be913fa7863`::moving from state init -> state preparing
>Thread-3758::INFO::2014-04-10 18:03:48,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3758::INFO::2014-04-10 18:03:48,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3758::DEBUG::2014-04-10 18:03:48,876::task::1168::TaskManager.Task::(prepare) Task=`8c0cf5bf-4683-47c7-8d09-1be913fa7863`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3758::DEBUG::2014-04-10 18:03:48,876::task::579::TaskManager.Task::(_updateState) Task=`8c0cf5bf-4683-47c7-8d09-1be913fa7863`::moving from state preparing -> state finished
>Thread-3758::DEBUG::2014-04-10 18:03:48,877::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3758::DEBUG::2014-04-10 18:03:48,877::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3758::DEBUG::2014-04-10 18:03:48,877::task::974::TaskManager.Task::(_decref) Task=`8c0cf5bf-4683-47c7-8d09-1be913fa7863`::ref 0 aborting False
>Thread-3759::DEBUG::2014-04-10 18:03:48,884::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3759::DEBUG::2014-04-10 18:03:48,884::task::579::TaskManager.Task::(_updateState) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::moving from state init -> state preparing
>Thread-3759::INFO::2014-04-10 18:03:48,884::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3759::DEBUG::2014-04-10 18:03:48,885::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b27d36a0-96eb-455a-9df7-ba4f690a9688`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3759::DEBUG::2014-04-10 18:03:48,885::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3759::DEBUG::2014-04-10 18:03:48,885::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3759::DEBUG::2014-04-10 18:03:48,885::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b27d36a0-96eb-455a-9df7-ba4f690a9688`::Granted request
>Thread-3759::DEBUG::2014-04-10 18:03:48,886::task::811::TaskManager.Task::(resourceAcquired) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3759::DEBUG::2014-04-10 18:03:48,886::task::974::TaskManager.Task::(_decref) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::ref 1 aborting False
>Thread-3759::INFO::2014-04-10 18:03:48,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3759::DEBUG::2014-04-10 18:03:48,888::task::1168::TaskManager.Task::(prepare) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3759::DEBUG::2014-04-10 18:03:48,888::task::579::TaskManager.Task::(_updateState) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::moving from state preparing -> state finished
>Thread-3759::DEBUG::2014-04-10 18:03:48,888::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3759::DEBUG::2014-04-10 18:03:48,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3759::DEBUG::2014-04-10 18:03:48,889::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3759::DEBUG::2014-04-10 18:03:48,889::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3759::DEBUG::2014-04-10 18:03:48,889::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3759::DEBUG::2014-04-10 18:03:48,889::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3759::DEBUG::2014-04-10 18:03:48,890::task::974::TaskManager.Task::(_decref) Task=`0fa8c268-5891-45f3-9482-6f2c08edc590`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:03:57,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:03:57,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000258454 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:03:57,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:03:57,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374577 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:03:58,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:03:58,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487215 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:03:58,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:03:58,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000472085 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3763::DEBUG::2014-04-10 18:03:59,034::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3763::DEBUG::2014-04-10 18:03:59,034::task::579::TaskManager.Task::(_updateState) Task=`9d286a07-8dd1-4c4f-9474-46209c47fbed`::moving from state init -> state preparing
>Thread-3763::INFO::2014-04-10 18:03:59,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3763::INFO::2014-04-10 18:03:59,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3763::DEBUG::2014-04-10 18:03:59,035::task::1168::TaskManager.Task::(prepare) Task=`9d286a07-8dd1-4c4f-9474-46209c47fbed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3763::DEBUG::2014-04-10 18:03:59,035::task::579::TaskManager.Task::(_updateState) Task=`9d286a07-8dd1-4c4f-9474-46209c47fbed`::moving from state preparing -> state finished
>Thread-3763::DEBUG::2014-04-10 18:03:59,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3763::DEBUG::2014-04-10 18:03:59,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3763::DEBUG::2014-04-10 18:03:59,036::task::974::TaskManager.Task::(_decref) Task=`9d286a07-8dd1-4c4f-9474-46209c47fbed`::ref 0 aborting False
>Thread-3764::DEBUG::2014-04-10 18:03:59,043::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-3764::DEBUG::2014-04-10 18:03:59,043::task::579::TaskManager.Task::(_updateState) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::moving from state init -> state preparing
>Thread-3764::INFO::2014-04-10 18:03:59,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3764::DEBUG::2014-04-10 18:03:59,044::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`340374f3-1779-4270-8dd8-a6d7109184f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3764::DEBUG::2014-04-10 18:03:59,044::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3764::DEBUG::2014-04-10 18:03:59,044::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3764::DEBUG::2014-04-10 18:03:59,044::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`340374f3-1779-4270-8dd8-a6d7109184f5`::Granted request
>Thread-3764::DEBUG::2014-04-10 18:03:59,045::task::811::TaskManager.Task::(resourceAcquired) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3764::DEBUG::2014-04-10 18:03:59,045::task::974::TaskManager.Task::(_decref) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::ref 1 aborting False
>Thread-3764::INFO::2014-04-10 18:03:59,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3764::DEBUG::2014-04-10 18:03:59,047::task::1168::TaskManager.Task::(prepare) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3764::DEBUG::2014-04-10 18:03:59,047::task::579::TaskManager.Task::(_updateState) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::moving from state preparing -> state finished
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3764::DEBUG::2014-04-10 18:03:59,048::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3764::DEBUG::2014-04-10 18:03:59,049::task::974::TaskManager.Task::(_decref) Task=`d0b49c2a-11d9-411b-bf05-325c172a015f`::ref 0 aborting False
>Thread-3765::DEBUG::2014-04-10 18:03:59,946::task::579::TaskManager.Task::(_updateState) Task=`f92dbd2a-3933-41a5-bbb0-4209912a2625`::moving from state init -> state preparing
>Thread-3765::INFO::2014-04-10 18:03:59,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3765::INFO::2014-04-10 18:03:59,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472085', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258454', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374577', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487215', 'lastCheck': '1.6', 'valid': True}}
>Thread-3765::DEBUG::2014-04-10 18:03:59,947::task::1168::TaskManager.Task::(prepare) Task=`f92dbd2a-3933-41a5-bbb0-4209912a2625`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472085', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258454', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374577', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487215', 'lastCheck': '1.6', 'valid': True}}
>Thread-3765::DEBUG::2014-04-10 18:03:59,947::task::579::TaskManager.Task::(_updateState) Task=`f92dbd2a-3933-41a5-bbb0-4209912a2625`::moving from state preparing -> state finished
>Thread-3765::DEBUG::2014-04-10 18:03:59,947::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3765::DEBUG::2014-04-10 18:03:59,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3765::DEBUG::2014-04-10 18:03:59,948::task::974::TaskManager.Task::(_decref) Task=`f92dbd2a-3933-41a5-bbb0-4209912a2625`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:07,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:07,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303905 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:07,975::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:07,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000241903 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:08,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:08,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000483059 s, 762 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:08,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:08,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000478214 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3770::DEBUG::2014-04-10 18:04:09,129::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3770::DEBUG::2014-04-10 18:04:09,130::task::579::TaskManager.Task::(_updateState) Task=`b6baccb2-1e68-41e1-8e9d-2ac63e6d95f7`::moving from state init -> state preparing
>Thread-3770::INFO::2014-04-10 18:04:09,130::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3770::INFO::2014-04-10 18:04:09,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3770::DEBUG::2014-04-10 18:04:09,131::task::1168::TaskManager.Task::(prepare) Task=`b6baccb2-1e68-41e1-8e9d-2ac63e6d95f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3770::DEBUG::2014-04-10 18:04:09,131::task::579::TaskManager.Task::(_updateState) Task=`b6baccb2-1e68-41e1-8e9d-2ac63e6d95f7`::moving from state preparing -> state finished
>Thread-3770::DEBUG::2014-04-10 18:04:09,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3770::DEBUG::2014-04-10 18:04:09,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3770::DEBUG::2014-04-10 18:04:09,131::task::974::TaskManager.Task::(_decref) Task=`b6baccb2-1e68-41e1-8e9d-2ac63e6d95f7`::ref 0 aborting False
>Thread-3771::DEBUG::2014-04-10 18:04:09,138::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3771::DEBUG::2014-04-10 18:04:09,138::task::579::TaskManager.Task::(_updateState) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::moving from state init -> state preparing
>Thread-3771::INFO::2014-04-10 18:04:09,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3771::DEBUG::2014-04-10 18:04:09,139::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bfd20e0f-1ee3-441e-9816-6ee77cc4e7d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3771::DEBUG::2014-04-10 18:04:09,139::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3771::DEBUG::2014-04-10 18:04:09,139::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3771::DEBUG::2014-04-10 18:04:09,139::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bfd20e0f-1ee3-441e-9816-6ee77cc4e7d7`::Granted request
>Thread-3771::DEBUG::2014-04-10 18:04:09,139::task::811::TaskManager.Task::(resourceAcquired) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3771::DEBUG::2014-04-10 18:04:09,140::task::974::TaskManager.Task::(_decref) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::ref 1 aborting False
>Thread-3771::INFO::2014-04-10 18:04:09,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3771::DEBUG::2014-04-10 18:04:09,142::task::1168::TaskManager.Task::(prepare) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3771::DEBUG::2014-04-10 18:04:09,142::task::579::TaskManager.Task::(_updateState) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::moving from state preparing -> state finished
>Thread-3771::DEBUG::2014-04-10 18:04:09,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3771::DEBUG::2014-04-10 18:04:09,142::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3771::DEBUG::2014-04-10 18:04:09,142::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3771::DEBUG::2014-04-10 18:04:09,143::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3771::DEBUG::2014-04-10 18:04:09,143::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3771::DEBUG::2014-04-10 18:04:09,143::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3771::DEBUG::2014-04-10 18:04:09,143::task::974::TaskManager.Task::(_decref) Task=`c15ba220-f623-4b80-bd78-6fc49f72787d`::ref 0 aborting False
>Thread-3773::DEBUG::2014-04-10 18:04:15,110::task::579::TaskManager.Task::(_updateState) Task=`f0d59edf-3cb4-440a-aad5-dcbbe4d34227`::moving from state init -> state preparing
>Thread-3773::INFO::2014-04-10 18:04:15,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3773::INFO::2014-04-10 18:04:15,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478214', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303905', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241903', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483059', 'lastCheck': '6.8', 'valid': True}}
>Thread-3773::DEBUG::2014-04-10 18:04:15,111::task::1168::TaskManager.Task::(prepare) Task=`f0d59edf-3cb4-440a-aad5-dcbbe4d34227`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478214', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303905', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241903', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483059', 'lastCheck': '6.8', 'valid': True}}
>Thread-3773::DEBUG::2014-04-10 18:04:15,111::task::579::TaskManager.Task::(_updateState) Task=`f0d59edf-3cb4-440a-aad5-dcbbe4d34227`::moving from state preparing -> state finished
>Thread-3773::DEBUG::2014-04-10 18:04:15,111::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3773::DEBUG::2014-04-10 18:04:15,111::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3773::DEBUG::2014-04-10 18:04:15,111::task::974::TaskManager.Task::(_decref) Task=`f0d59edf-3cb4-440a-aad5-dcbbe4d34227`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:17,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:17,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367835 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:17,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:17,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282798 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:18,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:18,337::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517001 s, 712 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:18,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:18,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479645 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3776::DEBUG::2014-04-10 18:04:19,221::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3776::DEBUG::2014-04-10 18:04:19,222::task::579::TaskManager.Task::(_updateState) Task=`bf205197-21cc-4056-9bcb-abdd17b374d4`::moving from state init -> state preparing
>Thread-3776::INFO::2014-04-10 18:04:19,222::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3776::INFO::2014-04-10 18:04:19,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3776::DEBUG::2014-04-10 18:04:19,223::task::1168::TaskManager.Task::(prepare) Task=`bf205197-21cc-4056-9bcb-abdd17b374d4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3776::DEBUG::2014-04-10 18:04:19,223::task::579::TaskManager.Task::(_updateState) Task=`bf205197-21cc-4056-9bcb-abdd17b374d4`::moving from state preparing -> state finished
>Thread-3776::DEBUG::2014-04-10 18:04:19,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3776::DEBUG::2014-04-10 18:04:19,223::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3776::DEBUG::2014-04-10 18:04:19,223::task::974::TaskManager.Task::(_decref) Task=`bf205197-21cc-4056-9bcb-abdd17b374d4`::ref 0 aborting False
>Thread-3777::DEBUG::2014-04-10 18:04:19,231::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3777::DEBUG::2014-04-10 18:04:19,231::task::579::TaskManager.Task::(_updateState) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::moving from state init -> state preparing
>Thread-3777::INFO::2014-04-10 18:04:19,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3777::DEBUG::2014-04-10 18:04:19,232::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c209d462-07f4-4094-9c78-df396173c7e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3777::DEBUG::2014-04-10 18:04:19,232::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3777::DEBUG::2014-04-10 18:04:19,232::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3777::DEBUG::2014-04-10 18:04:19,233::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c209d462-07f4-4094-9c78-df396173c7e5`::Granted request
>Thread-3777::DEBUG::2014-04-10 18:04:19,234::task::811::TaskManager.Task::(resourceAcquired) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3777::DEBUG::2014-04-10 18:04:19,234::task::974::TaskManager.Task::(_decref) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::ref 1 aborting False
>Thread-3777::INFO::2014-04-10 18:04:19,236::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3777::DEBUG::2014-04-10 18:04:19,236::task::1168::TaskManager.Task::(prepare) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3777::DEBUG::2014-04-10 18:04:19,237::task::579::TaskManager.Task::(_updateState) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::moving from state preparing -> state finished
>Thread-3777::DEBUG::2014-04-10 18:04:19,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3777::DEBUG::2014-04-10 18:04:19,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3777::DEBUG::2014-04-10 18:04:19,237::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3777::DEBUG::2014-04-10 18:04:19,237::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3777::DEBUG::2014-04-10 18:04:19,238::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3777::DEBUG::2014-04-10 18:04:19,238::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3777::DEBUG::2014-04-10 18:04:19,238::task::974::TaskManager.Task::(_decref) Task=`9031960f-de68-4d6e-b03b-26f730b45e75`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:27,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:27,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341511 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:28,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:28,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000495242 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:28,345::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:28,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000564354 s, 652 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:28,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:28,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479412 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3781::DEBUG::2014-04-10 18:04:29,346::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-3781::DEBUG::2014-04-10 18:04:29,361::task::579::TaskManager.Task::(_updateState) Task=`41f3c05d-701d-4563-bbb1-cb081946fb46`::moving from state init -> state preparing
>Thread-3781::INFO::2014-04-10 18:04:29,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3781::INFO::2014-04-10 18:04:29,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3781::DEBUG::2014-04-10 18:04:29,362::task::1168::TaskManager.Task::(prepare) Task=`41f3c05d-701d-4563-bbb1-cb081946fb46`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3781::DEBUG::2014-04-10 18:04:29,362::task::579::TaskManager.Task::(_updateState) Task=`41f3c05d-701d-4563-bbb1-cb081946fb46`::moving from state preparing -> state finished
>Thread-3781::DEBUG::2014-04-10 18:04:29,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3781::DEBUG::2014-04-10 18:04:29,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3781::DEBUG::2014-04-10 18:04:29,363::task::974::TaskManager.Task::(_decref) Task=`41f3c05d-701d-4563-bbb1-cb081946fb46`::ref 0 aborting False
>Thread-3782::DEBUG::2014-04-10 18:04:29,369::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-3782::DEBUG::2014-04-10 18:04:29,370::task::579::TaskManager.Task::(_updateState) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::moving from state init -> state preparing
>Thread-3782::INFO::2014-04-10 18:04:29,370::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3782::DEBUG::2014-04-10 18:04:29,371::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`150d1cfa-aa57-4b53-9cb7-e9da5808f3d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3782::DEBUG::2014-04-10 18:04:29,371::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3782::DEBUG::2014-04-10 18:04:29,371::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3782::DEBUG::2014-04-10 18:04:29,371::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`150d1cfa-aa57-4b53-9cb7-e9da5808f3d6`::Granted request
>Thread-3782::DEBUG::2014-04-10 18:04:29,372::task::811::TaskManager.Task::(resourceAcquired) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3782::DEBUG::2014-04-10 18:04:29,372::task::974::TaskManager.Task::(_decref) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::ref 1 aborting False
>Thread-3782::INFO::2014-04-10 18:04:29,374::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3782::DEBUG::2014-04-10 18:04:29,374::task::1168::TaskManager.Task::(prepare) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3782::DEBUG::2014-04-10 18:04:29,374::task::579::TaskManager.Task::(_updateState) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::moving from state preparing -> state finished
>Thread-3782::DEBUG::2014-04-10 18:04:29,375::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3782::DEBUG::2014-04-10 18:04:29,375::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3782::DEBUG::2014-04-10 18:04:29,375::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3782::DEBUG::2014-04-10 18:04:29,375::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3782::DEBUG::2014-04-10 18:04:29,375::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3782::DEBUG::2014-04-10 18:04:29,376::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3782::DEBUG::2014-04-10 18:04:29,376::task::974::TaskManager.Task::(_decref) Task=`44175804-6870-40ac-9b1d-462a736ecb5c`::ref 0 aborting False
>Thread-3783::DEBUG::2014-04-10 18:04:30,282::task::579::TaskManager.Task::(_updateState) Task=`4d3c3b86-ca76-437b-a3a3-f3193a4f400d`::moving from state init -> state preparing
>Thread-3783::INFO::2014-04-10 18:04:30,282::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3783::INFO::2014-04-10 18:04:30,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479412', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341511', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495242', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564354', 'lastCheck': '1.9', 'valid': True}}
>Thread-3783::DEBUG::2014-04-10 18:04:30,283::task::1168::TaskManager.Task::(prepare) Task=`4d3c3b86-ca76-437b-a3a3-f3193a4f400d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479412', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341511', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495242', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564354', 'lastCheck': '1.9', 'valid': True}}
>Thread-3783::DEBUG::2014-04-10 18:04:30,283::task::579::TaskManager.Task::(_updateState) Task=`4d3c3b86-ca76-437b-a3a3-f3193a4f400d`::moving from state preparing -> state finished
>Thread-3783::DEBUG::2014-04-10 18:04:30,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3783::DEBUG::2014-04-10 18:04:30,283::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3783::DEBUG::2014-04-10 18:04:30,283::task::974::TaskManager.Task::(_decref) Task=`4d3c3b86-ca76-437b-a3a3-f3193a4f400d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:37,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:37,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350788 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:38,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:38,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309617 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:38,359::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:38,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485323 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:38,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:38,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000476597 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3788::DEBUG::2014-04-10 18:04:39,476::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3788::DEBUG::2014-04-10 18:04:39,476::task::579::TaskManager.Task::(_updateState) Task=`efab49e6-4f89-4bc5-b042-bfc311e76501`::moving from state init -> state preparing
>Thread-3788::INFO::2014-04-10 18:04:39,477::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3788::INFO::2014-04-10 18:04:39,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3788::DEBUG::2014-04-10 18:04:39,477::task::1168::TaskManager.Task::(prepare) Task=`efab49e6-4f89-4bc5-b042-bfc311e76501`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3788::DEBUG::2014-04-10 18:04:39,477::task::579::TaskManager.Task::(_updateState) Task=`efab49e6-4f89-4bc5-b042-bfc311e76501`::moving from state preparing -> state finished
>Thread-3788::DEBUG::2014-04-10 18:04:39,477::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3788::DEBUG::2014-04-10 18:04:39,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3788::DEBUG::2014-04-10 18:04:39,478::task::974::TaskManager.Task::(_decref) Task=`efab49e6-4f89-4bc5-b042-bfc311e76501`::ref 0 aborting False
>Thread-3789::DEBUG::2014-04-10 18:04:39,484::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3789::DEBUG::2014-04-10 18:04:39,484::task::579::TaskManager.Task::(_updateState) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::moving from state init -> state preparing
>Thread-3789::INFO::2014-04-10 18:04:39,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3789::DEBUG::2014-04-10 18:04:39,485::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29f12524-fb66-47d9-80ea-bbac28a8a681`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3789::DEBUG::2014-04-10 18:04:39,485::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3789::DEBUG::2014-04-10 18:04:39,485::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3789::DEBUG::2014-04-10 18:04:39,485::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29f12524-fb66-47d9-80ea-bbac28a8a681`::Granted request
>Thread-3789::DEBUG::2014-04-10 18:04:39,486::task::811::TaskManager.Task::(resourceAcquired) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3789::DEBUG::2014-04-10 18:04:39,486::task::974::TaskManager.Task::(_decref) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::ref 1 aborting False
>Thread-3789::INFO::2014-04-10 18:04:39,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3789::DEBUG::2014-04-10 18:04:39,488::task::1168::TaskManager.Task::(prepare) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3789::DEBUG::2014-04-10 18:04:39,488::task::579::TaskManager.Task::(_updateState) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::moving from state preparing -> state finished
>Thread-3789::DEBUG::2014-04-10 18:04:39,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3789::DEBUG::2014-04-10 18:04:39,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3789::DEBUG::2014-04-10 18:04:39,489::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3789::DEBUG::2014-04-10 18:04:39,489::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3789::DEBUG::2014-04-10 18:04:39,489::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3789::DEBUG::2014-04-10 18:04:39,489::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3789::DEBUG::2014-04-10 18:04:39,489::task::974::TaskManager.Task::(_decref) Task=`487e0c06-9621-456b-a7cf-0f6f06f02d52`::ref 0 aborting False
>Thread-3791::DEBUG::2014-04-10 18:04:45,438::task::579::TaskManager.Task::(_updateState) Task=`1e8418f2-987c-4ed2-bdbc-5ee03b80e7e0`::moving from state init -> state preparing
>Thread-3791::INFO::2014-04-10 18:04:45,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3791::INFO::2014-04-10 18:04:45,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476597', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350788', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309617', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485323', 'lastCheck': '7.1', 'valid': True}}
>Thread-3791::DEBUG::2014-04-10 18:04:45,439::task::1168::TaskManager.Task::(prepare) Task=`1e8418f2-987c-4ed2-bdbc-5ee03b80e7e0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476597', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350788', 'lastCheck': '7.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309617', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485323', 'lastCheck': '7.1', 'valid': True}}
>Thread-3791::DEBUG::2014-04-10 18:04:45,439::task::579::TaskManager.Task::(_updateState) Task=`1e8418f2-987c-4ed2-bdbc-5ee03b80e7e0`::moving from state preparing -> state finished
>Thread-3791::DEBUG::2014-04-10 18:04:45,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3791::DEBUG::2014-04-10 18:04:45,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3791::DEBUG::2014-04-10 18:04:45,440::task::974::TaskManager.Task::(_decref) Task=`1e8418f2-987c-4ed2-bdbc-5ee03b80e7e0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:47,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:47,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276638 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:48,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:48,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000268244 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:48,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:48,380::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00055081 s, 668 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:48,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:48,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000565532 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3794::DEBUG::2014-04-10 18:04:49,583::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3794::DEBUG::2014-04-10 18:04:49,584::task::579::TaskManager.Task::(_updateState) Task=`8810e144-4c51-4feb-8bf9-2219c5b1c938`::moving from state init -> state preparing
>Thread-3794::INFO::2014-04-10 18:04:49,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3794::INFO::2014-04-10 18:04:49,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3794::DEBUG::2014-04-10 18:04:49,585::task::1168::TaskManager.Task::(prepare) Task=`8810e144-4c51-4feb-8bf9-2219c5b1c938`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3794::DEBUG::2014-04-10 18:04:49,585::task::579::TaskManager.Task::(_updateState) Task=`8810e144-4c51-4feb-8bf9-2219c5b1c938`::moving from state preparing -> state finished
>Thread-3794::DEBUG::2014-04-10 18:04:49,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3794::DEBUG::2014-04-10 18:04:49,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3794::DEBUG::2014-04-10 18:04:49,585::task::974::TaskManager.Task::(_decref) Task=`8810e144-4c51-4feb-8bf9-2219c5b1c938`::ref 0 aborting False
>Thread-3795::DEBUG::2014-04-10 18:04:49,592::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3795::DEBUG::2014-04-10 18:04:49,592::task::579::TaskManager.Task::(_updateState) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::moving from state init -> state preparing
>Thread-3795::INFO::2014-04-10 18:04:49,592::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3795::DEBUG::2014-04-10 18:04:49,593::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`edd2e09b-c0f8-4d18-83ff-aeeae7dd84c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3795::DEBUG::2014-04-10 18:04:49,593::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3795::DEBUG::2014-04-10 18:04:49,593::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3795::DEBUG::2014-04-10 18:04:49,594::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`edd2e09b-c0f8-4d18-83ff-aeeae7dd84c8`::Granted request
>Thread-3795::DEBUG::2014-04-10 18:04:49,594::task::811::TaskManager.Task::(resourceAcquired) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3795::DEBUG::2014-04-10 18:04:49,594::task::974::TaskManager.Task::(_decref) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::ref 1 aborting False
>Thread-3795::INFO::2014-04-10 18:04:49,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3795::DEBUG::2014-04-10 18:04:49,597::task::1168::TaskManager.Task::(prepare) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3795::DEBUG::2014-04-10 18:04:49,597::task::579::TaskManager.Task::(_updateState) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::moving from state preparing -> state finished
>Thread-3795::DEBUG::2014-04-10 18:04:49,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3795::DEBUG::2014-04-10 18:04:49,597::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3795::DEBUG::2014-04-10 18:04:49,597::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3795::DEBUG::2014-04-10 18:04:49,598::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3795::DEBUG::2014-04-10 18:04:49,598::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3795::DEBUG::2014-04-10 18:04:49,598::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3795::DEBUG::2014-04-10 18:04:49,598::task::974::TaskManager.Task::(_decref) Task=`7f75fae9-85b0-43ee-ab5c-96f6e5b87900`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:04:57,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:04:57,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321688 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:04:58,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:04:58,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324123 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:04:58,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:04:58,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000459389 s, 801 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:04:58,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:04:58,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000571358 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3799::DEBUG::2014-04-10 18:04:59,692::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3799::DEBUG::2014-04-10 18:04:59,693::task::579::TaskManager.Task::(_updateState) Task=`60a103fd-0d4e-4538-898b-08a731e123f3`::moving from state init -> state preparing
>Thread-3799::INFO::2014-04-10 18:04:59,693::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3799::INFO::2014-04-10 18:04:59,693::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3799::DEBUG::2014-04-10 18:04:59,693::task::1168::TaskManager.Task::(prepare) Task=`60a103fd-0d4e-4538-898b-08a731e123f3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3799::DEBUG::2014-04-10 18:04:59,694::task::579::TaskManager.Task::(_updateState) Task=`60a103fd-0d4e-4538-898b-08a731e123f3`::moving from state preparing -> state finished
>Thread-3799::DEBUG::2014-04-10 18:04:59,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3799::DEBUG::2014-04-10 18:04:59,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3799::DEBUG::2014-04-10 18:04:59,694::task::974::TaskManager.Task::(_decref) Task=`60a103fd-0d4e-4538-898b-08a731e123f3`::ref 0 aborting False
>Thread-3800::DEBUG::2014-04-10 18:04:59,701::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3800::DEBUG::2014-04-10 18:04:59,702::task::579::TaskManager.Task::(_updateState) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::moving from state init -> state preparing
>Thread-3800::INFO::2014-04-10 18:04:59,702::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3800::DEBUG::2014-04-10 18:04:59,702::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b48f51f1-fea3-4503-8d28-0884ea43646f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3800::DEBUG::2014-04-10 18:04:59,703::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3800::DEBUG::2014-04-10 18:04:59,703::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3800::DEBUG::2014-04-10 18:04:59,703::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b48f51f1-fea3-4503-8d28-0884ea43646f`::Granted request
>Thread-3800::DEBUG::2014-04-10 18:04:59,705::task::811::TaskManager.Task::(resourceAcquired) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3800::DEBUG::2014-04-10 18:04:59,705::task::974::TaskManager.Task::(_decref) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::ref 1 aborting False
>Thread-3800::INFO::2014-04-10 18:04:59,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3800::DEBUG::2014-04-10 18:04:59,707::task::1168::TaskManager.Task::(prepare) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3800::DEBUG::2014-04-10 18:04:59,707::task::579::TaskManager.Task::(_updateState) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::moving from state preparing -> state finished
>Thread-3800::DEBUG::2014-04-10 18:04:59,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3800::DEBUG::2014-04-10 18:04:59,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3800::DEBUG::2014-04-10 18:04:59,708::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3800::DEBUG::2014-04-10 18:04:59,708::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3800::DEBUG::2014-04-10 18:04:59,708::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3800::DEBUG::2014-04-10 18:04:59,709::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3800::DEBUG::2014-04-10 18:04:59,709::task::974::TaskManager.Task::(_decref) Task=`90fce6b3-4d0c-45e0-b31f-61149ed19956`::ref 0 aborting False
>Thread-3801::DEBUG::2014-04-10 18:05:00,594::task::579::TaskManager.Task::(_updateState) Task=`cebf805f-e880-4cb2-82fb-60915f3f3237`::moving from state init -> state preparing
>Thread-3801::INFO::2014-04-10 18:05:00,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3801::INFO::2014-04-10 18:05:00,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571358', 'lastCheck': '2.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321688', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324123', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459389', 'lastCheck': '2.2', 'valid': True}}
>Thread-3801::DEBUG::2014-04-10 18:05:00,594::task::1168::TaskManager.Task::(prepare) Task=`cebf805f-e880-4cb2-82fb-60915f3f3237`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571358', 'lastCheck': '2.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321688', 'lastCheck': '2.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324123', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459389', 'lastCheck': '2.2', 'valid': True}}
>Thread-3801::DEBUG::2014-04-10 18:05:00,594::task::579::TaskManager.Task::(_updateState) Task=`cebf805f-e880-4cb2-82fb-60915f3f3237`::moving from state preparing -> state finished
>Thread-3801::DEBUG::2014-04-10 18:05:00,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3801::DEBUG::2014-04-10 18:05:00,595::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3801::DEBUG::2014-04-10 18:05:00,595::task::974::TaskManager.Task::(_decref) Task=`cebf805f-e880-4cb2-82fb-60915f3f3237`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:07,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:07,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355042 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:08,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:08,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319792 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:08,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:08,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004968 s, 741 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:08,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:08,611::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000573027 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3806::DEBUG::2014-04-10 18:05:09,797::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3806::DEBUG::2014-04-10 18:05:09,798::task::579::TaskManager.Task::(_updateState) Task=`87e05e92-fcd9-4f58-a43c-fd0d75123604`::moving from state init -> state preparing
>Thread-3806::INFO::2014-04-10 18:05:09,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3806::INFO::2014-04-10 18:05:09,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3806::DEBUG::2014-04-10 18:05:09,798::task::1168::TaskManager.Task::(prepare) Task=`87e05e92-fcd9-4f58-a43c-fd0d75123604`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3806::DEBUG::2014-04-10 18:05:09,798::task::579::TaskManager.Task::(_updateState) Task=`87e05e92-fcd9-4f58-a43c-fd0d75123604`::moving from state preparing -> state finished
>Thread-3806::DEBUG::2014-04-10 18:05:09,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3806::DEBUG::2014-04-10 18:05:09,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3806::DEBUG::2014-04-10 18:05:09,799::task::974::TaskManager.Task::(_decref) Task=`87e05e92-fcd9-4f58-a43c-fd0d75123604`::ref 0 aborting False
>Thread-3807::DEBUG::2014-04-10 18:05:09,806::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3807::DEBUG::2014-04-10 18:05:09,806::task::579::TaskManager.Task::(_updateState) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::moving from state init -> state preparing
>Thread-3807::INFO::2014-04-10 18:05:09,806::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3807::DEBUG::2014-04-10 18:05:09,807::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`75579a0a-17bb-4c6a-abab-ad3690976a02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3807::DEBUG::2014-04-10 18:05:09,807::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3807::DEBUG::2014-04-10 18:05:09,807::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3807::DEBUG::2014-04-10 18:05:09,807::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`75579a0a-17bb-4c6a-abab-ad3690976a02`::Granted request
>Thread-3807::DEBUG::2014-04-10 18:05:09,808::task::811::TaskManager.Task::(resourceAcquired) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3807::DEBUG::2014-04-10 18:05:09,808::task::974::TaskManager.Task::(_decref) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::ref 1 aborting False
>Thread-3807::INFO::2014-04-10 18:05:09,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3807::DEBUG::2014-04-10 18:05:09,810::task::1168::TaskManager.Task::(prepare) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3807::DEBUG::2014-04-10 18:05:09,810::task::579::TaskManager.Task::(_updateState) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::moving from state preparing -> state finished
>Thread-3807::DEBUG::2014-04-10 18:05:09,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3807::DEBUG::2014-04-10 18:05:09,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3807::DEBUG::2014-04-10 18:05:09,811::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3807::DEBUG::2014-04-10 18:05:09,811::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3807::DEBUG::2014-04-10 18:05:09,811::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3807::DEBUG::2014-04-10 18:05:09,811::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3807::DEBUG::2014-04-10 18:05:09,811::task::974::TaskManager.Task::(_decref) Task=`af34557f-8d43-4419-b8e3-a28523bece2c`::ref 0 aborting False
>Thread-3809::DEBUG::2014-04-10 18:05:15,996::task::579::TaskManager.Task::(_updateState) Task=`652da66f-499d-4015-a98e-eb920cfb9434`::moving from state init -> state preparing
>Thread-3809::INFO::2014-04-10 18:05:15,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3809::INFO::2014-04-10 18:05:15,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573027', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355042', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319792', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004968', 'lastCheck': '7.6', 'valid': True}}
>Thread-3809::DEBUG::2014-04-10 18:05:15,997::task::1168::TaskManager.Task::(prepare) Task=`652da66f-499d-4015-a98e-eb920cfb9434`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573027', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355042', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319792', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004968', 'lastCheck': '7.6', 'valid': True}}
>Thread-3809::DEBUG::2014-04-10 18:05:15,997::task::579::TaskManager.Task::(_updateState) Task=`652da66f-499d-4015-a98e-eb920cfb9434`::moving from state preparing -> state finished
>Thread-3809::DEBUG::2014-04-10 18:05:15,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3809::DEBUG::2014-04-10 18:05:15,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3809::DEBUG::2014-04-10 18:05:15,997::task::974::TaskManager.Task::(_decref) Task=`652da66f-499d-4015-a98e-eb920cfb9434`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:17,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:17,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000412532 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:18,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:18,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035386 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:18,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:18,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493836 s, 745 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:18,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:18,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00046102 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3812::DEBUG::2014-04-10 18:05:19,920::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3812::DEBUG::2014-04-10 18:05:19,921::task::579::TaskManager.Task::(_updateState) Task=`c658e0bc-a772-44d4-9219-ee8d790dc9ae`::moving from state init -> state preparing
>Thread-3812::INFO::2014-04-10 18:05:19,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3812::INFO::2014-04-10 18:05:19,922::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3812::DEBUG::2014-04-10 18:05:19,922::task::1168::TaskManager.Task::(prepare) Task=`c658e0bc-a772-44d4-9219-ee8d790dc9ae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3812::DEBUG::2014-04-10 18:05:19,922::task::579::TaskManager.Task::(_updateState) Task=`c658e0bc-a772-44d4-9219-ee8d790dc9ae`::moving from state preparing -> state finished
>Thread-3812::DEBUG::2014-04-10 18:05:19,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3812::DEBUG::2014-04-10 18:05:19,923::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3812::DEBUG::2014-04-10 18:05:19,923::task::974::TaskManager.Task::(_decref) Task=`c658e0bc-a772-44d4-9219-ee8d790dc9ae`::ref 0 aborting False
>Thread-3813::DEBUG::2014-04-10 18:05:19,930::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3813::DEBUG::2014-04-10 18:05:19,930::task::579::TaskManager.Task::(_updateState) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::moving from state init -> state preparing
>Thread-3813::INFO::2014-04-10 18:05:19,930::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3813::DEBUG::2014-04-10 18:05:19,931::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24bcbb1e-8ef5-448f-a90c-c88577b200e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3813::DEBUG::2014-04-10 18:05:19,931::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3813::DEBUG::2014-04-10 18:05:19,931::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3813::DEBUG::2014-04-10 18:05:19,932::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24bcbb1e-8ef5-448f-a90c-c88577b200e2`::Granted request
>Thread-3813::DEBUG::2014-04-10 18:05:19,932::task::811::TaskManager.Task::(resourceAcquired) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3813::DEBUG::2014-04-10 18:05:19,932::task::974::TaskManager.Task::(_decref) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::ref 1 aborting False
>Thread-3813::INFO::2014-04-10 18:05:19,934::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3813::DEBUG::2014-04-10 18:05:19,934::task::1168::TaskManager.Task::(prepare) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3813::DEBUG::2014-04-10 18:05:19,935::task::579::TaskManager.Task::(_updateState) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::moving from state preparing -> state finished
>Thread-3813::DEBUG::2014-04-10 18:05:19,935::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3813::DEBUG::2014-04-10 18:05:19,935::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3813::DEBUG::2014-04-10 18:05:19,935::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3813::DEBUG::2014-04-10 18:05:19,935::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3813::DEBUG::2014-04-10 18:05:19,936::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3813::DEBUG::2014-04-10 18:05:19,936::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3813::DEBUG::2014-04-10 18:05:19,936::task::974::TaskManager.Task::(_decref) Task=`d62d3a11-b253-454e-af3d-bd9c79bf7a11`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:27,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:27,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357265 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:28,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:28,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000257656 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:28,432::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:28,439::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480903 s, 765 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:28,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:28,640::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485768 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3817::DEBUG::2014-04-10 18:05:30,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3817::DEBUG::2014-04-10 18:05:30,013::task::579::TaskManager.Task::(_updateState) Task=`a19a3d41-7e12-474b-af8a-ec2e77b66a01`::moving from state init -> state preparing
>Thread-3817::INFO::2014-04-10 18:05:30,014::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3817::INFO::2014-04-10 18:05:30,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3817::DEBUG::2014-04-10 18:05:30,014::task::1168::TaskManager.Task::(prepare) Task=`a19a3d41-7e12-474b-af8a-ec2e77b66a01`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3817::DEBUG::2014-04-10 18:05:30,014::task::579::TaskManager.Task::(_updateState) Task=`a19a3d41-7e12-474b-af8a-ec2e77b66a01`::moving from state preparing -> state finished
>Thread-3817::DEBUG::2014-04-10 18:05:30,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3817::DEBUG::2014-04-10 18:05:30,015::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3817::DEBUG::2014-04-10 18:05:30,015::task::974::TaskManager.Task::(_decref) Task=`a19a3d41-7e12-474b-af8a-ec2e77b66a01`::ref 0 aborting False
>Thread-3818::DEBUG::2014-04-10 18:05:30,055::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-3818::DEBUG::2014-04-10 18:05:30,056::task::579::TaskManager.Task::(_updateState) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::moving from state init -> state preparing
>Thread-3818::INFO::2014-04-10 18:05:30,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3818::DEBUG::2014-04-10 18:05:30,056::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9700aec-0d3d-4803-a65a-7d7636e4386e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3818::DEBUG::2014-04-10 18:05:30,056::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3818::DEBUG::2014-04-10 18:05:30,057::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3818::DEBUG::2014-04-10 18:05:30,057::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9700aec-0d3d-4803-a65a-7d7636e4386e`::Granted request
>Thread-3818::DEBUG::2014-04-10 18:05:30,057::task::811::TaskManager.Task::(resourceAcquired) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3818::DEBUG::2014-04-10 18:05:30,057::task::974::TaskManager.Task::(_decref) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::ref 1 aborting False
>Thread-3818::INFO::2014-04-10 18:05:30,059::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3818::DEBUG::2014-04-10 18:05:30,060::task::1168::TaskManager.Task::(prepare) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3818::DEBUG::2014-04-10 18:05:30,060::task::579::TaskManager.Task::(_updateState) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::moving from state preparing -> state finished
>Thread-3818::DEBUG::2014-04-10 18:05:30,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3818::DEBUG::2014-04-10 18:05:30,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3818::DEBUG::2014-04-10 18:05:30,061::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3818::DEBUG::2014-04-10 18:05:30,061::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3818::DEBUG::2014-04-10 18:05:30,061::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3818::DEBUG::2014-04-10 18:05:30,061::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3818::DEBUG::2014-04-10 18:05:30,061::task::974::TaskManager.Task::(_decref) Task=`0d038efe-1d1d-4110-8782-bb1df07ef2ba`::ref 0 aborting False
>Thread-3819::DEBUG::2014-04-10 18:05:31,194::task::579::TaskManager.Task::(_updateState) Task=`7d1edf24-eab3-42ae-9b7e-312f83444ae8`::moving from state init -> state preparing
>Thread-3819::INFO::2014-04-10 18:05:31,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3819::INFO::2014-04-10 18:05:31,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485768', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357265', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257656', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480903', 'lastCheck': '2.8', 'valid': True}}
>Thread-3819::DEBUG::2014-04-10 18:05:31,195::task::1168::TaskManager.Task::(prepare) Task=`7d1edf24-eab3-42ae-9b7e-312f83444ae8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485768', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357265', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257656', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480903', 'lastCheck': '2.8', 'valid': True}}
>Thread-3819::DEBUG::2014-04-10 18:05:31,195::task::579::TaskManager.Task::(_updateState) Task=`7d1edf24-eab3-42ae-9b7e-312f83444ae8`::moving from state preparing -> state finished
>Thread-3819::DEBUG::2014-04-10 18:05:31,195::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3819::DEBUG::2014-04-10 18:05:31,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3819::DEBUG::2014-04-10 18:05:31,195::task::974::TaskManager.Task::(_decref) Task=`7d1edf24-eab3-42ae-9b7e-312f83444ae8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:37,894::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:05:37,910::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:05:37,911::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:05:37,916::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:05:37,918::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:05:37,918::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:05:37,918::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:05:37,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:37,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261656 s, 2.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:38,109::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:05:38,126::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:05:38,127::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:05:38,132::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:05:38,133::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:05:38,133::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:05:38,133::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:05:38,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:38,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273133 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:38,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:38,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000507371 s, 725 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:38,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:38,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406576 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3831::DEBUG::2014-04-10 18:05:40,135::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3831::DEBUG::2014-04-10 18:05:40,143::task::579::TaskManager.Task::(_updateState) Task=`9d4921a4-39d5-4cc0-bd93-0d9a3f0f201b`::moving from state init -> state preparing
>Thread-3831::INFO::2014-04-10 18:05:40,143::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3831::INFO::2014-04-10 18:05:40,143::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3831::DEBUG::2014-04-10 18:05:40,143::task::1168::TaskManager.Task::(prepare) Task=`9d4921a4-39d5-4cc0-bd93-0d9a3f0f201b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3831::DEBUG::2014-04-10 18:05:40,143::task::579::TaskManager.Task::(_updateState) Task=`9d4921a4-39d5-4cc0-bd93-0d9a3f0f201b`::moving from state preparing -> state finished
>Thread-3831::DEBUG::2014-04-10 18:05:40,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3831::DEBUG::2014-04-10 18:05:40,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3831::DEBUG::2014-04-10 18:05:40,144::task::974::TaskManager.Task::(_decref) Task=`9d4921a4-39d5-4cc0-bd93-0d9a3f0f201b`::ref 0 aborting False
>Thread-3832::DEBUG::2014-04-10 18:05:40,151::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3832::DEBUG::2014-04-10 18:05:40,151::task::579::TaskManager.Task::(_updateState) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::moving from state init -> state preparing
>Thread-3832::INFO::2014-04-10 18:05:40,151::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3832::DEBUG::2014-04-10 18:05:40,152::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eaa62df0-6a03-4b2c-b672-162c771d041e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3832::DEBUG::2014-04-10 18:05:40,152::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3832::DEBUG::2014-04-10 18:05:40,152::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3832::DEBUG::2014-04-10 18:05:40,152::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eaa62df0-6a03-4b2c-b672-162c771d041e`::Granted request
>Thread-3832::DEBUG::2014-04-10 18:05:40,152::task::811::TaskManager.Task::(resourceAcquired) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3832::DEBUG::2014-04-10 18:05:40,153::task::974::TaskManager.Task::(_decref) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::ref 1 aborting False
>Thread-3832::INFO::2014-04-10 18:05:40,154::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3832::DEBUG::2014-04-10 18:05:40,154::task::1168::TaskManager.Task::(prepare) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3832::DEBUG::2014-04-10 18:05:40,155::task::579::TaskManager.Task::(_updateState) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::moving from state preparing -> state finished
>Thread-3832::DEBUG::2014-04-10 18:05:40,155::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3832::DEBUG::2014-04-10 18:05:40,155::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3832::DEBUG::2014-04-10 18:05:40,155::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3832::DEBUG::2014-04-10 18:05:40,155::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3832::DEBUG::2014-04-10 18:05:40,156::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3832::DEBUG::2014-04-10 18:05:40,156::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3832::DEBUG::2014-04-10 18:05:40,156::task::974::TaskManager.Task::(_decref) Task=`46822a62-00a7-437d-95a2-91a4188bd858`::ref 0 aborting False
>Thread-3835::DEBUG::2014-04-10 18:05:46,354::task::579::TaskManager.Task::(_updateState) Task=`86c4d0c9-56b1-4356-b995-09c0533af4bc`::moving from state init -> state preparing
>Thread-3835::INFO::2014-04-10 18:05:46,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3835::INFO::2014-04-10 18:05:46,355::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406576', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261656', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273133', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507371', 'lastCheck': '7.9', 'valid': True}}
>Thread-3835::DEBUG::2014-04-10 18:05:46,355::task::1168::TaskManager.Task::(prepare) Task=`86c4d0c9-56b1-4356-b995-09c0533af4bc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406576', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261656', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273133', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507371', 'lastCheck': '7.9', 'valid': True}}
>Thread-3835::DEBUG::2014-04-10 18:05:46,355::task::579::TaskManager.Task::(_updateState) Task=`86c4d0c9-56b1-4356-b995-09c0533af4bc`::moving from state preparing -> state finished
>Thread-3835::DEBUG::2014-04-10 18:05:46,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3835::DEBUG::2014-04-10 18:05:46,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3835::DEBUG::2014-04-10 18:05:46,355::task::974::TaskManager.Task::(_decref) Task=`86c4d0c9-56b1-4356-b995-09c0533af4bc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:47,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:47,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305949 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:48,154::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:48,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028006 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:48,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:48,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487819 s, 754 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:48,663::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:48,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485413 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3838::DEBUG::2014-04-10 18:05:50,225::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3838::DEBUG::2014-04-10 18:05:50,225::task::579::TaskManager.Task::(_updateState) Task=`cee2a7b7-1511-4104-a1f6-1487205dd96e`::moving from state init -> state preparing
>Thread-3838::INFO::2014-04-10 18:05:50,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3838::INFO::2014-04-10 18:05:50,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3838::DEBUG::2014-04-10 18:05:50,227::task::1168::TaskManager.Task::(prepare) Task=`cee2a7b7-1511-4104-a1f6-1487205dd96e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3838::DEBUG::2014-04-10 18:05:50,227::task::579::TaskManager.Task::(_updateState) Task=`cee2a7b7-1511-4104-a1f6-1487205dd96e`::moving from state preparing -> state finished
>Thread-3838::DEBUG::2014-04-10 18:05:50,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3838::DEBUG::2014-04-10 18:05:50,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3838::DEBUG::2014-04-10 18:05:50,228::task::974::TaskManager.Task::(_decref) Task=`cee2a7b7-1511-4104-a1f6-1487205dd96e`::ref 0 aborting False
>Thread-3839::DEBUG::2014-04-10 18:05:50,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3839::DEBUG::2014-04-10 18:05:50,235::task::579::TaskManager.Task::(_updateState) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::moving from state init -> state preparing
>Thread-3839::INFO::2014-04-10 18:05:50,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3839::DEBUG::2014-04-10 18:05:50,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c0ea34f-6961-4ad0-aa5a-0448e1a9fa3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3839::DEBUG::2014-04-10 18:05:50,237::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3839::DEBUG::2014-04-10 18:05:50,237::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3839::DEBUG::2014-04-10 18:05:50,237::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4c0ea34f-6961-4ad0-aa5a-0448e1a9fa3f`::Granted request
>Thread-3839::DEBUG::2014-04-10 18:05:50,237::task::811::TaskManager.Task::(resourceAcquired) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3839::DEBUG::2014-04-10 18:05:50,238::task::974::TaskManager.Task::(_decref) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::ref 1 aborting False
>Thread-3839::INFO::2014-04-10 18:05:50,240::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3839::DEBUG::2014-04-10 18:05:50,240::task::1168::TaskManager.Task::(prepare) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3839::DEBUG::2014-04-10 18:05:50,240::task::579::TaskManager.Task::(_updateState) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::moving from state preparing -> state finished
>Thread-3839::DEBUG::2014-04-10 18:05:50,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3839::DEBUG::2014-04-10 18:05:50,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3839::DEBUG::2014-04-10 18:05:50,241::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3839::DEBUG::2014-04-10 18:05:50,241::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3839::DEBUG::2014-04-10 18:05:50,241::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3839::DEBUG::2014-04-10 18:05:50,241::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3839::DEBUG::2014-04-10 18:05:50,242::task::974::TaskManager.Task::(_decref) Task=`9250d894-b735-4887-bc79-d98ba8d06ca0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:05:57,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:05:57,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034622 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:05:58,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:05:58,173::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000268622 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:05:58,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:05:58,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00036275 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:05:58,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:05:58,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000355361 s, 1.9 MB/s\n'; <rc> = 0
>Thread-3843::DEBUG::2014-04-10 18:06:00,332::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-3843::DEBUG::2014-04-10 18:06:00,332::task::579::TaskManager.Task::(_updateState) Task=`3b9dc97c-39d0-4a55-991a-002688389d2d`::moving from state init -> state preparing
>Thread-3843::INFO::2014-04-10 18:06:00,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3843::INFO::2014-04-10 18:06:00,333::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3843::DEBUG::2014-04-10 18:06:00,333::task::1168::TaskManager.Task::(prepare) Task=`3b9dc97c-39d0-4a55-991a-002688389d2d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3843::DEBUG::2014-04-10 18:06:00,333::task::579::TaskManager.Task::(_updateState) Task=`3b9dc97c-39d0-4a55-991a-002688389d2d`::moving from state preparing -> state finished
>Thread-3843::DEBUG::2014-04-10 18:06:00,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3843::DEBUG::2014-04-10 18:06:00,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3843::DEBUG::2014-04-10 18:06:00,333::task::974::TaskManager.Task::(_decref) Task=`3b9dc97c-39d0-4a55-991a-002688389d2d`::ref 0 aborting False
>Thread-3844::DEBUG::2014-04-10 18:06:00,340::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-3844::DEBUG::2014-04-10 18:06:00,341::task::579::TaskManager.Task::(_updateState) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::moving from state init -> state preparing
>Thread-3844::INFO::2014-04-10 18:06:00,341::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3844::DEBUG::2014-04-10 18:06:00,341::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`91cf07e2-ca30-4cba-b673-42c050bb385f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3844::DEBUG::2014-04-10 18:06:00,342::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3844::DEBUG::2014-04-10 18:06:00,342::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3844::DEBUG::2014-04-10 18:06:00,342::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`91cf07e2-ca30-4cba-b673-42c050bb385f`::Granted request
>Thread-3844::DEBUG::2014-04-10 18:06:00,342::task::811::TaskManager.Task::(resourceAcquired) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3844::DEBUG::2014-04-10 18:06:00,342::task::974::TaskManager.Task::(_decref) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::ref 1 aborting False
>Thread-3844::INFO::2014-04-10 18:06:00,344::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3844::DEBUG::2014-04-10 18:06:00,344::task::1168::TaskManager.Task::(prepare) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3844::DEBUG::2014-04-10 18:06:00,345::task::579::TaskManager.Task::(_updateState) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::moving from state preparing -> state finished
>Thread-3844::DEBUG::2014-04-10 18:06:00,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3844::DEBUG::2014-04-10 18:06:00,345::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3844::DEBUG::2014-04-10 18:06:00,345::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3844::DEBUG::2014-04-10 18:06:00,345::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3844::DEBUG::2014-04-10 18:06:00,346::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3844::DEBUG::2014-04-10 18:06:00,346::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3844::DEBUG::2014-04-10 18:06:00,346::task::974::TaskManager.Task::(_decref) Task=`77052c57-96ba-4d13-9c24-9ed9b6488fba`::ref 0 aborting False
>Thread-3845::DEBUG::2014-04-10 18:06:01,510::task::579::TaskManager.Task::(_updateState) Task=`7c25852b-ec01-47d2-87ab-64123fe8d011`::moving from state init -> state preparing
>Thread-3845::INFO::2014-04-10 18:06:01,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3845::INFO::2014-04-10 18:06:01,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355361', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034622', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268622', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036275', 'lastCheck': '3.0', 'valid': True}}
>Thread-3845::DEBUG::2014-04-10 18:06:01,511::task::1168::TaskManager.Task::(prepare) Task=`7c25852b-ec01-47d2-87ab-64123fe8d011`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355361', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034622', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000268622', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036275', 'lastCheck': '3.0', 'valid': True}}
>Thread-3845::DEBUG::2014-04-10 18:06:01,511::task::579::TaskManager.Task::(_updateState) Task=`7c25852b-ec01-47d2-87ab-64123fe8d011`::moving from state preparing -> state finished
>Thread-3845::DEBUG::2014-04-10 18:06:01,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3845::DEBUG::2014-04-10 18:06:01,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3845::DEBUG::2014-04-10 18:06:01,512::task::974::TaskManager.Task::(_decref) Task=`7c25852b-ec01-47d2-87ab-64123fe8d011`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:07,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:07,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338506 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:08,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:08,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363405 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:08,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:08,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437556 s, 841 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:08,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:08,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000536585 s, 1.2 MB/s\n'; <rc> = 0
>Thread-3849::DEBUG::2014-04-10 18:06:10,438::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3849::DEBUG::2014-04-10 18:06:10,439::task::579::TaskManager.Task::(_updateState) Task=`d49232e7-e9e6-43a2-acfb-e8dd6a9c3e48`::moving from state init -> state preparing
>Thread-3849::INFO::2014-04-10 18:06:10,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3849::INFO::2014-04-10 18:06:10,440::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3849::DEBUG::2014-04-10 18:06:10,440::task::1168::TaskManager.Task::(prepare) Task=`d49232e7-e9e6-43a2-acfb-e8dd6a9c3e48`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3849::DEBUG::2014-04-10 18:06:10,440::task::579::TaskManager.Task::(_updateState) Task=`d49232e7-e9e6-43a2-acfb-e8dd6a9c3e48`::moving from state preparing -> state finished
>Thread-3849::DEBUG::2014-04-10 18:06:10,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3849::DEBUG::2014-04-10 18:06:10,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3849::DEBUG::2014-04-10 18:06:10,440::task::974::TaskManager.Task::(_decref) Task=`d49232e7-e9e6-43a2-acfb-e8dd6a9c3e48`::ref 0 aborting False
>Thread-3850::DEBUG::2014-04-10 18:06:10,447::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3850::DEBUG::2014-04-10 18:06:10,448::task::579::TaskManager.Task::(_updateState) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::moving from state init -> state preparing
>Thread-3850::INFO::2014-04-10 18:06:10,448::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3850::DEBUG::2014-04-10 18:06:10,448::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5608a6a9-7713-47ef-a569-993315bf14af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3850::DEBUG::2014-04-10 18:06:10,449::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3850::DEBUG::2014-04-10 18:06:10,449::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3850::DEBUG::2014-04-10 18:06:10,449::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5608a6a9-7713-47ef-a569-993315bf14af`::Granted request
>Thread-3850::DEBUG::2014-04-10 18:06:10,449::task::811::TaskManager.Task::(resourceAcquired) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3850::DEBUG::2014-04-10 18:06:10,449::task::974::TaskManager.Task::(_decref) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::ref 1 aborting False
>Thread-3850::INFO::2014-04-10 18:06:10,451::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3850::DEBUG::2014-04-10 18:06:10,451::task::1168::TaskManager.Task::(prepare) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3850::DEBUG::2014-04-10 18:06:10,452::task::579::TaskManager.Task::(_updateState) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::moving from state preparing -> state finished
>Thread-3850::DEBUG::2014-04-10 18:06:10,452::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3850::DEBUG::2014-04-10 18:06:10,452::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3850::DEBUG::2014-04-10 18:06:10,452::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3850::DEBUG::2014-04-10 18:06:10,452::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3850::DEBUG::2014-04-10 18:06:10,453::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3850::DEBUG::2014-04-10 18:06:10,453::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3850::DEBUG::2014-04-10 18:06:10,453::task::974::TaskManager.Task::(_decref) Task=`4aeb15f6-ee6d-4350-b380-dc775ed8f4f9`::ref 0 aborting False
>Thread-3853::DEBUG::2014-04-10 18:06:16,678::task::579::TaskManager.Task::(_updateState) Task=`c267670a-6934-468a-b241-4d3d935ca693`::moving from state init -> state preparing
>Thread-3853::INFO::2014-04-10 18:06:16,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3853::INFO::2014-04-10 18:06:16,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536585', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338506', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363405', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437556', 'lastCheck': '8.2', 'valid': True}}
>Thread-3853::DEBUG::2014-04-10 18:06:16,678::task::1168::TaskManager.Task::(prepare) Task=`c267670a-6934-468a-b241-4d3d935ca693`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536585', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338506', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363405', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437556', 'lastCheck': '8.2', 'valid': True}}
>Thread-3853::DEBUG::2014-04-10 18:06:16,679::task::579::TaskManager.Task::(_updateState) Task=`c267670a-6934-468a-b241-4d3d935ca693`::moving from state preparing -> state finished
>Thread-3853::DEBUG::2014-04-10 18:06:16,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3853::DEBUG::2014-04-10 18:06:16,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3853::DEBUG::2014-04-10 18:06:16,679::task::974::TaskManager.Task::(_decref) Task=`c267670a-6934-468a-b241-4d3d935ca693`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:18,000::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:18,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026737 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:18,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:18,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256559 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:18,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:18,507::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476793 s, 772 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:18,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:18,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000450975 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3856::DEBUG::2014-04-10 18:06:20,711::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3856::DEBUG::2014-04-10 18:06:20,712::task::579::TaskManager.Task::(_updateState) Task=`afdd4a5c-7e2b-46c4-a6ce-c3d835c80565`::moving from state init -> state preparing
>Thread-3856::INFO::2014-04-10 18:06:20,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3856::INFO::2014-04-10 18:06:20,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3856::DEBUG::2014-04-10 18:06:20,713::task::1168::TaskManager.Task::(prepare) Task=`afdd4a5c-7e2b-46c4-a6ce-c3d835c80565`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3856::DEBUG::2014-04-10 18:06:20,713::task::579::TaskManager.Task::(_updateState) Task=`afdd4a5c-7e2b-46c4-a6ce-c3d835c80565`::moving from state preparing -> state finished
>Thread-3856::DEBUG::2014-04-10 18:06:20,713::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3856::DEBUG::2014-04-10 18:06:20,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3856::DEBUG::2014-04-10 18:06:20,713::task::974::TaskManager.Task::(_decref) Task=`afdd4a5c-7e2b-46c4-a6ce-c3d835c80565`::ref 0 aborting False
>Thread-3857::DEBUG::2014-04-10 18:06:20,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3857::DEBUG::2014-04-10 18:06:20,720::task::579::TaskManager.Task::(_updateState) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::moving from state init -> state preparing
>Thread-3857::INFO::2014-04-10 18:06:20,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3857::DEBUG::2014-04-10 18:06:20,721::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c2b43989-bc6d-4a71-9ac1-c0d0aa55839e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3857::DEBUG::2014-04-10 18:06:20,721::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3857::DEBUG::2014-04-10 18:06:20,722::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3857::DEBUG::2014-04-10 18:06:20,722::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c2b43989-bc6d-4a71-9ac1-c0d0aa55839e`::Granted request
>Thread-3857::DEBUG::2014-04-10 18:06:20,722::task::811::TaskManager.Task::(resourceAcquired) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3857::DEBUG::2014-04-10 18:06:20,722::task::974::TaskManager.Task::(_decref) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::ref 1 aborting False
>Thread-3857::INFO::2014-04-10 18:06:20,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3857::DEBUG::2014-04-10 18:06:20,725::task::1168::TaskManager.Task::(prepare) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3857::DEBUG::2014-04-10 18:06:20,725::task::579::TaskManager.Task::(_updateState) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::moving from state preparing -> state finished
>Thread-3857::DEBUG::2014-04-10 18:06:20,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3857::DEBUG::2014-04-10 18:06:20,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3857::DEBUG::2014-04-10 18:06:20,725::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3857::DEBUG::2014-04-10 18:06:20,726::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3857::DEBUG::2014-04-10 18:06:20,726::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3857::DEBUG::2014-04-10 18:06:20,726::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3857::DEBUG::2014-04-10 18:06:20,726::task::974::TaskManager.Task::(_decref) Task=`4f90e764-85d9-4510-ad2f-f9da9442bbb8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:28,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:28,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00039556 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:28,211::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:28,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026864 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:28,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:28,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0005736 s, 642 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:28,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:28,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000513634 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3861::DEBUG::2014-04-10 18:06:30,802::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3861::DEBUG::2014-04-10 18:06:30,803::task::579::TaskManager.Task::(_updateState) Task=`57a852e5-0340-479d-a3b9-f3438ee0b215`::moving from state init -> state preparing
>Thread-3861::INFO::2014-04-10 18:06:30,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3861::INFO::2014-04-10 18:06:30,803::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3861::DEBUG::2014-04-10 18:06:30,804::task::1168::TaskManager.Task::(prepare) Task=`57a852e5-0340-479d-a3b9-f3438ee0b215`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3861::DEBUG::2014-04-10 18:06:30,804::task::579::TaskManager.Task::(_updateState) Task=`57a852e5-0340-479d-a3b9-f3438ee0b215`::moving from state preparing -> state finished
>Thread-3861::DEBUG::2014-04-10 18:06:30,804::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3861::DEBUG::2014-04-10 18:06:30,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3861::DEBUG::2014-04-10 18:06:30,804::task::974::TaskManager.Task::(_decref) Task=`57a852e5-0340-479d-a3b9-f3438ee0b215`::ref 0 aborting False
>Thread-3862::DEBUG::2014-04-10 18:06:30,811::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-3862::DEBUG::2014-04-10 18:06:30,811::task::579::TaskManager.Task::(_updateState) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::moving from state init -> state preparing
>Thread-3862::INFO::2014-04-10 18:06:30,811::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3862::DEBUG::2014-04-10 18:06:30,812::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`871b0a7f-eaf2-493e-a37c-d68784b14286`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3862::DEBUG::2014-04-10 18:06:30,812::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3862::DEBUG::2014-04-10 18:06:30,812::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3862::DEBUG::2014-04-10 18:06:30,812::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`871b0a7f-eaf2-493e-a37c-d68784b14286`::Granted request
>Thread-3862::DEBUG::2014-04-10 18:06:30,812::task::811::TaskManager.Task::(resourceAcquired) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3862::DEBUG::2014-04-10 18:06:30,813::task::974::TaskManager.Task::(_decref) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::ref 1 aborting False
>Thread-3862::INFO::2014-04-10 18:06:30,814::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::task::1168::TaskManager.Task::(prepare) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::task::579::TaskManager.Task::(_updateState) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::moving from state preparing -> state finished
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3862::DEBUG::2014-04-10 18:06:30,815::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3862::DEBUG::2014-04-10 18:06:30,816::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3862::DEBUG::2014-04-10 18:06:30,816::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3862::DEBUG::2014-04-10 18:06:30,816::task::974::TaskManager.Task::(_decref) Task=`31d62140-5049-4108-b5f5-3fbe21e84b21`::ref 0 aborting False
>Thread-3863::DEBUG::2014-04-10 18:06:31,843::task::579::TaskManager.Task::(_updateState) Task=`b2896df7-672e-4956-ae23-bad48848b012`::moving from state init -> state preparing
>Thread-3863::INFO::2014-04-10 18:06:31,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3863::INFO::2014-04-10 18:06:31,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513634', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039556', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026864', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005736', 'lastCheck': '3.3', 'valid': True}}
>Thread-3863::DEBUG::2014-04-10 18:06:31,843::task::1168::TaskManager.Task::(prepare) Task=`b2896df7-672e-4956-ae23-bad48848b012`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513634', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039556', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026864', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005736', 'lastCheck': '3.3', 'valid': True}}
>Thread-3863::DEBUG::2014-04-10 18:06:31,843::task::579::TaskManager.Task::(_updateState) Task=`b2896df7-672e-4956-ae23-bad48848b012`::moving from state preparing -> state finished
>Thread-3863::DEBUG::2014-04-10 18:06:31,844::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3863::DEBUG::2014-04-10 18:06:31,844::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3863::DEBUG::2014-04-10 18:06:31,844::task::974::TaskManager.Task::(_decref) Task=`b2896df7-672e-4956-ae23-bad48848b012`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:38,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:38,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000322836 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:38,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:38,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250713 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:38,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:38,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000375091 s, 981 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:38,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:38,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446547 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3867::DEBUG::2014-04-10 18:06:40,892::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3867::DEBUG::2014-04-10 18:06:40,893::task::579::TaskManager.Task::(_updateState) Task=`2f02d304-0883-44f8-8c03-bc0b4ccddbac`::moving from state init -> state preparing
>Thread-3867::INFO::2014-04-10 18:06:40,893::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3867::INFO::2014-04-10 18:06:40,893::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3867::DEBUG::2014-04-10 18:06:40,893::task::1168::TaskManager.Task::(prepare) Task=`2f02d304-0883-44f8-8c03-bc0b4ccddbac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3867::DEBUG::2014-04-10 18:06:40,893::task::579::TaskManager.Task::(_updateState) Task=`2f02d304-0883-44f8-8c03-bc0b4ccddbac`::moving from state preparing -> state finished
>Thread-3867::DEBUG::2014-04-10 18:06:40,894::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3867::DEBUG::2014-04-10 18:06:40,894::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3867::DEBUG::2014-04-10 18:06:40,894::task::974::TaskManager.Task::(_decref) Task=`2f02d304-0883-44f8-8c03-bc0b4ccddbac`::ref 0 aborting False
>Thread-3868::DEBUG::2014-04-10 18:06:40,901::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-3868::DEBUG::2014-04-10 18:06:40,901::task::579::TaskManager.Task::(_updateState) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::moving from state init -> state preparing
>Thread-3868::INFO::2014-04-10 18:06:40,901::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3868::DEBUG::2014-04-10 18:06:40,902::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`175cf50b-1d43-444d-8b0a-7827eb39eaa3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3868::DEBUG::2014-04-10 18:06:40,902::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3868::DEBUG::2014-04-10 18:06:40,902::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3868::DEBUG::2014-04-10 18:06:40,902::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`175cf50b-1d43-444d-8b0a-7827eb39eaa3`::Granted request
>Thread-3868::DEBUG::2014-04-10 18:06:40,902::task::811::TaskManager.Task::(resourceAcquired) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3868::DEBUG::2014-04-10 18:06:40,903::task::974::TaskManager.Task::(_decref) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::ref 1 aborting False
>Thread-3868::INFO::2014-04-10 18:06:40,904::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3868::DEBUG::2014-04-10 18:06:40,904::task::1168::TaskManager.Task::(prepare) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::task::579::TaskManager.Task::(_updateState) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::moving from state preparing -> state finished
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3868::DEBUG::2014-04-10 18:06:40,905::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3868::DEBUG::2014-04-10 18:06:40,906::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3868::DEBUG::2014-04-10 18:06:40,906::task::974::TaskManager.Task::(_decref) Task=`4dff8d47-0bbe-4f77-b2f9-7354890fdf8d`::ref 0 aborting False
>Thread-3871::DEBUG::2014-04-10 18:06:47,006::task::579::TaskManager.Task::(_updateState) Task=`e5f969e3-474d-454a-bedd-119c74deb921`::moving from state init -> state preparing
>Thread-3871::INFO::2014-04-10 18:06:47,006::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3871::INFO::2014-04-10 18:06:47,006::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446547', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322836', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250713', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375091', 'lastCheck': '8.5', 'valid': True}}
>Thread-3871::DEBUG::2014-04-10 18:06:47,006::task::1168::TaskManager.Task::(prepare) Task=`e5f969e3-474d-454a-bedd-119c74deb921`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446547', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000322836', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250713', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375091', 'lastCheck': '8.5', 'valid': True}}
>Thread-3871::DEBUG::2014-04-10 18:06:47,007::task::579::TaskManager.Task::(_updateState) Task=`e5f969e3-474d-454a-bedd-119c74deb921`::moving from state preparing -> state finished
>Thread-3871::DEBUG::2014-04-10 18:06:47,007::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3871::DEBUG::2014-04-10 18:06:47,007::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3871::DEBUG::2014-04-10 18:06:47,007::task::974::TaskManager.Task::(_decref) Task=`e5f969e3-474d-454a-bedd-119c74deb921`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:48,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:48,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267872 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:48,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:48,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370316 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:48,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:48,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000461439 s, 798 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:48,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:48,759::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445172 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3874::DEBUG::2014-04-10 18:06:50,982::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3874::DEBUG::2014-04-10 18:06:50,983::task::579::TaskManager.Task::(_updateState) Task=`172a9bd9-621f-47a6-b5ac-7ad3e518aa8e`::moving from state init -> state preparing
>Thread-3874::INFO::2014-04-10 18:06:50,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3874::INFO::2014-04-10 18:06:50,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3874::DEBUG::2014-04-10 18:06:50,983::task::1168::TaskManager.Task::(prepare) Task=`172a9bd9-621f-47a6-b5ac-7ad3e518aa8e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3874::DEBUG::2014-04-10 18:06:50,984::task::579::TaskManager.Task::(_updateState) Task=`172a9bd9-621f-47a6-b5ac-7ad3e518aa8e`::moving from state preparing -> state finished
>Thread-3874::DEBUG::2014-04-10 18:06:50,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3874::DEBUG::2014-04-10 18:06:50,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3874::DEBUG::2014-04-10 18:06:50,984::task::974::TaskManager.Task::(_decref) Task=`172a9bd9-621f-47a6-b5ac-7ad3e518aa8e`::ref 0 aborting False
>Thread-3875::DEBUG::2014-04-10 18:06:50,992::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3875::DEBUG::2014-04-10 18:06:50,992::task::579::TaskManager.Task::(_updateState) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::moving from state init -> state preparing
>Thread-3875::INFO::2014-04-10 18:06:50,992::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3875::DEBUG::2014-04-10 18:06:50,993::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`11c9f87a-2fa0-4da9-81e7-0f28f4133fa6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3875::DEBUG::2014-04-10 18:06:50,993::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3875::DEBUG::2014-04-10 18:06:50,993::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3875::DEBUG::2014-04-10 18:06:50,993::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`11c9f87a-2fa0-4da9-81e7-0f28f4133fa6`::Granted request
>Thread-3875::DEBUG::2014-04-10 18:06:50,994::task::811::TaskManager.Task::(resourceAcquired) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3875::DEBUG::2014-04-10 18:06:50,995::task::974::TaskManager.Task::(_decref) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::ref 1 aborting False
>Thread-3875::INFO::2014-04-10 18:06:50,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3875::DEBUG::2014-04-10 18:06:50,997::task::1168::TaskManager.Task::(prepare) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3875::DEBUG::2014-04-10 18:06:50,997::task::579::TaskManager.Task::(_updateState) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::moving from state preparing -> state finished
>Thread-3875::DEBUG::2014-04-10 18:06:50,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3875::DEBUG::2014-04-10 18:06:50,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3875::DEBUG::2014-04-10 18:06:50,998::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3875::DEBUG::2014-04-10 18:06:50,998::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3875::DEBUG::2014-04-10 18:06:50,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3875::DEBUG::2014-04-10 18:06:50,998::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3875::DEBUG::2014-04-10 18:06:50,999::task::974::TaskManager.Task::(_decref) Task=`c4e23e0c-ecc1-48cc-ad20-82d0abc4c380`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:06:58,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:06:58,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028924 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:06:58,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:06:58,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365546 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:06:58,549::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:06:58,565::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:06:58,566::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:06:58,572::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:06:58,574::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:06:58,574::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:06:58,574::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:06:58,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:06:58,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000353627 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:06:58,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:06:58,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000358746 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3883::DEBUG::2014-04-10 18:07:01,407::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3883::DEBUG::2014-04-10 18:07:01,407::task::579::TaskManager.Task::(_updateState) Task=`5c9da528-a058-4615-bb03-55af0661da08`::moving from state init -> state preparing
>Thread-3883::INFO::2014-04-10 18:07:01,408::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3883::INFO::2014-04-10 18:07:01,408::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3883::DEBUG::2014-04-10 18:07:01,408::task::1168::TaskManager.Task::(prepare) Task=`5c9da528-a058-4615-bb03-55af0661da08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3883::DEBUG::2014-04-10 18:07:01,408::task::579::TaskManager.Task::(_updateState) Task=`5c9da528-a058-4615-bb03-55af0661da08`::moving from state preparing -> state finished
>Thread-3883::DEBUG::2014-04-10 18:07:01,408::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3883::DEBUG::2014-04-10 18:07:01,408::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3883::DEBUG::2014-04-10 18:07:01,409::task::974::TaskManager.Task::(_decref) Task=`5c9da528-a058-4615-bb03-55af0661da08`::ref 0 aborting False
>Thread-3884::DEBUG::2014-04-10 18:07:01,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45b0eed6]
>Thread-3884::DEBUG::2014-04-10 18:07:01,415::task::579::TaskManager.Task::(_updateState) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::moving from state init -> state preparing
>Thread-3884::INFO::2014-04-10 18:07:01,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3884::DEBUG::2014-04-10 18:07:01,416::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d30e12f0-3c32-438d-8653-155304be4d0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3884::DEBUG::2014-04-10 18:07:01,416::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3884::DEBUG::2014-04-10 18:07:01,416::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3884::DEBUG::2014-04-10 18:07:01,417::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d30e12f0-3c32-438d-8653-155304be4d0f`::Granted request
>Thread-3884::DEBUG::2014-04-10 18:07:01,417::task::811::TaskManager.Task::(resourceAcquired) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3884::DEBUG::2014-04-10 18:07:01,417::task::974::TaskManager.Task::(_decref) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::ref 1 aborting False
>Thread-3884::INFO::2014-04-10 18:07:01,419::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3884::DEBUG::2014-04-10 18:07:01,419::task::1168::TaskManager.Task::(prepare) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3884::DEBUG::2014-04-10 18:07:01,419::task::579::TaskManager.Task::(_updateState) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::moving from state preparing -> state finished
>Thread-3884::DEBUG::2014-04-10 18:07:01,419::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3884::DEBUG::2014-04-10 18:07:01,419::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3884::DEBUG::2014-04-10 18:07:01,420::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3884::DEBUG::2014-04-10 18:07:01,420::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3884::DEBUG::2014-04-10 18:07:01,420::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3884::DEBUG::2014-04-10 18:07:01,420::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3884::DEBUG::2014-04-10 18:07:01,420::task::974::TaskManager.Task::(_decref) Task=`1d1b2577-4364-4c54-bd80-de73b665706d`::ref 0 aborting False
>Thread-3885::DEBUG::2014-04-10 18:07:02,193::task::579::TaskManager.Task::(_updateState) Task=`784f9be2-bfb2-44be-83d2-6f4f01eadda8`::moving from state init -> state preparing
>Thread-3885::INFO::2014-04-10 18:07:02,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3885::INFO::2014-04-10 18:07:02,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358746', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028924', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365546', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353627', 'lastCheck': '3.6', 'valid': True}}
>Thread-3885::DEBUG::2014-04-10 18:07:02,194::task::1168::TaskManager.Task::(prepare) Task=`784f9be2-bfb2-44be-83d2-6f4f01eadda8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358746', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028924', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365546', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353627', 'lastCheck': '3.6', 'valid': True}}
>Thread-3885::DEBUG::2014-04-10 18:07:02,194::task::579::TaskManager.Task::(_updateState) Task=`784f9be2-bfb2-44be-83d2-6f4f01eadda8`::moving from state preparing -> state finished
>Thread-3885::DEBUG::2014-04-10 18:07:02,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3885::DEBUG::2014-04-10 18:07:02,195::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3885::DEBUG::2014-04-10 18:07:02,195::task::974::TaskManager.Task::(_decref) Task=`784f9be2-bfb2-44be-83d2-6f4f01eadda8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:08,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:08,104::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377507 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:08,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:08,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345933 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:08,593::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:08,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484322 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:08,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:08,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446073 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3890::DEBUG::2014-04-10 18:07:11,497::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3890::DEBUG::2014-04-10 18:07:11,498::task::579::TaskManager.Task::(_updateState) Task=`fb85a873-fe00-4e8d-ba28-27abfffdab5b`::moving from state init -> state preparing
>Thread-3890::INFO::2014-04-10 18:07:11,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3890::INFO::2014-04-10 18:07:11,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3890::DEBUG::2014-04-10 18:07:11,498::task::1168::TaskManager.Task::(prepare) Task=`fb85a873-fe00-4e8d-ba28-27abfffdab5b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3890::DEBUG::2014-04-10 18:07:11,498::task::579::TaskManager.Task::(_updateState) Task=`fb85a873-fe00-4e8d-ba28-27abfffdab5b`::moving from state preparing -> state finished
>Thread-3890::DEBUG::2014-04-10 18:07:11,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3890::DEBUG::2014-04-10 18:07:11,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3890::DEBUG::2014-04-10 18:07:11,499::task::974::TaskManager.Task::(_decref) Task=`fb85a873-fe00-4e8d-ba28-27abfffdab5b`::ref 0 aborting False
>Thread-3891::DEBUG::2014-04-10 18:07:11,505::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3891::DEBUG::2014-04-10 18:07:11,506::task::579::TaskManager.Task::(_updateState) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::moving from state init -> state preparing
>Thread-3891::INFO::2014-04-10 18:07:11,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3891::DEBUG::2014-04-10 18:07:11,506::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41a43d37-419d-4969-9ee6-5f5008799363`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3891::DEBUG::2014-04-10 18:07:11,506::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3891::DEBUG::2014-04-10 18:07:11,507::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3891::DEBUG::2014-04-10 18:07:11,507::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41a43d37-419d-4969-9ee6-5f5008799363`::Granted request
>Thread-3891::DEBUG::2014-04-10 18:07:11,507::task::811::TaskManager.Task::(resourceAcquired) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3891::DEBUG::2014-04-10 18:07:11,507::task::974::TaskManager.Task::(_decref) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::ref 1 aborting False
>Thread-3891::INFO::2014-04-10 18:07:11,509::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3891::DEBUG::2014-04-10 18:07:11,509::task::1168::TaskManager.Task::(prepare) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3891::DEBUG::2014-04-10 18:07:11,509::task::579::TaskManager.Task::(_updateState) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::moving from state preparing -> state finished
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3891::DEBUG::2014-04-10 18:07:11,510::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3891::DEBUG::2014-04-10 18:07:11,511::task::974::TaskManager.Task::(_decref) Task=`9afe1ac7-5afb-41f5-ad9e-5753390282a0`::ref 0 aborting False
>Thread-3893::DEBUG::2014-04-10 18:07:17,361::task::579::TaskManager.Task::(_updateState) Task=`d9277992-695d-4420-aad3-ce5aa0226f6b`::moving from state init -> state preparing
>Thread-3893::INFO::2014-04-10 18:07:17,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3893::INFO::2014-04-10 18:07:17,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446073', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377507', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345933', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484322', 'lastCheck': '8.8', 'valid': True}}
>Thread-3893::DEBUG::2014-04-10 18:07:17,361::task::1168::TaskManager.Task::(prepare) Task=`d9277992-695d-4420-aad3-ce5aa0226f6b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446073', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377507', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345933', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484322', 'lastCheck': '8.8', 'valid': True}}
>Thread-3893::DEBUG::2014-04-10 18:07:17,362::task::579::TaskManager.Task::(_updateState) Task=`d9277992-695d-4420-aad3-ce5aa0226f6b`::moving from state preparing -> state finished
>Thread-3893::DEBUG::2014-04-10 18:07:17,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3893::DEBUG::2014-04-10 18:07:17,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3893::DEBUG::2014-04-10 18:07:17,362::task::974::TaskManager.Task::(_decref) Task=`d9277992-695d-4420-aad3-ce5aa0226f6b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:18,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:18,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365792 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:18,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:18,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349755 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:18,607::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:18,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000401381 s, 917 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:18,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:18,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000518388 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3896::DEBUG::2014-04-10 18:07:21,604::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3896::DEBUG::2014-04-10 18:07:21,604::task::579::TaskManager.Task::(_updateState) Task=`62a15609-99de-4de0-9928-f2ed01bdb9df`::moving from state init -> state preparing
>Thread-3896::INFO::2014-04-10 18:07:21,605::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3896::INFO::2014-04-10 18:07:21,605::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3896::DEBUG::2014-04-10 18:07:21,605::task::1168::TaskManager.Task::(prepare) Task=`62a15609-99de-4de0-9928-f2ed01bdb9df`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3896::DEBUG::2014-04-10 18:07:21,605::task::579::TaskManager.Task::(_updateState) Task=`62a15609-99de-4de0-9928-f2ed01bdb9df`::moving from state preparing -> state finished
>Thread-3896::DEBUG::2014-04-10 18:07:21,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3896::DEBUG::2014-04-10 18:07:21,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3896::DEBUG::2014-04-10 18:07:21,606::task::974::TaskManager.Task::(_decref) Task=`62a15609-99de-4de0-9928-f2ed01bdb9df`::ref 0 aborting False
>Thread-3897::DEBUG::2014-04-10 18:07:21,612::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3897::DEBUG::2014-04-10 18:07:21,612::task::579::TaskManager.Task::(_updateState) Task=`108b4623-a252-45f7-be56-3556e5b08284`::moving from state init -> state preparing
>Thread-3897::INFO::2014-04-10 18:07:21,613::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3897::DEBUG::2014-04-10 18:07:21,613::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ade12c84-ca01-4083-a9b4-4c3207ac1ec1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3897::DEBUG::2014-04-10 18:07:21,613::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3897::DEBUG::2014-04-10 18:07:21,613::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3897::DEBUG::2014-04-10 18:07:21,614::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ade12c84-ca01-4083-a9b4-4c3207ac1ec1`::Granted request
>Thread-3897::DEBUG::2014-04-10 18:07:21,614::task::811::TaskManager.Task::(resourceAcquired) Task=`108b4623-a252-45f7-be56-3556e5b08284`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3897::DEBUG::2014-04-10 18:07:21,614::task::974::TaskManager.Task::(_decref) Task=`108b4623-a252-45f7-be56-3556e5b08284`::ref 1 aborting False
>Thread-3897::INFO::2014-04-10 18:07:21,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3897::DEBUG::2014-04-10 18:07:21,616::task::1168::TaskManager.Task::(prepare) Task=`108b4623-a252-45f7-be56-3556e5b08284`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3897::DEBUG::2014-04-10 18:07:21,616::task::579::TaskManager.Task::(_updateState) Task=`108b4623-a252-45f7-be56-3556e5b08284`::moving from state preparing -> state finished
>Thread-3897::DEBUG::2014-04-10 18:07:21,616::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3897::DEBUG::2014-04-10 18:07:21,617::task::974::TaskManager.Task::(_decref) Task=`108b4623-a252-45f7-be56-3556e5b08284`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:28,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:28,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035476 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:28,299::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:28,304::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000236795 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:28,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:28,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000471002 s, 781 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:28,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:28,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00037434 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3901::DEBUG::2014-04-10 18:07:31,739::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3901::DEBUG::2014-04-10 18:07:31,739::task::579::TaskManager.Task::(_updateState) Task=`5393eb1c-a288-48a3-bf4e-69c1863adab9`::moving from state init -> state preparing
>Thread-3901::INFO::2014-04-10 18:07:31,739::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3901::INFO::2014-04-10 18:07:31,740::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3901::DEBUG::2014-04-10 18:07:31,740::task::1168::TaskManager.Task::(prepare) Task=`5393eb1c-a288-48a3-bf4e-69c1863adab9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3901::DEBUG::2014-04-10 18:07:31,740::task::579::TaskManager.Task::(_updateState) Task=`5393eb1c-a288-48a3-bf4e-69c1863adab9`::moving from state preparing -> state finished
>Thread-3901::DEBUG::2014-04-10 18:07:31,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3901::DEBUG::2014-04-10 18:07:31,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3901::DEBUG::2014-04-10 18:07:31,740::task::974::TaskManager.Task::(_decref) Task=`5393eb1c-a288-48a3-bf4e-69c1863adab9`::ref 0 aborting False
>Thread-3902::DEBUG::2014-04-10 18:07:31,747::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3902::DEBUG::2014-04-10 18:07:31,747::task::579::TaskManager.Task::(_updateState) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::moving from state init -> state preparing
>Thread-3902::INFO::2014-04-10 18:07:31,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3902::DEBUG::2014-04-10 18:07:31,748::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f9bdf5-08e6-490e-98cf-b8747d373c27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3902::DEBUG::2014-04-10 18:07:31,749::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3902::DEBUG::2014-04-10 18:07:31,749::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3902::DEBUG::2014-04-10 18:07:31,749::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f9bdf5-08e6-490e-98cf-b8747d373c27`::Granted request
>Thread-3902::DEBUG::2014-04-10 18:07:31,750::task::811::TaskManager.Task::(resourceAcquired) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3902::DEBUG::2014-04-10 18:07:31,750::task::974::TaskManager.Task::(_decref) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::ref 1 aborting False
>Thread-3902::INFO::2014-04-10 18:07:31,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3902::DEBUG::2014-04-10 18:07:31,752::task::1168::TaskManager.Task::(prepare) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3902::DEBUG::2014-04-10 18:07:31,752::task::579::TaskManager.Task::(_updateState) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::moving from state preparing -> state finished
>Thread-3902::DEBUG::2014-04-10 18:07:31,752::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3902::DEBUG::2014-04-10 18:07:31,752::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3902::DEBUG::2014-04-10 18:07:31,753::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3902::DEBUG::2014-04-10 18:07:31,753::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3902::DEBUG::2014-04-10 18:07:31,753::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3902::DEBUG::2014-04-10 18:07:31,753::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3902::DEBUG::2014-04-10 18:07:31,753::task::974::TaskManager.Task::(_decref) Task=`0ea3c488-7554-4c08-b5d5-16c16b4eb9a4`::ref 0 aborting False
>Thread-3903::DEBUG::2014-04-10 18:07:32,516::task::579::TaskManager.Task::(_updateState) Task=`50bdc125-ddb2-45fd-8dc6-5e67ffabb1a5`::moving from state init -> state preparing
>Thread-3903::INFO::2014-04-10 18:07:32,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3903::INFO::2014-04-10 18:07:32,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037434', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035476', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236795', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471002', 'lastCheck': '3.9', 'valid': True}}
>Thread-3903::DEBUG::2014-04-10 18:07:32,517::task::1168::TaskManager.Task::(prepare) Task=`50bdc125-ddb2-45fd-8dc6-5e67ffabb1a5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037434', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035476', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000236795', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471002', 'lastCheck': '3.9', 'valid': True}}
>Thread-3903::DEBUG::2014-04-10 18:07:32,517::task::579::TaskManager.Task::(_updateState) Task=`50bdc125-ddb2-45fd-8dc6-5e67ffabb1a5`::moving from state preparing -> state finished
>Thread-3903::DEBUG::2014-04-10 18:07:32,517::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3903::DEBUG::2014-04-10 18:07:32,517::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3903::DEBUG::2014-04-10 18:07:32,517::task::974::TaskManager.Task::(_decref) Task=`50bdc125-ddb2-45fd-8dc6-5e67ffabb1a5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:38,147::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:38,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273469 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:38,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:38,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000394817 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:38,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:38,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000524838 s, 701 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:38,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:38,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00049922 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3908::DEBUG::2014-04-10 18:07:41,844::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3908::DEBUG::2014-04-10 18:07:41,845::task::579::TaskManager.Task::(_updateState) Task=`64bc32e3-58aa-4acc-9a92-263721fc95e3`::moving from state init -> state preparing
>Thread-3908::INFO::2014-04-10 18:07:41,845::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3908::INFO::2014-04-10 18:07:41,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3908::DEBUG::2014-04-10 18:07:41,845::task::1168::TaskManager.Task::(prepare) Task=`64bc32e3-58aa-4acc-9a92-263721fc95e3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3908::DEBUG::2014-04-10 18:07:41,846::task::579::TaskManager.Task::(_updateState) Task=`64bc32e3-58aa-4acc-9a92-263721fc95e3`::moving from state preparing -> state finished
>Thread-3908::DEBUG::2014-04-10 18:07:41,846::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3908::DEBUG::2014-04-10 18:07:41,846::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3908::DEBUG::2014-04-10 18:07:41,846::task::974::TaskManager.Task::(_decref) Task=`64bc32e3-58aa-4acc-9a92-263721fc95e3`::ref 0 aborting False
>Thread-3909::DEBUG::2014-04-10 18:07:41,852::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3909::DEBUG::2014-04-10 18:07:41,852::task::579::TaskManager.Task::(_updateState) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::moving from state init -> state preparing
>Thread-3909::INFO::2014-04-10 18:07:41,853::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3909::DEBUG::2014-04-10 18:07:41,853::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b70ba6ea-b72d-4af3-8877-2461acb88bdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3909::DEBUG::2014-04-10 18:07:41,853::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3909::DEBUG::2014-04-10 18:07:41,853::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3909::DEBUG::2014-04-10 18:07:41,854::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b70ba6ea-b72d-4af3-8877-2461acb88bdb`::Granted request
>Thread-3909::DEBUG::2014-04-10 18:07:41,854::task::811::TaskManager.Task::(resourceAcquired) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3909::DEBUG::2014-04-10 18:07:41,854::task::974::TaskManager.Task::(_decref) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::ref 1 aborting False
>Thread-3909::INFO::2014-04-10 18:07:41,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3909::DEBUG::2014-04-10 18:07:41,856::task::1168::TaskManager.Task::(prepare) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3909::DEBUG::2014-04-10 18:07:41,856::task::579::TaskManager.Task::(_updateState) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::moving from state preparing -> state finished
>Thread-3909::DEBUG::2014-04-10 18:07:41,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3909::DEBUG::2014-04-10 18:07:41,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3909::DEBUG::2014-04-10 18:07:41,857::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3909::DEBUG::2014-04-10 18:07:41,857::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3909::DEBUG::2014-04-10 18:07:41,857::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3909::DEBUG::2014-04-10 18:07:41,857::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3909::DEBUG::2014-04-10 18:07:41,857::task::974::TaskManager.Task::(_decref) Task=`e72b83f5-5458-4979-bfb7-8eafdd4018bd`::ref 0 aborting False
>Thread-3911::DEBUG::2014-04-10 18:07:47,672::task::579::TaskManager.Task::(_updateState) Task=`d6957cb0-4632-4acd-8960-fee7453dff44`::moving from state init -> state preparing
>Thread-3911::INFO::2014-04-10 18:07:47,672::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3911::INFO::2014-04-10 18:07:47,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049922', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273469', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394817', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524838', 'lastCheck': '9.0', 'valid': True}}
>Thread-3911::DEBUG::2014-04-10 18:07:47,673::task::1168::TaskManager.Task::(prepare) Task=`d6957cb0-4632-4acd-8960-fee7453dff44`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049922', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273469', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394817', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524838', 'lastCheck': '9.0', 'valid': True}}
>Thread-3911::DEBUG::2014-04-10 18:07:47,673::task::579::TaskManager.Task::(_updateState) Task=`d6957cb0-4632-4acd-8960-fee7453dff44`::moving from state preparing -> state finished
>Thread-3911::DEBUG::2014-04-10 18:07:47,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3911::DEBUG::2014-04-10 18:07:47,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3911::DEBUG::2014-04-10 18:07:47,673::task::974::TaskManager.Task::(_decref) Task=`d6957cb0-4632-4acd-8960-fee7453dff44`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:48,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:48,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350536 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:48,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:48,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265877 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:48,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:48,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464913 s, 792 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:48,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:48,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000360698 s, 1.8 MB/s\n'; <rc> = 0
>Thread-3914::DEBUG::2014-04-10 18:07:51,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3914::DEBUG::2014-04-10 18:07:51,985::task::579::TaskManager.Task::(_updateState) Task=`feaed45d-1de5-4c91-a3b2-75db104d4e60`::moving from state init -> state preparing
>Thread-3914::INFO::2014-04-10 18:07:51,985::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3914::INFO::2014-04-10 18:07:51,986::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3914::DEBUG::2014-04-10 18:07:51,986::task::1168::TaskManager.Task::(prepare) Task=`feaed45d-1de5-4c91-a3b2-75db104d4e60`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3914::DEBUG::2014-04-10 18:07:51,986::task::579::TaskManager.Task::(_updateState) Task=`feaed45d-1de5-4c91-a3b2-75db104d4e60`::moving from state preparing -> state finished
>Thread-3914::DEBUG::2014-04-10 18:07:51,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3914::DEBUG::2014-04-10 18:07:51,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3914::DEBUG::2014-04-10 18:07:51,986::task::974::TaskManager.Task::(_decref) Task=`feaed45d-1de5-4c91-a3b2-75db104d4e60`::ref 0 aborting False
>Thread-3915::DEBUG::2014-04-10 18:07:51,993::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3915::DEBUG::2014-04-10 18:07:51,993::task::579::TaskManager.Task::(_updateState) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::moving from state init -> state preparing
>Thread-3915::INFO::2014-04-10 18:07:51,994::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3915::DEBUG::2014-04-10 18:07:51,994::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c5888191-b7ab-433e-a13c-42f435a41e3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3915::DEBUG::2014-04-10 18:07:51,994::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3915::DEBUG::2014-04-10 18:07:51,994::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3915::DEBUG::2014-04-10 18:07:51,995::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c5888191-b7ab-433e-a13c-42f435a41e3c`::Granted request
>Thread-3915::DEBUG::2014-04-10 18:07:51,995::task::811::TaskManager.Task::(resourceAcquired) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3915::DEBUG::2014-04-10 18:07:51,995::task::974::TaskManager.Task::(_decref) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::ref 1 aborting False
>Thread-3915::INFO::2014-04-10 18:07:51,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3915::DEBUG::2014-04-10 18:07:51,997::task::1168::TaskManager.Task::(prepare) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3915::DEBUG::2014-04-10 18:07:51,997::task::579::TaskManager.Task::(_updateState) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::moving from state preparing -> state finished
>Thread-3915::DEBUG::2014-04-10 18:07:51,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3915::DEBUG::2014-04-10 18:07:51,998::task::974::TaskManager.Task::(_decref) Task=`d0a99925-2b73-49ae-8c49-c3b3bc0bb9a9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:07:58,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:07:58,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273237 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:07:58,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:07:58,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260905 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:07:58,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:07:58,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000332089 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:07:58,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:07:58,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000488922 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3919::DEBUG::2014-04-10 18:08:02,128::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-3919::DEBUG::2014-04-10 18:08:02,128::task::579::TaskManager.Task::(_updateState) Task=`eb5db908-57c2-4a12-b441-5a1bea656c8e`::moving from state init -> state preparing
>Thread-3919::INFO::2014-04-10 18:08:02,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3919::INFO::2014-04-10 18:08:02,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3919::DEBUG::2014-04-10 18:08:02,129::task::1168::TaskManager.Task::(prepare) Task=`eb5db908-57c2-4a12-b441-5a1bea656c8e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3919::DEBUG::2014-04-10 18:08:02,129::task::579::TaskManager.Task::(_updateState) Task=`eb5db908-57c2-4a12-b441-5a1bea656c8e`::moving from state preparing -> state finished
>Thread-3919::DEBUG::2014-04-10 18:08:02,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3919::DEBUG::2014-04-10 18:08:02,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3919::DEBUG::2014-04-10 18:08:02,130::task::974::TaskManager.Task::(_decref) Task=`eb5db908-57c2-4a12-b441-5a1bea656c8e`::ref 0 aborting False
>Thread-3920::DEBUG::2014-04-10 18:08:02,136::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-3920::DEBUG::2014-04-10 18:08:02,136::task::579::TaskManager.Task::(_updateState) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::moving from state init -> state preparing
>Thread-3920::INFO::2014-04-10 18:08:02,136::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3920::DEBUG::2014-04-10 18:08:02,137::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`52f28eee-7571-4bc4-a65c-21ddc512632a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3920::DEBUG::2014-04-10 18:08:02,137::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3920::DEBUG::2014-04-10 18:08:02,137::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3920::DEBUG::2014-04-10 18:08:02,137::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`52f28eee-7571-4bc4-a65c-21ddc512632a`::Granted request
>Thread-3920::DEBUG::2014-04-10 18:08:02,138::task::811::TaskManager.Task::(resourceAcquired) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3920::DEBUG::2014-04-10 18:08:02,138::task::974::TaskManager.Task::(_decref) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::ref 1 aborting False
>Thread-3920::INFO::2014-04-10 18:08:02,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3920::DEBUG::2014-04-10 18:08:02,140::task::1168::TaskManager.Task::(prepare) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3920::DEBUG::2014-04-10 18:08:02,140::task::579::TaskManager.Task::(_updateState) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::moving from state preparing -> state finished
>Thread-3920::DEBUG::2014-04-10 18:08:02,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3920::DEBUG::2014-04-10 18:08:02,140::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3920::DEBUG::2014-04-10 18:08:02,140::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3920::DEBUG::2014-04-10 18:08:02,141::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3920::DEBUG::2014-04-10 18:08:02,141::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3920::DEBUG::2014-04-10 18:08:02,141::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3920::DEBUG::2014-04-10 18:08:02,141::task::974::TaskManager.Task::(_decref) Task=`210e31ff-6ba2-4513-a607-47cdbab81285`::ref 0 aborting False
>Thread-3921::DEBUG::2014-04-10 18:08:02,827::task::579::TaskManager.Task::(_updateState) Task=`4cfcfc45-a198-4710-9fac-710657a9502d`::moving from state init -> state preparing
>Thread-3921::INFO::2014-04-10 18:08:02,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3921::INFO::2014-04-10 18:08:02,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488922', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273237', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260905', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332089', 'lastCheck': '4.1', 'valid': True}}
>Thread-3921::DEBUG::2014-04-10 18:08:02,828::task::1168::TaskManager.Task::(prepare) Task=`4cfcfc45-a198-4710-9fac-710657a9502d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488922', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273237', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260905', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332089', 'lastCheck': '4.1', 'valid': True}}
>Thread-3921::DEBUG::2014-04-10 18:08:02,828::task::579::TaskManager.Task::(_updateState) Task=`4cfcfc45-a198-4710-9fac-710657a9502d`::moving from state preparing -> state finished
>Thread-3921::DEBUG::2014-04-10 18:08:02,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3921::DEBUG::2014-04-10 18:08:02,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3921::DEBUG::2014-04-10 18:08:02,828::task::974::TaskManager.Task::(_decref) Task=`4cfcfc45-a198-4710-9fac-710657a9502d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:08,196::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:08,204::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000444908 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:08,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:08,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024253 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:08,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:08,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000450792 s, 816 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:08:08,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:08,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410381 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3925::DEBUG::2014-04-10 18:08:12,231::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-3925::DEBUG::2014-04-10 18:08:12,232::task::579::TaskManager.Task::(_updateState) Task=`f8d3adac-6625-47ad-a1ac-125518959b13`::moving from state init -> state preparing
>Thread-3925::INFO::2014-04-10 18:08:12,232::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3925::INFO::2014-04-10 18:08:12,233::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3925::DEBUG::2014-04-10 18:08:12,233::task::1168::TaskManager.Task::(prepare) Task=`f8d3adac-6625-47ad-a1ac-125518959b13`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3925::DEBUG::2014-04-10 18:08:12,233::task::579::TaskManager.Task::(_updateState) Task=`f8d3adac-6625-47ad-a1ac-125518959b13`::moving from state preparing -> state finished
>Thread-3925::DEBUG::2014-04-10 18:08:12,233::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3925::DEBUG::2014-04-10 18:08:12,233::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3925::DEBUG::2014-04-10 18:08:12,233::task::974::TaskManager.Task::(_decref) Task=`f8d3adac-6625-47ad-a1ac-125518959b13`::ref 0 aborting False
>Thread-3926::DEBUG::2014-04-10 18:08:12,240::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-3926::DEBUG::2014-04-10 18:08:12,240::task::579::TaskManager.Task::(_updateState) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::moving from state init -> state preparing
>Thread-3926::INFO::2014-04-10 18:08:12,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3926::DEBUG::2014-04-10 18:08:12,241::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad4fe4b-cdd6-4109-a322-cd9b5bdb876e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3926::DEBUG::2014-04-10 18:08:12,241::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3926::DEBUG::2014-04-10 18:08:12,241::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3926::DEBUG::2014-04-10 18:08:12,241::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ad4fe4b-cdd6-4109-a322-cd9b5bdb876e`::Granted request
>Thread-3926::DEBUG::2014-04-10 18:08:12,242::task::811::TaskManager.Task::(resourceAcquired) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3926::DEBUG::2014-04-10 18:08:12,242::task::974::TaskManager.Task::(_decref) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::ref 1 aborting False
>Thread-3926::INFO::2014-04-10 18:08:12,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3926::DEBUG::2014-04-10 18:08:12,244::task::1168::TaskManager.Task::(prepare) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::task::579::TaskManager.Task::(_updateState) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::moving from state preparing -> state finished
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3926::DEBUG::2014-04-10 18:08:12,245::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3926::DEBUG::2014-04-10 18:08:12,246::task::974::TaskManager.Task::(_decref) Task=`b5821ca5-ce5e-4df1-a782-ce7e7fcfc9c0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:18,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:18,220::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273487 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:18,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:18,375::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000240774 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:18,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:18,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000400409 s, 919 kB/s\n'; <rc> = 0
>Thread-3929::DEBUG::2014-04-10 18:08:18,720::task::579::TaskManager.Task::(_updateState) Task=`1845c2d5-5564-4a17-8577-2f97e49f19fa`::moving from state init -> state preparing
>Thread-3929::INFO::2014-04-10 18:08:18,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3929::INFO::2014-04-10 18:08:18,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410381', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273487', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240774', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400409', 'lastCheck': '0.0', 'valid': True}}
>Thread-3929::DEBUG::2014-04-10 18:08:18,721::task::1168::TaskManager.Task::(prepare) Task=`1845c2d5-5564-4a17-8577-2f97e49f19fa`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410381', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273487', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000240774', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400409', 'lastCheck': '0.0', 'valid': True}}
>Thread-3929::DEBUG::2014-04-10 18:08:18,721::task::579::TaskManager.Task::(_updateState) Task=`1845c2d5-5564-4a17-8577-2f97e49f19fa`::moving from state preparing -> state finished
>Thread-3929::DEBUG::2014-04-10 18:08:18,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3929::DEBUG::2014-04-10 18:08:18,721::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3929::DEBUG::2014-04-10 18:08:18,722::task::974::TaskManager.Task::(_decref) Task=`1845c2d5-5564-4a17-8577-2f97e49f19fa`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:08:18,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:18,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448204 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3932::DEBUG::2014-04-10 18:08:22,331::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3932::DEBUG::2014-04-10 18:08:22,332::task::579::TaskManager.Task::(_updateState) Task=`481f0270-c632-47e8-8e0e-f7276f0b4426`::moving from state init -> state preparing
>Thread-3932::INFO::2014-04-10 18:08:22,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3932::INFO::2014-04-10 18:08:22,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3932::DEBUG::2014-04-10 18:08:22,333::task::1168::TaskManager.Task::(prepare) Task=`481f0270-c632-47e8-8e0e-f7276f0b4426`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3932::DEBUG::2014-04-10 18:08:22,333::task::579::TaskManager.Task::(_updateState) Task=`481f0270-c632-47e8-8e0e-f7276f0b4426`::moving from state preparing -> state finished
>Thread-3932::DEBUG::2014-04-10 18:08:22,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3932::DEBUG::2014-04-10 18:08:22,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3932::DEBUG::2014-04-10 18:08:22,333::task::974::TaskManager.Task::(_decref) Task=`481f0270-c632-47e8-8e0e-f7276f0b4426`::ref 0 aborting False
>Thread-3933::DEBUG::2014-04-10 18:08:22,340::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3933::DEBUG::2014-04-10 18:08:22,340::task::579::TaskManager.Task::(_updateState) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::moving from state init -> state preparing
>Thread-3933::INFO::2014-04-10 18:08:22,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3933::DEBUG::2014-04-10 18:08:22,341::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`863b747f-b187-4319-ba97-343ed1b3e06f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3933::DEBUG::2014-04-10 18:08:22,341::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3933::DEBUG::2014-04-10 18:08:22,341::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3933::DEBUG::2014-04-10 18:08:22,341::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`863b747f-b187-4319-ba97-343ed1b3e06f`::Granted request
>Thread-3933::DEBUG::2014-04-10 18:08:22,342::task::811::TaskManager.Task::(resourceAcquired) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3933::DEBUG::2014-04-10 18:08:22,342::task::974::TaskManager.Task::(_decref) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::ref 1 aborting False
>Thread-3933::INFO::2014-04-10 18:08:22,343::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3933::DEBUG::2014-04-10 18:08:22,344::task::1168::TaskManager.Task::(prepare) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3933::DEBUG::2014-04-10 18:08:22,344::task::579::TaskManager.Task::(_updateState) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::moving from state preparing -> state finished
>Thread-3933::DEBUG::2014-04-10 18:08:22,344::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3933::DEBUG::2014-04-10 18:08:22,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3933::DEBUG::2014-04-10 18:08:22,344::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3933::DEBUG::2014-04-10 18:08:22,345::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3933::DEBUG::2014-04-10 18:08:22,345::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3933::DEBUG::2014-04-10 18:08:22,345::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3933::DEBUG::2014-04-10 18:08:22,345::task::974::TaskManager.Task::(_decref) Task=`6fa2937d-b0ac-4257-8b56-68ac5e044e96`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:28,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:28,236::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398567 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:28,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:28,389::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044857 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:28,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:28,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000412048 s, 893 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:08:28,897::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:08:28,912::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:08:28,913::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:08:28,919::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:08:28,920::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:08:28,921::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:08:28,921::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:08:28,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:28,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000353348 s, 1.9 MB/s\n'; <rc> = 0
>Thread-3941::DEBUG::2014-04-10 18:08:32,422::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3941::DEBUG::2014-04-10 18:08:32,423::task::579::TaskManager.Task::(_updateState) Task=`ee915494-5fc1-4ad5-9817-4091402eacaa`::moving from state init -> state preparing
>Thread-3941::INFO::2014-04-10 18:08:32,423::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3941::INFO::2014-04-10 18:08:32,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3941::DEBUG::2014-04-10 18:08:32,424::task::1168::TaskManager.Task::(prepare) Task=`ee915494-5fc1-4ad5-9817-4091402eacaa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3941::DEBUG::2014-04-10 18:08:32,424::task::579::TaskManager.Task::(_updateState) Task=`ee915494-5fc1-4ad5-9817-4091402eacaa`::moving from state preparing -> state finished
>Thread-3941::DEBUG::2014-04-10 18:08:32,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3941::DEBUG::2014-04-10 18:08:32,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3941::DEBUG::2014-04-10 18:08:32,424::task::974::TaskManager.Task::(_decref) Task=`ee915494-5fc1-4ad5-9817-4091402eacaa`::ref 0 aborting False
>Thread-3942::DEBUG::2014-04-10 18:08:32,430::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3942::DEBUG::2014-04-10 18:08:32,431::task::579::TaskManager.Task::(_updateState) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::moving from state init -> state preparing
>Thread-3942::INFO::2014-04-10 18:08:32,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3942::DEBUG::2014-04-10 18:08:32,431::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e43b3c4-6889-4942-9643-13b80291bac6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3942::DEBUG::2014-04-10 18:08:32,431::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3942::DEBUG::2014-04-10 18:08:32,432::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3942::DEBUG::2014-04-10 18:08:32,432::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9e43b3c4-6889-4942-9643-13b80291bac6`::Granted request
>Thread-3942::DEBUG::2014-04-10 18:08:32,432::task::811::TaskManager.Task::(resourceAcquired) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3942::DEBUG::2014-04-10 18:08:32,432::task::974::TaskManager.Task::(_decref) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::ref 1 aborting False
>Thread-3942::INFO::2014-04-10 18:08:32,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3942::DEBUG::2014-04-10 18:08:32,434::task::1168::TaskManager.Task::(prepare) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3942::DEBUG::2014-04-10 18:08:32,434::task::579::TaskManager.Task::(_updateState) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::moving from state preparing -> state finished
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3942::DEBUG::2014-04-10 18:08:32,435::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3942::DEBUG::2014-04-10 18:08:32,436::task::974::TaskManager.Task::(_decref) Task=`111a1308-f06e-42cb-98ad-0c6b2e035941`::ref 0 aborting False
>Thread-3943::DEBUG::2014-04-10 18:08:33,882::task::579::TaskManager.Task::(_updateState) Task=`6343ebb4-6c29-446f-8702-bfcce95c86c8`::moving from state init -> state preparing
>Thread-3943::INFO::2014-04-10 18:08:33,882::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3943::INFO::2014-04-10 18:08:33,883::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353348', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398567', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044857', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412048', 'lastCheck': '5.2', 'valid': True}}
>Thread-3943::DEBUG::2014-04-10 18:08:33,883::task::1168::TaskManager.Task::(prepare) Task=`6343ebb4-6c29-446f-8702-bfcce95c86c8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353348', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398567', 'lastCheck': '5.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044857', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412048', 'lastCheck': '5.2', 'valid': True}}
>Thread-3943::DEBUG::2014-04-10 18:08:33,883::task::579::TaskManager.Task::(_updateState) Task=`6343ebb4-6c29-446f-8702-bfcce95c86c8`::moving from state preparing -> state finished
>Thread-3943::DEBUG::2014-04-10 18:08:33,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3943::DEBUG::2014-04-10 18:08:33,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3943::DEBUG::2014-04-10 18:08:33,884::task::974::TaskManager.Task::(_decref) Task=`6343ebb4-6c29-446f-8702-bfcce95c86c8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:38,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:38,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390338 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:38,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:38,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337631 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:38,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:38,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00046107 s, 798 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:08:38,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:38,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496415 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3947::DEBUG::2014-04-10 18:08:42,511::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3947::DEBUG::2014-04-10 18:08:42,512::task::579::TaskManager.Task::(_updateState) Task=`2af5c8d6-1946-4113-8ea8-0ec323cf5bc6`::moving from state init -> state preparing
>Thread-3947::INFO::2014-04-10 18:08:42,512::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3947::INFO::2014-04-10 18:08:42,512::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3947::DEBUG::2014-04-10 18:08:42,513::task::1168::TaskManager.Task::(prepare) Task=`2af5c8d6-1946-4113-8ea8-0ec323cf5bc6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3947::DEBUG::2014-04-10 18:08:42,513::task::579::TaskManager.Task::(_updateState) Task=`2af5c8d6-1946-4113-8ea8-0ec323cf5bc6`::moving from state preparing -> state finished
>Thread-3947::DEBUG::2014-04-10 18:08:42,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3947::DEBUG::2014-04-10 18:08:42,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3947::DEBUG::2014-04-10 18:08:42,513::task::974::TaskManager.Task::(_decref) Task=`2af5c8d6-1946-4113-8ea8-0ec323cf5bc6`::ref 0 aborting False
>Thread-3948::DEBUG::2014-04-10 18:08:42,520::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3948::DEBUG::2014-04-10 18:08:42,520::task::579::TaskManager.Task::(_updateState) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::moving from state init -> state preparing
>Thread-3948::INFO::2014-04-10 18:08:42,520::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3948::DEBUG::2014-04-10 18:08:42,521::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`42acf7b8-dfe8-473f-aa25-9d1fbc16b7d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3948::DEBUG::2014-04-10 18:08:42,521::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3948::DEBUG::2014-04-10 18:08:42,521::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3948::DEBUG::2014-04-10 18:08:42,521::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`42acf7b8-dfe8-473f-aa25-9d1fbc16b7d2`::Granted request
>Thread-3948::DEBUG::2014-04-10 18:08:42,522::task::811::TaskManager.Task::(resourceAcquired) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3948::DEBUG::2014-04-10 18:08:42,522::task::974::TaskManager.Task::(_decref) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::ref 1 aborting False
>Thread-3948::INFO::2014-04-10 18:08:42,524::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3948::DEBUG::2014-04-10 18:08:42,524::task::1168::TaskManager.Task::(prepare) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3948::DEBUG::2014-04-10 18:08:42,524::task::579::TaskManager.Task::(_updateState) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::moving from state preparing -> state finished
>Thread-3948::DEBUG::2014-04-10 18:08:42,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3948::DEBUG::2014-04-10 18:08:42,524::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3948::DEBUG::2014-04-10 18:08:42,524::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3948::DEBUG::2014-04-10 18:08:42,525::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3948::DEBUG::2014-04-10 18:08:42,525::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3948::DEBUG::2014-04-10 18:08:42,525::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3948::DEBUG::2014-04-10 18:08:42,525::task::974::TaskManager.Task::(_decref) Task=`68481d3e-3988-4972-b47f-fe991e47cc81`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:48,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:48,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000480023 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:48,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:48,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306123 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:48,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:48,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000433586 s, 849 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:08:48,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:48,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496401 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3951::DEBUG::2014-04-10 18:08:49,089::task::579::TaskManager.Task::(_updateState) Task=`4af4ceda-5b04-45c7-8f89-a55bab427660`::moving from state init -> state preparing
>Thread-3951::INFO::2014-04-10 18:08:49,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3951::INFO::2014-04-10 18:08:49,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496401', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480023', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306123', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433586', 'lastCheck': '0.3', 'valid': True}}
>Thread-3951::DEBUG::2014-04-10 18:08:49,089::task::1168::TaskManager.Task::(prepare) Task=`4af4ceda-5b04-45c7-8f89-a55bab427660`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496401', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480023', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306123', 'lastCheck': '0.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433586', 'lastCheck': '0.3', 'valid': True}}
>Thread-3951::DEBUG::2014-04-10 18:08:49,090::task::579::TaskManager.Task::(_updateState) Task=`4af4ceda-5b04-45c7-8f89-a55bab427660`::moving from state preparing -> state finished
>Thread-3951::DEBUG::2014-04-10 18:08:49,090::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3951::DEBUG::2014-04-10 18:08:49,090::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3951::DEBUG::2014-04-10 18:08:49,090::task::974::TaskManager.Task::(_decref) Task=`4af4ceda-5b04-45c7-8f89-a55bab427660`::ref 0 aborting False
>Thread-3954::DEBUG::2014-04-10 18:08:52,601::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3954::DEBUG::2014-04-10 18:08:52,602::task::579::TaskManager.Task::(_updateState) Task=`29442244-3d6e-4fd5-84a2-be78e01d83f7`::moving from state init -> state preparing
>Thread-3954::INFO::2014-04-10 18:08:52,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3954::INFO::2014-04-10 18:08:52,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3954::DEBUG::2014-04-10 18:08:52,603::task::1168::TaskManager.Task::(prepare) Task=`29442244-3d6e-4fd5-84a2-be78e01d83f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3954::DEBUG::2014-04-10 18:08:52,603::task::579::TaskManager.Task::(_updateState) Task=`29442244-3d6e-4fd5-84a2-be78e01d83f7`::moving from state preparing -> state finished
>Thread-3954::DEBUG::2014-04-10 18:08:52,603::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3954::DEBUG::2014-04-10 18:08:52,603::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3954::DEBUG::2014-04-10 18:08:52,603::task::974::TaskManager.Task::(_decref) Task=`29442244-3d6e-4fd5-84a2-be78e01d83f7`::ref 0 aborting False
>Thread-3955::DEBUG::2014-04-10 18:08:52,610::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3955::DEBUG::2014-04-10 18:08:52,610::task::579::TaskManager.Task::(_updateState) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::moving from state init -> state preparing
>Thread-3955::INFO::2014-04-10 18:08:52,610::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3955::DEBUG::2014-04-10 18:08:52,611::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895becbe-41e3-4777-94fd-8073377b6226`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3955::DEBUG::2014-04-10 18:08:52,611::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3955::DEBUG::2014-04-10 18:08:52,611::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3955::DEBUG::2014-04-10 18:08:52,612::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895becbe-41e3-4777-94fd-8073377b6226`::Granted request
>Thread-3955::DEBUG::2014-04-10 18:08:52,612::task::811::TaskManager.Task::(resourceAcquired) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3955::DEBUG::2014-04-10 18:08:52,612::task::974::TaskManager.Task::(_decref) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::ref 1 aborting False
>Thread-3955::INFO::2014-04-10 18:08:52,614::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3955::DEBUG::2014-04-10 18:08:52,614::task::1168::TaskManager.Task::(prepare) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3955::DEBUG::2014-04-10 18:08:52,614::task::579::TaskManager.Task::(_updateState) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::moving from state preparing -> state finished
>Thread-3955::DEBUG::2014-04-10 18:08:52,614::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3955::DEBUG::2014-04-10 18:08:52,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3955::DEBUG::2014-04-10 18:08:52,615::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3955::DEBUG::2014-04-10 18:08:52,615::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3955::DEBUG::2014-04-10 18:08:52,615::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3955::DEBUG::2014-04-10 18:08:52,615::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3955::DEBUG::2014-04-10 18:08:52,615::task::974::TaskManager.Task::(_decref) Task=`390d0ad0-f07f-41c4-81a9-44071a69d3a7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:08:58,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:08:58,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000474427 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:08:58,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:08:58,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326412 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:08:58,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:08:58,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000589726 s, 624 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:08:58,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:08:58,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000428729 s, 1.5 MB/s\n'; <rc> = 0
>Thread-3959::DEBUG::2014-04-10 18:09:02,709::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3959::DEBUG::2014-04-10 18:09:02,709::task::579::TaskManager.Task::(_updateState) Task=`32c455f0-511b-484d-8f66-0715beee70eb`::moving from state init -> state preparing
>Thread-3959::INFO::2014-04-10 18:09:02,710::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3959::INFO::2014-04-10 18:09:02,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3959::DEBUG::2014-04-10 18:09:02,710::task::1168::TaskManager.Task::(prepare) Task=`32c455f0-511b-484d-8f66-0715beee70eb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3959::DEBUG::2014-04-10 18:09:02,710::task::579::TaskManager.Task::(_updateState) Task=`32c455f0-511b-484d-8f66-0715beee70eb`::moving from state preparing -> state finished
>Thread-3959::DEBUG::2014-04-10 18:09:02,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3959::DEBUG::2014-04-10 18:09:02,710::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3959::DEBUG::2014-04-10 18:09:02,711::task::974::TaskManager.Task::(_decref) Task=`32c455f0-511b-484d-8f66-0715beee70eb`::ref 0 aborting False
>Thread-3960::DEBUG::2014-04-10 18:09:02,717::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3960::DEBUG::2014-04-10 18:09:02,717::task::579::TaskManager.Task::(_updateState) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::moving from state init -> state preparing
>Thread-3960::INFO::2014-04-10 18:09:02,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3960::DEBUG::2014-04-10 18:09:02,718::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f07a58a2-6563-4c27-b1a2-03d25051582c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3960::DEBUG::2014-04-10 18:09:02,718::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3960::DEBUG::2014-04-10 18:09:02,718::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3960::DEBUG::2014-04-10 18:09:02,718::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f07a58a2-6563-4c27-b1a2-03d25051582c`::Granted request
>Thread-3960::DEBUG::2014-04-10 18:09:02,719::task::811::TaskManager.Task::(resourceAcquired) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3960::DEBUG::2014-04-10 18:09:02,719::task::974::TaskManager.Task::(_decref) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::ref 1 aborting False
>Thread-3960::INFO::2014-04-10 18:09:02,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3960::DEBUG::2014-04-10 18:09:02,721::task::1168::TaskManager.Task::(prepare) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3960::DEBUG::2014-04-10 18:09:02,721::task::579::TaskManager.Task::(_updateState) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::moving from state preparing -> state finished
>Thread-3960::DEBUG::2014-04-10 18:09:02,721::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3960::DEBUG::2014-04-10 18:09:02,721::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3960::DEBUG::2014-04-10 18:09:02,722::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3960::DEBUG::2014-04-10 18:09:02,722::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3960::DEBUG::2014-04-10 18:09:02,722::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3960::DEBUG::2014-04-10 18:09:02,722::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3960::DEBUG::2014-04-10 18:09:02,722::task::974::TaskManager.Task::(_decref) Task=`a8f5ac59-f90f-49e0-8818-afc1d8d151ec`::ref 0 aborting False
>Thread-3961::DEBUG::2014-04-10 18:09:04,263::task::579::TaskManager.Task::(_updateState) Task=`78df715f-48a5-4bf0-a118-2cb152d9f515`::moving from state init -> state preparing
>Thread-3961::INFO::2014-04-10 18:09:04,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3961::INFO::2014-04-10 18:09:04,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428729', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474427', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326412', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589726', 'lastCheck': '5.5', 'valid': True}}
>Thread-3961::DEBUG::2014-04-10 18:09:04,264::task::1168::TaskManager.Task::(prepare) Task=`78df715f-48a5-4bf0-a118-2cb152d9f515`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428729', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474427', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326412', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589726', 'lastCheck': '5.5', 'valid': True}}
>Thread-3961::DEBUG::2014-04-10 18:09:04,264::task::579::TaskManager.Task::(_updateState) Task=`78df715f-48a5-4bf0-a118-2cb152d9f515`::moving from state preparing -> state finished
>Thread-3961::DEBUG::2014-04-10 18:09:04,264::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3961::DEBUG::2014-04-10 18:09:04,264::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3961::DEBUG::2014-04-10 18:09:04,265::task::974::TaskManager.Task::(_decref) Task=`78df715f-48a5-4bf0-a118-2cb152d9f515`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:08,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:08,295::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369874 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:08,438::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:08,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306876 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:08,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:08,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000436365 s, 843 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:08,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:08,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406827 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3965::DEBUG::2014-04-10 18:09:12,789::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3965::DEBUG::2014-04-10 18:09:12,805::task::579::TaskManager.Task::(_updateState) Task=`1ef005ea-a927-4509-b263-5ff9661a5c3e`::moving from state init -> state preparing
>Thread-3965::INFO::2014-04-10 18:09:12,805::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3965::INFO::2014-04-10 18:09:12,805::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3965::DEBUG::2014-04-10 18:09:12,805::task::1168::TaskManager.Task::(prepare) Task=`1ef005ea-a927-4509-b263-5ff9661a5c3e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3965::DEBUG::2014-04-10 18:09:12,805::task::579::TaskManager.Task::(_updateState) Task=`1ef005ea-a927-4509-b263-5ff9661a5c3e`::moving from state preparing -> state finished
>Thread-3965::DEBUG::2014-04-10 18:09:12,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3965::DEBUG::2014-04-10 18:09:12,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3965::DEBUG::2014-04-10 18:09:12,806::task::974::TaskManager.Task::(_decref) Task=`1ef005ea-a927-4509-b263-5ff9661a5c3e`::ref 0 aborting False
>Thread-3966::DEBUG::2014-04-10 18:09:12,813::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3966::DEBUG::2014-04-10 18:09:12,813::task::579::TaskManager.Task::(_updateState) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::moving from state init -> state preparing
>Thread-3966::INFO::2014-04-10 18:09:12,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3966::DEBUG::2014-04-10 18:09:12,814::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55e5dd33-7f54-45c5-8d4d-e735f65ab2a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3966::DEBUG::2014-04-10 18:09:12,814::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3966::DEBUG::2014-04-10 18:09:12,814::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3966::DEBUG::2014-04-10 18:09:12,814::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55e5dd33-7f54-45c5-8d4d-e735f65ab2a3`::Granted request
>Thread-3966::DEBUG::2014-04-10 18:09:12,815::task::811::TaskManager.Task::(resourceAcquired) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3966::DEBUG::2014-04-10 18:09:12,815::task::974::TaskManager.Task::(_decref) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::ref 1 aborting False
>Thread-3966::INFO::2014-04-10 18:09:12,817::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3966::DEBUG::2014-04-10 18:09:12,817::task::1168::TaskManager.Task::(prepare) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3966::DEBUG::2014-04-10 18:09:12,817::task::579::TaskManager.Task::(_updateState) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::moving from state preparing -> state finished
>Thread-3966::DEBUG::2014-04-10 18:09:12,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3966::DEBUG::2014-04-10 18:09:12,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3966::DEBUG::2014-04-10 18:09:12,818::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3966::DEBUG::2014-04-10 18:09:12,818::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3966::DEBUG::2014-04-10 18:09:12,818::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3966::DEBUG::2014-04-10 18:09:12,818::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3966::DEBUG::2014-04-10 18:09:12,818::task::974::TaskManager.Task::(_decref) Task=`d37adefb-f775-4010-988b-1c08fe83ac22`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:18,303::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:18,310::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000473394 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:18,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:18,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036301 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:18,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:18,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044363 s, 830 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:19,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:19,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000491209 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3969::DEBUG::2014-04-10 18:09:19,433::task::579::TaskManager.Task::(_updateState) Task=`adba6257-f067-4aab-85f8-9466a4b06cd8`::moving from state init -> state preparing
>Thread-3969::INFO::2014-04-10 18:09:19,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3969::INFO::2014-04-10 18:09:19,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491209', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473394', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036301', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044363', 'lastCheck': '0.6', 'valid': True}}
>Thread-3969::DEBUG::2014-04-10 18:09:19,434::task::1168::TaskManager.Task::(prepare) Task=`adba6257-f067-4aab-85f8-9466a4b06cd8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491209', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473394', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036301', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044363', 'lastCheck': '0.6', 'valid': True}}
>Thread-3969::DEBUG::2014-04-10 18:09:19,434::task::579::TaskManager.Task::(_updateState) Task=`adba6257-f067-4aab-85f8-9466a4b06cd8`::moving from state preparing -> state finished
>Thread-3969::DEBUG::2014-04-10 18:09:19,435::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3969::DEBUG::2014-04-10 18:09:19,435::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3969::DEBUG::2014-04-10 18:09:19,435::task::974::TaskManager.Task::(_decref) Task=`adba6257-f067-4aab-85f8-9466a4b06cd8`::ref 0 aborting False
>Thread-3972::DEBUG::2014-04-10 18:09:22,905::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3972::DEBUG::2014-04-10 18:09:22,906::task::579::TaskManager.Task::(_updateState) Task=`68b830e7-2f05-45a5-9269-d82c5432c42c`::moving from state init -> state preparing
>Thread-3972::INFO::2014-04-10 18:09:22,906::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3972::INFO::2014-04-10 18:09:22,906::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3972::DEBUG::2014-04-10 18:09:22,906::task::1168::TaskManager.Task::(prepare) Task=`68b830e7-2f05-45a5-9269-d82c5432c42c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3972::DEBUG::2014-04-10 18:09:22,906::task::579::TaskManager.Task::(_updateState) Task=`68b830e7-2f05-45a5-9269-d82c5432c42c`::moving from state preparing -> state finished
>Thread-3972::DEBUG::2014-04-10 18:09:22,907::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3972::DEBUG::2014-04-10 18:09:22,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3972::DEBUG::2014-04-10 18:09:22,907::task::974::TaskManager.Task::(_decref) Task=`68b830e7-2f05-45a5-9269-d82c5432c42c`::ref 0 aborting False
>Thread-3973::DEBUG::2014-04-10 18:09:22,913::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3973::DEBUG::2014-04-10 18:09:22,914::task::579::TaskManager.Task::(_updateState) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::moving from state init -> state preparing
>Thread-3973::INFO::2014-04-10 18:09:22,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3973::DEBUG::2014-04-10 18:09:22,914::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b84ada5a-3874-4f91-874e-05e3e0dd846b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3973::DEBUG::2014-04-10 18:09:22,914::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3973::DEBUG::2014-04-10 18:09:22,915::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3973::DEBUG::2014-04-10 18:09:22,915::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b84ada5a-3874-4f91-874e-05e3e0dd846b`::Granted request
>Thread-3973::DEBUG::2014-04-10 18:09:22,915::task::811::TaskManager.Task::(resourceAcquired) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3973::DEBUG::2014-04-10 18:09:22,915::task::974::TaskManager.Task::(_decref) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::ref 1 aborting False
>Thread-3973::INFO::2014-04-10 18:09:22,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3973::DEBUG::2014-04-10 18:09:22,917::task::1168::TaskManager.Task::(prepare) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3973::DEBUG::2014-04-10 18:09:22,917::task::579::TaskManager.Task::(_updateState) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::moving from state preparing -> state finished
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3973::DEBUG::2014-04-10 18:09:22,918::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3973::DEBUG::2014-04-10 18:09:22,919::task::974::TaskManager.Task::(_decref) Task=`e950235a-761b-4e52-a7c2-1802a671eb3f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:28,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:28,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383369 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:28,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:28,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346264 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:28,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:28,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000437429 s, 841 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:29,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:29,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485023 s, 1.4 MB/s\n'; <rc> = 0
>Thread-3977::DEBUG::2014-04-10 18:09:32,996::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3977::DEBUG::2014-04-10 18:09:32,997::task::579::TaskManager.Task::(_updateState) Task=`0b602c99-0675-4a44-bf5b-a5a7ad75a2d6`::moving from state init -> state preparing
>Thread-3977::INFO::2014-04-10 18:09:32,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3977::INFO::2014-04-10 18:09:32,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3977::DEBUG::2014-04-10 18:09:32,998::task::1168::TaskManager.Task::(prepare) Task=`0b602c99-0675-4a44-bf5b-a5a7ad75a2d6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3977::DEBUG::2014-04-10 18:09:32,998::task::579::TaskManager.Task::(_updateState) Task=`0b602c99-0675-4a44-bf5b-a5a7ad75a2d6`::moving from state preparing -> state finished
>Thread-3977::DEBUG::2014-04-10 18:09:32,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3977::DEBUG::2014-04-10 18:09:32,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3977::DEBUG::2014-04-10 18:09:32,998::task::974::TaskManager.Task::(_decref) Task=`0b602c99-0675-4a44-bf5b-a5a7ad75a2d6`::ref 0 aborting False
>Thread-3978::DEBUG::2014-04-10 18:09:33,005::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3978::DEBUG::2014-04-10 18:09:33,005::task::579::TaskManager.Task::(_updateState) Task=`2453ad54-3700-444d-a485-b38412111384`::moving from state init -> state preparing
>Thread-3978::INFO::2014-04-10 18:09:33,006::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3978::DEBUG::2014-04-10 18:09:33,007::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`af5491ab-31fb-48fb-b1f0-ac9c888e30ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3978::DEBUG::2014-04-10 18:09:33,007::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3978::DEBUG::2014-04-10 18:09:33,007::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3978::DEBUG::2014-04-10 18:09:33,007::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`af5491ab-31fb-48fb-b1f0-ac9c888e30ca`::Granted request
>Thread-3978::DEBUG::2014-04-10 18:09:33,008::task::811::TaskManager.Task::(resourceAcquired) Task=`2453ad54-3700-444d-a485-b38412111384`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3978::DEBUG::2014-04-10 18:09:33,008::task::974::TaskManager.Task::(_decref) Task=`2453ad54-3700-444d-a485-b38412111384`::ref 1 aborting False
>Thread-3978::INFO::2014-04-10 18:09:33,010::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3978::DEBUG::2014-04-10 18:09:33,010::task::1168::TaskManager.Task::(prepare) Task=`2453ad54-3700-444d-a485-b38412111384`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3978::DEBUG::2014-04-10 18:09:33,010::task::579::TaskManager.Task::(_updateState) Task=`2453ad54-3700-444d-a485-b38412111384`::moving from state preparing -> state finished
>Thread-3978::DEBUG::2014-04-10 18:09:33,010::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3978::DEBUG::2014-04-10 18:09:33,010::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3978::DEBUG::2014-04-10 18:09:33,011::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3978::DEBUG::2014-04-10 18:09:33,011::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3978::DEBUG::2014-04-10 18:09:33,011::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3978::DEBUG::2014-04-10 18:09:33,011::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3978::DEBUG::2014-04-10 18:09:33,011::task::974::TaskManager.Task::(_decref) Task=`2453ad54-3700-444d-a485-b38412111384`::ref 0 aborting False
>Thread-3979::DEBUG::2014-04-10 18:09:34,718::task::579::TaskManager.Task::(_updateState) Task=`f5aab563-7947-490a-97cf-afb95901bd57`::moving from state init -> state preparing
>Thread-3979::INFO::2014-04-10 18:09:34,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3979::INFO::2014-04-10 18:09:34,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485023', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383369', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346264', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437429', 'lastCheck': '5.9', 'valid': True}}
>Thread-3979::DEBUG::2014-04-10 18:09:34,719::task::1168::TaskManager.Task::(prepare) Task=`f5aab563-7947-490a-97cf-afb95901bd57`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485023', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383369', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346264', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437429', 'lastCheck': '5.9', 'valid': True}}
>Thread-3979::DEBUG::2014-04-10 18:09:34,720::task::579::TaskManager.Task::(_updateState) Task=`f5aab563-7947-490a-97cf-afb95901bd57`::moving from state preparing -> state finished
>Thread-3979::DEBUG::2014-04-10 18:09:34,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3979::DEBUG::2014-04-10 18:09:34,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3979::DEBUG::2014-04-10 18:09:34,720::task::974::TaskManager.Task::(_decref) Task=`f5aab563-7947-490a-97cf-afb95901bd57`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:38,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:38,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000440495 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:38,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:38,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374455 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:38,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:38,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484292 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:39,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:39,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000422934 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3983::DEBUG::2014-04-10 18:09:43,094::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-3983::DEBUG::2014-04-10 18:09:43,103::task::579::TaskManager.Task::(_updateState) Task=`59e77565-49f4-4f27-9622-22f48f045720`::moving from state init -> state preparing
>Thread-3983::INFO::2014-04-10 18:09:43,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3983::INFO::2014-04-10 18:09:43,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3983::DEBUG::2014-04-10 18:09:43,104::task::1168::TaskManager.Task::(prepare) Task=`59e77565-49f4-4f27-9622-22f48f045720`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3983::DEBUG::2014-04-10 18:09:43,104::task::579::TaskManager.Task::(_updateState) Task=`59e77565-49f4-4f27-9622-22f48f045720`::moving from state preparing -> state finished
>Thread-3983::DEBUG::2014-04-10 18:09:43,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3983::DEBUG::2014-04-10 18:09:43,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3983::DEBUG::2014-04-10 18:09:43,105::task::974::TaskManager.Task::(_decref) Task=`59e77565-49f4-4f27-9622-22f48f045720`::ref 0 aborting False
>Thread-3984::DEBUG::2014-04-10 18:09:43,111::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-3984::DEBUG::2014-04-10 18:09:43,112::task::579::TaskManager.Task::(_updateState) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::moving from state init -> state preparing
>Thread-3984::INFO::2014-04-10 18:09:43,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3984::DEBUG::2014-04-10 18:09:43,112::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb615b8d-8da4-442c-9fc8-a08d5251bf73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3984::DEBUG::2014-04-10 18:09:43,112::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3984::DEBUG::2014-04-10 18:09:43,113::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3984::DEBUG::2014-04-10 18:09:43,113::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb615b8d-8da4-442c-9fc8-a08d5251bf73`::Granted request
>Thread-3984::DEBUG::2014-04-10 18:09:43,113::task::811::TaskManager.Task::(resourceAcquired) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3984::DEBUG::2014-04-10 18:09:43,113::task::974::TaskManager.Task::(_decref) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::ref 1 aborting False
>Thread-3984::INFO::2014-04-10 18:09:43,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3984::DEBUG::2014-04-10 18:09:43,115::task::1168::TaskManager.Task::(prepare) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3984::DEBUG::2014-04-10 18:09:43,115::task::579::TaskManager.Task::(_updateState) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::moving from state preparing -> state finished
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3984::DEBUG::2014-04-10 18:09:43,116::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3984::DEBUG::2014-04-10 18:09:43,117::task::974::TaskManager.Task::(_decref) Task=`69993bee-4754-41c8-a2b1-7fe9b1cc522b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:48,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:48,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000385443 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:48,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:48,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353459 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:48,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:48,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464141 s, 793 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:49,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:49,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000488163 s, 1.3 MB/s\n'; <rc> = 0
>Thread-3987::DEBUG::2014-04-10 18:09:49,891::task::579::TaskManager.Task::(_updateState) Task=`2cefa46c-46f8-4ed8-a7fa-6744d9b9bf11`::moving from state init -> state preparing
>Thread-3987::INFO::2014-04-10 18:09:49,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3987::INFO::2014-04-10 18:09:49,892::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488163', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385443', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353459', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464141', 'lastCheck': '1.0', 'valid': True}}
>Thread-3987::DEBUG::2014-04-10 18:09:49,892::task::1168::TaskManager.Task::(prepare) Task=`2cefa46c-46f8-4ed8-a7fa-6744d9b9bf11`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488163', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385443', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353459', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464141', 'lastCheck': '1.0', 'valid': True}}
>Thread-3987::DEBUG::2014-04-10 18:09:49,892::task::579::TaskManager.Task::(_updateState) Task=`2cefa46c-46f8-4ed8-a7fa-6744d9b9bf11`::moving from state preparing -> state finished
>Thread-3987::DEBUG::2014-04-10 18:09:49,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3987::DEBUG::2014-04-10 18:09:49,892::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3987::DEBUG::2014-04-10 18:09:49,893::task::974::TaskManager.Task::(_decref) Task=`2cefa46c-46f8-4ed8-a7fa-6744d9b9bf11`::ref 0 aborting False
>Thread-3990::DEBUG::2014-04-10 18:09:53,211::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3990::DEBUG::2014-04-10 18:09:53,211::task::579::TaskManager.Task::(_updateState) Task=`52c09f88-56a8-4e5f-ba52-4e0eaffa6b84`::moving from state init -> state preparing
>Thread-3990::INFO::2014-04-10 18:09:53,211::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3990::INFO::2014-04-10 18:09:53,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3990::DEBUG::2014-04-10 18:09:53,212::task::1168::TaskManager.Task::(prepare) Task=`52c09f88-56a8-4e5f-ba52-4e0eaffa6b84`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3990::DEBUG::2014-04-10 18:09:53,212::task::579::TaskManager.Task::(_updateState) Task=`52c09f88-56a8-4e5f-ba52-4e0eaffa6b84`::moving from state preparing -> state finished
>Thread-3990::DEBUG::2014-04-10 18:09:53,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3990::DEBUG::2014-04-10 18:09:53,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3990::DEBUG::2014-04-10 18:09:53,212::task::974::TaskManager.Task::(_decref) Task=`52c09f88-56a8-4e5f-ba52-4e0eaffa6b84`::ref 0 aborting False
>Thread-3991::DEBUG::2014-04-10 18:09:53,219::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3991::DEBUG::2014-04-10 18:09:53,220::task::579::TaskManager.Task::(_updateState) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::moving from state init -> state preparing
>Thread-3991::INFO::2014-04-10 18:09:53,220::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3991::DEBUG::2014-04-10 18:09:53,220::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a45a23e-013e-48f0-9edd-2f1dcb36dff0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3991::DEBUG::2014-04-10 18:09:53,220::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3991::DEBUG::2014-04-10 18:09:53,221::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3991::DEBUG::2014-04-10 18:09:53,221::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a45a23e-013e-48f0-9edd-2f1dcb36dff0`::Granted request
>Thread-3991::DEBUG::2014-04-10 18:09:53,221::task::811::TaskManager.Task::(resourceAcquired) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3991::DEBUG::2014-04-10 18:09:53,221::task::974::TaskManager.Task::(_decref) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::ref 1 aborting False
>Thread-3991::INFO::2014-04-10 18:09:53,223::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3991::DEBUG::2014-04-10 18:09:53,223::task::1168::TaskManager.Task::(prepare) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3991::DEBUG::2014-04-10 18:09:53,223::task::579::TaskManager.Task::(_updateState) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::moving from state preparing -> state finished
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3991::DEBUG::2014-04-10 18:09:53,224::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3991::DEBUG::2014-04-10 18:09:53,225::task::974::TaskManager.Task::(_decref) Task=`4a2b22b9-8769-4908-9d5d-01c5f4f9b060`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:09:58,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:09:58,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000431209 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:09:58,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:09:58,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309488 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:09:58,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:09:58,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000468367 s, 786 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:09:59,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:09:59,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000418616 s, 1.6 MB/s\n'; <rc> = 0
>Thread-3995::DEBUG::2014-04-10 18:10:03,319::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3995::DEBUG::2014-04-10 18:10:03,320::task::579::TaskManager.Task::(_updateState) Task=`2ebb5176-312c-4bf9-8bc3-1979800f2cd2`::moving from state init -> state preparing
>Thread-3995::INFO::2014-04-10 18:10:03,320::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3995::INFO::2014-04-10 18:10:03,320::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3995::DEBUG::2014-04-10 18:10:03,320::task::1168::TaskManager.Task::(prepare) Task=`2ebb5176-312c-4bf9-8bc3-1979800f2cd2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-3995::DEBUG::2014-04-10 18:10:03,320::task::579::TaskManager.Task::(_updateState) Task=`2ebb5176-312c-4bf9-8bc3-1979800f2cd2`::moving from state preparing -> state finished
>Thread-3995::DEBUG::2014-04-10 18:10:03,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3995::DEBUG::2014-04-10 18:10:03,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3995::DEBUG::2014-04-10 18:10:03,321::task::974::TaskManager.Task::(_decref) Task=`2ebb5176-312c-4bf9-8bc3-1979800f2cd2`::ref 0 aborting False
>Thread-3996::DEBUG::2014-04-10 18:10:03,327::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-3996::DEBUG::2014-04-10 18:10:03,328::task::579::TaskManager.Task::(_updateState) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::moving from state init -> state preparing
>Thread-3996::INFO::2014-04-10 18:10:03,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-3996::DEBUG::2014-04-10 18:10:03,328::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e641d93a-b25b-4bf6-a909-8b706ac04b41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-3996::DEBUG::2014-04-10 18:10:03,328::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-3996::DEBUG::2014-04-10 18:10:03,329::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-3996::DEBUG::2014-04-10 18:10:03,329::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e641d93a-b25b-4bf6-a909-8b706ac04b41`::Granted request
>Thread-3996::DEBUG::2014-04-10 18:10:03,329::task::811::TaskManager.Task::(resourceAcquired) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-3996::DEBUG::2014-04-10 18:10:03,329::task::974::TaskManager.Task::(_decref) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::ref 1 aborting False
>Thread-3996::INFO::2014-04-10 18:10:03,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3996::DEBUG::2014-04-10 18:10:03,331::task::1168::TaskManager.Task::(prepare) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-3996::DEBUG::2014-04-10 18:10:03,331::task::579::TaskManager.Task::(_updateState) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::moving from state preparing -> state finished
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-3996::DEBUG::2014-04-10 18:10:03,332::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-3996::DEBUG::2014-04-10 18:10:03,333::task::974::TaskManager.Task::(_decref) Task=`ce010690-1855-4d0c-b535-7dd13a919ebd`::ref 0 aborting False
>Thread-3997::DEBUG::2014-04-10 18:10:05,068::task::579::TaskManager.Task::(_updateState) Task=`b65e9b77-5258-4806-9228-132389bff5a9`::moving from state init -> state preparing
>Thread-3997::INFO::2014-04-10 18:10:05,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-3997::INFO::2014-04-10 18:10:05,069::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418616', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431209', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309488', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468367', 'lastCheck': '6.2', 'valid': True}}
>Thread-3997::DEBUG::2014-04-10 18:10:05,069::task::1168::TaskManager.Task::(prepare) Task=`b65e9b77-5258-4806-9228-132389bff5a9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418616', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431209', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309488', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468367', 'lastCheck': '6.2', 'valid': True}}
>Thread-3997::DEBUG::2014-04-10 18:10:05,069::task::579::TaskManager.Task::(_updateState) Task=`b65e9b77-5258-4806-9228-132389bff5a9`::moving from state preparing -> state finished
>Thread-3997::DEBUG::2014-04-10 18:10:05,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-3997::DEBUG::2014-04-10 18:10:05,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-3997::DEBUG::2014-04-10 18:10:05,070::task::974::TaskManager.Task::(_decref) Task=`b65e9b77-5258-4806-9228-132389bff5a9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:08,375::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:08,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000490024 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:08,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:08,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346258 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:08,876::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:08,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457639 s, 804 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:09,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:09,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000381595 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4001::DEBUG::2014-04-10 18:10:13,424::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4001::DEBUG::2014-04-10 18:10:13,433::task::579::TaskManager.Task::(_updateState) Task=`ce72077a-7041-4d9d-afc1-f2463bd97d82`::moving from state init -> state preparing
>Thread-4001::INFO::2014-04-10 18:10:13,433::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4001::INFO::2014-04-10 18:10:13,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4001::DEBUG::2014-04-10 18:10:13,433::task::1168::TaskManager.Task::(prepare) Task=`ce72077a-7041-4d9d-afc1-f2463bd97d82`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4001::DEBUG::2014-04-10 18:10:13,434::task::579::TaskManager.Task::(_updateState) Task=`ce72077a-7041-4d9d-afc1-f2463bd97d82`::moving from state preparing -> state finished
>Thread-4001::DEBUG::2014-04-10 18:10:13,434::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4001::DEBUG::2014-04-10 18:10:13,434::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4001::DEBUG::2014-04-10 18:10:13,434::task::974::TaskManager.Task::(_decref) Task=`ce72077a-7041-4d9d-afc1-f2463bd97d82`::ref 0 aborting False
>Thread-4002::DEBUG::2014-04-10 18:10:13,441::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4002::DEBUG::2014-04-10 18:10:13,441::task::579::TaskManager.Task::(_updateState) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::moving from state init -> state preparing
>Thread-4002::INFO::2014-04-10 18:10:13,441::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4002::DEBUG::2014-04-10 18:10:13,442::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7bceca87-421e-4c20-923e-667045dddcc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4002::DEBUG::2014-04-10 18:10:13,442::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4002::DEBUG::2014-04-10 18:10:13,442::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4002::DEBUG::2014-04-10 18:10:13,442::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7bceca87-421e-4c20-923e-667045dddcc3`::Granted request
>Thread-4002::DEBUG::2014-04-10 18:10:13,443::task::811::TaskManager.Task::(resourceAcquired) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4002::DEBUG::2014-04-10 18:10:13,443::task::974::TaskManager.Task::(_decref) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::ref 1 aborting False
>Thread-4002::INFO::2014-04-10 18:10:13,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4002::DEBUG::2014-04-10 18:10:13,445::task::1168::TaskManager.Task::(prepare) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4002::DEBUG::2014-04-10 18:10:13,445::task::579::TaskManager.Task::(_updateState) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::moving from state preparing -> state finished
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4002::DEBUG::2014-04-10 18:10:13,446::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4002::DEBUG::2014-04-10 18:10:13,447::task::974::TaskManager.Task::(_decref) Task=`6626e181-0b89-422a-93b4-8884bce3d08d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:18,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:18,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307627 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:18,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:18,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314595 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:18,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:18,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451677 s, 815 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:19,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:19,099::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468663 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4005::DEBUG::2014-04-10 18:10:20,236::task::579::TaskManager.Task::(_updateState) Task=`10774ab6-6c29-4b63-929e-a7fcaed3f21d`::moving from state init -> state preparing
>Thread-4005::INFO::2014-04-10 18:10:20,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4005::INFO::2014-04-10 18:10:20,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468663', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307627', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314595', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451677', 'lastCheck': '1.3', 'valid': True}}
>Thread-4005::DEBUG::2014-04-10 18:10:20,237::task::1168::TaskManager.Task::(prepare) Task=`10774ab6-6c29-4b63-929e-a7fcaed3f21d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468663', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307627', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314595', 'lastCheck': '1.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451677', 'lastCheck': '1.3', 'valid': True}}
>Thread-4005::DEBUG::2014-04-10 18:10:20,237::task::579::TaskManager.Task::(_updateState) Task=`10774ab6-6c29-4b63-929e-a7fcaed3f21d`::moving from state preparing -> state finished
>Thread-4005::DEBUG::2014-04-10 18:10:20,237::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4005::DEBUG::2014-04-10 18:10:20,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4005::DEBUG::2014-04-10 18:10:20,237::task::974::TaskManager.Task::(_decref) Task=`10774ab6-6c29-4b63-929e-a7fcaed3f21d`::ref 0 aborting False
>Thread-4008::DEBUG::2014-04-10 18:10:23,540::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4008::DEBUG::2014-04-10 18:10:23,540::task::579::TaskManager.Task::(_updateState) Task=`15b84454-c384-4c57-9fa0-2d07cc7a3866`::moving from state init -> state preparing
>Thread-4008::INFO::2014-04-10 18:10:23,540::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4008::INFO::2014-04-10 18:10:23,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4008::DEBUG::2014-04-10 18:10:23,541::task::1168::TaskManager.Task::(prepare) Task=`15b84454-c384-4c57-9fa0-2d07cc7a3866`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4008::DEBUG::2014-04-10 18:10:23,541::task::579::TaskManager.Task::(_updateState) Task=`15b84454-c384-4c57-9fa0-2d07cc7a3866`::moving from state preparing -> state finished
>Thread-4008::DEBUG::2014-04-10 18:10:23,541::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4008::DEBUG::2014-04-10 18:10:23,541::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4008::DEBUG::2014-04-10 18:10:23,541::task::974::TaskManager.Task::(_decref) Task=`15b84454-c384-4c57-9fa0-2d07cc7a3866`::ref 0 aborting False
>Thread-4009::DEBUG::2014-04-10 18:10:23,548::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4009::DEBUG::2014-04-10 18:10:23,548::task::579::TaskManager.Task::(_updateState) Task=`a5adea86-5c45-4608-b265-16b416a25939`::moving from state init -> state preparing
>Thread-4009::INFO::2014-04-10 18:10:23,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4009::DEBUG::2014-04-10 18:10:23,549::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29ca7648-43b7-4843-a397-6405bf89fb8b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4009::DEBUG::2014-04-10 18:10:23,549::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4009::DEBUG::2014-04-10 18:10:23,549::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4009::DEBUG::2014-04-10 18:10:23,549::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`29ca7648-43b7-4843-a397-6405bf89fb8b`::Granted request
>Thread-4009::DEBUG::2014-04-10 18:10:23,550::task::811::TaskManager.Task::(resourceAcquired) Task=`a5adea86-5c45-4608-b265-16b416a25939`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4009::DEBUG::2014-04-10 18:10:23,550::task::974::TaskManager.Task::(_decref) Task=`a5adea86-5c45-4608-b265-16b416a25939`::ref 1 aborting False
>Thread-4009::INFO::2014-04-10 18:10:23,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4009::DEBUG::2014-04-10 18:10:23,552::task::1168::TaskManager.Task::(prepare) Task=`a5adea86-5c45-4608-b265-16b416a25939`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4009::DEBUG::2014-04-10 18:10:23,552::task::579::TaskManager.Task::(_updateState) Task=`a5adea86-5c45-4608-b265-16b416a25939`::moving from state preparing -> state finished
>Thread-4009::DEBUG::2014-04-10 18:10:23,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4009::DEBUG::2014-04-10 18:10:23,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4009::DEBUG::2014-04-10 18:10:23,553::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4009::DEBUG::2014-04-10 18:10:23,553::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4009::DEBUG::2014-04-10 18:10:23,553::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4009::DEBUG::2014-04-10 18:10:23,553::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4009::DEBUG::2014-04-10 18:10:23,553::task::974::TaskManager.Task::(_decref) Task=`a5adea86-5c45-4608-b265-16b416a25939`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:28,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:28,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000419612 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:28,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:28,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371032 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:28,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:28,916::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486728 s, 756 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:29,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:29,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000440836 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4013::DEBUG::2014-04-10 18:10:33,638::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4013::DEBUG::2014-04-10 18:10:33,639::task::579::TaskManager.Task::(_updateState) Task=`e9c41515-86ac-42f7-94c5-07a466e2e0f9`::moving from state init -> state preparing
>Thread-4013::INFO::2014-04-10 18:10:33,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4013::INFO::2014-04-10 18:10:33,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4013::DEBUG::2014-04-10 18:10:33,639::task::1168::TaskManager.Task::(prepare) Task=`e9c41515-86ac-42f7-94c5-07a466e2e0f9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4013::DEBUG::2014-04-10 18:10:33,639::task::579::TaskManager.Task::(_updateState) Task=`e9c41515-86ac-42f7-94c5-07a466e2e0f9`::moving from state preparing -> state finished
>Thread-4013::DEBUG::2014-04-10 18:10:33,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4013::DEBUG::2014-04-10 18:10:33,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4013::DEBUG::2014-04-10 18:10:33,640::task::974::TaskManager.Task::(_decref) Task=`e9c41515-86ac-42f7-94c5-07a466e2e0f9`::ref 0 aborting False
>Thread-4014::DEBUG::2014-04-10 18:10:33,647::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4014::DEBUG::2014-04-10 18:10:33,647::task::579::TaskManager.Task::(_updateState) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::moving from state init -> state preparing
>Thread-4014::INFO::2014-04-10 18:10:33,647::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4014::DEBUG::2014-04-10 18:10:33,647::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fcaa79b6-53ef-4283-9432-8619caf7179d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4014::DEBUG::2014-04-10 18:10:33,648::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4014::DEBUG::2014-04-10 18:10:33,648::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4014::DEBUG::2014-04-10 18:10:33,648::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fcaa79b6-53ef-4283-9432-8619caf7179d`::Granted request
>Thread-4014::DEBUG::2014-04-10 18:10:33,648::task::811::TaskManager.Task::(resourceAcquired) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4014::DEBUG::2014-04-10 18:10:33,648::task::974::TaskManager.Task::(_decref) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::ref 1 aborting False
>Thread-4014::INFO::2014-04-10 18:10:33,650::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4014::DEBUG::2014-04-10 18:10:33,650::task::1168::TaskManager.Task::(prepare) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::task::579::TaskManager.Task::(_updateState) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::moving from state preparing -> state finished
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4014::DEBUG::2014-04-10 18:10:33,651::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4014::DEBUG::2014-04-10 18:10:33,652::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4014::DEBUG::2014-04-10 18:10:33,652::task::974::TaskManager.Task::(_decref) Task=`6cca0feb-8d6a-4ac8-8a44-52c422c377dd`::ref 0 aborting False
>Thread-4015::DEBUG::2014-04-10 18:10:35,422::task::579::TaskManager.Task::(_updateState) Task=`aaacd39c-6c09-419b-a1c6-513877ea20a9`::moving from state init -> state preparing
>Thread-4015::INFO::2014-04-10 18:10:35,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4015::INFO::2014-04-10 18:10:35,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440836', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419612', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371032', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486728', 'lastCheck': '6.5', 'valid': True}}
>Thread-4015::DEBUG::2014-04-10 18:10:35,423::task::1168::TaskManager.Task::(prepare) Task=`aaacd39c-6c09-419b-a1c6-513877ea20a9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440836', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419612', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371032', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486728', 'lastCheck': '6.5', 'valid': True}}
>Thread-4015::DEBUG::2014-04-10 18:10:35,423::task::579::TaskManager.Task::(_updateState) Task=`aaacd39c-6c09-419b-a1c6-513877ea20a9`::moving from state preparing -> state finished
>Thread-4015::DEBUG::2014-04-10 18:10:35,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4015::DEBUG::2014-04-10 18:10:35,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4015::DEBUG::2014-04-10 18:10:35,424::task::974::TaskManager.Task::(_decref) Task=`aaacd39c-6c09-419b-a1c6-513877ea20a9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:38,414::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:10:38,420::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:10:38,421::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:10:38,425::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:10:38,426::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:10:38,427::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:10:38,427::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:10:38,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:38,438::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361052 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:38,603::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:10:38,626::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:10:38,628::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:10:38,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:10:38,634::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:10:38,634::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:10:38,634::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:10:38,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:38,645::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00024964 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:38,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:38,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000558069 s, 659 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:39,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:39,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000345965 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4027::DEBUG::2014-04-10 18:10:43,728::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4027::DEBUG::2014-04-10 18:10:43,738::task::579::TaskManager.Task::(_updateState) Task=`cce0ec2d-32ae-4d76-a631-fc82365f3f6f`::moving from state init -> state preparing
>Thread-4027::INFO::2014-04-10 18:10:43,738::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4027::INFO::2014-04-10 18:10:43,738::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4027::DEBUG::2014-04-10 18:10:43,739::task::1168::TaskManager.Task::(prepare) Task=`cce0ec2d-32ae-4d76-a631-fc82365f3f6f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4027::DEBUG::2014-04-10 18:10:43,739::task::579::TaskManager.Task::(_updateState) Task=`cce0ec2d-32ae-4d76-a631-fc82365f3f6f`::moving from state preparing -> state finished
>Thread-4027::DEBUG::2014-04-10 18:10:43,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4027::DEBUG::2014-04-10 18:10:43,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4027::DEBUG::2014-04-10 18:10:43,739::task::974::TaskManager.Task::(_decref) Task=`cce0ec2d-32ae-4d76-a631-fc82365f3f6f`::ref 0 aborting False
>Thread-4028::DEBUG::2014-04-10 18:10:43,746::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4028::DEBUG::2014-04-10 18:10:43,746::task::579::TaskManager.Task::(_updateState) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::moving from state init -> state preparing
>Thread-4028::INFO::2014-04-10 18:10:43,746::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4028::DEBUG::2014-04-10 18:10:43,747::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b78ac68b-c249-47b7-b552-fdcb227d6b1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4028::DEBUG::2014-04-10 18:10:43,747::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4028::DEBUG::2014-04-10 18:10:43,747::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4028::DEBUG::2014-04-10 18:10:43,747::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b78ac68b-c249-47b7-b552-fdcb227d6b1e`::Granted request
>Thread-4028::DEBUG::2014-04-10 18:10:43,748::task::811::TaskManager.Task::(resourceAcquired) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4028::DEBUG::2014-04-10 18:10:43,748::task::974::TaskManager.Task::(_decref) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::ref 1 aborting False
>Thread-4028::INFO::2014-04-10 18:10:43,749::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4028::DEBUG::2014-04-10 18:10:43,750::task::1168::TaskManager.Task::(prepare) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4028::DEBUG::2014-04-10 18:10:43,750::task::579::TaskManager.Task::(_updateState) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::moving from state preparing -> state finished
>Thread-4028::DEBUG::2014-04-10 18:10:43,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4028::DEBUG::2014-04-10 18:10:43,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4028::DEBUG::2014-04-10 18:10:43,750::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4028::DEBUG::2014-04-10 18:10:43,751::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4028::DEBUG::2014-04-10 18:10:43,751::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4028::DEBUG::2014-04-10 18:10:43,751::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4028::DEBUG::2014-04-10 18:10:43,751::task::974::TaskManager.Task::(_decref) Task=`a671911c-8099-46f8-b82e-ee5f904b9968`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:48,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:48,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000432927 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:48,653::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:48,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320584 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:48,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:48,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464673 s, 792 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:49,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:49,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000380026 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4031::DEBUG::2014-04-10 18:10:50,591::task::579::TaskManager.Task::(_updateState) Task=`79cb7c6c-cbd8-43bc-9254-e9dfc0537d1d`::moving from state init -> state preparing
>Thread-4031::INFO::2014-04-10 18:10:50,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4031::INFO::2014-04-10 18:10:50,592::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380026', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432927', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320584', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464673', 'lastCheck': '1.6', 'valid': True}}
>Thread-4031::DEBUG::2014-04-10 18:10:50,592::task::1168::TaskManager.Task::(prepare) Task=`79cb7c6c-cbd8-43bc-9254-e9dfc0537d1d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380026', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432927', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320584', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464673', 'lastCheck': '1.6', 'valid': True}}
>Thread-4031::DEBUG::2014-04-10 18:10:50,592::task::579::TaskManager.Task::(_updateState) Task=`79cb7c6c-cbd8-43bc-9254-e9dfc0537d1d`::moving from state preparing -> state finished
>Thread-4031::DEBUG::2014-04-10 18:10:50,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4031::DEBUG::2014-04-10 18:10:50,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4031::DEBUG::2014-04-10 18:10:50,592::task::974::TaskManager.Task::(_decref) Task=`79cb7c6c-cbd8-43bc-9254-e9dfc0537d1d`::ref 0 aborting False
>Thread-4034::DEBUG::2014-04-10 18:10:53,943::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4034::DEBUG::2014-04-10 18:10:53,944::task::579::TaskManager.Task::(_updateState) Task=`c622291d-6aa0-4406-b271-2cc7397de163`::moving from state init -> state preparing
>Thread-4034::INFO::2014-04-10 18:10:53,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4034::INFO::2014-04-10 18:10:53,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4034::DEBUG::2014-04-10 18:10:53,945::task::1168::TaskManager.Task::(prepare) Task=`c622291d-6aa0-4406-b271-2cc7397de163`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4034::DEBUG::2014-04-10 18:10:53,945::task::579::TaskManager.Task::(_updateState) Task=`c622291d-6aa0-4406-b271-2cc7397de163`::moving from state preparing -> state finished
>Thread-4034::DEBUG::2014-04-10 18:10:53,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4034::DEBUG::2014-04-10 18:10:53,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4034::DEBUG::2014-04-10 18:10:53,945::task::974::TaskManager.Task::(_decref) Task=`c622291d-6aa0-4406-b271-2cc7397de163`::ref 0 aborting False
>Thread-4035::DEBUG::2014-04-10 18:10:53,952::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4035::DEBUG::2014-04-10 18:10:53,973::task::579::TaskManager.Task::(_updateState) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::moving from state init -> state preparing
>Thread-4035::INFO::2014-04-10 18:10:53,973::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4035::DEBUG::2014-04-10 18:10:53,973::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`521ab216-d631-41b9-89b8-9e58f9f00411`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4035::DEBUG::2014-04-10 18:10:53,973::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4035::DEBUG::2014-04-10 18:10:53,975::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4035::DEBUG::2014-04-10 18:10:53,975::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`521ab216-d631-41b9-89b8-9e58f9f00411`::Granted request
>Thread-4035::DEBUG::2014-04-10 18:10:53,975::task::811::TaskManager.Task::(resourceAcquired) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4035::DEBUG::2014-04-10 18:10:53,976::task::974::TaskManager.Task::(_decref) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::ref 1 aborting False
>Thread-4035::INFO::2014-04-10 18:10:53,978::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4035::DEBUG::2014-04-10 18:10:53,978::task::1168::TaskManager.Task::(prepare) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4035::DEBUG::2014-04-10 18:10:53,978::task::579::TaskManager.Task::(_updateState) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::moving from state preparing -> state finished
>Thread-4035::DEBUG::2014-04-10 18:10:53,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4035::DEBUG::2014-04-10 18:10:53,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4035::DEBUG::2014-04-10 18:10:53,979::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4035::DEBUG::2014-04-10 18:10:53,979::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4035::DEBUG::2014-04-10 18:10:53,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4035::DEBUG::2014-04-10 18:10:53,979::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4035::DEBUG::2014-04-10 18:10:53,980::task::974::TaskManager.Task::(_decref) Task=`2c454692-7d63-4c60-add7-be981480d3f4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:10:58,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:10:58,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000478734 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:10:58,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:10:58,671::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341091 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:10:58,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:10:58,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474829 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:10:59,154::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:10:59,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000466172 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4039::DEBUG::2014-04-10 18:11:04,068::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-4039::DEBUG::2014-04-10 18:11:04,075::task::579::TaskManager.Task::(_updateState) Task=`23cf4360-5732-48e0-a02a-2914fd6a3b92`::moving from state init -> state preparing
>Thread-4039::INFO::2014-04-10 18:11:04,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4039::INFO::2014-04-10 18:11:04,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4039::DEBUG::2014-04-10 18:11:04,076::task::1168::TaskManager.Task::(prepare) Task=`23cf4360-5732-48e0-a02a-2914fd6a3b92`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4039::DEBUG::2014-04-10 18:11:04,076::task::579::TaskManager.Task::(_updateState) Task=`23cf4360-5732-48e0-a02a-2914fd6a3b92`::moving from state preparing -> state finished
>Thread-4039::DEBUG::2014-04-10 18:11:04,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4039::DEBUG::2014-04-10 18:11:04,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4039::DEBUG::2014-04-10 18:11:04,077::task::974::TaskManager.Task::(_decref) Task=`23cf4360-5732-48e0-a02a-2914fd6a3b92`::ref 0 aborting False
>Thread-4040::DEBUG::2014-04-10 18:11:04,083::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6952031]
>Thread-4040::DEBUG::2014-04-10 18:11:04,083::task::579::TaskManager.Task::(_updateState) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::moving from state init -> state preparing
>Thread-4040::INFO::2014-04-10 18:11:04,084::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4040::DEBUG::2014-04-10 18:11:04,084::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef675429-e81b-4de5-85a5-e59290312883`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4040::DEBUG::2014-04-10 18:11:04,084::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4040::DEBUG::2014-04-10 18:11:04,085::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4040::DEBUG::2014-04-10 18:11:04,085::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef675429-e81b-4de5-85a5-e59290312883`::Granted request
>Thread-4040::DEBUG::2014-04-10 18:11:04,085::task::811::TaskManager.Task::(resourceAcquired) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4040::DEBUG::2014-04-10 18:11:04,085::task::974::TaskManager.Task::(_decref) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::ref 1 aborting False
>Thread-4040::INFO::2014-04-10 18:11:04,087::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4040::DEBUG::2014-04-10 18:11:04,088::task::1168::TaskManager.Task::(prepare) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4040::DEBUG::2014-04-10 18:11:04,088::task::579::TaskManager.Task::(_updateState) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::moving from state preparing -> state finished
>Thread-4040::DEBUG::2014-04-10 18:11:04,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4040::DEBUG::2014-04-10 18:11:04,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4040::DEBUG::2014-04-10 18:11:04,088::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4040::DEBUG::2014-04-10 18:11:04,089::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4040::DEBUG::2014-04-10 18:11:04,089::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4040::DEBUG::2014-04-10 18:11:04,089::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4040::DEBUG::2014-04-10 18:11:04,089::task::974::TaskManager.Task::(_decref) Task=`9ff89a31-03ec-42a7-b88c-4c2031cba862`::ref 0 aborting False
>Thread-4041::DEBUG::2014-04-10 18:11:05,754::task::579::TaskManager.Task::(_updateState) Task=`a8c7fb63-0305-4088-a1f0-fde948168290`::moving from state init -> state preparing
>Thread-4041::INFO::2014-04-10 18:11:05,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4041::INFO::2014-04-10 18:11:05,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466172', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478734', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341091', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474829', 'lastCheck': '6.8', 'valid': True}}
>Thread-4041::DEBUG::2014-04-10 18:11:05,754::task::1168::TaskManager.Task::(prepare) Task=`a8c7fb63-0305-4088-a1f0-fde948168290`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466172', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478734', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341091', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474829', 'lastCheck': '6.8', 'valid': True}}
>Thread-4041::DEBUG::2014-04-10 18:11:05,754::task::579::TaskManager.Task::(_updateState) Task=`a8c7fb63-0305-4088-a1f0-fde948168290`::moving from state preparing -> state finished
>Thread-4041::DEBUG::2014-04-10 18:11:05,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4041::DEBUG::2014-04-10 18:11:05,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4041::DEBUG::2014-04-10 18:11:05,755::task::974::TaskManager.Task::(_decref) Task=`a8c7fb63-0305-4088-a1f0-fde948168290`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:08,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:08,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402206 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:08,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:08,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306689 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:08,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:08,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000523672 s, 703 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:09,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:09,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000545211 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4045::DEBUG::2014-04-10 18:11:14,174::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4045::DEBUG::2014-04-10 18:11:14,196::task::579::TaskManager.Task::(_updateState) Task=`1cc062ea-c770-4087-a36b-5098c4a847c2`::moving from state init -> state preparing
>Thread-4045::INFO::2014-04-10 18:11:14,196::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4045::INFO::2014-04-10 18:11:14,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4045::DEBUG::2014-04-10 18:11:14,197::task::1168::TaskManager.Task::(prepare) Task=`1cc062ea-c770-4087-a36b-5098c4a847c2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4045::DEBUG::2014-04-10 18:11:14,197::task::579::TaskManager.Task::(_updateState) Task=`1cc062ea-c770-4087-a36b-5098c4a847c2`::moving from state preparing -> state finished
>Thread-4045::DEBUG::2014-04-10 18:11:14,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4045::DEBUG::2014-04-10 18:11:14,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4045::DEBUG::2014-04-10 18:11:14,197::task::974::TaskManager.Task::(_decref) Task=`1cc062ea-c770-4087-a36b-5098c4a847c2`::ref 0 aborting False
>Thread-4046::DEBUG::2014-04-10 18:11:14,205::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4046::DEBUG::2014-04-10 18:11:14,205::task::579::TaskManager.Task::(_updateState) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::moving from state init -> state preparing
>Thread-4046::INFO::2014-04-10 18:11:14,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4046::DEBUG::2014-04-10 18:11:14,206::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a76eae8b-a1ad-409b-8ff0-961164f81442`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4046::DEBUG::2014-04-10 18:11:14,206::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4046::DEBUG::2014-04-10 18:11:14,207::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4046::DEBUG::2014-04-10 18:11:14,207::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a76eae8b-a1ad-409b-8ff0-961164f81442`::Granted request
>Thread-4046::DEBUG::2014-04-10 18:11:14,207::task::811::TaskManager.Task::(resourceAcquired) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4046::DEBUG::2014-04-10 18:11:14,207::task::974::TaskManager.Task::(_decref) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::ref 1 aborting False
>Thread-4046::INFO::2014-04-10 18:11:14,209::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4046::DEBUG::2014-04-10 18:11:14,210::task::1168::TaskManager.Task::(prepare) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4046::DEBUG::2014-04-10 18:11:14,210::task::579::TaskManager.Task::(_updateState) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::moving from state preparing -> state finished
>Thread-4046::DEBUG::2014-04-10 18:11:14,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4046::DEBUG::2014-04-10 18:11:14,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4046::DEBUG::2014-04-10 18:11:14,211::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4046::DEBUG::2014-04-10 18:11:14,211::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4046::DEBUG::2014-04-10 18:11:14,211::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4046::DEBUG::2014-04-10 18:11:14,211::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4046::DEBUG::2014-04-10 18:11:14,211::task::974::TaskManager.Task::(_decref) Task=`20f6816a-7f18-46cf-a0f1-e5ebb586b323`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:18,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:18,497::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302063 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:18,693::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:18,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000392562 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:18,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:19,005::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533878 s, 689 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:19,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:19,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000495568 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4049::DEBUG::2014-04-10 18:11:20,920::task::579::TaskManager.Task::(_updateState) Task=`a6c9c38d-beb3-4778-97ba-198cb89b16e7`::moving from state init -> state preparing
>Thread-4049::INFO::2014-04-10 18:11:20,920::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4049::INFO::2014-04-10 18:11:20,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495568', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302063', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392562', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533878', 'lastCheck': '1.9', 'valid': True}}
>Thread-4049::DEBUG::2014-04-10 18:11:20,921::task::1168::TaskManager.Task::(prepare) Task=`a6c9c38d-beb3-4778-97ba-198cb89b16e7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495568', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302063', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392562', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533878', 'lastCheck': '1.9', 'valid': True}}
>Thread-4049::DEBUG::2014-04-10 18:11:20,921::task::579::TaskManager.Task::(_updateState) Task=`a6c9c38d-beb3-4778-97ba-198cb89b16e7`::moving from state preparing -> state finished
>Thread-4049::DEBUG::2014-04-10 18:11:20,921::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4049::DEBUG::2014-04-10 18:11:20,921::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4049::DEBUG::2014-04-10 18:11:20,922::task::974::TaskManager.Task::(_decref) Task=`a6c9c38d-beb3-4778-97ba-198cb89b16e7`::ref 0 aborting False
>Thread-4052::DEBUG::2014-04-10 18:11:24,297::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4052::DEBUG::2014-04-10 18:11:24,305::task::579::TaskManager.Task::(_updateState) Task=`e425a804-e23d-45eb-87e6-c9a01136795c`::moving from state init -> state preparing
>Thread-4052::INFO::2014-04-10 18:11:24,306::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4052::INFO::2014-04-10 18:11:24,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4052::DEBUG::2014-04-10 18:11:24,306::task::1168::TaskManager.Task::(prepare) Task=`e425a804-e23d-45eb-87e6-c9a01136795c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4052::DEBUG::2014-04-10 18:11:24,306::task::579::TaskManager.Task::(_updateState) Task=`e425a804-e23d-45eb-87e6-c9a01136795c`::moving from state preparing -> state finished
>Thread-4052::DEBUG::2014-04-10 18:11:24,306::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4052::DEBUG::2014-04-10 18:11:24,307::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4052::DEBUG::2014-04-10 18:11:24,307::task::974::TaskManager.Task::(_decref) Task=`e425a804-e23d-45eb-87e6-c9a01136795c`::ref 0 aborting False
>Thread-4053::DEBUG::2014-04-10 18:11:24,314::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4053::DEBUG::2014-04-10 18:11:24,314::task::579::TaskManager.Task::(_updateState) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::moving from state init -> state preparing
>Thread-4053::INFO::2014-04-10 18:11:24,314::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4053::DEBUG::2014-04-10 18:11:24,315::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08a923ee-353c-4595-8708-0c39a41fc471`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4053::DEBUG::2014-04-10 18:11:24,315::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4053::DEBUG::2014-04-10 18:11:24,315::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4053::DEBUG::2014-04-10 18:11:24,316::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08a923ee-353c-4595-8708-0c39a41fc471`::Granted request
>Thread-4053::DEBUG::2014-04-10 18:11:24,316::task::811::TaskManager.Task::(resourceAcquired) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4053::DEBUG::2014-04-10 18:11:24,316::task::974::TaskManager.Task::(_decref) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::ref 1 aborting False
>Thread-4053::INFO::2014-04-10 18:11:24,318::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4053::DEBUG::2014-04-10 18:11:24,319::task::1168::TaskManager.Task::(prepare) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4053::DEBUG::2014-04-10 18:11:24,319::task::579::TaskManager.Task::(_updateState) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::moving from state preparing -> state finished
>Thread-4053::DEBUG::2014-04-10 18:11:24,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4053::DEBUG::2014-04-10 18:11:24,319::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4053::DEBUG::2014-04-10 18:11:24,319::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4053::DEBUG::2014-04-10 18:11:24,320::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4053::DEBUG::2014-04-10 18:11:24,320::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4053::DEBUG::2014-04-10 18:11:24,320::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4053::DEBUG::2014-04-10 18:11:24,320::task::974::TaskManager.Task::(_decref) Task=`0d7eda02-448f-47d3-b730-41c0cb7998a8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:28,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:28,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000429094 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:28,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:28,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349349 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:29,013::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:29,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00050357 s, 731 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:29,204::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:29,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000508061 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4057::DEBUG::2014-04-10 18:11:34,413::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4057::DEBUG::2014-04-10 18:11:34,414::task::579::TaskManager.Task::(_updateState) Task=`d82f00e7-93da-4118-92dc-eef6459d1e05`::moving from state init -> state preparing
>Thread-4057::INFO::2014-04-10 18:11:34,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4057::INFO::2014-04-10 18:11:34,415::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4057::DEBUG::2014-04-10 18:11:34,415::task::1168::TaskManager.Task::(prepare) Task=`d82f00e7-93da-4118-92dc-eef6459d1e05`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4057::DEBUG::2014-04-10 18:11:34,415::task::579::TaskManager.Task::(_updateState) Task=`d82f00e7-93da-4118-92dc-eef6459d1e05`::moving from state preparing -> state finished
>Thread-4057::DEBUG::2014-04-10 18:11:34,415::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4057::DEBUG::2014-04-10 18:11:34,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4057::DEBUG::2014-04-10 18:11:34,416::task::974::TaskManager.Task::(_decref) Task=`d82f00e7-93da-4118-92dc-eef6459d1e05`::ref 0 aborting False
>Thread-4058::DEBUG::2014-04-10 18:11:34,422::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4058::DEBUG::2014-04-10 18:11:34,423::task::579::TaskManager.Task::(_updateState) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::moving from state init -> state preparing
>Thread-4058::INFO::2014-04-10 18:11:34,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4058::DEBUG::2014-04-10 18:11:34,424::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`840e6087-5097-4b0c-823b-90faa8f271db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4058::DEBUG::2014-04-10 18:11:34,424::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4058::DEBUG::2014-04-10 18:11:34,424::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4058::DEBUG::2014-04-10 18:11:34,424::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`840e6087-5097-4b0c-823b-90faa8f271db`::Granted request
>Thread-4058::DEBUG::2014-04-10 18:11:34,426::task::811::TaskManager.Task::(resourceAcquired) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4058::DEBUG::2014-04-10 18:11:34,426::task::974::TaskManager.Task::(_decref) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::ref 1 aborting False
>Thread-4058::INFO::2014-04-10 18:11:34,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4058::DEBUG::2014-04-10 18:11:34,428::task::1168::TaskManager.Task::(prepare) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4058::DEBUG::2014-04-10 18:11:34,429::task::579::TaskManager.Task::(_updateState) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::moving from state preparing -> state finished
>Thread-4058::DEBUG::2014-04-10 18:11:34,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4058::DEBUG::2014-04-10 18:11:34,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4058::DEBUG::2014-04-10 18:11:34,429::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4058::DEBUG::2014-04-10 18:11:34,429::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4058::DEBUG::2014-04-10 18:11:34,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4058::DEBUG::2014-04-10 18:11:34,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4058::DEBUG::2014-04-10 18:11:34,430::task::974::TaskManager.Task::(_decref) Task=`54c45f4b-92c0-4afa-949a-b8e2402b59cc`::ref 0 aborting False
>Thread-4059::DEBUG::2014-04-10 18:11:36,278::task::579::TaskManager.Task::(_updateState) Task=`e0ccd420-0e8c-4435-b82e-136fb57a37ec`::moving from state init -> state preparing
>Thread-4059::INFO::2014-04-10 18:11:36,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4059::INFO::2014-04-10 18:11:36,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508061', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429094', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349349', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050357', 'lastCheck': '7.3', 'valid': True}}
>Thread-4059::DEBUG::2014-04-10 18:11:36,279::task::1168::TaskManager.Task::(prepare) Task=`e0ccd420-0e8c-4435-b82e-136fb57a37ec`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508061', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429094', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349349', 'lastCheck': '7.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050357', 'lastCheck': '7.3', 'valid': True}}
>Thread-4059::DEBUG::2014-04-10 18:11:36,279::task::579::TaskManager.Task::(_updateState) Task=`e0ccd420-0e8c-4435-b82e-136fb57a37ec`::moving from state preparing -> state finished
>Thread-4059::DEBUG::2014-04-10 18:11:36,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4059::DEBUG::2014-04-10 18:11:36,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4059::DEBUG::2014-04-10 18:11:36,279::task::974::TaskManager.Task::(_decref) Task=`e0ccd420-0e8c-4435-b82e-136fb57a37ec`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:38,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:38,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338679 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:38,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:38,727::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000275333 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:39,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:39,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000413788 s, 889 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:39,218::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:39,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000492745 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4063::DEBUG::2014-04-10 18:11:44,736::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4063::DEBUG::2014-04-10 18:11:44,737::task::579::TaskManager.Task::(_updateState) Task=`e151ff16-ac55-4dee-89f7-0feddea0672b`::moving from state init -> state preparing
>Thread-4063::INFO::2014-04-10 18:11:44,737::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4063::INFO::2014-04-10 18:11:44,738::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4063::DEBUG::2014-04-10 18:11:44,738::task::1168::TaskManager.Task::(prepare) Task=`e151ff16-ac55-4dee-89f7-0feddea0672b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4063::DEBUG::2014-04-10 18:11:44,738::task::579::TaskManager.Task::(_updateState) Task=`e151ff16-ac55-4dee-89f7-0feddea0672b`::moving from state preparing -> state finished
>Thread-4063::DEBUG::2014-04-10 18:11:44,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4063::DEBUG::2014-04-10 18:11:44,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4063::DEBUG::2014-04-10 18:11:44,739::task::974::TaskManager.Task::(_decref) Task=`e151ff16-ac55-4dee-89f7-0feddea0672b`::ref 0 aborting False
>Thread-4064::DEBUG::2014-04-10 18:11:44,746::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4064::DEBUG::2014-04-10 18:11:44,746::task::579::TaskManager.Task::(_updateState) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::moving from state init -> state preparing
>Thread-4064::INFO::2014-04-10 18:11:44,746::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4064::DEBUG::2014-04-10 18:11:44,747::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`72aae419-ef99-4575-bc49-17a0316337d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4064::DEBUG::2014-04-10 18:11:44,747::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4064::DEBUG::2014-04-10 18:11:44,747::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4064::DEBUG::2014-04-10 18:11:44,747::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`72aae419-ef99-4575-bc49-17a0316337d1`::Granted request
>Thread-4064::DEBUG::2014-04-10 18:11:44,748::task::811::TaskManager.Task::(resourceAcquired) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4064::DEBUG::2014-04-10 18:11:44,748::task::974::TaskManager.Task::(_decref) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::ref 1 aborting False
>Thread-4064::INFO::2014-04-10 18:11:44,750::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4064::DEBUG::2014-04-10 18:11:44,750::task::1168::TaskManager.Task::(prepare) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4064::DEBUG::2014-04-10 18:11:44,750::task::579::TaskManager.Task::(_updateState) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::moving from state preparing -> state finished
>Thread-4064::DEBUG::2014-04-10 18:11:44,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4064::DEBUG::2014-04-10 18:11:44,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4064::DEBUG::2014-04-10 18:11:44,751::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4064::DEBUG::2014-04-10 18:11:44,751::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4064::DEBUG::2014-04-10 18:11:44,751::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4064::DEBUG::2014-04-10 18:11:44,752::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4064::DEBUG::2014-04-10 18:11:44,752::task::974::TaskManager.Task::(_decref) Task=`62d09b99-ccb5-4c4c-bc89-d62957788d80`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:48,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:48,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279265 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:48,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:48,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368228 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:49,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:49,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048993 s, 751 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:49,234::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:49,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000543962 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4067::DEBUG::2014-04-10 18:11:51,443::task::579::TaskManager.Task::(_updateState) Task=`cee71caf-6be5-4cc6-be62-c8ee848f0fe0`::moving from state init -> state preparing
>Thread-4067::INFO::2014-04-10 18:11:51,443::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4067::INFO::2014-04-10 18:11:51,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543962', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279265', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368228', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048993', 'lastCheck': '2.4', 'valid': True}}
>Thread-4067::DEBUG::2014-04-10 18:11:51,444::task::1168::TaskManager.Task::(prepare) Task=`cee71caf-6be5-4cc6-be62-c8ee848f0fe0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543962', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279265', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368228', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048993', 'lastCheck': '2.4', 'valid': True}}
>Thread-4067::DEBUG::2014-04-10 18:11:51,444::task::579::TaskManager.Task::(_updateState) Task=`cee71caf-6be5-4cc6-be62-c8ee848f0fe0`::moving from state preparing -> state finished
>Thread-4067::DEBUG::2014-04-10 18:11:51,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4067::DEBUG::2014-04-10 18:11:51,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4067::DEBUG::2014-04-10 18:11:51,445::task::974::TaskManager.Task::(_decref) Task=`cee71caf-6be5-4cc6-be62-c8ee848f0fe0`::ref 0 aborting False
>Thread-4070::DEBUG::2014-04-10 18:11:54,834::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4070::DEBUG::2014-04-10 18:11:54,835::task::579::TaskManager.Task::(_updateState) Task=`5d975df3-5a0a-49a5-ac79-c209d74a911a`::moving from state init -> state preparing
>Thread-4070::INFO::2014-04-10 18:11:54,835::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4070::INFO::2014-04-10 18:11:54,836::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4070::DEBUG::2014-04-10 18:11:54,836::task::1168::TaskManager.Task::(prepare) Task=`5d975df3-5a0a-49a5-ac79-c209d74a911a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4070::DEBUG::2014-04-10 18:11:54,836::task::579::TaskManager.Task::(_updateState) Task=`5d975df3-5a0a-49a5-ac79-c209d74a911a`::moving from state preparing -> state finished
>Thread-4070::DEBUG::2014-04-10 18:11:54,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4070::DEBUG::2014-04-10 18:11:54,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4070::DEBUG::2014-04-10 18:11:54,836::task::974::TaskManager.Task::(_decref) Task=`5d975df3-5a0a-49a5-ac79-c209d74a911a`::ref 0 aborting False
>Thread-4071::DEBUG::2014-04-10 18:11:54,843::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4071::DEBUG::2014-04-10 18:11:54,843::task::579::TaskManager.Task::(_updateState) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::moving from state init -> state preparing
>Thread-4071::INFO::2014-04-10 18:11:54,843::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4071::DEBUG::2014-04-10 18:11:54,844::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eebf76fc-73ac-44f8-9133-f0876500e9c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4071::DEBUG::2014-04-10 18:11:54,844::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4071::DEBUG::2014-04-10 18:11:54,844::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4071::DEBUG::2014-04-10 18:11:54,844::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eebf76fc-73ac-44f8-9133-f0876500e9c4`::Granted request
>Thread-4071::DEBUG::2014-04-10 18:11:54,845::task::811::TaskManager.Task::(resourceAcquired) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4071::DEBUG::2014-04-10 18:11:54,845::task::974::TaskManager.Task::(_decref) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::ref 1 aborting False
>Thread-4071::INFO::2014-04-10 18:11:54,847::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4071::DEBUG::2014-04-10 18:11:54,847::task::1168::TaskManager.Task::(prepare) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4071::DEBUG::2014-04-10 18:11:54,847::task::579::TaskManager.Task::(_updateState) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::moving from state preparing -> state finished
>Thread-4071::DEBUG::2014-04-10 18:11:54,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4071::DEBUG::2014-04-10 18:11:54,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4071::DEBUG::2014-04-10 18:11:54,848::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4071::DEBUG::2014-04-10 18:11:54,848::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4071::DEBUG::2014-04-10 18:11:54,848::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4071::DEBUG::2014-04-10 18:11:54,848::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4071::DEBUG::2014-04-10 18:11:54,848::task::974::TaskManager.Task::(_decref) Task=`7345b09f-a281-44b0-8d46-7e33e7a02484`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:11:58,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:11:58,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359758 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:11:58,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:11:58,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386217 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:11:59,053::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:11:59,069::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:11:59,070::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:11:59,076::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:11:59,077::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:11:59,078::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:11:59,078::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:11:59,083::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:11:59,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000407251 s, 904 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:11:59,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:11:59,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000553811 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4079::DEBUG::2014-04-10 18:12:05,247::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4079::DEBUG::2014-04-10 18:12:05,248::task::579::TaskManager.Task::(_updateState) Task=`c625707e-d310-4495-bc1d-8f41a09fe63e`::moving from state init -> state preparing
>Thread-4079::INFO::2014-04-10 18:12:05,248::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4079::INFO::2014-04-10 18:12:05,249::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4079::DEBUG::2014-04-10 18:12:05,249::task::1168::TaskManager.Task::(prepare) Task=`c625707e-d310-4495-bc1d-8f41a09fe63e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4079::DEBUG::2014-04-10 18:12:05,249::task::579::TaskManager.Task::(_updateState) Task=`c625707e-d310-4495-bc1d-8f41a09fe63e`::moving from state preparing -> state finished
>Thread-4079::DEBUG::2014-04-10 18:12:05,249::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4079::DEBUG::2014-04-10 18:12:05,249::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4079::DEBUG::2014-04-10 18:12:05,249::task::974::TaskManager.Task::(_decref) Task=`c625707e-d310-4495-bc1d-8f41a09fe63e`::ref 0 aborting False
>Thread-4080::DEBUG::2014-04-10 18:12:05,256::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4080::DEBUG::2014-04-10 18:12:05,257::task::579::TaskManager.Task::(_updateState) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::moving from state init -> state preparing
>Thread-4080::INFO::2014-04-10 18:12:05,257::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4080::DEBUG::2014-04-10 18:12:05,257::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`659655aa-878f-4818-bc3e-467f2456b573`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4080::DEBUG::2014-04-10 18:12:05,258::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4080::DEBUG::2014-04-10 18:12:05,258::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4080::DEBUG::2014-04-10 18:12:05,258::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`659655aa-878f-4818-bc3e-467f2456b573`::Granted request
>Thread-4080::DEBUG::2014-04-10 18:12:05,258::task::811::TaskManager.Task::(resourceAcquired) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4080::DEBUG::2014-04-10 18:12:05,259::task::974::TaskManager.Task::(_decref) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::ref 1 aborting False
>Thread-4080::INFO::2014-04-10 18:12:05,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4080::DEBUG::2014-04-10 18:12:05,261::task::1168::TaskManager.Task::(prepare) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4080::DEBUG::2014-04-10 18:12:05,261::task::579::TaskManager.Task::(_updateState) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::moving from state preparing -> state finished
>Thread-4080::DEBUG::2014-04-10 18:12:05,261::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4080::DEBUG::2014-04-10 18:12:05,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4080::DEBUG::2014-04-10 18:12:05,262::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4080::DEBUG::2014-04-10 18:12:05,262::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4080::DEBUG::2014-04-10 18:12:05,262::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4080::DEBUG::2014-04-10 18:12:05,262::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4080::DEBUG::2014-04-10 18:12:05,263::task::974::TaskManager.Task::(_decref) Task=`adb40723-d153-4bb5-b7cb-aba0796b11bc`::ref 0 aborting False
>Thread-4081::DEBUG::2014-04-10 18:12:06,601::task::579::TaskManager.Task::(_updateState) Task=`374e176d-d92c-423c-a352-e36a770f07d9`::moving from state init -> state preparing
>Thread-4081::INFO::2014-04-10 18:12:06,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4081::INFO::2014-04-10 18:12:06,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553811', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359758', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386217', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407251', 'lastCheck': '7.5', 'valid': True}}
>Thread-4081::DEBUG::2014-04-10 18:12:06,601::task::1168::TaskManager.Task::(prepare) Task=`374e176d-d92c-423c-a352-e36a770f07d9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553811', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359758', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386217', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407251', 'lastCheck': '7.5', 'valid': True}}
>Thread-4081::DEBUG::2014-04-10 18:12:06,602::task::579::TaskManager.Task::(_updateState) Task=`374e176d-d92c-423c-a352-e36a770f07d9`::moving from state preparing -> state finished
>Thread-4081::DEBUG::2014-04-10 18:12:06,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4081::DEBUG::2014-04-10 18:12:06,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4081::DEBUG::2014-04-10 18:12:06,602::task::974::TaskManager.Task::(_decref) Task=`374e176d-d92c-423c-a352-e36a770f07d9`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:08,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:08,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00530403 s, 127 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:08,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:08,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369452 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:09,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:09,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000491497 s, 749 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:09,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:09,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000493079 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4085::DEBUG::2014-04-10 18:12:15,571::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4085::DEBUG::2014-04-10 18:12:15,571::task::579::TaskManager.Task::(_updateState) Task=`12f2562d-9438-4aeb-a44f-f239aa51036f`::moving from state init -> state preparing
>Thread-4085::INFO::2014-04-10 18:12:15,572::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4085::INFO::2014-04-10 18:12:15,572::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4085::DEBUG::2014-04-10 18:12:15,572::task::1168::TaskManager.Task::(prepare) Task=`12f2562d-9438-4aeb-a44f-f239aa51036f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4085::DEBUG::2014-04-10 18:12:15,572::task::579::TaskManager.Task::(_updateState) Task=`12f2562d-9438-4aeb-a44f-f239aa51036f`::moving from state preparing -> state finished
>Thread-4085::DEBUG::2014-04-10 18:12:15,573::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4085::DEBUG::2014-04-10 18:12:15,573::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4085::DEBUG::2014-04-10 18:12:15,573::task::974::TaskManager.Task::(_decref) Task=`12f2562d-9438-4aeb-a44f-f239aa51036f`::ref 0 aborting False
>Thread-4086::DEBUG::2014-04-10 18:12:15,580::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4086::DEBUG::2014-04-10 18:12:15,581::task::579::TaskManager.Task::(_updateState) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::moving from state init -> state preparing
>Thread-4086::INFO::2014-04-10 18:12:15,581::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4086::DEBUG::2014-04-10 18:12:15,581::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0058f594-ffb4-4f6f-97c6-e316f1af3255`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4086::DEBUG::2014-04-10 18:12:15,582::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4086::DEBUG::2014-04-10 18:12:15,582::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4086::DEBUG::2014-04-10 18:12:15,582::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0058f594-ffb4-4f6f-97c6-e316f1af3255`::Granted request
>Thread-4086::DEBUG::2014-04-10 18:12:15,583::task::811::TaskManager.Task::(resourceAcquired) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4086::DEBUG::2014-04-10 18:12:15,583::task::974::TaskManager.Task::(_decref) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::ref 1 aborting False
>Thread-4086::INFO::2014-04-10 18:12:15,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4086::DEBUG::2014-04-10 18:12:15,586::task::1168::TaskManager.Task::(prepare) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4086::DEBUG::2014-04-10 18:12:15,586::task::579::TaskManager.Task::(_updateState) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::moving from state preparing -> state finished
>Thread-4086::DEBUG::2014-04-10 18:12:15,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4086::DEBUG::2014-04-10 18:12:15,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4086::DEBUG::2014-04-10 18:12:15,587::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4086::DEBUG::2014-04-10 18:12:15,587::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4086::DEBUG::2014-04-10 18:12:15,587::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4086::DEBUG::2014-04-10 18:12:15,587::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4086::DEBUG::2014-04-10 18:12:15,587::task::974::TaskManager.Task::(_decref) Task=`9268514b-f5d1-400c-b26f-0aca9dbaf7de`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:18,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:18,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00193606 s, 347 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:18,823::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:18,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025179 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:19,114::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:19,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000458093 s, 803 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:19,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:19,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000490472 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4089::DEBUG::2014-04-10 18:12:21,768::task::579::TaskManager.Task::(_updateState) Task=`a44823a6-3e2c-4b12-b124-841ca930a0f8`::moving from state init -> state preparing
>Thread-4089::INFO::2014-04-10 18:12:21,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4089::INFO::2014-04-10 18:12:21,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490472', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00193606', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025179', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458093', 'lastCheck': '2.6', 'valid': True}}
>Thread-4089::DEBUG::2014-04-10 18:12:21,768::task::1168::TaskManager.Task::(prepare) Task=`a44823a6-3e2c-4b12-b124-841ca930a0f8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490472', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00193606', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025179', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458093', 'lastCheck': '2.6', 'valid': True}}
>Thread-4089::DEBUG::2014-04-10 18:12:21,768::task::579::TaskManager.Task::(_updateState) Task=`a44823a6-3e2c-4b12-b124-841ca930a0f8`::moving from state preparing -> state finished
>Thread-4089::DEBUG::2014-04-10 18:12:21,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4089::DEBUG::2014-04-10 18:12:21,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4089::DEBUG::2014-04-10 18:12:21,769::task::974::TaskManager.Task::(_decref) Task=`a44823a6-3e2c-4b12-b124-841ca930a0f8`::ref 0 aborting False
>Thread-4092::DEBUG::2014-04-10 18:12:25,661::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4092::DEBUG::2014-04-10 18:12:25,661::task::579::TaskManager.Task::(_updateState) Task=`3ba6f982-09f0-4f8b-b8d8-39ec741a1740`::moving from state init -> state preparing
>Thread-4092::INFO::2014-04-10 18:12:25,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4092::INFO::2014-04-10 18:12:25,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4092::DEBUG::2014-04-10 18:12:25,662::task::1168::TaskManager.Task::(prepare) Task=`3ba6f982-09f0-4f8b-b8d8-39ec741a1740`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4092::DEBUG::2014-04-10 18:12:25,662::task::579::TaskManager.Task::(_updateState) Task=`3ba6f982-09f0-4f8b-b8d8-39ec741a1740`::moving from state preparing -> state finished
>Thread-4092::DEBUG::2014-04-10 18:12:25,662::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4092::DEBUG::2014-04-10 18:12:25,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4092::DEBUG::2014-04-10 18:12:25,663::task::974::TaskManager.Task::(_decref) Task=`3ba6f982-09f0-4f8b-b8d8-39ec741a1740`::ref 0 aborting False
>Thread-4093::DEBUG::2014-04-10 18:12:25,669::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4093::DEBUG::2014-04-10 18:12:25,670::task::579::TaskManager.Task::(_updateState) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::moving from state init -> state preparing
>Thread-4093::INFO::2014-04-10 18:12:25,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4093::DEBUG::2014-04-10 18:12:25,671::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24b84ea0-f1b0-4257-9f00-6564df58c675`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4093::DEBUG::2014-04-10 18:12:25,671::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4093::DEBUG::2014-04-10 18:12:25,671::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4093::DEBUG::2014-04-10 18:12:25,671::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`24b84ea0-f1b0-4257-9f00-6564df58c675`::Granted request
>Thread-4093::DEBUG::2014-04-10 18:12:25,672::task::811::TaskManager.Task::(resourceAcquired) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4093::DEBUG::2014-04-10 18:12:25,672::task::974::TaskManager.Task::(_decref) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::ref 1 aborting False
>Thread-4093::INFO::2014-04-10 18:12:25,674::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4093::DEBUG::2014-04-10 18:12:25,674::task::1168::TaskManager.Task::(prepare) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4093::DEBUG::2014-04-10 18:12:25,674::task::579::TaskManager.Task::(_updateState) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::moving from state preparing -> state finished
>Thread-4093::DEBUG::2014-04-10 18:12:25,674::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4093::DEBUG::2014-04-10 18:12:25,674::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4093::DEBUG::2014-04-10 18:12:25,675::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4093::DEBUG::2014-04-10 18:12:25,675::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4093::DEBUG::2014-04-10 18:12:25,675::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4093::DEBUG::2014-04-10 18:12:25,675::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4093::DEBUG::2014-04-10 18:12:25,675::task::974::TaskManager.Task::(_decref) Task=`1eda2b6f-5f50-49dd-a4b3-3731150ad3d0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:28,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:28,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308487 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:28,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:28,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287353 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:29,129::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:29,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000495952 s, 742 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:29,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:29,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000433095 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4097::DEBUG::2014-04-10 18:12:35,752::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4097::DEBUG::2014-04-10 18:12:35,753::task::579::TaskManager.Task::(_updateState) Task=`34cb7194-a648-440c-82d5-1179a8833b8a`::moving from state init -> state preparing
>Thread-4097::INFO::2014-04-10 18:12:35,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4097::INFO::2014-04-10 18:12:35,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4097::DEBUG::2014-04-10 18:12:35,754::task::1168::TaskManager.Task::(prepare) Task=`34cb7194-a648-440c-82d5-1179a8833b8a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4097::DEBUG::2014-04-10 18:12:35,754::task::579::TaskManager.Task::(_updateState) Task=`34cb7194-a648-440c-82d5-1179a8833b8a`::moving from state preparing -> state finished
>Thread-4097::DEBUG::2014-04-10 18:12:35,754::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4097::DEBUG::2014-04-10 18:12:35,754::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4097::DEBUG::2014-04-10 18:12:35,754::task::974::TaskManager.Task::(_decref) Task=`34cb7194-a648-440c-82d5-1179a8833b8a`::ref 0 aborting False
>Thread-4098::DEBUG::2014-04-10 18:12:35,761::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4098::DEBUG::2014-04-10 18:12:35,762::task::579::TaskManager.Task::(_updateState) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::moving from state init -> state preparing
>Thread-4098::INFO::2014-04-10 18:12:35,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4098::DEBUG::2014-04-10 18:12:35,763::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0bd91883-0bdc-4cf3-bd66-c9d804211002`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4098::DEBUG::2014-04-10 18:12:35,763::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4098::DEBUG::2014-04-10 18:12:35,763::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4098::DEBUG::2014-04-10 18:12:35,763::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0bd91883-0bdc-4cf3-bd66-c9d804211002`::Granted request
>Thread-4098::DEBUG::2014-04-10 18:12:35,764::task::811::TaskManager.Task::(resourceAcquired) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4098::DEBUG::2014-04-10 18:12:35,764::task::974::TaskManager.Task::(_decref) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::ref 1 aborting False
>Thread-4098::INFO::2014-04-10 18:12:35,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4098::DEBUG::2014-04-10 18:12:35,767::task::1168::TaskManager.Task::(prepare) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4098::DEBUG::2014-04-10 18:12:35,767::task::579::TaskManager.Task::(_updateState) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::moving from state preparing -> state finished
>Thread-4098::DEBUG::2014-04-10 18:12:35,767::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4098::DEBUG::2014-04-10 18:12:35,767::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4098::DEBUG::2014-04-10 18:12:35,767::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4098::DEBUG::2014-04-10 18:12:35,768::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4098::DEBUG::2014-04-10 18:12:35,768::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4098::DEBUG::2014-04-10 18:12:35,768::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4098::DEBUG::2014-04-10 18:12:35,768::task::974::TaskManager.Task::(_decref) Task=`06579bb1-11fb-4bcb-92b8-bc7a3856db2b`::ref 0 aborting False
>Thread-4099::DEBUG::2014-04-10 18:12:36,928::task::579::TaskManager.Task::(_updateState) Task=`6ddfd727-1f1b-4a8a-84b3-92afa435ee02`::moving from state init -> state preparing
>Thread-4099::INFO::2014-04-10 18:12:36,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4099::INFO::2014-04-10 18:12:36,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433095', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308487', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287353', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495952', 'lastCheck': '7.8', 'valid': True}}
>Thread-4099::DEBUG::2014-04-10 18:12:36,928::task::1168::TaskManager.Task::(prepare) Task=`6ddfd727-1f1b-4a8a-84b3-92afa435ee02`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433095', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308487', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287353', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495952', 'lastCheck': '7.8', 'valid': True}}
>Thread-4099::DEBUG::2014-04-10 18:12:36,929::task::579::TaskManager.Task::(_updateState) Task=`6ddfd727-1f1b-4a8a-84b3-92afa435ee02`::moving from state preparing -> state finished
>Thread-4099::DEBUG::2014-04-10 18:12:36,929::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4099::DEBUG::2014-04-10 18:12:36,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4099::DEBUG::2014-04-10 18:12:36,929::task::974::TaskManager.Task::(_decref) Task=`6ddfd727-1f1b-4a8a-84b3-92afa435ee02`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:38,651::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:38,702::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.026563 s, 25.3 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:38,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:38,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.02663 s, 25.2 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:39,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:39,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447354 s, 823 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:39,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:39,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000441538 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4103::DEBUG::2014-04-10 18:12:45,858::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4103::DEBUG::2014-04-10 18:12:45,859::task::579::TaskManager.Task::(_updateState) Task=`94196c77-0daa-4de2-a66e-e7d3f203d47c`::moving from state init -> state preparing
>Thread-4103::INFO::2014-04-10 18:12:45,859::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4103::INFO::2014-04-10 18:12:45,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4103::DEBUG::2014-04-10 18:12:45,860::task::1168::TaskManager.Task::(prepare) Task=`94196c77-0daa-4de2-a66e-e7d3f203d47c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4103::DEBUG::2014-04-10 18:12:45,860::task::579::TaskManager.Task::(_updateState) Task=`94196c77-0daa-4de2-a66e-e7d3f203d47c`::moving from state preparing -> state finished
>Thread-4103::DEBUG::2014-04-10 18:12:45,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4103::DEBUG::2014-04-10 18:12:45,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4103::DEBUG::2014-04-10 18:12:45,860::task::974::TaskManager.Task::(_decref) Task=`94196c77-0daa-4de2-a66e-e7d3f203d47c`::ref 0 aborting False
>Thread-4104::DEBUG::2014-04-10 18:12:45,867::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4104::DEBUG::2014-04-10 18:12:45,867::task::579::TaskManager.Task::(_updateState) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::moving from state init -> state preparing
>Thread-4104::INFO::2014-04-10 18:12:45,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4104::DEBUG::2014-04-10 18:12:45,868::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32b73e6c-14e9-40f1-ab7a-fc42e7d2c4c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4104::DEBUG::2014-04-10 18:12:45,868::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4104::DEBUG::2014-04-10 18:12:45,868::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4104::DEBUG::2014-04-10 18:12:45,868::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32b73e6c-14e9-40f1-ab7a-fc42e7d2c4c9`::Granted request
>Thread-4104::DEBUG::2014-04-10 18:12:45,869::task::811::TaskManager.Task::(resourceAcquired) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4104::DEBUG::2014-04-10 18:12:45,869::task::974::TaskManager.Task::(_decref) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::ref 1 aborting False
>Thread-4104::INFO::2014-04-10 18:12:45,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4104::DEBUG::2014-04-10 18:12:45,871::task::1168::TaskManager.Task::(prepare) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4104::DEBUG::2014-04-10 18:12:45,871::task::579::TaskManager.Task::(_updateState) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::moving from state preparing -> state finished
>Thread-4104::DEBUG::2014-04-10 18:12:45,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4104::DEBUG::2014-04-10 18:12:45,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4104::DEBUG::2014-04-10 18:12:45,871::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4104::DEBUG::2014-04-10 18:12:45,872::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4104::DEBUG::2014-04-10 18:12:45,872::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4104::DEBUG::2014-04-10 18:12:45,872::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4104::DEBUG::2014-04-10 18:12:45,872::task::974::TaskManager.Task::(_decref) Task=`96441186-244f-4b55-bd9a-c2e3188e6c69`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:48,736::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:48,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000460198 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:49,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:49,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410117 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:49,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:49,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000495642 s, 742 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:49,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:49,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00048013 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4107::DEBUG::2014-04-10 18:12:52,097::task::579::TaskManager.Task::(_updateState) Task=`e9a7ea4b-43cd-4088-bb61-54ab685b387c`::moving from state init -> state preparing
>Thread-4107::INFO::2014-04-10 18:12:52,097::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4107::INFO::2014-04-10 18:12:52,098::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048013', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460198', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410117', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495642', 'lastCheck': '2.9', 'valid': True}}
>Thread-4107::DEBUG::2014-04-10 18:12:52,098::task::1168::TaskManager.Task::(prepare) Task=`e9a7ea4b-43cd-4088-bb61-54ab685b387c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048013', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460198', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410117', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495642', 'lastCheck': '2.9', 'valid': True}}
>Thread-4107::DEBUG::2014-04-10 18:12:52,098::task::579::TaskManager.Task::(_updateState) Task=`e9a7ea4b-43cd-4088-bb61-54ab685b387c`::moving from state preparing -> state finished
>Thread-4107::DEBUG::2014-04-10 18:12:52,098::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4107::DEBUG::2014-04-10 18:12:52,098::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4107::DEBUG::2014-04-10 18:12:52,098::task::974::TaskManager.Task::(_decref) Task=`e9a7ea4b-43cd-4088-bb61-54ab685b387c`::ref 0 aborting False
>Thread-4110::DEBUG::2014-04-10 18:12:55,982::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4110::DEBUG::2014-04-10 18:12:55,983::task::579::TaskManager.Task::(_updateState) Task=`058ddd71-27d0-486c-af15-4d068b3b9309`::moving from state init -> state preparing
>Thread-4110::INFO::2014-04-10 18:12:55,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4110::INFO::2014-04-10 18:12:55,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4110::DEBUG::2014-04-10 18:12:55,984::task::1168::TaskManager.Task::(prepare) Task=`058ddd71-27d0-486c-af15-4d068b3b9309`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4110::DEBUG::2014-04-10 18:12:55,984::task::579::TaskManager.Task::(_updateState) Task=`058ddd71-27d0-486c-af15-4d068b3b9309`::moving from state preparing -> state finished
>Thread-4110::DEBUG::2014-04-10 18:12:55,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4110::DEBUG::2014-04-10 18:12:55,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4110::DEBUG::2014-04-10 18:12:55,984::task::974::TaskManager.Task::(_decref) Task=`058ddd71-27d0-486c-af15-4d068b3b9309`::ref 0 aborting False
>Thread-4111::DEBUG::2014-04-10 18:12:55,991::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4111::DEBUG::2014-04-10 18:12:55,991::task::579::TaskManager.Task::(_updateState) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::moving from state init -> state preparing
>Thread-4111::INFO::2014-04-10 18:12:55,991::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4111::DEBUG::2014-04-10 18:12:55,992::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`527213ac-8abf-4da0-bf8a-51471f7742ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4111::DEBUG::2014-04-10 18:12:55,992::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4111::DEBUG::2014-04-10 18:12:55,992::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4111::DEBUG::2014-04-10 18:12:55,992::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`527213ac-8abf-4da0-bf8a-51471f7742ae`::Granted request
>Thread-4111::DEBUG::2014-04-10 18:12:55,993::task::811::TaskManager.Task::(resourceAcquired) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4111::DEBUG::2014-04-10 18:12:55,993::task::974::TaskManager.Task::(_decref) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::ref 1 aborting False
>Thread-4111::INFO::2014-04-10 18:12:55,995::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4111::DEBUG::2014-04-10 18:12:55,995::task::1168::TaskManager.Task::(prepare) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4111::DEBUG::2014-04-10 18:12:55,995::task::579::TaskManager.Task::(_updateState) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::moving from state preparing -> state finished
>Thread-4111::DEBUG::2014-04-10 18:12:55,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4111::DEBUG::2014-04-10 18:12:55,996::task::974::TaskManager.Task::(_decref) Task=`401bf9c6-384b-47c4-8019-bdcf38c657a1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:12:58,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:12:58,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279757 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:12:59,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:12:59,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00193681 s, 346 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:12:59,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:12:59,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000497699 s, 739 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:12:59,337::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:12:59,343::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475643 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4115::DEBUG::2014-04-10 18:13:06,073::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4115::DEBUG::2014-04-10 18:13:06,074::task::579::TaskManager.Task::(_updateState) Task=`bb327720-b7ff-4b70-a271-220734e5630e`::moving from state init -> state preparing
>Thread-4115::INFO::2014-04-10 18:13:06,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4115::INFO::2014-04-10 18:13:06,075::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4115::DEBUG::2014-04-10 18:13:06,075::task::1168::TaskManager.Task::(prepare) Task=`bb327720-b7ff-4b70-a271-220734e5630e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4115::DEBUG::2014-04-10 18:13:06,075::task::579::TaskManager.Task::(_updateState) Task=`bb327720-b7ff-4b70-a271-220734e5630e`::moving from state preparing -> state finished
>Thread-4115::DEBUG::2014-04-10 18:13:06,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4115::DEBUG::2014-04-10 18:13:06,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4115::DEBUG::2014-04-10 18:13:06,076::task::974::TaskManager.Task::(_decref) Task=`bb327720-b7ff-4b70-a271-220734e5630e`::ref 0 aborting False
>Thread-4116::DEBUG::2014-04-10 18:13:06,082::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4116::DEBUG::2014-04-10 18:13:06,083::task::579::TaskManager.Task::(_updateState) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::moving from state init -> state preparing
>Thread-4116::INFO::2014-04-10 18:13:06,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4116::DEBUG::2014-04-10 18:13:06,083::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e0369177-6fc2-448e-9767-d251ade37bbc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4116::DEBUG::2014-04-10 18:13:06,084::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4116::DEBUG::2014-04-10 18:13:06,084::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4116::DEBUG::2014-04-10 18:13:06,084::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e0369177-6fc2-448e-9767-d251ade37bbc`::Granted request
>Thread-4116::DEBUG::2014-04-10 18:13:06,084::task::811::TaskManager.Task::(resourceAcquired) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4116::DEBUG::2014-04-10 18:13:06,085::task::974::TaskManager.Task::(_decref) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::ref 1 aborting False
>Thread-4116::INFO::2014-04-10 18:13:06,087::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4116::DEBUG::2014-04-10 18:13:06,087::task::1168::TaskManager.Task::(prepare) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4116::DEBUG::2014-04-10 18:13:06,087::task::579::TaskManager.Task::(_updateState) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::moving from state preparing -> state finished
>Thread-4116::DEBUG::2014-04-10 18:13:06,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4116::DEBUG::2014-04-10 18:13:06,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4116::DEBUG::2014-04-10 18:13:06,088::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4116::DEBUG::2014-04-10 18:13:06,088::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4116::DEBUG::2014-04-10 18:13:06,088::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4116::DEBUG::2014-04-10 18:13:06,088::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4116::DEBUG::2014-04-10 18:13:06,089::task::974::TaskManager.Task::(_decref) Task=`20fbacb4-f729-4166-86fe-8ad1ead8dd3f`::ref 0 aborting False
>Thread-4117::DEBUG::2014-04-10 18:13:07,256::task::579::TaskManager.Task::(_updateState) Task=`5e298bc9-6dbd-42db-bc9a-13806babe336`::moving from state init -> state preparing
>Thread-4117::INFO::2014-04-10 18:13:07,257::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4117::INFO::2014-04-10 18:13:07,257::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475643', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279757', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00193681', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497699', 'lastCheck': '8.1', 'valid': True}}
>Thread-4117::DEBUG::2014-04-10 18:13:07,257::task::1168::TaskManager.Task::(prepare) Task=`5e298bc9-6dbd-42db-bc9a-13806babe336`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475643', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279757', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00193681', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497699', 'lastCheck': '8.1', 'valid': True}}
>Thread-4117::DEBUG::2014-04-10 18:13:07,257::task::579::TaskManager.Task::(_updateState) Task=`5e298bc9-6dbd-42db-bc9a-13806babe336`::moving from state preparing -> state finished
>Thread-4117::DEBUG::2014-04-10 18:13:07,257::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4117::DEBUG::2014-04-10 18:13:07,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4117::DEBUG::2014-04-10 18:13:07,258::task::974::TaskManager.Task::(_decref) Task=`5e298bc9-6dbd-42db-bc9a-13806babe336`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:08,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:08,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343274 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:09,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:09,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00042955 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:09,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:09,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476753 s, 772 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:09,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:09,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000582127 s, 1.1 MB/s\n'; <rc> = 0
>Thread-4121::DEBUG::2014-04-10 18:13:16,204::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-4121::DEBUG::2014-04-10 18:13:16,205::task::579::TaskManager.Task::(_updateState) Task=`3ccfd492-8d6d-45ef-8fe2-f9d5da2390e1`::moving from state init -> state preparing
>Thread-4121::INFO::2014-04-10 18:13:16,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4121::INFO::2014-04-10 18:13:16,206::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4121::DEBUG::2014-04-10 18:13:16,206::task::1168::TaskManager.Task::(prepare) Task=`3ccfd492-8d6d-45ef-8fe2-f9d5da2390e1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4121::DEBUG::2014-04-10 18:13:16,206::task::579::TaskManager.Task::(_updateState) Task=`3ccfd492-8d6d-45ef-8fe2-f9d5da2390e1`::moving from state preparing -> state finished
>Thread-4121::DEBUG::2014-04-10 18:13:16,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4121::DEBUG::2014-04-10 18:13:16,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4121::DEBUG::2014-04-10 18:13:16,207::task::974::TaskManager.Task::(_decref) Task=`3ccfd492-8d6d-45ef-8fe2-f9d5da2390e1`::ref 0 aborting False
>Thread-4122::DEBUG::2014-04-10 18:13:16,213::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-4122::DEBUG::2014-04-10 18:13:16,213::task::579::TaskManager.Task::(_updateState) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::moving from state init -> state preparing
>Thread-4122::INFO::2014-04-10 18:13:16,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4122::DEBUG::2014-04-10 18:13:16,214::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4712db14-c07a-4f0d-ac94-bf180eae0199`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4122::DEBUG::2014-04-10 18:13:16,214::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4122::DEBUG::2014-04-10 18:13:16,214::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4122::DEBUG::2014-04-10 18:13:16,214::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4712db14-c07a-4f0d-ac94-bf180eae0199`::Granted request
>Thread-4122::DEBUG::2014-04-10 18:13:16,214::task::811::TaskManager.Task::(resourceAcquired) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4122::DEBUG::2014-04-10 18:13:16,215::task::974::TaskManager.Task::(_decref) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::ref 1 aborting False
>Thread-4122::INFO::2014-04-10 18:13:16,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4122::DEBUG::2014-04-10 18:13:16,217::task::1168::TaskManager.Task::(prepare) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4122::DEBUG::2014-04-10 18:13:16,217::task::579::TaskManager.Task::(_updateState) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::moving from state preparing -> state finished
>Thread-4122::DEBUG::2014-04-10 18:13:16,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4122::DEBUG::2014-04-10 18:13:16,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4122::DEBUG::2014-04-10 18:13:16,217::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4122::DEBUG::2014-04-10 18:13:16,218::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4122::DEBUG::2014-04-10 18:13:16,218::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4122::DEBUG::2014-04-10 18:13:16,218::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4122::DEBUG::2014-04-10 18:13:16,218::task::974::TaskManager.Task::(_decref) Task=`e2e3081e-f73c-43cf-8734-d0ec2b380a50`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:18,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:18,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323268 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:19,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:19,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280798 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:19,203::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:19,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000536336 s, 686 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:19,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:19,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000497834 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4125::DEBUG::2014-04-10 18:13:22,421::task::579::TaskManager.Task::(_updateState) Task=`2d12ac33-57ca-4ff9-8d2c-39ba7063ae2c`::moving from state init -> state preparing
>Thread-4125::INFO::2014-04-10 18:13:22,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4125::INFO::2014-04-10 18:13:22,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497834', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323268', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280798', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536336', 'lastCheck': '3.2', 'valid': True}}
>Thread-4125::DEBUG::2014-04-10 18:13:22,422::task::1168::TaskManager.Task::(prepare) Task=`2d12ac33-57ca-4ff9-8d2c-39ba7063ae2c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497834', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323268', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000280798', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536336', 'lastCheck': '3.2', 'valid': True}}
>Thread-4125::DEBUG::2014-04-10 18:13:22,422::task::579::TaskManager.Task::(_updateState) Task=`2d12ac33-57ca-4ff9-8d2c-39ba7063ae2c`::moving from state preparing -> state finished
>Thread-4125::DEBUG::2014-04-10 18:13:22,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4125::DEBUG::2014-04-10 18:13:22,423::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4125::DEBUG::2014-04-10 18:13:22,423::task::974::TaskManager.Task::(_decref) Task=`2d12ac33-57ca-4ff9-8d2c-39ba7063ae2c`::ref 0 aborting False
>Thread-4128::DEBUG::2014-04-10 18:13:26,310::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4128::DEBUG::2014-04-10 18:13:26,311::task::579::TaskManager.Task::(_updateState) Task=`cc485fbc-50f4-4aa6-9d51-4c3e5f74c260`::moving from state init -> state preparing
>Thread-4128::INFO::2014-04-10 18:13:26,311::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4128::INFO::2014-04-10 18:13:26,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4128::DEBUG::2014-04-10 18:13:26,311::task::1168::TaskManager.Task::(prepare) Task=`cc485fbc-50f4-4aa6-9d51-4c3e5f74c260`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4128::DEBUG::2014-04-10 18:13:26,311::task::579::TaskManager.Task::(_updateState) Task=`cc485fbc-50f4-4aa6-9d51-4c3e5f74c260`::moving from state preparing -> state finished
>Thread-4128::DEBUG::2014-04-10 18:13:26,312::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4128::DEBUG::2014-04-10 18:13:26,312::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4128::DEBUG::2014-04-10 18:13:26,312::task::974::TaskManager.Task::(_decref) Task=`cc485fbc-50f4-4aa6-9d51-4c3e5f74c260`::ref 0 aborting False
>Thread-4129::DEBUG::2014-04-10 18:13:26,318::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4129::DEBUG::2014-04-10 18:13:26,319::task::579::TaskManager.Task::(_updateState) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::moving from state init -> state preparing
>Thread-4129::INFO::2014-04-10 18:13:26,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4129::DEBUG::2014-04-10 18:13:26,320::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01786b86-7896-4e06-a3c4-236b77d509c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4129::DEBUG::2014-04-10 18:13:26,320::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4129::DEBUG::2014-04-10 18:13:26,320::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4129::DEBUG::2014-04-10 18:13:26,320::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01786b86-7896-4e06-a3c4-236b77d509c2`::Granted request
>Thread-4129::DEBUG::2014-04-10 18:13:26,321::task::811::TaskManager.Task::(resourceAcquired) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4129::DEBUG::2014-04-10 18:13:26,321::task::974::TaskManager.Task::(_decref) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::ref 1 aborting False
>Thread-4129::INFO::2014-04-10 18:13:26,323::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4129::DEBUG::2014-04-10 18:13:26,323::task::1168::TaskManager.Task::(prepare) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4129::DEBUG::2014-04-10 18:13:26,323::task::579::TaskManager.Task::(_updateState) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::moving from state preparing -> state finished
>Thread-4129::DEBUG::2014-04-10 18:13:26,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4129::DEBUG::2014-04-10 18:13:26,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4129::DEBUG::2014-04-10 18:13:26,324::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4129::DEBUG::2014-04-10 18:13:26,324::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4129::DEBUG::2014-04-10 18:13:26,324::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4129::DEBUG::2014-04-10 18:13:26,324::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4129::DEBUG::2014-04-10 18:13:26,324::task::974::TaskManager.Task::(_decref) Task=`563a6169-2945-4a0f-ae2a-e5c464ffe04d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:28,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:28,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278375 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:29,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:29,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000441201 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:29,218::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:29,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000568304 s, 648 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:29,381::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:13:29,398::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:13:29,399::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:13:29,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:13:29,406::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:13:29,406::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:13:29,406::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:13:29,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:29,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000380223 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4137::DEBUG::2014-04-10 18:13:36,638::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4137::DEBUG::2014-04-10 18:13:36,639::task::579::TaskManager.Task::(_updateState) Task=`5f219b28-3b3c-4231-b778-e1cc339abda1`::moving from state init -> state preparing
>Thread-4137::INFO::2014-04-10 18:13:36,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4137::INFO::2014-04-10 18:13:36,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4137::DEBUG::2014-04-10 18:13:36,640::task::1168::TaskManager.Task::(prepare) Task=`5f219b28-3b3c-4231-b778-e1cc339abda1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4137::DEBUG::2014-04-10 18:13:36,640::task::579::TaskManager.Task::(_updateState) Task=`5f219b28-3b3c-4231-b778-e1cc339abda1`::moving from state preparing -> state finished
>Thread-4137::DEBUG::2014-04-10 18:13:36,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4137::DEBUG::2014-04-10 18:13:36,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4137::DEBUG::2014-04-10 18:13:36,641::task::974::TaskManager.Task::(_decref) Task=`5f219b28-3b3c-4231-b778-e1cc339abda1`::ref 0 aborting False
>Thread-4138::DEBUG::2014-04-10 18:13:36,647::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4138::DEBUG::2014-04-10 18:13:36,648::task::579::TaskManager.Task::(_updateState) Task=`56b708dd-becb-445f-9606-7057befd2a70`::moving from state init -> state preparing
>Thread-4138::INFO::2014-04-10 18:13:36,648::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4138::DEBUG::2014-04-10 18:13:36,649::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b33ff257-adbc-46a3-a35b-9e39527b3f19`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4138::DEBUG::2014-04-10 18:13:36,649::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4138::DEBUG::2014-04-10 18:13:36,649::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4138::DEBUG::2014-04-10 18:13:36,649::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b33ff257-adbc-46a3-a35b-9e39527b3f19`::Granted request
>Thread-4138::DEBUG::2014-04-10 18:13:36,650::task::811::TaskManager.Task::(resourceAcquired) Task=`56b708dd-becb-445f-9606-7057befd2a70`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4138::DEBUG::2014-04-10 18:13:36,650::task::974::TaskManager.Task::(_decref) Task=`56b708dd-becb-445f-9606-7057befd2a70`::ref 1 aborting False
>Thread-4138::INFO::2014-04-10 18:13:36,652::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4138::DEBUG::2014-04-10 18:13:36,652::task::1168::TaskManager.Task::(prepare) Task=`56b708dd-becb-445f-9606-7057befd2a70`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4138::DEBUG::2014-04-10 18:13:36,652::task::579::TaskManager.Task::(_updateState) Task=`56b708dd-becb-445f-9606-7057befd2a70`::moving from state preparing -> state finished
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4138::DEBUG::2014-04-10 18:13:36,653::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4138::DEBUG::2014-04-10 18:13:36,654::task::974::TaskManager.Task::(_decref) Task=`56b708dd-becb-445f-9606-7057befd2a70`::ref 0 aborting False
>Thread-4139::DEBUG::2014-04-10 18:13:37,569::task::579::TaskManager.Task::(_updateState) Task=`461d6a22-61da-4cc8-a38f-3f2e4854ff09`::moving from state init -> state preparing
>Thread-4139::INFO::2014-04-10 18:13:37,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4139::INFO::2014-04-10 18:13:37,569::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380223', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278375', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441201', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568304', 'lastCheck': '8.3', 'valid': True}}
>Thread-4139::DEBUG::2014-04-10 18:13:37,569::task::1168::TaskManager.Task::(prepare) Task=`461d6a22-61da-4cc8-a38f-3f2e4854ff09`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380223', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278375', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441201', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000568304', 'lastCheck': '8.3', 'valid': True}}
>Thread-4139::DEBUG::2014-04-10 18:13:37,570::task::579::TaskManager.Task::(_updateState) Task=`461d6a22-61da-4cc8-a38f-3f2e4854ff09`::moving from state preparing -> state finished
>Thread-4139::DEBUG::2014-04-10 18:13:37,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4139::DEBUG::2014-04-10 18:13:37,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4139::DEBUG::2014-04-10 18:13:37,570::task::974::TaskManager.Task::(_decref) Task=`461d6a22-61da-4cc8-a38f-3f2e4854ff09`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:38,812::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:38,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324018 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:39,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:39,096::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000428468 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:39,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:39,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517054 s, 712 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:39,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:39,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458377 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4144::DEBUG::2014-04-10 18:13:46,728::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4144::DEBUG::2014-04-10 18:13:46,728::task::579::TaskManager.Task::(_updateState) Task=`e120a271-1186-4a2c-a5e1-e14a4aee44e8`::moving from state init -> state preparing
>Thread-4144::INFO::2014-04-10 18:13:46,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4144::INFO::2014-04-10 18:13:46,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4144::DEBUG::2014-04-10 18:13:46,729::task::1168::TaskManager.Task::(prepare) Task=`e120a271-1186-4a2c-a5e1-e14a4aee44e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4144::DEBUG::2014-04-10 18:13:46,729::task::579::TaskManager.Task::(_updateState) Task=`e120a271-1186-4a2c-a5e1-e14a4aee44e8`::moving from state preparing -> state finished
>Thread-4144::DEBUG::2014-04-10 18:13:46,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4144::DEBUG::2014-04-10 18:13:46,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4144::DEBUG::2014-04-10 18:13:46,730::task::974::TaskManager.Task::(_decref) Task=`e120a271-1186-4a2c-a5e1-e14a4aee44e8`::ref 0 aborting False
>Thread-4145::DEBUG::2014-04-10 18:13:46,736::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4145::DEBUG::2014-04-10 18:13:46,736::task::579::TaskManager.Task::(_updateState) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::moving from state init -> state preparing
>Thread-4145::INFO::2014-04-10 18:13:46,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4145::DEBUG::2014-04-10 18:13:46,737::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2095ce3a-3f6a-4852-a36f-45fcaf166a13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4145::DEBUG::2014-04-10 18:13:46,737::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4145::DEBUG::2014-04-10 18:13:46,737::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4145::DEBUG::2014-04-10 18:13:46,738::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2095ce3a-3f6a-4852-a36f-45fcaf166a13`::Granted request
>Thread-4145::DEBUG::2014-04-10 18:13:46,738::task::811::TaskManager.Task::(resourceAcquired) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4145::DEBUG::2014-04-10 18:13:46,738::task::974::TaskManager.Task::(_decref) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::ref 1 aborting False
>Thread-4145::INFO::2014-04-10 18:13:46,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4145::DEBUG::2014-04-10 18:13:46,740::task::1168::TaskManager.Task::(prepare) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4145::DEBUG::2014-04-10 18:13:46,740::task::579::TaskManager.Task::(_updateState) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::moving from state preparing -> state finished
>Thread-4145::DEBUG::2014-04-10 18:13:46,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4145::DEBUG::2014-04-10 18:13:46,741::task::974::TaskManager.Task::(_decref) Task=`d3613af5-c2ef-4ef4-9e96-f22b0c7b9564`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:48,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:48,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00264761 s, 253 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:49,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:49,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307114 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:49,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:49,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000468957 s, 785 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:49,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:49,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000491511 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4147::DEBUG::2014-04-10 18:13:52,723::task::579::TaskManager.Task::(_updateState) Task=`3f689b5f-4d6d-423c-be89-9098c4a8fb69`::moving from state init -> state preparing
>Thread-4147::INFO::2014-04-10 18:13:52,724::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4147::INFO::2014-04-10 18:13:52,724::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491511', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00264761', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307114', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468957', 'lastCheck': '3.5', 'valid': True}}
>Thread-4147::DEBUG::2014-04-10 18:13:52,724::task::1168::TaskManager.Task::(prepare) Task=`3f689b5f-4d6d-423c-be89-9098c4a8fb69`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491511', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00264761', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307114', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468957', 'lastCheck': '3.5', 'valid': True}}
>Thread-4147::DEBUG::2014-04-10 18:13:52,724::task::579::TaskManager.Task::(_updateState) Task=`3f689b5f-4d6d-423c-be89-9098c4a8fb69`::moving from state preparing -> state finished
>Thread-4147::DEBUG::2014-04-10 18:13:52,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4147::DEBUG::2014-04-10 18:13:52,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4147::DEBUG::2014-04-10 18:13:52,725::task::974::TaskManager.Task::(_decref) Task=`3f689b5f-4d6d-423c-be89-9098c4a8fb69`::ref 0 aborting False
>Thread-4150::DEBUG::2014-04-10 18:13:56,826::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4150::DEBUG::2014-04-10 18:13:56,826::task::579::TaskManager.Task::(_updateState) Task=`0e9808f4-d936-4b6c-964b-d27cb0708ed8`::moving from state init -> state preparing
>Thread-4150::INFO::2014-04-10 18:13:56,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4150::INFO::2014-04-10 18:13:56,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4150::DEBUG::2014-04-10 18:13:56,827::task::1168::TaskManager.Task::(prepare) Task=`0e9808f4-d936-4b6c-964b-d27cb0708ed8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4150::DEBUG::2014-04-10 18:13:56,827::task::579::TaskManager.Task::(_updateState) Task=`0e9808f4-d936-4b6c-964b-d27cb0708ed8`::moving from state preparing -> state finished
>Thread-4150::DEBUG::2014-04-10 18:13:56,827::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4150::DEBUG::2014-04-10 18:13:56,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4150::DEBUG::2014-04-10 18:13:56,828::task::974::TaskManager.Task::(_decref) Task=`0e9808f4-d936-4b6c-964b-d27cb0708ed8`::ref 0 aborting False
>Thread-4151::DEBUG::2014-04-10 18:13:56,834::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4151::DEBUG::2014-04-10 18:13:56,835::task::579::TaskManager.Task::(_updateState) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::moving from state init -> state preparing
>Thread-4151::INFO::2014-04-10 18:13:56,835::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4151::DEBUG::2014-04-10 18:13:56,835::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1aa5610a-0b53-4954-a3ba-065192b12c2d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4151::DEBUG::2014-04-10 18:13:56,835::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4151::DEBUG::2014-04-10 18:13:56,836::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4151::DEBUG::2014-04-10 18:13:56,836::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1aa5610a-0b53-4954-a3ba-065192b12c2d`::Granted request
>Thread-4151::DEBUG::2014-04-10 18:13:56,836::task::811::TaskManager.Task::(resourceAcquired) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4151::DEBUG::2014-04-10 18:13:56,836::task::974::TaskManager.Task::(_decref) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::ref 1 aborting False
>Thread-4151::INFO::2014-04-10 18:13:56,838::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4151::DEBUG::2014-04-10 18:13:56,838::task::1168::TaskManager.Task::(prepare) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::task::579::TaskManager.Task::(_updateState) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::moving from state preparing -> state finished
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4151::DEBUG::2014-04-10 18:13:56,839::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4151::DEBUG::2014-04-10 18:13:56,840::task::974::TaskManager.Task::(_decref) Task=`e320adf1-2abf-4667-b2ef-724b7168d60f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:13:58,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:13:58,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354603 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:13:59,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:13:59,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003901 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:13:59,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:13:59,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481848 s, 764 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:13:59,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:13:59,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429158 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4155::DEBUG::2014-04-10 18:14:06,941::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4155::DEBUG::2014-04-10 18:14:06,942::task::579::TaskManager.Task::(_updateState) Task=`36e51526-49f6-4ef0-adff-d403f48cb7d1`::moving from state init -> state preparing
>Thread-4155::INFO::2014-04-10 18:14:06,942::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4155::INFO::2014-04-10 18:14:06,943::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4155::DEBUG::2014-04-10 18:14:06,943::task::1168::TaskManager.Task::(prepare) Task=`36e51526-49f6-4ef0-adff-d403f48cb7d1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4155::DEBUG::2014-04-10 18:14:06,943::task::579::TaskManager.Task::(_updateState) Task=`36e51526-49f6-4ef0-adff-d403f48cb7d1`::moving from state preparing -> state finished
>Thread-4155::DEBUG::2014-04-10 18:14:06,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4155::DEBUG::2014-04-10 18:14:06,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4155::DEBUG::2014-04-10 18:14:06,943::task::974::TaskManager.Task::(_decref) Task=`36e51526-49f6-4ef0-adff-d403f48cb7d1`::ref 0 aborting False
>Thread-4156::DEBUG::2014-04-10 18:14:06,949::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4156::DEBUG::2014-04-10 18:14:06,950::task::579::TaskManager.Task::(_updateState) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::moving from state init -> state preparing
>Thread-4156::INFO::2014-04-10 18:14:06,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4156::DEBUG::2014-04-10 18:14:06,950::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bae25d37-5db4-42d4-ac2d-81b1958827c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4156::DEBUG::2014-04-10 18:14:06,951::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4156::DEBUG::2014-04-10 18:14:06,951::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4156::DEBUG::2014-04-10 18:14:06,951::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bae25d37-5db4-42d4-ac2d-81b1958827c2`::Granted request
>Thread-4156::DEBUG::2014-04-10 18:14:06,951::task::811::TaskManager.Task::(resourceAcquired) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4156::DEBUG::2014-04-10 18:14:06,952::task::974::TaskManager.Task::(_decref) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::ref 1 aborting False
>Thread-4156::INFO::2014-04-10 18:14:06,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4156::DEBUG::2014-04-10 18:14:06,954::task::1168::TaskManager.Task::(prepare) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081744384', 'isoprefix': '', 'alerts': [], 'disktotal': '910948892672', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4156::DEBUG::2014-04-10 18:14:06,954::task::579::TaskManager.Task::(_updateState) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::moving from state preparing -> state finished
>Thread-4156::DEBUG::2014-04-10 18:14:06,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4156::DEBUG::2014-04-10 18:14:06,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4156::DEBUG::2014-04-10 18:14:06,954::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4156::DEBUG::2014-04-10 18:14:06,955::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4156::DEBUG::2014-04-10 18:14:06,955::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4156::DEBUG::2014-04-10 18:14:06,955::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4156::DEBUG::2014-04-10 18:14:06,955::task::974::TaskManager.Task::(_decref) Task=`38e4f628-9586-4259-a4db-a5dd3f5ce4e2`::ref 0 aborting False
>Thread-4157::DEBUG::2014-04-10 18:14:07,878::task::579::TaskManager.Task::(_updateState) Task=`1f352611-a73d-43ed-835a-2b09946b03b3`::moving from state init -> state preparing
>Thread-4157::INFO::2014-04-10 18:14:07,878::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4157::INFO::2014-04-10 18:14:07,878::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429158', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354603', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003901', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481848', 'lastCheck': '8.6', 'valid': True}}
>Thread-4157::DEBUG::2014-04-10 18:14:07,878::task::1168::TaskManager.Task::(prepare) Task=`1f352611-a73d-43ed-835a-2b09946b03b3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429158', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354603', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003901', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481848', 'lastCheck': '8.6', 'valid': True}}
>Thread-4157::DEBUG::2014-04-10 18:14:07,878::task::579::TaskManager.Task::(_updateState) Task=`1f352611-a73d-43ed-835a-2b09946b03b3`::moving from state preparing -> state finished
>Thread-4157::DEBUG::2014-04-10 18:14:07,878::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4157::DEBUG::2014-04-10 18:14:07,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4157::DEBUG::2014-04-10 18:14:07,879::task::974::TaskManager.Task::(_decref) Task=`1f352611-a73d-43ed-835a-2b09946b03b3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:08,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:08,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000392362 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:09,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:09,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003694 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:09,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:09,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486299 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:09,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:09,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000575062 s, 1.1 MB/s\n'; <rc> = 0
>Thread-4162::DEBUG::2014-04-10 18:14:17,039::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4162::DEBUG::2014-04-10 18:14:17,039::task::579::TaskManager.Task::(_updateState) Task=`0aad95cb-b024-4b6d-b115-018e44fe33b0`::moving from state init -> state preparing
>Thread-4162::INFO::2014-04-10 18:14:17,040::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4162::INFO::2014-04-10 18:14:17,040::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4162::DEBUG::2014-04-10 18:14:17,040::task::1168::TaskManager.Task::(prepare) Task=`0aad95cb-b024-4b6d-b115-018e44fe33b0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4162::DEBUG::2014-04-10 18:14:17,040::task::579::TaskManager.Task::(_updateState) Task=`0aad95cb-b024-4b6d-b115-018e44fe33b0`::moving from state preparing -> state finished
>Thread-4162::DEBUG::2014-04-10 18:14:17,040::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4162::DEBUG::2014-04-10 18:14:17,041::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4162::DEBUG::2014-04-10 18:14:17,041::task::974::TaskManager.Task::(_decref) Task=`0aad95cb-b024-4b6d-b115-018e44fe33b0`::ref 0 aborting False
>Thread-4163::DEBUG::2014-04-10 18:14:17,047::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4163::DEBUG::2014-04-10 18:14:17,047::task::579::TaskManager.Task::(_updateState) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::moving from state init -> state preparing
>Thread-4163::INFO::2014-04-10 18:14:17,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4163::DEBUG::2014-04-10 18:14:17,048::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8194a67f-689b-4183-8c68-b87ae6e05683`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4163::DEBUG::2014-04-10 18:14:17,048::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4163::DEBUG::2014-04-10 18:14:17,048::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4163::DEBUG::2014-04-10 18:14:17,048::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8194a67f-689b-4183-8c68-b87ae6e05683`::Granted request
>Thread-4163::DEBUG::2014-04-10 18:14:17,049::task::811::TaskManager.Task::(resourceAcquired) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4163::DEBUG::2014-04-10 18:14:17,049::task::974::TaskManager.Task::(_decref) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::ref 1 aborting False
>Thread-4163::INFO::2014-04-10 18:14:17,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4163::DEBUG::2014-04-10 18:14:17,051::task::1168::TaskManager.Task::(prepare) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4163::DEBUG::2014-04-10 18:14:17,051::task::579::TaskManager.Task::(_updateState) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::moving from state preparing -> state finished
>Thread-4163::DEBUG::2014-04-10 18:14:17,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4163::DEBUG::2014-04-10 18:14:17,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4163::DEBUG::2014-04-10 18:14:17,052::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4163::DEBUG::2014-04-10 18:14:17,052::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4163::DEBUG::2014-04-10 18:14:17,052::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4163::DEBUG::2014-04-10 18:14:17,052::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4163::DEBUG::2014-04-10 18:14:17,052::task::974::TaskManager.Task::(_decref) Task=`c8592deb-0710-479c-b0ac-3176d948dd38`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:18,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:18,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326677 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:19,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:19,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277061 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:19,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:19,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000490958 s, 750 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:19,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:19,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484644 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4165::DEBUG::2014-04-10 18:14:23,036::task::579::TaskManager.Task::(_updateState) Task=`82534c7f-2475-40a3-9982-bbe219a7b719`::moving from state init -> state preparing
>Thread-4165::INFO::2014-04-10 18:14:23,036::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4165::INFO::2014-04-10 18:14:23,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484644', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326677', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277061', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490958', 'lastCheck': '3.7', 'valid': True}}
>Thread-4165::DEBUG::2014-04-10 18:14:23,036::task::1168::TaskManager.Task::(prepare) Task=`82534c7f-2475-40a3-9982-bbe219a7b719`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484644', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326677', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277061', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490958', 'lastCheck': '3.7', 'valid': True}}
>Thread-4165::DEBUG::2014-04-10 18:14:23,037::task::579::TaskManager.Task::(_updateState) Task=`82534c7f-2475-40a3-9982-bbe219a7b719`::moving from state preparing -> state finished
>Thread-4165::DEBUG::2014-04-10 18:14:23,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4165::DEBUG::2014-04-10 18:14:23,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4165::DEBUG::2014-04-10 18:14:23,037::task::974::TaskManager.Task::(_decref) Task=`82534c7f-2475-40a3-9982-bbe219a7b719`::ref 0 aborting False
>Thread-4168::DEBUG::2014-04-10 18:14:27,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4168::DEBUG::2014-04-10 18:14:27,131::task::579::TaskManager.Task::(_updateState) Task=`38fa5355-0698-427a-a582-338c9915d505`::moving from state init -> state preparing
>Thread-4168::INFO::2014-04-10 18:14:27,131::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4168::INFO::2014-04-10 18:14:27,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4168::DEBUG::2014-04-10 18:14:27,132::task::1168::TaskManager.Task::(prepare) Task=`38fa5355-0698-427a-a582-338c9915d505`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4168::DEBUG::2014-04-10 18:14:27,132::task::579::TaskManager.Task::(_updateState) Task=`38fa5355-0698-427a-a582-338c9915d505`::moving from state preparing -> state finished
>Thread-4168::DEBUG::2014-04-10 18:14:27,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4168::DEBUG::2014-04-10 18:14:27,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4168::DEBUG::2014-04-10 18:14:27,132::task::974::TaskManager.Task::(_decref) Task=`38fa5355-0698-427a-a582-338c9915d505`::ref 0 aborting False
>Thread-4169::DEBUG::2014-04-10 18:14:27,139::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4169::DEBUG::2014-04-10 18:14:27,139::task::579::TaskManager.Task::(_updateState) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::moving from state init -> state preparing
>Thread-4169::INFO::2014-04-10 18:14:27,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4169::DEBUG::2014-04-10 18:14:27,140::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d67e7d87-acd1-417b-80f3-9f7cec6cc420`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4169::DEBUG::2014-04-10 18:14:27,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4169::DEBUG::2014-04-10 18:14:27,141::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4169::DEBUG::2014-04-10 18:14:27,141::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d67e7d87-acd1-417b-80f3-9f7cec6cc420`::Granted request
>Thread-4169::DEBUG::2014-04-10 18:14:27,141::task::811::TaskManager.Task::(resourceAcquired) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4169::DEBUG::2014-04-10 18:14:27,141::task::974::TaskManager.Task::(_decref) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::ref 1 aborting False
>Thread-4169::INFO::2014-04-10 18:14:27,144::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4169::DEBUG::2014-04-10 18:14:27,144::task::1168::TaskManager.Task::(prepare) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4169::DEBUG::2014-04-10 18:14:27,144::task::579::TaskManager.Task::(_updateState) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::moving from state preparing -> state finished
>Thread-4169::DEBUG::2014-04-10 18:14:27,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4169::DEBUG::2014-04-10 18:14:27,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4169::DEBUG::2014-04-10 18:14:27,145::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4169::DEBUG::2014-04-10 18:14:27,145::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4169::DEBUG::2014-04-10 18:14:27,145::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4169::DEBUG::2014-04-10 18:14:27,145::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4169::DEBUG::2014-04-10 18:14:27,145::task::974::TaskManager.Task::(_decref) Task=`35313ac5-714b-41f4-9da8-fbac28294c1b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:28,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:28,986::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304453 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:29,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:29,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000221553 s, 3.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:29,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:29,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517628 s, 711 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:29,498::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:29,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000474771 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4173::DEBUG::2014-04-10 18:14:37,462::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4173::DEBUG::2014-04-10 18:14:37,463::task::579::TaskManager.Task::(_updateState) Task=`27f487bc-6817-42ae-b516-32ba3dda08ee`::moving from state init -> state preparing
>Thread-4173::INFO::2014-04-10 18:14:37,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4173::INFO::2014-04-10 18:14:37,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4173::DEBUG::2014-04-10 18:14:37,463::task::1168::TaskManager.Task::(prepare) Task=`27f487bc-6817-42ae-b516-32ba3dda08ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4173::DEBUG::2014-04-10 18:14:37,464::task::579::TaskManager.Task::(_updateState) Task=`27f487bc-6817-42ae-b516-32ba3dda08ee`::moving from state preparing -> state finished
>Thread-4173::DEBUG::2014-04-10 18:14:37,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4173::DEBUG::2014-04-10 18:14:37,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4173::DEBUG::2014-04-10 18:14:37,464::task::974::TaskManager.Task::(_decref) Task=`27f487bc-6817-42ae-b516-32ba3dda08ee`::ref 0 aborting False
>Thread-4174::DEBUG::2014-04-10 18:14:37,470::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4174::DEBUG::2014-04-10 18:14:37,471::task::579::TaskManager.Task::(_updateState) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::moving from state init -> state preparing
>Thread-4174::INFO::2014-04-10 18:14:37,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4174::DEBUG::2014-04-10 18:14:37,472::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cfa56676-ff16-4529-bc33-fdc6538869f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4174::DEBUG::2014-04-10 18:14:37,472::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4174::DEBUG::2014-04-10 18:14:37,472::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4174::DEBUG::2014-04-10 18:14:37,472::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cfa56676-ff16-4529-bc33-fdc6538869f6`::Granted request
>Thread-4174::DEBUG::2014-04-10 18:14:37,472::task::811::TaskManager.Task::(resourceAcquired) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4174::DEBUG::2014-04-10 18:14:37,473::task::974::TaskManager.Task::(_decref) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::ref 1 aborting False
>Thread-4174::INFO::2014-04-10 18:14:37,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4174::DEBUG::2014-04-10 18:14:37,475::task::1168::TaskManager.Task::(prepare) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4174::DEBUG::2014-04-10 18:14:37,475::task::579::TaskManager.Task::(_updateState) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::moving from state preparing -> state finished
>Thread-4174::DEBUG::2014-04-10 18:14:37,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4174::DEBUG::2014-04-10 18:14:37,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4174::DEBUG::2014-04-10 18:14:37,475::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4174::DEBUG::2014-04-10 18:14:37,476::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4174::DEBUG::2014-04-10 18:14:37,476::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4174::DEBUG::2014-04-10 18:14:37,476::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4174::DEBUG::2014-04-10 18:14:37,476::task::974::TaskManager.Task::(_decref) Task=`d0a66d73-a24b-4e6b-8a99-d828ef5b0883`::ref 0 aborting False
>Thread-4175::DEBUG::2014-04-10 18:14:38,215::task::579::TaskManager.Task::(_updateState) Task=`a33b993c-3e3b-405e-b07f-b11302c1c95d`::moving from state init -> state preparing
>Thread-4175::INFO::2014-04-10 18:14:38,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4175::INFO::2014-04-10 18:14:38,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474771', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304453', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221553', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517628', 'lastCheck': '8.9', 'valid': True}}
>Thread-4175::DEBUG::2014-04-10 18:14:38,215::task::1168::TaskManager.Task::(prepare) Task=`a33b993c-3e3b-405e-b07f-b11302c1c95d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474771', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304453', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000221553', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517628', 'lastCheck': '8.9', 'valid': True}}
>Thread-4175::DEBUG::2014-04-10 18:14:38,215::task::579::TaskManager.Task::(_updateState) Task=`a33b993c-3e3b-405e-b07f-b11302c1c95d`::moving from state preparing -> state finished
>Thread-4175::DEBUG::2014-04-10 18:14:38,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4175::DEBUG::2014-04-10 18:14:38,216::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4175::DEBUG::2014-04-10 18:14:38,216::task::974::TaskManager.Task::(_decref) Task=`a33b993c-3e3b-405e-b07f-b11302c1c95d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:38,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:39,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372792 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:39,180::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:39,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263944 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:39,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:39,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000394778 s, 932 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:39,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:39,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000373386 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4180::DEBUG::2014-04-10 18:14:47,552::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4180::DEBUG::2014-04-10 18:14:47,552::task::579::TaskManager.Task::(_updateState) Task=`a533d1b7-5b25-4724-aa37-59e9da17cf69`::moving from state init -> state preparing
>Thread-4180::INFO::2014-04-10 18:14:47,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4180::INFO::2014-04-10 18:14:47,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4180::DEBUG::2014-04-10 18:14:47,553::task::1168::TaskManager.Task::(prepare) Task=`a533d1b7-5b25-4724-aa37-59e9da17cf69`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4180::DEBUG::2014-04-10 18:14:47,553::task::579::TaskManager.Task::(_updateState) Task=`a533d1b7-5b25-4724-aa37-59e9da17cf69`::moving from state preparing -> state finished
>Thread-4180::DEBUG::2014-04-10 18:14:47,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4180::DEBUG::2014-04-10 18:14:47,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4180::DEBUG::2014-04-10 18:14:47,554::task::974::TaskManager.Task::(_decref) Task=`a533d1b7-5b25-4724-aa37-59e9da17cf69`::ref 0 aborting False
>Thread-4181::DEBUG::2014-04-10 18:14:47,560::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4181::DEBUG::2014-04-10 18:14:47,560::task::579::TaskManager.Task::(_updateState) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::moving from state init -> state preparing
>Thread-4181::INFO::2014-04-10 18:14:47,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4181::DEBUG::2014-04-10 18:14:47,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`070be5b0-56d3-458b-8595-b171df3d51fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4181::DEBUG::2014-04-10 18:14:47,561::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4181::DEBUG::2014-04-10 18:14:47,562::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4181::DEBUG::2014-04-10 18:14:47,563::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`070be5b0-56d3-458b-8595-b171df3d51fc`::Granted request
>Thread-4181::DEBUG::2014-04-10 18:14:47,563::task::811::TaskManager.Task::(resourceAcquired) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4181::DEBUG::2014-04-10 18:14:47,563::task::974::TaskManager.Task::(_decref) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::ref 1 aborting False
>Thread-4181::INFO::2014-04-10 18:14:47,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4181::DEBUG::2014-04-10 18:14:47,565::task::1168::TaskManager.Task::(prepare) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4181::DEBUG::2014-04-10 18:14:47,565::task::579::TaskManager.Task::(_updateState) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::moving from state preparing -> state finished
>Thread-4181::DEBUG::2014-04-10 18:14:47,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4181::DEBUG::2014-04-10 18:14:47,566::task::974::TaskManager.Task::(_decref) Task=`4f3c1dea-c796-4ab2-bfa1-d3c039a3a7aa`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:49,012::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:49,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410657 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:49,195::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:49,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000378596 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:49,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:49,343::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487339 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:49,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:49,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000505147 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4183::DEBUG::2014-04-10 18:14:53,368::task::579::TaskManager.Task::(_updateState) Task=`e514aa32-961f-4a0b-b9ac-5ab045118208`::moving from state init -> state preparing
>Thread-4183::INFO::2014-04-10 18:14:53,368::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4183::INFO::2014-04-10 18:14:53,368::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505147', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410657', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378596', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487339', 'lastCheck': '4.0', 'valid': True}}
>Thread-4183::DEBUG::2014-04-10 18:14:53,368::task::1168::TaskManager.Task::(prepare) Task=`e514aa32-961f-4a0b-b9ac-5ab045118208`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505147', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410657', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378596', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487339', 'lastCheck': '4.0', 'valid': True}}
>Thread-4183::DEBUG::2014-04-10 18:14:53,369::task::579::TaskManager.Task::(_updateState) Task=`e514aa32-961f-4a0b-b9ac-5ab045118208`::moving from state preparing -> state finished
>Thread-4183::DEBUG::2014-04-10 18:14:53,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4183::DEBUG::2014-04-10 18:14:53,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4183::DEBUG::2014-04-10 18:14:53,369::task::974::TaskManager.Task::(_decref) Task=`e514aa32-961f-4a0b-b9ac-5ab045118208`::ref 0 aborting False
>Thread-4186::DEBUG::2014-04-10 18:14:57,650::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4186::DEBUG::2014-04-10 18:14:57,651::task::579::TaskManager.Task::(_updateState) Task=`c7296761-3674-40ad-894a-6fe5a553c8c4`::moving from state init -> state preparing
>Thread-4186::INFO::2014-04-10 18:14:57,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4186::INFO::2014-04-10 18:14:57,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4186::DEBUG::2014-04-10 18:14:57,652::task::1168::TaskManager.Task::(prepare) Task=`c7296761-3674-40ad-894a-6fe5a553c8c4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4186::DEBUG::2014-04-10 18:14:57,652::task::579::TaskManager.Task::(_updateState) Task=`c7296761-3674-40ad-894a-6fe5a553c8c4`::moving from state preparing -> state finished
>Thread-4186::DEBUG::2014-04-10 18:14:57,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4186::DEBUG::2014-04-10 18:14:57,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4186::DEBUG::2014-04-10 18:14:57,653::task::974::TaskManager.Task::(_decref) Task=`c7296761-3674-40ad-894a-6fe5a553c8c4`::ref 0 aborting False
>Thread-4187::DEBUG::2014-04-10 18:14:57,660::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4187::DEBUG::2014-04-10 18:14:57,660::task::579::TaskManager.Task::(_updateState) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::moving from state init -> state preparing
>Thread-4187::INFO::2014-04-10 18:14:57,661::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4187::DEBUG::2014-04-10 18:14:57,661::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0d5728b1-5bfc-48cb-9107-efabe9bd85a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4187::DEBUG::2014-04-10 18:14:57,661::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4187::DEBUG::2014-04-10 18:14:57,662::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4187::DEBUG::2014-04-10 18:14:57,662::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0d5728b1-5bfc-48cb-9107-efabe9bd85a6`::Granted request
>Thread-4187::DEBUG::2014-04-10 18:14:57,662::task::811::TaskManager.Task::(resourceAcquired) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4187::DEBUG::2014-04-10 18:14:57,662::task::974::TaskManager.Task::(_decref) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::ref 1 aborting False
>Thread-4187::INFO::2014-04-10 18:14:57,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4187::DEBUG::2014-04-10 18:14:57,665::task::1168::TaskManager.Task::(prepare) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4187::DEBUG::2014-04-10 18:14:57,665::task::579::TaskManager.Task::(_updateState) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::moving from state preparing -> state finished
>Thread-4187::DEBUG::2014-04-10 18:14:57,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4187::DEBUG::2014-04-10 18:14:57,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4187::DEBUG::2014-04-10 18:14:57,666::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4187::DEBUG::2014-04-10 18:14:57,666::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4187::DEBUG::2014-04-10 18:14:57,666::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4187::DEBUG::2014-04-10 18:14:57,666::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4187::DEBUG::2014-04-10 18:14:57,666::task::974::TaskManager.Task::(_decref) Task=`1a26cc57-3319-4edf-9c67-f8558276c41c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:14:59,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:14:59,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363826 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:14:59,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:14:59,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00043099 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:14:59,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:14:59,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000535358 s, 687 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:14:59,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:14:59,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000547731 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4191::DEBUG::2014-04-10 18:15:07,741::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4191::DEBUG::2014-04-10 18:15:07,742::task::579::TaskManager.Task::(_updateState) Task=`cdbcc761-fdca-4c0f-9397-23c3307bc7b0`::moving from state init -> state preparing
>Thread-4191::INFO::2014-04-10 18:15:07,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4191::INFO::2014-04-10 18:15:07,743::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4191::DEBUG::2014-04-10 18:15:07,743::task::1168::TaskManager.Task::(prepare) Task=`cdbcc761-fdca-4c0f-9397-23c3307bc7b0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4191::DEBUG::2014-04-10 18:15:07,743::task::579::TaskManager.Task::(_updateState) Task=`cdbcc761-fdca-4c0f-9397-23c3307bc7b0`::moving from state preparing -> state finished
>Thread-4191::DEBUG::2014-04-10 18:15:07,743::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4191::DEBUG::2014-04-10 18:15:07,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4191::DEBUG::2014-04-10 18:15:07,743::task::974::TaskManager.Task::(_decref) Task=`cdbcc761-fdca-4c0f-9397-23c3307bc7b0`::ref 0 aborting False
>Thread-4192::DEBUG::2014-04-10 18:15:07,750::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4192::DEBUG::2014-04-10 18:15:07,751::task::579::TaskManager.Task::(_updateState) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::moving from state init -> state preparing
>Thread-4192::INFO::2014-04-10 18:15:07,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4192::DEBUG::2014-04-10 18:15:07,751::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0030dffc-ddc8-43e1-9cda-c2019226cc8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4192::DEBUG::2014-04-10 18:15:07,752::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4192::DEBUG::2014-04-10 18:15:07,752::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4192::DEBUG::2014-04-10 18:15:07,752::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0030dffc-ddc8-43e1-9cda-c2019226cc8e`::Granted request
>Thread-4192::DEBUG::2014-04-10 18:15:07,752::task::811::TaskManager.Task::(resourceAcquired) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4192::DEBUG::2014-04-10 18:15:07,752::task::974::TaskManager.Task::(_decref) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::ref 1 aborting False
>Thread-4192::INFO::2014-04-10 18:15:07,754::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4192::DEBUG::2014-04-10 18:15:07,755::task::1168::TaskManager.Task::(prepare) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4192::DEBUG::2014-04-10 18:15:07,755::task::579::TaskManager.Task::(_updateState) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::moving from state preparing -> state finished
>Thread-4192::DEBUG::2014-04-10 18:15:07,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4192::DEBUG::2014-04-10 18:15:07,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4192::DEBUG::2014-04-10 18:15:07,755::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4192::DEBUG::2014-04-10 18:15:07,756::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4192::DEBUG::2014-04-10 18:15:07,756::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4192::DEBUG::2014-04-10 18:15:07,756::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4192::DEBUG::2014-04-10 18:15:07,756::task::974::TaskManager.Task::(_decref) Task=`5b5fc536-4abb-4bf8-bf1c-9145de2abb99`::ref 0 aborting False
>Thread-4193::DEBUG::2014-04-10 18:15:08,517::task::579::TaskManager.Task::(_updateState) Task=`6614e30a-795a-403c-83ed-cdc1d1c04111`::moving from state init -> state preparing
>Thread-4193::INFO::2014-04-10 18:15:08,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4193::INFO::2014-04-10 18:15:08,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547731', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363826', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043099', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535358', 'lastCheck': '9.2', 'valid': True}}
>Thread-4193::DEBUG::2014-04-10 18:15:08,518::task::1168::TaskManager.Task::(prepare) Task=`6614e30a-795a-403c-83ed-cdc1d1c04111`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547731', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363826', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043099', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535358', 'lastCheck': '9.2', 'valid': True}}
>Thread-4193::DEBUG::2014-04-10 18:15:08,518::task::579::TaskManager.Task::(_updateState) Task=`6614e30a-795a-403c-83ed-cdc1d1c04111`::moving from state preparing -> state finished
>Thread-4193::DEBUG::2014-04-10 18:15:08,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4193::DEBUG::2014-04-10 18:15:08,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4193::DEBUG::2014-04-10 18:15:08,519::task::974::TaskManager.Task::(_decref) Task=`6614e30a-795a-403c-83ed-cdc1d1c04111`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:09,050::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:09,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420224 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:09,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:09,229::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266639 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:09,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:09,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000416126 s, 884 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:09,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:09,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000545496 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4198::DEBUG::2014-04-10 18:15:17,839::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4198::DEBUG::2014-04-10 18:15:17,840::task::579::TaskManager.Task::(_updateState) Task=`13bbfcf1-c21d-49d7-8151-cf5041d845ed`::moving from state init -> state preparing
>Thread-4198::INFO::2014-04-10 18:15:17,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4198::INFO::2014-04-10 18:15:17,840::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4198::DEBUG::2014-04-10 18:15:17,841::task::1168::TaskManager.Task::(prepare) Task=`13bbfcf1-c21d-49d7-8151-cf5041d845ed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4198::DEBUG::2014-04-10 18:15:17,841::task::579::TaskManager.Task::(_updateState) Task=`13bbfcf1-c21d-49d7-8151-cf5041d845ed`::moving from state preparing -> state finished
>Thread-4198::DEBUG::2014-04-10 18:15:17,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4198::DEBUG::2014-04-10 18:15:17,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4198::DEBUG::2014-04-10 18:15:17,841::task::974::TaskManager.Task::(_decref) Task=`13bbfcf1-c21d-49d7-8151-cf5041d845ed`::ref 0 aborting False
>Thread-4199::DEBUG::2014-04-10 18:15:17,848::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4199::DEBUG::2014-04-10 18:15:17,848::task::579::TaskManager.Task::(_updateState) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::moving from state init -> state preparing
>Thread-4199::INFO::2014-04-10 18:15:17,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4199::DEBUG::2014-04-10 18:15:17,849::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f5c213c-4e30-476b-acc0-3750da35ea7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4199::DEBUG::2014-04-10 18:15:17,849::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4199::DEBUG::2014-04-10 18:15:17,849::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4199::DEBUG::2014-04-10 18:15:17,849::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5f5c213c-4e30-476b-acc0-3750da35ea7a`::Granted request
>Thread-4199::DEBUG::2014-04-10 18:15:17,849::task::811::TaskManager.Task::(resourceAcquired) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4199::DEBUG::2014-04-10 18:15:17,850::task::974::TaskManager.Task::(_decref) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::ref 1 aborting False
>Thread-4199::INFO::2014-04-10 18:15:17,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4199::DEBUG::2014-04-10 18:15:17,852::task::1168::TaskManager.Task::(prepare) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4199::DEBUG::2014-04-10 18:15:17,852::task::579::TaskManager.Task::(_updateState) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::moving from state preparing -> state finished
>Thread-4199::DEBUG::2014-04-10 18:15:17,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4199::DEBUG::2014-04-10 18:15:17,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4199::DEBUG::2014-04-10 18:15:17,852::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4199::DEBUG::2014-04-10 18:15:17,853::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4199::DEBUG::2014-04-10 18:15:17,853::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4199::DEBUG::2014-04-10 18:15:17,853::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4199::DEBUG::2014-04-10 18:15:17,853::task::974::TaskManager.Task::(_decref) Task=`b23451a8-c6a4-4c42-b9d8-b7d2e187eab7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:19,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:19,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312073 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:19,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:19,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270542 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:19,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:19,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000454616 s, 809 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:19,570::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:19,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000486711 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4201::DEBUG::2014-04-10 18:15:23,678::task::579::TaskManager.Task::(_updateState) Task=`e82e011b-456e-46d3-8e42-a10b2f04b38b`::moving from state init -> state preparing
>Thread-4201::INFO::2014-04-10 18:15:23,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4201::INFO::2014-04-10 18:15:23,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486711', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312073', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270542', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454616', 'lastCheck': '4.3', 'valid': True}}
>Thread-4201::DEBUG::2014-04-10 18:15:23,679::task::1168::TaskManager.Task::(prepare) Task=`e82e011b-456e-46d3-8e42-a10b2f04b38b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486711', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000312073', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270542', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454616', 'lastCheck': '4.3', 'valid': True}}
>Thread-4201::DEBUG::2014-04-10 18:15:23,679::task::579::TaskManager.Task::(_updateState) Task=`e82e011b-456e-46d3-8e42-a10b2f04b38b`::moving from state preparing -> state finished
>Thread-4201::DEBUG::2014-04-10 18:15:23,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4201::DEBUG::2014-04-10 18:15:23,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4201::DEBUG::2014-04-10 18:15:23,680::task::974::TaskManager.Task::(_decref) Task=`e82e011b-456e-46d3-8e42-a10b2f04b38b`::ref 0 aborting False
>Thread-4204::DEBUG::2014-04-10 18:15:28,199::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4204::DEBUG::2014-04-10 18:15:28,199::task::579::TaskManager.Task::(_updateState) Task=`beb698f6-9b5e-4190-a1c6-06db7df6478e`::moving from state init -> state preparing
>Thread-4204::INFO::2014-04-10 18:15:28,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4204::INFO::2014-04-10 18:15:28,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4204::DEBUG::2014-04-10 18:15:28,200::task::1168::TaskManager.Task::(prepare) Task=`beb698f6-9b5e-4190-a1c6-06db7df6478e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4204::DEBUG::2014-04-10 18:15:28,200::task::579::TaskManager.Task::(_updateState) Task=`beb698f6-9b5e-4190-a1c6-06db7df6478e`::moving from state preparing -> state finished
>Thread-4204::DEBUG::2014-04-10 18:15:28,200::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4204::DEBUG::2014-04-10 18:15:28,200::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4204::DEBUG::2014-04-10 18:15:28,201::task::974::TaskManager.Task::(_decref) Task=`beb698f6-9b5e-4190-a1c6-06db7df6478e`::ref 0 aborting False
>Thread-4205::DEBUG::2014-04-10 18:15:28,207::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4205::DEBUG::2014-04-10 18:15:28,207::task::579::TaskManager.Task::(_updateState) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::moving from state init -> state preparing
>Thread-4205::INFO::2014-04-10 18:15:28,208::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4205::DEBUG::2014-04-10 18:15:28,208::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`737462f8-c51a-4861-b4d1-e6bcb3381ab3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4205::DEBUG::2014-04-10 18:15:28,208::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4205::DEBUG::2014-04-10 18:15:28,208::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4205::DEBUG::2014-04-10 18:15:28,210::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`737462f8-c51a-4861-b4d1-e6bcb3381ab3`::Granted request
>Thread-4205::DEBUG::2014-04-10 18:15:28,210::task::811::TaskManager.Task::(resourceAcquired) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4205::DEBUG::2014-04-10 18:15:28,210::task::974::TaskManager.Task::(_decref) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::ref 1 aborting False
>Thread-4205::INFO::2014-04-10 18:15:28,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4205::DEBUG::2014-04-10 18:15:28,212::task::1168::TaskManager.Task::(prepare) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4205::DEBUG::2014-04-10 18:15:28,212::task::579::TaskManager.Task::(_updateState) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::moving from state preparing -> state finished
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4205::DEBUG::2014-04-10 18:15:28,213::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4205::DEBUG::2014-04-10 18:15:28,214::task::974::TaskManager.Task::(_decref) Task=`ac13f1de-5e17-4cd9-9da4-ddabe3acf8ac`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:29,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:29,089::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330727 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:29,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:29,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000425967 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:29,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:29,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485395 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:29,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:29,590::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000415813 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4209::DEBUG::2014-04-10 18:15:38,329::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4209::DEBUG::2014-04-10 18:15:38,330::task::579::TaskManager.Task::(_updateState) Task=`651fdc63-19e8-49f4-bb58-321aad47a7ff`::moving from state init -> state preparing
>Thread-4209::INFO::2014-04-10 18:15:38,330::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4209::INFO::2014-04-10 18:15:38,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4209::DEBUG::2014-04-10 18:15:38,331::task::1168::TaskManager.Task::(prepare) Task=`651fdc63-19e8-49f4-bb58-321aad47a7ff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4209::DEBUG::2014-04-10 18:15:38,331::task::579::TaskManager.Task::(_updateState) Task=`651fdc63-19e8-49f4-bb58-321aad47a7ff`::moving from state preparing -> state finished
>Thread-4209::DEBUG::2014-04-10 18:15:38,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4209::DEBUG::2014-04-10 18:15:38,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4209::DEBUG::2014-04-10 18:15:38,331::task::974::TaskManager.Task::(_decref) Task=`651fdc63-19e8-49f4-bb58-321aad47a7ff`::ref 0 aborting False
>Thread-4210::DEBUG::2014-04-10 18:15:38,338::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4210::DEBUG::2014-04-10 18:15:38,338::task::579::TaskManager.Task::(_updateState) Task=`65ddfd17-3270-4710-836b-963bc457004b`::moving from state init -> state preparing
>Thread-4210::INFO::2014-04-10 18:15:38,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4210::DEBUG::2014-04-10 18:15:38,339::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`50dfb978-b953-463c-aa9a-442e81684d1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4210::DEBUG::2014-04-10 18:15:38,339::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4210::DEBUG::2014-04-10 18:15:38,339::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4210::DEBUG::2014-04-10 18:15:38,339::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`50dfb978-b953-463c-aa9a-442e81684d1b`::Granted request
>Thread-4210::DEBUG::2014-04-10 18:15:38,339::task::811::TaskManager.Task::(resourceAcquired) Task=`65ddfd17-3270-4710-836b-963bc457004b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4210::DEBUG::2014-04-10 18:15:38,340::task::974::TaskManager.Task::(_decref) Task=`65ddfd17-3270-4710-836b-963bc457004b`::ref 1 aborting False
>Thread-4210::INFO::2014-04-10 18:15:38,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::task::1168::TaskManager.Task::(prepare) Task=`65ddfd17-3270-4710-836b-963bc457004b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::task::579::TaskManager.Task::(_updateState) Task=`65ddfd17-3270-4710-836b-963bc457004b`::moving from state preparing -> state finished
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4210::DEBUG::2014-04-10 18:15:38,342::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4210::DEBUG::2014-04-10 18:15:38,343::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4210::DEBUG::2014-04-10 18:15:38,343::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4210::DEBUG::2014-04-10 18:15:38,343::task::974::TaskManager.Task::(_decref) Task=`65ddfd17-3270-4710-836b-963bc457004b`::ref 0 aborting False
>Thread-4211::DEBUG::2014-04-10 18:15:38,850::task::579::TaskManager.Task::(_updateState) Task=`7b9d3230-8c85-4f81-a204-4e65a534ba87`::moving from state init -> state preparing
>Thread-4211::INFO::2014-04-10 18:15:38,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4211::INFO::2014-04-10 18:15:38,851::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415813', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330727', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485395', 'lastCheck': '9.4', 'valid': True}}
>Thread-4211::DEBUG::2014-04-10 18:15:38,851::task::1168::TaskManager.Task::(prepare) Task=`7b9d3230-8c85-4f81-a204-4e65a534ba87`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415813', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330727', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485395', 'lastCheck': '9.4', 'valid': True}}
>Thread-4211::DEBUG::2014-04-10 18:15:38,851::task::579::TaskManager.Task::(_updateState) Task=`7b9d3230-8c85-4f81-a204-4e65a534ba87`::moving from state preparing -> state finished
>Thread-4211::DEBUG::2014-04-10 18:15:38,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4211::DEBUG::2014-04-10 18:15:38,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4211::DEBUG::2014-04-10 18:15:38,851::task::974::TaskManager.Task::(_decref) Task=`7b9d3230-8c85-4f81-a204-4e65a534ba87`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:39,099::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:15:39,105::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:15:39,106::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:15:39,111::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:15:39,112::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:15:39,112::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:15:39,112::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:15:39,117::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:39,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277178 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:39,262::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:15:39,277::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:15:39,279::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:15:39,283::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:15:39,285::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:15:39,285::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:15:39,285::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:15:39,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:39,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0002428 s, 2.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:39,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:39,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000548997 s, 670 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:39,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:39,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000483337 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4224::DEBUG::2014-04-10 18:15:48,426::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4224::DEBUG::2014-04-10 18:15:48,427::task::579::TaskManager.Task::(_updateState) Task=`74232af1-035b-496d-b928-4498b07fe0aa`::moving from state init -> state preparing
>Thread-4224::INFO::2014-04-10 18:15:48,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4224::INFO::2014-04-10 18:15:48,427::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4224::DEBUG::2014-04-10 18:15:48,427::task::1168::TaskManager.Task::(prepare) Task=`74232af1-035b-496d-b928-4498b07fe0aa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4224::DEBUG::2014-04-10 18:15:48,428::task::579::TaskManager.Task::(_updateState) Task=`74232af1-035b-496d-b928-4498b07fe0aa`::moving from state preparing -> state finished
>Thread-4224::DEBUG::2014-04-10 18:15:48,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4224::DEBUG::2014-04-10 18:15:48,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4224::DEBUG::2014-04-10 18:15:48,428::task::974::TaskManager.Task::(_decref) Task=`74232af1-035b-496d-b928-4498b07fe0aa`::ref 0 aborting False
>Thread-4225::DEBUG::2014-04-10 18:15:48,434::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4225::DEBUG::2014-04-10 18:15:48,435::task::579::TaskManager.Task::(_updateState) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::moving from state init -> state preparing
>Thread-4225::INFO::2014-04-10 18:15:48,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4225::DEBUG::2014-04-10 18:15:48,435::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`499513db-a4a5-4a15-ba07-0a4d035bc664`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4225::DEBUG::2014-04-10 18:15:48,435::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4225::DEBUG::2014-04-10 18:15:48,436::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4225::DEBUG::2014-04-10 18:15:48,436::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`499513db-a4a5-4a15-ba07-0a4d035bc664`::Granted request
>Thread-4225::DEBUG::2014-04-10 18:15:48,436::task::811::TaskManager.Task::(resourceAcquired) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4225::DEBUG::2014-04-10 18:15:48,436::task::974::TaskManager.Task::(_decref) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::ref 1 aborting False
>Thread-4225::INFO::2014-04-10 18:15:48,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4225::DEBUG::2014-04-10 18:15:48,438::task::1168::TaskManager.Task::(prepare) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::task::579::TaskManager.Task::(_updateState) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::moving from state preparing -> state finished
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4225::DEBUG::2014-04-10 18:15:48,439::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4225::DEBUG::2014-04-10 18:15:48,440::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4225::DEBUG::2014-04-10 18:15:48,440::task::974::TaskManager.Task::(_decref) Task=`ba57d613-a82d-4306-a78c-33ae34ee10ce`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:49,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:49,140::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331953 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:49,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:49,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420263 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:49,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:49,432::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476309 s, 773 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:49,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:49,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464401 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4227::DEBUG::2014-04-10 18:15:54,840::task::579::TaskManager.Task::(_updateState) Task=`fbfc3f99-63bc-49c5-b494-b3a285e92434`::moving from state init -> state preparing
>Thread-4227::INFO::2014-04-10 18:15:54,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4227::INFO::2014-04-10 18:15:54,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464401', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331953', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420263', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476309', 'lastCheck': '5.4', 'valid': True}}
>Thread-4227::DEBUG::2014-04-10 18:15:54,841::task::1168::TaskManager.Task::(prepare) Task=`fbfc3f99-63bc-49c5-b494-b3a285e92434`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464401', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331953', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420263', 'lastCheck': '5.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476309', 'lastCheck': '5.4', 'valid': True}}
>Thread-4227::DEBUG::2014-04-10 18:15:54,841::task::579::TaskManager.Task::(_updateState) Task=`fbfc3f99-63bc-49c5-b494-b3a285e92434`::moving from state preparing -> state finished
>Thread-4227::DEBUG::2014-04-10 18:15:54,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4227::DEBUG::2014-04-10 18:15:54,842::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4227::DEBUG::2014-04-10 18:15:54,842::task::974::TaskManager.Task::(_decref) Task=`fbfc3f99-63bc-49c5-b494-b3a285e92434`::ref 0 aborting False
>Thread-4230::DEBUG::2014-04-10 18:15:58,516::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4230::DEBUG::2014-04-10 18:15:58,517::task::579::TaskManager.Task::(_updateState) Task=`adb1cf2d-e2e5-4ce3-bded-8cd3e8673d6b`::moving from state init -> state preparing
>Thread-4230::INFO::2014-04-10 18:15:58,517::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4230::INFO::2014-04-10 18:15:58,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4230::DEBUG::2014-04-10 18:15:58,517::task::1168::TaskManager.Task::(prepare) Task=`adb1cf2d-e2e5-4ce3-bded-8cd3e8673d6b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4230::DEBUG::2014-04-10 18:15:58,517::task::579::TaskManager.Task::(_updateState) Task=`adb1cf2d-e2e5-4ce3-bded-8cd3e8673d6b`::moving from state preparing -> state finished
>Thread-4230::DEBUG::2014-04-10 18:15:58,518::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4230::DEBUG::2014-04-10 18:15:58,518::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4230::DEBUG::2014-04-10 18:15:58,518::task::974::TaskManager.Task::(_decref) Task=`adb1cf2d-e2e5-4ce3-bded-8cd3e8673d6b`::ref 0 aborting False
>Thread-4231::DEBUG::2014-04-10 18:15:58,524::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4231::DEBUG::2014-04-10 18:15:58,525::task::579::TaskManager.Task::(_updateState) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::moving from state init -> state preparing
>Thread-4231::INFO::2014-04-10 18:15:58,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4231::DEBUG::2014-04-10 18:15:58,525::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`54914b9b-13df-4b11-8e70-9790a1c0ac28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4231::DEBUG::2014-04-10 18:15:58,525::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4231::DEBUG::2014-04-10 18:15:58,526::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4231::DEBUG::2014-04-10 18:15:58,526::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`54914b9b-13df-4b11-8e70-9790a1c0ac28`::Granted request
>Thread-4231::DEBUG::2014-04-10 18:15:58,526::task::811::TaskManager.Task::(resourceAcquired) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4231::DEBUG::2014-04-10 18:15:58,526::task::974::TaskManager.Task::(_decref) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::ref 1 aborting False
>Thread-4231::INFO::2014-04-10 18:15:58,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4231::DEBUG::2014-04-10 18:15:58,528::task::1168::TaskManager.Task::(prepare) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4231::DEBUG::2014-04-10 18:15:58,528::task::579::TaskManager.Task::(_updateState) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::moving from state preparing -> state finished
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4231::DEBUG::2014-04-10 18:15:58,529::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4231::DEBUG::2014-04-10 18:15:58,530::task::974::TaskManager.Task::(_decref) Task=`d7b8f379-c99d-4dfc-828c-3d829a102b15`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:15:59,149::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:15:59,162::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296486 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:15:59,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:15:59,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278108 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:15:59,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:15:59,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000461325 s, 798 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:15:59,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:15:59,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00045043 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4235::DEBUG::2014-04-10 18:16:08,608::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-4235::DEBUG::2014-04-10 18:16:08,608::task::579::TaskManager.Task::(_updateState) Task=`cda40a94-3ba2-48ca-9206-c359b3302292`::moving from state init -> state preparing
>Thread-4235::INFO::2014-04-10 18:16:08,609::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4235::INFO::2014-04-10 18:16:08,609::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4235::DEBUG::2014-04-10 18:16:08,609::task::1168::TaskManager.Task::(prepare) Task=`cda40a94-3ba2-48ca-9206-c359b3302292`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4235::DEBUG::2014-04-10 18:16:08,609::task::579::TaskManager.Task::(_updateState) Task=`cda40a94-3ba2-48ca-9206-c359b3302292`::moving from state preparing -> state finished
>Thread-4235::DEBUG::2014-04-10 18:16:08,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4235::DEBUG::2014-04-10 18:16:08,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4235::DEBUG::2014-04-10 18:16:08,610::task::974::TaskManager.Task::(_decref) Task=`cda40a94-3ba2-48ca-9206-c359b3302292`::ref 0 aborting False
>Thread-4236::DEBUG::2014-04-10 18:16:08,616::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-4236::DEBUG::2014-04-10 18:16:08,617::task::579::TaskManager.Task::(_updateState) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::moving from state init -> state preparing
>Thread-4236::INFO::2014-04-10 18:16:08,617::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4236::DEBUG::2014-04-10 18:16:08,617::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f379e596-97fa-4657-b1e8-6941896d7965`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4236::DEBUG::2014-04-10 18:16:08,617::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4236::DEBUG::2014-04-10 18:16:08,618::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4236::DEBUG::2014-04-10 18:16:08,618::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f379e596-97fa-4657-b1e8-6941896d7965`::Granted request
>Thread-4236::DEBUG::2014-04-10 18:16:08,619::task::811::TaskManager.Task::(resourceAcquired) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4236::DEBUG::2014-04-10 18:16:08,619::task::974::TaskManager.Task::(_decref) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::ref 1 aborting False
>Thread-4236::INFO::2014-04-10 18:16:08,621::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4236::DEBUG::2014-04-10 18:16:08,621::task::1168::TaskManager.Task::(prepare) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::task::579::TaskManager.Task::(_updateState) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::moving from state preparing -> state finished
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4236::DEBUG::2014-04-10 18:16:08,622::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4236::DEBUG::2014-04-10 18:16:08,623::task::974::TaskManager.Task::(_decref) Task=`89e2f102-cd87-4d06-b4a6-c8f2ab912aff`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:09,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:09,177::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277904 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:09,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:09,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00159328 s, 421 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:09,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:09,458::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489491 s, 752 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:09,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:09,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000440965 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4237::DEBUG::2014-04-10 18:16:10,660::task::579::TaskManager.Task::(_updateState) Task=`cf17f356-91a7-445c-bd3e-951541379f7f`::moving from state init -> state preparing
>Thread-4237::INFO::2014-04-10 18:16:10,660::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4237::INFO::2014-04-10 18:16:10,660::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440965', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277904', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00159328', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489491', 'lastCheck': '1.2', 'valid': True}}
>Thread-4237::DEBUG::2014-04-10 18:16:10,661::task::1168::TaskManager.Task::(prepare) Task=`cf17f356-91a7-445c-bd3e-951541379f7f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440965', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277904', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00159328', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489491', 'lastCheck': '1.2', 'valid': True}}
>Thread-4237::DEBUG::2014-04-10 18:16:10,661::task::579::TaskManager.Task::(_updateState) Task=`cf17f356-91a7-445c-bd3e-951541379f7f`::moving from state preparing -> state finished
>Thread-4237::DEBUG::2014-04-10 18:16:10,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4237::DEBUG::2014-04-10 18:16:10,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4237::DEBUG::2014-04-10 18:16:10,661::task::974::TaskManager.Task::(_decref) Task=`cf17f356-91a7-445c-bd3e-951541379f7f`::ref 0 aborting False
>Thread-4241::DEBUG::2014-04-10 18:16:18,706::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4241::DEBUG::2014-04-10 18:16:18,706::task::579::TaskManager.Task::(_updateState) Task=`60ace586-a56d-4def-8217-c159d05c171e`::moving from state init -> state preparing
>Thread-4241::INFO::2014-04-10 18:16:18,707::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4241::INFO::2014-04-10 18:16:18,707::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4241::DEBUG::2014-04-10 18:16:18,707::task::1168::TaskManager.Task::(prepare) Task=`60ace586-a56d-4def-8217-c159d05c171e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4241::DEBUG::2014-04-10 18:16:18,707::task::579::TaskManager.Task::(_updateState) Task=`60ace586-a56d-4def-8217-c159d05c171e`::moving from state preparing -> state finished
>Thread-4241::DEBUG::2014-04-10 18:16:18,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4241::DEBUG::2014-04-10 18:16:18,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4241::DEBUG::2014-04-10 18:16:18,708::task::974::TaskManager.Task::(_decref) Task=`60ace586-a56d-4def-8217-c159d05c171e`::ref 0 aborting False
>Thread-4242::DEBUG::2014-04-10 18:16:18,714::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4242::DEBUG::2014-04-10 18:16:18,714::task::579::TaskManager.Task::(_updateState) Task=`897682db-720e-4283-9a82-ed226713a076`::moving from state init -> state preparing
>Thread-4242::INFO::2014-04-10 18:16:18,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4242::DEBUG::2014-04-10 18:16:18,715::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e599b76d-7a72-4564-8f42-eb7bb18e42bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4242::DEBUG::2014-04-10 18:16:18,715::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4242::DEBUG::2014-04-10 18:16:18,715::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4242::DEBUG::2014-04-10 18:16:18,716::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e599b76d-7a72-4564-8f42-eb7bb18e42bc`::Granted request
>Thread-4242::DEBUG::2014-04-10 18:16:18,716::task::811::TaskManager.Task::(resourceAcquired) Task=`897682db-720e-4283-9a82-ed226713a076`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4242::DEBUG::2014-04-10 18:16:18,716::task::974::TaskManager.Task::(_decref) Task=`897682db-720e-4283-9a82-ed226713a076`::ref 1 aborting False
>Thread-4242::INFO::2014-04-10 18:16:18,718::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4242::DEBUG::2014-04-10 18:16:18,718::task::1168::TaskManager.Task::(prepare) Task=`897682db-720e-4283-9a82-ed226713a076`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4242::DEBUG::2014-04-10 18:16:18,718::task::579::TaskManager.Task::(_updateState) Task=`897682db-720e-4283-9a82-ed226713a076`::moving from state preparing -> state finished
>Thread-4242::DEBUG::2014-04-10 18:16:18,718::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4242::DEBUG::2014-04-10 18:16:18,719::task::974::TaskManager.Task::(_decref) Task=`897682db-720e-4283-9a82-ed226713a076`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:19,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:19,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000427003 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:19,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:19,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290664 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:19,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:19,473::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000386524 s, 952 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:19,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:19,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000546161 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4245::DEBUG::2014-04-10 18:16:25,834::task::579::TaskManager.Task::(_updateState) Task=`96b0984d-0cde-4602-8acb-63baf8507dfa`::moving from state init -> state preparing
>Thread-4245::INFO::2014-04-10 18:16:25,835::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4245::INFO::2014-04-10 18:16:25,835::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546161', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427003', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290664', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386524', 'lastCheck': '6.4', 'valid': True}}
>Thread-4245::DEBUG::2014-04-10 18:16:25,835::task::1168::TaskManager.Task::(prepare) Task=`96b0984d-0cde-4602-8acb-63baf8507dfa`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546161', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427003', 'lastCheck': '6.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000290664', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386524', 'lastCheck': '6.4', 'valid': True}}
>Thread-4245::DEBUG::2014-04-10 18:16:25,836::task::579::TaskManager.Task::(_updateState) Task=`96b0984d-0cde-4602-8acb-63baf8507dfa`::moving from state preparing -> state finished
>Thread-4245::DEBUG::2014-04-10 18:16:25,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4245::DEBUG::2014-04-10 18:16:25,836::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4245::DEBUG::2014-04-10 18:16:25,836::task::974::TaskManager.Task::(_decref) Task=`96b0984d-0cde-4602-8acb-63baf8507dfa`::ref 0 aborting False
>Thread-4247::DEBUG::2014-04-10 18:16:28,813::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4247::DEBUG::2014-04-10 18:16:28,813::task::579::TaskManager.Task::(_updateState) Task=`8849444c-c209-40a8-b90a-157cf47c7706`::moving from state init -> state preparing
>Thread-4247::INFO::2014-04-10 18:16:28,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4247::INFO::2014-04-10 18:16:28,814::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4247::DEBUG::2014-04-10 18:16:28,814::task::1168::TaskManager.Task::(prepare) Task=`8849444c-c209-40a8-b90a-157cf47c7706`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4247::DEBUG::2014-04-10 18:16:28,814::task::579::TaskManager.Task::(_updateState) Task=`8849444c-c209-40a8-b90a-157cf47c7706`::moving from state preparing -> state finished
>Thread-4247::DEBUG::2014-04-10 18:16:28,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4247::DEBUG::2014-04-10 18:16:28,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4247::DEBUG::2014-04-10 18:16:28,814::task::974::TaskManager.Task::(_decref) Task=`8849444c-c209-40a8-b90a-157cf47c7706`::ref 0 aborting False
>Thread-4248::DEBUG::2014-04-10 18:16:28,821::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4248::DEBUG::2014-04-10 18:16:28,821::task::579::TaskManager.Task::(_updateState) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::moving from state init -> state preparing
>Thread-4248::INFO::2014-04-10 18:16:28,821::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4248::DEBUG::2014-04-10 18:16:28,822::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`835c38ed-d968-45cf-9f7f-a1e303419d65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4248::DEBUG::2014-04-10 18:16:28,822::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4248::DEBUG::2014-04-10 18:16:28,822::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4248::DEBUG::2014-04-10 18:16:28,822::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`835c38ed-d968-45cf-9f7f-a1e303419d65`::Granted request
>Thread-4248::DEBUG::2014-04-10 18:16:28,822::task::811::TaskManager.Task::(resourceAcquired) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4248::DEBUG::2014-04-10 18:16:28,823::task::974::TaskManager.Task::(_decref) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::ref 1 aborting False
>Thread-4248::INFO::2014-04-10 18:16:28,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4248::DEBUG::2014-04-10 18:16:28,825::task::1168::TaskManager.Task::(prepare) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4248::DEBUG::2014-04-10 18:16:28,825::task::579::TaskManager.Task::(_updateState) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::moving from state preparing -> state finished
>Thread-4248::DEBUG::2014-04-10 18:16:28,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4248::DEBUG::2014-04-10 18:16:28,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4248::DEBUG::2014-04-10 18:16:28,825::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4248::DEBUG::2014-04-10 18:16:28,826::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4248::DEBUG::2014-04-10 18:16:28,826::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4248::DEBUG::2014-04-10 18:16:28,826::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4248::DEBUG::2014-04-10 18:16:28,826::task::974::TaskManager.Task::(_decref) Task=`d25d60b5-fc4c-4500-8c5c-7905fb898a64`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:29,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:29,208::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282086 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:29,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:29,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309168 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:29,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:29,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00053458 s, 688 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:29,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:29,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000450524 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4253::DEBUG::2014-04-10 18:16:38,904::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4253::DEBUG::2014-04-10 18:16:38,904::task::579::TaskManager.Task::(_updateState) Task=`a159fab9-6ca9-4ab2-bc40-54cb6d28591a`::moving from state init -> state preparing
>Thread-4253::INFO::2014-04-10 18:16:38,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4253::INFO::2014-04-10 18:16:38,905::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4253::DEBUG::2014-04-10 18:16:38,905::task::1168::TaskManager.Task::(prepare) Task=`a159fab9-6ca9-4ab2-bc40-54cb6d28591a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4253::DEBUG::2014-04-10 18:16:38,905::task::579::TaskManager.Task::(_updateState) Task=`a159fab9-6ca9-4ab2-bc40-54cb6d28591a`::moving from state preparing -> state finished
>Thread-4253::DEBUG::2014-04-10 18:16:38,905::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4253::DEBUG::2014-04-10 18:16:38,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4253::DEBUG::2014-04-10 18:16:38,906::task::974::TaskManager.Task::(_decref) Task=`a159fab9-6ca9-4ab2-bc40-54cb6d28591a`::ref 0 aborting False
>Thread-4254::DEBUG::2014-04-10 18:16:38,912::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4254::DEBUG::2014-04-10 18:16:38,913::task::579::TaskManager.Task::(_updateState) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::moving from state init -> state preparing
>Thread-4254::INFO::2014-04-10 18:16:38,913::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4254::DEBUG::2014-04-10 18:16:38,913::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3da9ddd-15b2-4eab-96a6-d319c08a9364`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4254::DEBUG::2014-04-10 18:16:38,913::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4254::DEBUG::2014-04-10 18:16:38,914::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4254::DEBUG::2014-04-10 18:16:38,914::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3da9ddd-15b2-4eab-96a6-d319c08a9364`::Granted request
>Thread-4254::DEBUG::2014-04-10 18:16:38,914::task::811::TaskManager.Task::(resourceAcquired) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4254::DEBUG::2014-04-10 18:16:38,914::task::974::TaskManager.Task::(_decref) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::ref 1 aborting False
>Thread-4254::INFO::2014-04-10 18:16:38,916::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4254::DEBUG::2014-04-10 18:16:38,916::task::1168::TaskManager.Task::(prepare) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::task::579::TaskManager.Task::(_updateState) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::moving from state preparing -> state finished
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4254::DEBUG::2014-04-10 18:16:38,917::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4254::DEBUG::2014-04-10 18:16:38,918::task::974::TaskManager.Task::(_decref) Task=`207981e1-81c3-4973-8c4c-4ec8943eb4e4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:39,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:39,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000343308 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:39,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:39,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374035 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:39,495::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:39,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000501612 s, 734 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:39,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:39,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000481661 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4255::DEBUG::2014-04-10 18:16:41,007::task::579::TaskManager.Task::(_updateState) Task=`81dab68b-ff2b-4af8-8ca1-00447a81b041`::moving from state init -> state preparing
>Thread-4255::INFO::2014-04-10 18:16:41,007::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4255::INFO::2014-04-10 18:16:41,007::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481661', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343308', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374035', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501612', 'lastCheck': '1.5', 'valid': True}}
>Thread-4255::DEBUG::2014-04-10 18:16:41,007::task::1168::TaskManager.Task::(prepare) Task=`81dab68b-ff2b-4af8-8ca1-00447a81b041`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481661', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343308', 'lastCheck': '1.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374035', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501612', 'lastCheck': '1.5', 'valid': True}}
>Thread-4255::DEBUG::2014-04-10 18:16:41,008::task::579::TaskManager.Task::(_updateState) Task=`81dab68b-ff2b-4af8-8ca1-00447a81b041`::moving from state preparing -> state finished
>Thread-4255::DEBUG::2014-04-10 18:16:41,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4255::DEBUG::2014-04-10 18:16:41,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4255::DEBUG::2014-04-10 18:16:41,008::task::974::TaskManager.Task::(_decref) Task=`81dab68b-ff2b-4af8-8ca1-00447a81b041`::ref 0 aborting False
>Thread-4259::DEBUG::2014-04-10 18:16:48,993::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4259::DEBUG::2014-04-10 18:16:48,993::task::579::TaskManager.Task::(_updateState) Task=`eb24446f-b7d8-4983-b372-d93c5be76969`::moving from state init -> state preparing
>Thread-4259::INFO::2014-04-10 18:16:48,994::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4259::INFO::2014-04-10 18:16:48,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4259::DEBUG::2014-04-10 18:16:48,994::task::1168::TaskManager.Task::(prepare) Task=`eb24446f-b7d8-4983-b372-d93c5be76969`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4259::DEBUG::2014-04-10 18:16:48,994::task::579::TaskManager.Task::(_updateState) Task=`eb24446f-b7d8-4983-b372-d93c5be76969`::moving from state preparing -> state finished
>Thread-4259::DEBUG::2014-04-10 18:16:48,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4259::DEBUG::2014-04-10 18:16:48,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4259::DEBUG::2014-04-10 18:16:48,995::task::974::TaskManager.Task::(_decref) Task=`eb24446f-b7d8-4983-b372-d93c5be76969`::ref 0 aborting False
>Thread-4260::DEBUG::2014-04-10 18:16:49,001::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4260::DEBUG::2014-04-10 18:16:49,002::task::579::TaskManager.Task::(_updateState) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::moving from state init -> state preparing
>Thread-4260::INFO::2014-04-10 18:16:49,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4260::DEBUG::2014-04-10 18:16:49,003::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3285b1af-0c6b-41b0-8235-e86533e47c66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4260::DEBUG::2014-04-10 18:16:49,003::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4260::DEBUG::2014-04-10 18:16:49,003::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4260::DEBUG::2014-04-10 18:16:49,003::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3285b1af-0c6b-41b0-8235-e86533e47c66`::Granted request
>Thread-4260::DEBUG::2014-04-10 18:16:49,004::task::811::TaskManager.Task::(resourceAcquired) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4260::DEBUG::2014-04-10 18:16:49,004::task::974::TaskManager.Task::(_decref) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::ref 1 aborting False
>Thread-4260::INFO::2014-04-10 18:16:49,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::task::1168::TaskManager.Task::(prepare) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::task::579::TaskManager.Task::(_updateState) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::moving from state preparing -> state finished
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4260::DEBUG::2014-04-10 18:16:49,007::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4260::DEBUG::2014-04-10 18:16:49,008::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4260::DEBUG::2014-04-10 18:16:49,008::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4260::DEBUG::2014-04-10 18:16:49,008::task::974::TaskManager.Task::(_decref) Task=`0105a671-d140-4c41-aaf8-a4cb6128ccda`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:49,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:49,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354263 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:49,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:49,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348418 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:49,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:49,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045604 s, 807 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:49,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:49,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000439977 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4263::DEBUG::2014-04-10 18:16:56,182::task::579::TaskManager.Task::(_updateState) Task=`ce67763a-74ab-486a-8d5c-f90b6a8c79a9`::moving from state init -> state preparing
>Thread-4263::INFO::2014-04-10 18:16:56,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4263::INFO::2014-04-10 18:16:56,182::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439977', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354263', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348418', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045604', 'lastCheck': '6.7', 'valid': True}}
>Thread-4263::DEBUG::2014-04-10 18:16:56,183::task::1168::TaskManager.Task::(prepare) Task=`ce67763a-74ab-486a-8d5c-f90b6a8c79a9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439977', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354263', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348418', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045604', 'lastCheck': '6.7', 'valid': True}}
>Thread-4263::DEBUG::2014-04-10 18:16:56,183::task::579::TaskManager.Task::(_updateState) Task=`ce67763a-74ab-486a-8d5c-f90b6a8c79a9`::moving from state preparing -> state finished
>Thread-4263::DEBUG::2014-04-10 18:16:56,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4263::DEBUG::2014-04-10 18:16:56,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4263::DEBUG::2014-04-10 18:16:56,183::task::974::TaskManager.Task::(_decref) Task=`ce67763a-74ab-486a-8d5c-f90b6a8c79a9`::ref 0 aborting False
>Thread-4265::DEBUG::2014-04-10 18:16:59,083::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4265::DEBUG::2014-04-10 18:16:59,083::task::579::TaskManager.Task::(_updateState) Task=`34861964-7eee-4e0d-b97d-72732fd912d0`::moving from state init -> state preparing
>Thread-4265::INFO::2014-04-10 18:16:59,084::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4265::INFO::2014-04-10 18:16:59,084::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4265::DEBUG::2014-04-10 18:16:59,084::task::1168::TaskManager.Task::(prepare) Task=`34861964-7eee-4e0d-b97d-72732fd912d0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4265::DEBUG::2014-04-10 18:16:59,084::task::579::TaskManager.Task::(_updateState) Task=`34861964-7eee-4e0d-b97d-72732fd912d0`::moving from state preparing -> state finished
>Thread-4265::DEBUG::2014-04-10 18:16:59,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4265::DEBUG::2014-04-10 18:16:59,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4265::DEBUG::2014-04-10 18:16:59,085::task::974::TaskManager.Task::(_decref) Task=`34861964-7eee-4e0d-b97d-72732fd912d0`::ref 0 aborting False
>Thread-4266::DEBUG::2014-04-10 18:16:59,091::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4266::DEBUG::2014-04-10 18:16:59,091::task::579::TaskManager.Task::(_updateState) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::moving from state init -> state preparing
>Thread-4266::INFO::2014-04-10 18:16:59,091::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4266::DEBUG::2014-04-10 18:16:59,092::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`126a8d5b-e3ab-40c6-b13c-f7a0de5ae76a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4266::DEBUG::2014-04-10 18:16:59,092::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4266::DEBUG::2014-04-10 18:16:59,092::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4266::DEBUG::2014-04-10 18:16:59,092::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`126a8d5b-e3ab-40c6-b13c-f7a0de5ae76a`::Granted request
>Thread-4266::DEBUG::2014-04-10 18:16:59,093::task::811::TaskManager.Task::(resourceAcquired) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4266::DEBUG::2014-04-10 18:16:59,093::task::974::TaskManager.Task::(_decref) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::ref 1 aborting False
>Thread-4266::INFO::2014-04-10 18:16:59,095::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4266::DEBUG::2014-04-10 18:16:59,095::task::1168::TaskManager.Task::(prepare) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4266::DEBUG::2014-04-10 18:16:59,095::task::579::TaskManager.Task::(_updateState) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::moving from state preparing -> state finished
>Thread-4266::DEBUG::2014-04-10 18:16:59,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4266::DEBUG::2014-04-10 18:16:59,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4266::DEBUG::2014-04-10 18:16:59,096::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4266::DEBUG::2014-04-10 18:16:59,096::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4266::DEBUG::2014-04-10 18:16:59,096::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4266::DEBUG::2014-04-10 18:16:59,096::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4266::DEBUG::2014-04-10 18:16:59,096::task::974::TaskManager.Task::(_decref) Task=`23322520-f680-4e7c-a19e-a57a1c5abf26`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:16:59,244::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:16:59,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000405732 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:16:59,406::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:16:59,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382647 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:16:59,519::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:16:59,536::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:16:59,537::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:16:59,543::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:16:59,544::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:16:59,544::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:16:59,544::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:16:59,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:16:59,557::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000367647 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:16:59,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:16:59,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00036377 s, 1.8 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:17:09,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:09,264::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000424098 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:09,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:09,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355484 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4275::DEBUG::2014-04-10 18:17:09,512::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4275::DEBUG::2014-04-10 18:17:09,513::task::579::TaskManager.Task::(_updateState) Task=`065117df-093d-4847-b23c-ce32b6ac6263`::moving from state init -> state preparing
>Thread-4275::INFO::2014-04-10 18:17:09,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4275::INFO::2014-04-10 18:17:09,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4275::DEBUG::2014-04-10 18:17:09,513::task::1168::TaskManager.Task::(prepare) Task=`065117df-093d-4847-b23c-ce32b6ac6263`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4275::DEBUG::2014-04-10 18:17:09,514::task::579::TaskManager.Task::(_updateState) Task=`065117df-093d-4847-b23c-ce32b6ac6263`::moving from state preparing -> state finished
>Thread-4275::DEBUG::2014-04-10 18:17:09,514::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4275::DEBUG::2014-04-10 18:17:09,514::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4275::DEBUG::2014-04-10 18:17:09,514::task::974::TaskManager.Task::(_decref) Task=`065117df-093d-4847-b23c-ce32b6ac6263`::ref 0 aborting False
>Thread-4276::DEBUG::2014-04-10 18:17:09,521::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4276::DEBUG::2014-04-10 18:17:09,521::task::579::TaskManager.Task::(_updateState) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::moving from state init -> state preparing
>Thread-4276::INFO::2014-04-10 18:17:09,522::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4276::DEBUG::2014-04-10 18:17:09,522::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1160c47b-c3b5-4d9d-a777-f99c1bc428b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4276::DEBUG::2014-04-10 18:17:09,522::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4276::DEBUG::2014-04-10 18:17:09,523::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4276::DEBUG::2014-04-10 18:17:09,523::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1160c47b-c3b5-4d9d-a777-f99c1bc428b2`::Granted request
>Thread-4276::DEBUG::2014-04-10 18:17:09,523::task::811::TaskManager.Task::(resourceAcquired) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4276::DEBUG::2014-04-10 18:17:09,523::task::974::TaskManager.Task::(_decref) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::ref 1 aborting False
>Thread-4276::INFO::2014-04-10 18:17:09,526::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4276::DEBUG::2014-04-10 18:17:09,526::task::1168::TaskManager.Task::(prepare) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4276::DEBUG::2014-04-10 18:17:09,526::task::579::TaskManager.Task::(_updateState) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::moving from state preparing -> state finished
>Thread-4276::DEBUG::2014-04-10 18:17:09,526::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4276::DEBUG::2014-04-10 18:17:09,526::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4276::DEBUG::2014-04-10 18:17:09,527::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4276::DEBUG::2014-04-10 18:17:09,527::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4276::DEBUG::2014-04-10 18:17:09,527::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4276::DEBUG::2014-04-10 18:17:09,527::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4276::DEBUG::2014-04-10 18:17:09,527::task::974::TaskManager.Task::(_decref) Task=`9bd1cb17-fb94-4970-81d0-32ed46209fcb`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:17:09,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:09,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000495011 s, 743 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:17:09,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:09,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473252 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4277::DEBUG::2014-04-10 18:17:11,354::task::579::TaskManager.Task::(_updateState) Task=`b2ee541f-5ed3-4824-b0d7-a9e8a2dc84a4`::moving from state init -> state preparing
>Thread-4277::INFO::2014-04-10 18:17:11,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4277::INFO::2014-04-10 18:17:11,355::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473252', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424098', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355484', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495011', 'lastCheck': '1.8', 'valid': True}}
>Thread-4277::DEBUG::2014-04-10 18:17:11,355::task::1168::TaskManager.Task::(prepare) Task=`b2ee541f-5ed3-4824-b0d7-a9e8a2dc84a4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473252', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000424098', 'lastCheck': '2.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355484', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495011', 'lastCheck': '1.8', 'valid': True}}
>Thread-4277::DEBUG::2014-04-10 18:17:11,355::task::579::TaskManager.Task::(_updateState) Task=`b2ee541f-5ed3-4824-b0d7-a9e8a2dc84a4`::moving from state preparing -> state finished
>Thread-4277::DEBUG::2014-04-10 18:17:11,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4277::DEBUG::2014-04-10 18:17:11,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4277::DEBUG::2014-04-10 18:17:11,355::task::974::TaskManager.Task::(_decref) Task=`b2ee541f-5ed3-4824-b0d7-a9e8a2dc84a4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:17:19,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:19,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000410029 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:19,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:19,439::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390207 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:17:19,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:19,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000364365 s, 1.0 MB/s\n'; <rc> = 0
>Thread-4281::DEBUG::2014-04-10 18:17:19,613::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4281::DEBUG::2014-04-10 18:17:19,614::task::579::TaskManager.Task::(_updateState) Task=`ddbe2eb6-a1c6-4ee7-9472-4ac242846459`::moving from state init -> state preparing
>Thread-4281::INFO::2014-04-10 18:17:19,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4281::INFO::2014-04-10 18:17:19,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4281::DEBUG::2014-04-10 18:17:19,615::task::1168::TaskManager.Task::(prepare) Task=`ddbe2eb6-a1c6-4ee7-9472-4ac242846459`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4281::DEBUG::2014-04-10 18:17:19,615::task::579::TaskManager.Task::(_updateState) Task=`ddbe2eb6-a1c6-4ee7-9472-4ac242846459`::moving from state preparing -> state finished
>Thread-4281::DEBUG::2014-04-10 18:17:19,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4281::DEBUG::2014-04-10 18:17:19,615::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4281::DEBUG::2014-04-10 18:17:19,616::task::974::TaskManager.Task::(_decref) Task=`ddbe2eb6-a1c6-4ee7-9472-4ac242846459`::ref 0 aborting False
>Thread-4282::DEBUG::2014-04-10 18:17:19,622::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4282::DEBUG::2014-04-10 18:17:19,623::task::579::TaskManager.Task::(_updateState) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::moving from state init -> state preparing
>Thread-4282::INFO::2014-04-10 18:17:19,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4282::DEBUG::2014-04-10 18:17:19,623::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8ec961e-d49e-4bba-a0ec-1bac549bdf2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4282::DEBUG::2014-04-10 18:17:19,624::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4282::DEBUG::2014-04-10 18:17:19,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4282::DEBUG::2014-04-10 18:17:19,624::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8ec961e-d49e-4bba-a0ec-1bac549bdf2e`::Granted request
>Thread-4282::DEBUG::2014-04-10 18:17:19,624::task::811::TaskManager.Task::(resourceAcquired) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4282::DEBUG::2014-04-10 18:17:19,625::task::974::TaskManager.Task::(_decref) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::ref 1 aborting False
>Thread-4282::INFO::2014-04-10 18:17:19,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4282::DEBUG::2014-04-10 18:17:19,627::task::1168::TaskManager.Task::(prepare) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4282::DEBUG::2014-04-10 18:17:19,627::task::579::TaskManager.Task::(_updateState) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::moving from state preparing -> state finished
>Thread-4282::DEBUG::2014-04-10 18:17:19,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4282::DEBUG::2014-04-10 18:17:19,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4282::DEBUG::2014-04-10 18:17:19,628::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4282::DEBUG::2014-04-10 18:17:19,628::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4282::DEBUG::2014-04-10 18:17:19,628::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4282::DEBUG::2014-04-10 18:17:19,628::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4282::DEBUG::2014-04-10 18:17:19,629::task::974::TaskManager.Task::(_decref) Task=`1ab8a2bf-f6c0-469d-9dc8-ab330c6ffdb7`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:17:19,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:19,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496857 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4285::DEBUG::2014-04-10 18:17:26,566::task::579::TaskManager.Task::(_updateState) Task=`eb887f97-a290-4046-b3c4-dc074fee2d1f`::moving from state init -> state preparing
>Thread-4285::INFO::2014-04-10 18:17:26,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4285::INFO::2014-04-10 18:17:26,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496857', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410029', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390207', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364365', 'lastCheck': '7.0', 'valid': True}}
>Thread-4285::DEBUG::2014-04-10 18:17:26,567::task::1168::TaskManager.Task::(prepare) Task=`eb887f97-a290-4046-b3c4-dc074fee2d1f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496857', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410029', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390207', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364365', 'lastCheck': '7.0', 'valid': True}}
>Thread-4285::DEBUG::2014-04-10 18:17:26,567::task::579::TaskManager.Task::(_updateState) Task=`eb887f97-a290-4046-b3c4-dc074fee2d1f`::moving from state preparing -> state finished
>Thread-4285::DEBUG::2014-04-10 18:17:26,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4285::DEBUG::2014-04-10 18:17:26,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4285::DEBUG::2014-04-10 18:17:26,568::task::974::TaskManager.Task::(_decref) Task=`eb887f97-a290-4046-b3c4-dc074fee2d1f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:17:29,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:29,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365108 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:29,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:29,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379726 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:17:29,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:29,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000494864 s, 744 kB/s\n'; <rc> = 0
>Thread-4288::DEBUG::2014-04-10 18:17:29,711::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-4288::DEBUG::2014-04-10 18:17:29,712::task::579::TaskManager.Task::(_updateState) Task=`a42c9dc7-1017-4324-8408-52f7bc04e776`::moving from state init -> state preparing
>Thread-4288::INFO::2014-04-10 18:17:29,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4288::INFO::2014-04-10 18:17:29,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4288::DEBUG::2014-04-10 18:17:29,712::task::1168::TaskManager.Task::(prepare) Task=`a42c9dc7-1017-4324-8408-52f7bc04e776`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4288::DEBUG::2014-04-10 18:17:29,712::task::579::TaskManager.Task::(_updateState) Task=`a42c9dc7-1017-4324-8408-52f7bc04e776`::moving from state preparing -> state finished
>Thread-4288::DEBUG::2014-04-10 18:17:29,713::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4288::DEBUG::2014-04-10 18:17:29,713::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4288::DEBUG::2014-04-10 18:17:29,713::task::974::TaskManager.Task::(_decref) Task=`a42c9dc7-1017-4324-8408-52f7bc04e776`::ref 0 aborting False
>Thread-4289::DEBUG::2014-04-10 18:17:29,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [49f31e30]
>Thread-4289::DEBUG::2014-04-10 18:17:29,720::task::579::TaskManager.Task::(_updateState) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::moving from state init -> state preparing
>Thread-4289::INFO::2014-04-10 18:17:29,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4289::DEBUG::2014-04-10 18:17:29,722::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dd5a0169-138e-4169-8f30-38d7fc1d2d20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4289::DEBUG::2014-04-10 18:17:29,722::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4289::DEBUG::2014-04-10 18:17:29,722::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4289::DEBUG::2014-04-10 18:17:29,722::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dd5a0169-138e-4169-8f30-38d7fc1d2d20`::Granted request
>Thread-4289::DEBUG::2014-04-10 18:17:29,723::task::811::TaskManager.Task::(resourceAcquired) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4289::DEBUG::2014-04-10 18:17:29,723::task::974::TaskManager.Task::(_decref) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::ref 1 aborting False
>Thread-4289::INFO::2014-04-10 18:17:29,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4289::DEBUG::2014-04-10 18:17:29,725::task::1168::TaskManager.Task::(prepare) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::task::579::TaskManager.Task::(_updateState) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::moving from state preparing -> state finished
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4289::DEBUG::2014-04-10 18:17:29,726::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4289::DEBUG::2014-04-10 18:17:29,727::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4289::DEBUG::2014-04-10 18:17:29,727::task::974::TaskManager.Task::(_decref) Task=`dc001e50-7cdb-4aef-9404-17ddd414ad68`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:17:29,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:29,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000505548 s, 1.3 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:17:39,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:39,307::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000422523 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:39,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:39,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398339 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:17:39,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:39,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000457174 s, 805 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:17:39,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:39,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00045612 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4293::DEBUG::2014-04-10 18:17:39,821::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4293::DEBUG::2014-04-10 18:17:39,822::task::579::TaskManager.Task::(_updateState) Task=`817d6062-1014-468c-9750-3b36e7795856`::moving from state init -> state preparing
>Thread-4293::INFO::2014-04-10 18:17:39,822::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4293::INFO::2014-04-10 18:17:39,823::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4293::DEBUG::2014-04-10 18:17:39,823::task::1168::TaskManager.Task::(prepare) Task=`817d6062-1014-468c-9750-3b36e7795856`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4293::DEBUG::2014-04-10 18:17:39,823::task::579::TaskManager.Task::(_updateState) Task=`817d6062-1014-468c-9750-3b36e7795856`::moving from state preparing -> state finished
>Thread-4293::DEBUG::2014-04-10 18:17:39,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4293::DEBUG::2014-04-10 18:17:39,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4293::DEBUG::2014-04-10 18:17:39,823::task::974::TaskManager.Task::(_decref) Task=`817d6062-1014-468c-9750-3b36e7795856`::ref 0 aborting False
>Thread-4294::DEBUG::2014-04-10 18:17:39,830::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4294::DEBUG::2014-04-10 18:17:39,830::task::579::TaskManager.Task::(_updateState) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::moving from state init -> state preparing
>Thread-4294::INFO::2014-04-10 18:17:39,831::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4294::DEBUG::2014-04-10 18:17:39,831::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8907f581-011b-48fa-b36d-053930cdb7b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4294::DEBUG::2014-04-10 18:17:39,831::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4294::DEBUG::2014-04-10 18:17:39,831::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4294::DEBUG::2014-04-10 18:17:39,832::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8907f581-011b-48fa-b36d-053930cdb7b4`::Granted request
>Thread-4294::DEBUG::2014-04-10 18:17:39,832::task::811::TaskManager.Task::(resourceAcquired) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4294::DEBUG::2014-04-10 18:17:39,832::task::974::TaskManager.Task::(_decref) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::ref 1 aborting False
>Thread-4294::INFO::2014-04-10 18:17:39,834::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4294::DEBUG::2014-04-10 18:17:39,834::task::1168::TaskManager.Task::(prepare) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4294::DEBUG::2014-04-10 18:17:39,835::task::579::TaskManager.Task::(_updateState) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::moving from state preparing -> state finished
>Thread-4294::DEBUG::2014-04-10 18:17:39,835::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4294::DEBUG::2014-04-10 18:17:39,835::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4294::DEBUG::2014-04-10 18:17:39,835::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4294::DEBUG::2014-04-10 18:17:39,835::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4294::DEBUG::2014-04-10 18:17:39,836::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4294::DEBUG::2014-04-10 18:17:39,836::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4294::DEBUG::2014-04-10 18:17:39,836::task::974::TaskManager.Task::(_decref) Task=`1a8c37d0-78e8-4690-9884-53efc24eacfb`::ref 0 aborting False
>Thread-4295::DEBUG::2014-04-10 18:17:42,320::task::579::TaskManager.Task::(_updateState) Task=`3c2d1748-615a-42c7-a902-ecf9dbf54938`::moving from state init -> state preparing
>Thread-4295::INFO::2014-04-10 18:17:42,320::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4295::INFO::2014-04-10 18:17:42,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045612', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422523', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398339', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457174', 'lastCheck': '2.7', 'valid': True}}
>Thread-4295::DEBUG::2014-04-10 18:17:42,321::task::1168::TaskManager.Task::(prepare) Task=`3c2d1748-615a-42c7-a902-ecf9dbf54938`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045612', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422523', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398339', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457174', 'lastCheck': '2.7', 'valid': True}}
>Thread-4295::DEBUG::2014-04-10 18:17:42,321::task::579::TaskManager.Task::(_updateState) Task=`3c2d1748-615a-42c7-a902-ecf9dbf54938`::moving from state preparing -> state finished
>Thread-4295::DEBUG::2014-04-10 18:17:42,321::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4295::DEBUG::2014-04-10 18:17:42,321::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4295::DEBUG::2014-04-10 18:17:42,321::task::974::TaskManager.Task::(_decref) Task=`3c2d1748-615a-42c7-a902-ecf9dbf54938`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:17:49,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:49,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00041178 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:49,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:49,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000401592 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:17:49,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:49,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474194 s, 776 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:17:49,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:49,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000456729 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4299::DEBUG::2014-04-10 18:17:49,918::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4299::DEBUG::2014-04-10 18:17:49,919::task::579::TaskManager.Task::(_updateState) Task=`b4fbf872-33e2-4f30-bbcf-e224c5516d08`::moving from state init -> state preparing
>Thread-4299::INFO::2014-04-10 18:17:49,919::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4299::INFO::2014-04-10 18:17:49,919::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4299::DEBUG::2014-04-10 18:17:49,920::task::1168::TaskManager.Task::(prepare) Task=`b4fbf872-33e2-4f30-bbcf-e224c5516d08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4299::DEBUG::2014-04-10 18:17:49,920::task::579::TaskManager.Task::(_updateState) Task=`b4fbf872-33e2-4f30-bbcf-e224c5516d08`::moving from state preparing -> state finished
>Thread-4299::DEBUG::2014-04-10 18:17:49,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4299::DEBUG::2014-04-10 18:17:49,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4299::DEBUG::2014-04-10 18:17:49,920::task::974::TaskManager.Task::(_decref) Task=`b4fbf872-33e2-4f30-bbcf-e224c5516d08`::ref 0 aborting False
>Thread-4300::DEBUG::2014-04-10 18:17:49,927::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4300::DEBUG::2014-04-10 18:17:49,927::task::579::TaskManager.Task::(_updateState) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::moving from state init -> state preparing
>Thread-4300::INFO::2014-04-10 18:17:49,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4300::DEBUG::2014-04-10 18:17:49,928::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5772f4c8-c181-44b0-912a-d0ebc4542cae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4300::DEBUG::2014-04-10 18:17:49,928::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4300::DEBUG::2014-04-10 18:17:49,928::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4300::DEBUG::2014-04-10 18:17:49,928::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5772f4c8-c181-44b0-912a-d0ebc4542cae`::Granted request
>Thread-4300::DEBUG::2014-04-10 18:17:49,929::task::811::TaskManager.Task::(resourceAcquired) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4300::DEBUG::2014-04-10 18:17:49,929::task::974::TaskManager.Task::(_decref) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::ref 1 aborting False
>Thread-4300::INFO::2014-04-10 18:17:49,931::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4300::DEBUG::2014-04-10 18:17:49,931::task::1168::TaskManager.Task::(prepare) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::task::579::TaskManager.Task::(_updateState) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::moving from state preparing -> state finished
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4300::DEBUG::2014-04-10 18:17:49,932::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4300::DEBUG::2014-04-10 18:17:49,933::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4300::DEBUG::2014-04-10 18:17:49,933::task::974::TaskManager.Task::(_decref) Task=`9fb4d883-8baa-4b6c-b129-d51a013c67b8`::ref 0 aborting False
>Thread-4303::DEBUG::2014-04-10 18:17:57,698::task::579::TaskManager.Task::(_updateState) Task=`2f6641a3-0c42-4646-b197-fbf3af67845e`::moving from state init -> state preparing
>Thread-4303::INFO::2014-04-10 18:17:57,699::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4303::INFO::2014-04-10 18:17:57,699::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456729', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041178', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401592', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474194', 'lastCheck': '8.1', 'valid': True}}
>Thread-4303::DEBUG::2014-04-10 18:17:57,699::task::1168::TaskManager.Task::(prepare) Task=`2f6641a3-0c42-4646-b197-fbf3af67845e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456729', 'lastCheck': '7.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041178', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401592', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474194', 'lastCheck': '8.1', 'valid': True}}
>Thread-4303::DEBUG::2014-04-10 18:17:57,700::task::579::TaskManager.Task::(_updateState) Task=`2f6641a3-0c42-4646-b197-fbf3af67845e`::moving from state preparing -> state finished
>Thread-4303::DEBUG::2014-04-10 18:17:57,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4303::DEBUG::2014-04-10 18:17:57,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4303::DEBUG::2014-04-10 18:17:57,700::task::974::TaskManager.Task::(_decref) Task=`2f6641a3-0c42-4646-b197-fbf3af67845e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:17:59,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:17:59,335::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373019 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:17:59,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:17:59,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381765 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:17:59,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:17:59,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000449342 s, 819 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:17:59,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:17:59,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000547334 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4305::DEBUG::2014-04-10 18:18:00,025::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-4305::DEBUG::2014-04-10 18:18:00,025::task::579::TaskManager.Task::(_updateState) Task=`dbd7c63d-8efd-42f6-b3e5-e084ac9c21bf`::moving from state init -> state preparing
>Thread-4305::INFO::2014-04-10 18:18:00,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4305::INFO::2014-04-10 18:18:00,026::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4305::DEBUG::2014-04-10 18:18:00,026::task::1168::TaskManager.Task::(prepare) Task=`dbd7c63d-8efd-42f6-b3e5-e084ac9c21bf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4305::DEBUG::2014-04-10 18:18:00,026::task::579::TaskManager.Task::(_updateState) Task=`dbd7c63d-8efd-42f6-b3e5-e084ac9c21bf`::moving from state preparing -> state finished
>Thread-4305::DEBUG::2014-04-10 18:18:00,027::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4305::DEBUG::2014-04-10 18:18:00,027::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4305::DEBUG::2014-04-10 18:18:00,027::task::974::TaskManager.Task::(_decref) Task=`dbd7c63d-8efd-42f6-b3e5-e084ac9c21bf`::ref 0 aborting False
>Thread-4306::DEBUG::2014-04-10 18:18:00,034::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-4306::DEBUG::2014-04-10 18:18:00,034::task::579::TaskManager.Task::(_updateState) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::moving from state init -> state preparing
>Thread-4306::INFO::2014-04-10 18:18:00,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4306::DEBUG::2014-04-10 18:18:00,035::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3b6960f2-2a5e-48cb-a664-5d1dbb8b7e3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4306::DEBUG::2014-04-10 18:18:00,035::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4306::DEBUG::2014-04-10 18:18:00,036::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4306::DEBUG::2014-04-10 18:18:00,036::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3b6960f2-2a5e-48cb-a664-5d1dbb8b7e3a`::Granted request
>Thread-4306::DEBUG::2014-04-10 18:18:00,036::task::811::TaskManager.Task::(resourceAcquired) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4306::DEBUG::2014-04-10 18:18:00,036::task::974::TaskManager.Task::(_decref) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::ref 1 aborting False
>Thread-4306::INFO::2014-04-10 18:18:00,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4306::DEBUG::2014-04-10 18:18:00,039::task::1168::TaskManager.Task::(prepare) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4306::DEBUG::2014-04-10 18:18:00,039::task::579::TaskManager.Task::(_updateState) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::moving from state preparing -> state finished
>Thread-4306::DEBUG::2014-04-10 18:18:00,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4306::DEBUG::2014-04-10 18:18:00,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4306::DEBUG::2014-04-10 18:18:00,040::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4306::DEBUG::2014-04-10 18:18:00,040::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4306::DEBUG::2014-04-10 18:18:00,040::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4306::DEBUG::2014-04-10 18:18:00,040::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4306::DEBUG::2014-04-10 18:18:00,040::task::974::TaskManager.Task::(_decref) Task=`97c74e24-3ba9-4c9a-b02b-49991e57941e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:09,343::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:09,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383062 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:09,507::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:09,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382479 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:09,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:09,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000364144 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:09,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:09,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00051582 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4311::DEBUG::2014-04-10 18:18:10,122::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4311::DEBUG::2014-04-10 18:18:10,123::task::579::TaskManager.Task::(_updateState) Task=`f3878610-bf71-4681-8f15-ebba6c3883ec`::moving from state init -> state preparing
>Thread-4311::INFO::2014-04-10 18:18:10,123::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4311::INFO::2014-04-10 18:18:10,123::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4311::DEBUG::2014-04-10 18:18:10,123::task::1168::TaskManager.Task::(prepare) Task=`f3878610-bf71-4681-8f15-ebba6c3883ec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4311::DEBUG::2014-04-10 18:18:10,124::task::579::TaskManager.Task::(_updateState) Task=`f3878610-bf71-4681-8f15-ebba6c3883ec`::moving from state preparing -> state finished
>Thread-4311::DEBUG::2014-04-10 18:18:10,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4311::DEBUG::2014-04-10 18:18:10,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4311::DEBUG::2014-04-10 18:18:10,124::task::974::TaskManager.Task::(_decref) Task=`f3878610-bf71-4681-8f15-ebba6c3883ec`::ref 0 aborting False
>Thread-4312::DEBUG::2014-04-10 18:18:10,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4312::DEBUG::2014-04-10 18:18:10,131::task::579::TaskManager.Task::(_updateState) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::moving from state init -> state preparing
>Thread-4312::INFO::2014-04-10 18:18:10,131::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4312::DEBUG::2014-04-10 18:18:10,131::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a342fddd-58e6-4615-8bf8-58039c4864a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4312::DEBUG::2014-04-10 18:18:10,131::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4312::DEBUG::2014-04-10 18:18:10,132::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4312::DEBUG::2014-04-10 18:18:10,132::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a342fddd-58e6-4615-8bf8-58039c4864a2`::Granted request
>Thread-4312::DEBUG::2014-04-10 18:18:10,133::task::811::TaskManager.Task::(resourceAcquired) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4312::DEBUG::2014-04-10 18:18:10,133::task::974::TaskManager.Task::(_decref) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::ref 1 aborting False
>Thread-4312::INFO::2014-04-10 18:18:10,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4312::DEBUG::2014-04-10 18:18:10,135::task::1168::TaskManager.Task::(prepare) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4312::DEBUG::2014-04-10 18:18:10,135::task::579::TaskManager.Task::(_updateState) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::moving from state preparing -> state finished
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4312::DEBUG::2014-04-10 18:18:10,136::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4312::DEBUG::2014-04-10 18:18:10,137::task::974::TaskManager.Task::(_decref) Task=`36644419-d498-446a-aa6c-ff87ad114abe`::ref 0 aborting False
>Thread-4313::DEBUG::2014-04-10 18:18:12,870::task::579::TaskManager.Task::(_updateState) Task=`52cde860-cb65-4ab5-99d4-2f0c087288c6`::moving from state init -> state preparing
>Thread-4313::INFO::2014-04-10 18:18:12,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4313::INFO::2014-04-10 18:18:12,871::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051582', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383062', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382479', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364144', 'lastCheck': '3.2', 'valid': True}}
>Thread-4313::DEBUG::2014-04-10 18:18:12,871::task::1168::TaskManager.Task::(prepare) Task=`52cde860-cb65-4ab5-99d4-2f0c087288c6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051582', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383062', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382479', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364144', 'lastCheck': '3.2', 'valid': True}}
>Thread-4313::DEBUG::2014-04-10 18:18:12,871::task::579::TaskManager.Task::(_updateState) Task=`52cde860-cb65-4ab5-99d4-2f0c087288c6`::moving from state preparing -> state finished
>Thread-4313::DEBUG::2014-04-10 18:18:12,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4313::DEBUG::2014-04-10 18:18:12,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4313::DEBUG::2014-04-10 18:18:12,872::task::974::TaskManager.Task::(_decref) Task=`52cde860-cb65-4ab5-99d4-2f0c087288c6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:19,358::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:19,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420232 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:19,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:19,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365135 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:19,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:19,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000429202 s, 857 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:19,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:19,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000435297 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4317::DEBUG::2014-04-10 18:18:20,229::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4317::DEBUG::2014-04-10 18:18:20,229::task::579::TaskManager.Task::(_updateState) Task=`ef0c0a73-50c6-4d17-a5d5-1e023d76db6a`::moving from state init -> state preparing
>Thread-4317::INFO::2014-04-10 18:18:20,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4317::INFO::2014-04-10 18:18:20,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4317::DEBUG::2014-04-10 18:18:20,230::task::1168::TaskManager.Task::(prepare) Task=`ef0c0a73-50c6-4d17-a5d5-1e023d76db6a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4317::DEBUG::2014-04-10 18:18:20,230::task::579::TaskManager.Task::(_updateState) Task=`ef0c0a73-50c6-4d17-a5d5-1e023d76db6a`::moving from state preparing -> state finished
>Thread-4317::DEBUG::2014-04-10 18:18:20,230::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4317::DEBUG::2014-04-10 18:18:20,230::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4317::DEBUG::2014-04-10 18:18:20,231::task::974::TaskManager.Task::(_decref) Task=`ef0c0a73-50c6-4d17-a5d5-1e023d76db6a`::ref 0 aborting False
>Thread-4318::DEBUG::2014-04-10 18:18:20,236::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4318::DEBUG::2014-04-10 18:18:20,236::task::579::TaskManager.Task::(_updateState) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::moving from state init -> state preparing
>Thread-4318::INFO::2014-04-10 18:18:20,236::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4318::DEBUG::2014-04-10 18:18:20,237::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7524173f-b67a-428b-ac06-9fccb38ff1cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4318::DEBUG::2014-04-10 18:18:20,237::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4318::DEBUG::2014-04-10 18:18:20,237::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4318::DEBUG::2014-04-10 18:18:20,238::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7524173f-b67a-428b-ac06-9fccb38ff1cd`::Granted request
>Thread-4318::DEBUG::2014-04-10 18:18:20,238::task::811::TaskManager.Task::(resourceAcquired) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4318::DEBUG::2014-04-10 18:18:20,238::task::974::TaskManager.Task::(_decref) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::ref 1 aborting False
>Thread-4318::INFO::2014-04-10 18:18:20,240::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4318::DEBUG::2014-04-10 18:18:20,240::task::1168::TaskManager.Task::(prepare) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4318::DEBUG::2014-04-10 18:18:20,241::task::579::TaskManager.Task::(_updateState) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::moving from state preparing -> state finished
>Thread-4318::DEBUG::2014-04-10 18:18:20,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4318::DEBUG::2014-04-10 18:18:20,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4318::DEBUG::2014-04-10 18:18:20,241::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4318::DEBUG::2014-04-10 18:18:20,242::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4318::DEBUG::2014-04-10 18:18:20,242::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4318::DEBUG::2014-04-10 18:18:20,242::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4318::DEBUG::2014-04-10 18:18:20,242::task::974::TaskManager.Task::(_decref) Task=`e6b88770-fd46-4868-b4c3-e5a6011819ae`::ref 0 aborting False
>Thread-4321::DEBUG::2014-04-10 18:18:28,530::task::579::TaskManager.Task::(_updateState) Task=`74075293-8d70-4320-8489-a1396dfec968`::moving from state init -> state preparing
>Thread-4321::INFO::2014-04-10 18:18:28,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4321::INFO::2014-04-10 18:18:28,531::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435297', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420232', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365135', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429202', 'lastCheck': '8.8', 'valid': True}}
>Thread-4321::DEBUG::2014-04-10 18:18:28,531::task::1168::TaskManager.Task::(prepare) Task=`74075293-8d70-4320-8489-a1396dfec968`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000435297', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420232', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365135', 'lastCheck': '9.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429202', 'lastCheck': '8.8', 'valid': True}}
>Thread-4321::DEBUG::2014-04-10 18:18:28,531::task::579::TaskManager.Task::(_updateState) Task=`74075293-8d70-4320-8489-a1396dfec968`::moving from state preparing -> state finished
>Thread-4321::DEBUG::2014-04-10 18:18:28,531::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4321::DEBUG::2014-04-10 18:18:28,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4321::DEBUG::2014-04-10 18:18:28,532::task::974::TaskManager.Task::(_decref) Task=`74075293-8d70-4320-8489-a1396dfec968`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:29,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:29,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000568431 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:29,535::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:29,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000408846 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:29,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:29,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442708 s, 831 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:29,852::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:18:29,866::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:18:29,868::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:18:29,873::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:18:29,875::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:18:29,875::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:18:29,875::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:18:29,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:29,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000389375 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4327::DEBUG::2014-04-10 18:18:30,329::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4327::DEBUG::2014-04-10 18:18:30,329::task::579::TaskManager.Task::(_updateState) Task=`1e67fb86-cf5c-492f-a78b-81459421494d`::moving from state init -> state preparing
>Thread-4327::INFO::2014-04-10 18:18:30,330::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4327::INFO::2014-04-10 18:18:30,330::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4327::DEBUG::2014-04-10 18:18:30,330::task::1168::TaskManager.Task::(prepare) Task=`1e67fb86-cf5c-492f-a78b-81459421494d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4327::DEBUG::2014-04-10 18:18:30,330::task::579::TaskManager.Task::(_updateState) Task=`1e67fb86-cf5c-492f-a78b-81459421494d`::moving from state preparing -> state finished
>Thread-4327::DEBUG::2014-04-10 18:18:30,331::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4327::DEBUG::2014-04-10 18:18:30,331::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4327::DEBUG::2014-04-10 18:18:30,331::task::974::TaskManager.Task::(_decref) Task=`1e67fb86-cf5c-492f-a78b-81459421494d`::ref 0 aborting False
>Thread-4328::DEBUG::2014-04-10 18:18:30,337::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4328::DEBUG::2014-04-10 18:18:30,338::task::579::TaskManager.Task::(_updateState) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::moving from state init -> state preparing
>Thread-4328::INFO::2014-04-10 18:18:30,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4328::DEBUG::2014-04-10 18:18:30,338::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d68b9f-5e73-49a0-8721-817108f37951`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4328::DEBUG::2014-04-10 18:18:30,339::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4328::DEBUG::2014-04-10 18:18:30,339::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4328::DEBUG::2014-04-10 18:18:30,339::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d68b9f-5e73-49a0-8721-817108f37951`::Granted request
>Thread-4328::DEBUG::2014-04-10 18:18:30,339::task::811::TaskManager.Task::(resourceAcquired) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4328::DEBUG::2014-04-10 18:18:30,340::task::974::TaskManager.Task::(_decref) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::ref 1 aborting False
>Thread-4328::INFO::2014-04-10 18:18:30,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4328::DEBUG::2014-04-10 18:18:30,342::task::1168::TaskManager.Task::(prepare) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4328::DEBUG::2014-04-10 18:18:30,342::task::579::TaskManager.Task::(_updateState) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::moving from state preparing -> state finished
>Thread-4328::DEBUG::2014-04-10 18:18:30,342::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4328::DEBUG::2014-04-10 18:18:30,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4328::DEBUG::2014-04-10 18:18:30,343::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4328::DEBUG::2014-04-10 18:18:30,343::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4328::DEBUG::2014-04-10 18:18:30,343::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4328::DEBUG::2014-04-10 18:18:30,343::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4328::DEBUG::2014-04-10 18:18:30,344::task::974::TaskManager.Task::(_decref) Task=`5ae2ff08-b4ab-437b-afb2-414e8fdec029`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:39,387::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:39,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000493919 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:39,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:39,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375702 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:39,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:39,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000458614 s, 802 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:39,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:39,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000447983 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4332::DEBUG::2014-04-10 18:18:40,437::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4332::DEBUG::2014-04-10 18:18:40,437::task::579::TaskManager.Task::(_updateState) Task=`9bf1defc-90a6-42ff-a930-e733088cd4ee`::moving from state init -> state preparing
>Thread-4332::INFO::2014-04-10 18:18:40,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4332::INFO::2014-04-10 18:18:40,438::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4332::DEBUG::2014-04-10 18:18:40,438::task::1168::TaskManager.Task::(prepare) Task=`9bf1defc-90a6-42ff-a930-e733088cd4ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4332::DEBUG::2014-04-10 18:18:40,438::task::579::TaskManager.Task::(_updateState) Task=`9bf1defc-90a6-42ff-a930-e733088cd4ee`::moving from state preparing -> state finished
>Thread-4332::DEBUG::2014-04-10 18:18:40,438::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4332::DEBUG::2014-04-10 18:18:40,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4332::DEBUG::2014-04-10 18:18:40,439::task::974::TaskManager.Task::(_decref) Task=`9bf1defc-90a6-42ff-a930-e733088cd4ee`::ref 0 aborting False
>Thread-4333::DEBUG::2014-04-10 18:18:40,445::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4333::DEBUG::2014-04-10 18:18:40,446::task::579::TaskManager.Task::(_updateState) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::moving from state init -> state preparing
>Thread-4333::INFO::2014-04-10 18:18:40,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4333::DEBUG::2014-04-10 18:18:40,446::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e886f31f-a245-4f99-9184-be2229f50628`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4333::DEBUG::2014-04-10 18:18:40,446::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4333::DEBUG::2014-04-10 18:18:40,447::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4333::DEBUG::2014-04-10 18:18:40,447::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e886f31f-a245-4f99-9184-be2229f50628`::Granted request
>Thread-4333::DEBUG::2014-04-10 18:18:40,447::task::811::TaskManager.Task::(resourceAcquired) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4333::DEBUG::2014-04-10 18:18:40,447::task::974::TaskManager.Task::(_decref) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::ref 1 aborting False
>Thread-4333::INFO::2014-04-10 18:18:40,449::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4333::DEBUG::2014-04-10 18:18:40,449::task::1168::TaskManager.Task::(prepare) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::task::579::TaskManager.Task::(_updateState) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::moving from state preparing -> state finished
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4333::DEBUG::2014-04-10 18:18:40,450::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4333::DEBUG::2014-04-10 18:18:40,451::task::974::TaskManager.Task::(_decref) Task=`b0aebd55-605b-4997-90f1-00147ba12d0e`::ref 0 aborting False
>Thread-4335::DEBUG::2014-04-10 18:18:43,702::task::579::TaskManager.Task::(_updateState) Task=`3eb501d0-84b9-49ef-acb3-4ab978c5d599`::moving from state init -> state preparing
>Thread-4335::INFO::2014-04-10 18:18:43,702::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4335::INFO::2014-04-10 18:18:43,703::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447983', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493919', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375702', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458614', 'lastCheck': '4.0', 'valid': True}}
>Thread-4335::DEBUG::2014-04-10 18:18:43,703::task::1168::TaskManager.Task::(prepare) Task=`3eb501d0-84b9-49ef-acb3-4ab978c5d599`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447983', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493919', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375702', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458614', 'lastCheck': '4.0', 'valid': True}}
>Thread-4335::DEBUG::2014-04-10 18:18:43,703::task::579::TaskManager.Task::(_updateState) Task=`3eb501d0-84b9-49ef-acb3-4ab978c5d599`::moving from state preparing -> state finished
>Thread-4335::DEBUG::2014-04-10 18:18:43,703::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4335::DEBUG::2014-04-10 18:18:43,703::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4335::DEBUG::2014-04-10 18:18:43,703::task::974::TaskManager.Task::(_decref) Task=`3eb501d0-84b9-49ef-acb3-4ab978c5d599`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:49,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:49,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000418743 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:49,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:49,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340981 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:49,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:49,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000404597 s, 910 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:49,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:49,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000392779 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4339::DEBUG::2014-04-10 18:18:50,535::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-4339::DEBUG::2014-04-10 18:18:50,535::task::579::TaskManager.Task::(_updateState) Task=`54d48e99-2466-48bd-b5af-e76a0ead5e4e`::moving from state init -> state preparing
>Thread-4339::INFO::2014-04-10 18:18:50,535::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4339::INFO::2014-04-10 18:18:50,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4339::DEBUG::2014-04-10 18:18:50,536::task::1168::TaskManager.Task::(prepare) Task=`54d48e99-2466-48bd-b5af-e76a0ead5e4e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4339::DEBUG::2014-04-10 18:18:50,536::task::579::TaskManager.Task::(_updateState) Task=`54d48e99-2466-48bd-b5af-e76a0ead5e4e`::moving from state preparing -> state finished
>Thread-4339::DEBUG::2014-04-10 18:18:50,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4339::DEBUG::2014-04-10 18:18:50,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4339::DEBUG::2014-04-10 18:18:50,537::task::974::TaskManager.Task::(_decref) Task=`54d48e99-2466-48bd-b5af-e76a0ead5e4e`::ref 0 aborting False
>Thread-4340::DEBUG::2014-04-10 18:18:50,544::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-4340::DEBUG::2014-04-10 18:18:50,544::task::579::TaskManager.Task::(_updateState) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::moving from state init -> state preparing
>Thread-4340::INFO::2014-04-10 18:18:50,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4340::DEBUG::2014-04-10 18:18:50,545::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76e56ec3-4286-4ebb-8f61-4d900a660c21`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4340::DEBUG::2014-04-10 18:18:50,545::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4340::DEBUG::2014-04-10 18:18:50,546::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4340::DEBUG::2014-04-10 18:18:50,547::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76e56ec3-4286-4ebb-8f61-4d900a660c21`::Granted request
>Thread-4340::DEBUG::2014-04-10 18:18:50,547::task::811::TaskManager.Task::(resourceAcquired) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4340::DEBUG::2014-04-10 18:18:50,547::task::974::TaskManager.Task::(_decref) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::ref 1 aborting False
>Thread-4340::INFO::2014-04-10 18:18:50,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4340::DEBUG::2014-04-10 18:18:50,549::task::1168::TaskManager.Task::(prepare) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4340::DEBUG::2014-04-10 18:18:50,550::task::579::TaskManager.Task::(_updateState) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::moving from state preparing -> state finished
>Thread-4340::DEBUG::2014-04-10 18:18:50,550::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4340::DEBUG::2014-04-10 18:18:50,550::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4340::DEBUG::2014-04-10 18:18:50,550::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4340::DEBUG::2014-04-10 18:18:50,551::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4340::DEBUG::2014-04-10 18:18:50,551::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4340::DEBUG::2014-04-10 18:18:50,551::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4340::DEBUG::2014-04-10 18:18:50,551::task::974::TaskManager.Task::(_decref) Task=`70e7b461-01e8-499b-abe3-ccd5eea3e4fc`::ref 0 aborting False
>Thread-4343::DEBUG::2014-04-10 18:18:58,859::task::579::TaskManager.Task::(_updateState) Task=`6a47f522-c4cd-45b7-81c0-55ea74a11e29`::moving from state init -> state preparing
>Thread-4343::INFO::2014-04-10 18:18:58,860::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4343::INFO::2014-04-10 18:18:58,860::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392779', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418743', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340981', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404597', 'lastCheck': '9.1', 'valid': True}}
>Thread-4343::DEBUG::2014-04-10 18:18:58,860::task::1168::TaskManager.Task::(prepare) Task=`6a47f522-c4cd-45b7-81c0-55ea74a11e29`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392779', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418743', 'lastCheck': '9.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340981', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404597', 'lastCheck': '9.1', 'valid': True}}
>Thread-4343::DEBUG::2014-04-10 18:18:58,860::task::579::TaskManager.Task::(_updateState) Task=`6a47f522-c4cd-45b7-81c0-55ea74a11e29`::moving from state preparing -> state finished
>Thread-4343::DEBUG::2014-04-10 18:18:58,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4343::DEBUG::2014-04-10 18:18:58,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4343::DEBUG::2014-04-10 18:18:58,861::task::974::TaskManager.Task::(_decref) Task=`6a47f522-c4cd-45b7-81c0-55ea74a11e29`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:18:59,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:18:59,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302306 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:18:59,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:18:59,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000422269 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:18:59,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:18:59,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000432456 s, 851 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:18:59,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:18:59,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000493128 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4345::DEBUG::2014-04-10 18:19:00,641::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-4345::DEBUG::2014-04-10 18:19:00,641::task::579::TaskManager.Task::(_updateState) Task=`5df4662d-8d01-4a57-b474-18d9d5abe018`::moving from state init -> state preparing
>Thread-4345::INFO::2014-04-10 18:19:00,641::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4345::INFO::2014-04-10 18:19:00,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4345::DEBUG::2014-04-10 18:19:00,642::task::1168::TaskManager.Task::(prepare) Task=`5df4662d-8d01-4a57-b474-18d9d5abe018`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4345::DEBUG::2014-04-10 18:19:00,642::task::579::TaskManager.Task::(_updateState) Task=`5df4662d-8d01-4a57-b474-18d9d5abe018`::moving from state preparing -> state finished
>Thread-4345::DEBUG::2014-04-10 18:19:00,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4345::DEBUG::2014-04-10 18:19:00,643::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4345::DEBUG::2014-04-10 18:19:00,643::task::974::TaskManager.Task::(_decref) Task=`5df4662d-8d01-4a57-b474-18d9d5abe018`::ref 0 aborting False
>Thread-4346::DEBUG::2014-04-10 18:19:00,649::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-4346::DEBUG::2014-04-10 18:19:00,649::task::579::TaskManager.Task::(_updateState) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::moving from state init -> state preparing
>Thread-4346::INFO::2014-04-10 18:19:00,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4346::DEBUG::2014-04-10 18:19:00,650::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`afd30dd8-124b-4edf-a6f3-bb268cdd0240`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4346::DEBUG::2014-04-10 18:19:00,650::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4346::DEBUG::2014-04-10 18:19:00,651::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4346::DEBUG::2014-04-10 18:19:00,651::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`afd30dd8-124b-4edf-a6f3-bb268cdd0240`::Granted request
>Thread-4346::DEBUG::2014-04-10 18:19:00,651::task::811::TaskManager.Task::(resourceAcquired) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4346::DEBUG::2014-04-10 18:19:00,651::task::974::TaskManager.Task::(_decref) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::ref 1 aborting False
>Thread-4346::INFO::2014-04-10 18:19:00,653::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4346::DEBUG::2014-04-10 18:19:00,654::task::1168::TaskManager.Task::(prepare) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4346::DEBUG::2014-04-10 18:19:00,654::task::579::TaskManager.Task::(_updateState) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::moving from state preparing -> state finished
>Thread-4346::DEBUG::2014-04-10 18:19:00,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4346::DEBUG::2014-04-10 18:19:00,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4346::DEBUG::2014-04-10 18:19:00,654::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4346::DEBUG::2014-04-10 18:19:00,655::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4346::DEBUG::2014-04-10 18:19:00,655::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4346::DEBUG::2014-04-10 18:19:00,655::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4346::DEBUG::2014-04-10 18:19:00,655::task::974::TaskManager.Task::(_decref) Task=`a2933e1a-7fba-43d0-be25-f268eec951c1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:09,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:09,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372668 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:19:09,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:09,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000401264 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:09,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:09,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000443318 s, 830 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:19:09,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:19:09,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00045601 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4350::DEBUG::2014-04-10 18:19:10,748::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4350::DEBUG::2014-04-10 18:19:10,749::task::579::TaskManager.Task::(_updateState) Task=`b53f30ce-b090-44ef-a580-8f8524b12f03`::moving from state init -> state preparing
>Thread-4350::INFO::2014-04-10 18:19:10,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4350::INFO::2014-04-10 18:19:10,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4350::DEBUG::2014-04-10 18:19:10,749::task::1168::TaskManager.Task::(prepare) Task=`b53f30ce-b090-44ef-a580-8f8524b12f03`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4350::DEBUG::2014-04-10 18:19:10,749::task::579::TaskManager.Task::(_updateState) Task=`b53f30ce-b090-44ef-a580-8f8524b12f03`::moving from state preparing -> state finished
>Thread-4350::DEBUG::2014-04-10 18:19:10,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4350::DEBUG::2014-04-10 18:19:10,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4350::DEBUG::2014-04-10 18:19:10,750::task::974::TaskManager.Task::(_decref) Task=`b53f30ce-b090-44ef-a580-8f8524b12f03`::ref 0 aborting False
>Thread-4351::DEBUG::2014-04-10 18:19:10,757::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4351::DEBUG::2014-04-10 18:19:10,757::task::579::TaskManager.Task::(_updateState) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::moving from state init -> state preparing
>Thread-4351::INFO::2014-04-10 18:19:10,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4351::DEBUG::2014-04-10 18:19:10,758::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4668672-0a2b-43a9-9069-88513ddf276f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4351::DEBUG::2014-04-10 18:19:10,758::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4351::DEBUG::2014-04-10 18:19:10,758::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4351::DEBUG::2014-04-10 18:19:10,758::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4668672-0a2b-43a9-9069-88513ddf276f`::Granted request
>Thread-4351::DEBUG::2014-04-10 18:19:10,759::task::811::TaskManager.Task::(resourceAcquired) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4351::DEBUG::2014-04-10 18:19:10,759::task::974::TaskManager.Task::(_decref) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::ref 1 aborting False
>Thread-4351::INFO::2014-04-10 18:19:10,761::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4351::DEBUG::2014-04-10 18:19:10,761::task::1168::TaskManager.Task::(prepare) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4351::DEBUG::2014-04-10 18:19:10,761::task::579::TaskManager.Task::(_updateState) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::moving from state preparing -> state finished
>Thread-4351::DEBUG::2014-04-10 18:19:10,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4351::DEBUG::2014-04-10 18:19:10,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4351::DEBUG::2014-04-10 18:19:10,761::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4351::DEBUG::2014-04-10 18:19:10,762::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4351::DEBUG::2014-04-10 18:19:10,762::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4351::DEBUG::2014-04-10 18:19:10,762::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4351::DEBUG::2014-04-10 18:19:10,762::task::974::TaskManager.Task::(_decref) Task=`eca51d3f-40a1-4783-acbc-cd7130e29d80`::ref 0 aborting False
>Thread-4353::DEBUG::2014-04-10 18:19:14,024::task::579::TaskManager.Task::(_updateState) Task=`da46f5c5-8cc9-4ee8-91ab-3909c57feb4c`::moving from state init -> state preparing
>Thread-4353::INFO::2014-04-10 18:19:14,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4353::INFO::2014-04-10 18:19:14,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045601', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372668', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401264', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443318', 'lastCheck': '4.3', 'valid': True}}
>Thread-4353::DEBUG::2014-04-10 18:19:14,025::task::1168::TaskManager.Task::(prepare) Task=`da46f5c5-8cc9-4ee8-91ab-3909c57feb4c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045601', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372668', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401264', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443318', 'lastCheck': '4.3', 'valid': True}}
>Thread-4353::DEBUG::2014-04-10 18:19:14,025::task::579::TaskManager.Task::(_updateState) Task=`da46f5c5-8cc9-4ee8-91ab-3909c57feb4c`::moving from state preparing -> state finished
>Thread-4353::DEBUG::2014-04-10 18:19:14,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4353::DEBUG::2014-04-10 18:19:14,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4353::DEBUG::2014-04-10 18:19:14,025::task::974::TaskManager.Task::(_decref) Task=`da46f5c5-8cc9-4ee8-91ab-3909c57feb4c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:19,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:19,451::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000413703 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:19:19,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:19,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360106 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:19,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:19,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000445235 s, 827 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:19:19,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:19:19,962::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429188 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4357::DEBUG::2014-04-10 18:19:20,854::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4357::DEBUG::2014-04-10 18:19:20,854::task::579::TaskManager.Task::(_updateState) Task=`311dfcfd-0503-400e-916c-cc672ab1f6aa`::moving from state init -> state preparing
>Thread-4357::INFO::2014-04-10 18:19:20,855::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4357::INFO::2014-04-10 18:19:20,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4357::DEBUG::2014-04-10 18:19:20,855::task::1168::TaskManager.Task::(prepare) Task=`311dfcfd-0503-400e-916c-cc672ab1f6aa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4357::DEBUG::2014-04-10 18:19:20,855::task::579::TaskManager.Task::(_updateState) Task=`311dfcfd-0503-400e-916c-cc672ab1f6aa`::moving from state preparing -> state finished
>Thread-4357::DEBUG::2014-04-10 18:19:20,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4357::DEBUG::2014-04-10 18:19:20,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4357::DEBUG::2014-04-10 18:19:20,856::task::974::TaskManager.Task::(_decref) Task=`311dfcfd-0503-400e-916c-cc672ab1f6aa`::ref 0 aborting False
>Thread-4358::DEBUG::2014-04-10 18:19:20,863::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4358::DEBUG::2014-04-10 18:19:20,863::task::579::TaskManager.Task::(_updateState) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::moving from state init -> state preparing
>Thread-4358::INFO::2014-04-10 18:19:20,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4358::DEBUG::2014-04-10 18:19:20,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20700a63-2eaf-40f9-a758-b0c98e79e41d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4358::DEBUG::2014-04-10 18:19:20,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4358::DEBUG::2014-04-10 18:19:20,865::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4358::DEBUG::2014-04-10 18:19:20,865::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20700a63-2eaf-40f9-a758-b0c98e79e41d`::Granted request
>Thread-4358::DEBUG::2014-04-10 18:19:20,865::task::811::TaskManager.Task::(resourceAcquired) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4358::DEBUG::2014-04-10 18:19:20,865::task::974::TaskManager.Task::(_decref) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::ref 1 aborting False
>Thread-4358::INFO::2014-04-10 18:19:20,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4358::DEBUG::2014-04-10 18:19:20,868::task::1168::TaskManager.Task::(prepare) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4358::DEBUG::2014-04-10 18:19:20,868::task::579::TaskManager.Task::(_updateState) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::moving from state preparing -> state finished
>Thread-4358::DEBUG::2014-04-10 18:19:20,868::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4358::DEBUG::2014-04-10 18:19:20,868::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4358::DEBUG::2014-04-10 18:19:20,869::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4358::DEBUG::2014-04-10 18:19:20,869::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4358::DEBUG::2014-04-10 18:19:20,869::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4358::DEBUG::2014-04-10 18:19:20,869::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4358::DEBUG::2014-04-10 18:19:20,869::task::974::TaskManager.Task::(_decref) Task=`4d3a54eb-bba3-44a9-a9f5-69512b1a65ff`::ref 0 aborting False
>Thread-4361::DEBUG::2014-04-10 18:19:29,195::task::579::TaskManager.Task::(_updateState) Task=`b2a1a3a1-e8ce-4440-bd66-70d66d3af2a7`::moving from state init -> state preparing
>Thread-4361::INFO::2014-04-10 18:19:29,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4361::INFO::2014-04-10 18:19:29,196::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429188', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413703', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360106', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445235', 'lastCheck': '9.4', 'valid': True}}
>Thread-4361::DEBUG::2014-04-10 18:19:29,196::task::1168::TaskManager.Task::(prepare) Task=`b2a1a3a1-e8ce-4440-bd66-70d66d3af2a7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429188', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413703', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360106', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445235', 'lastCheck': '9.4', 'valid': True}}
>Thread-4361::DEBUG::2014-04-10 18:19:29,196::task::579::TaskManager.Task::(_updateState) Task=`b2a1a3a1-e8ce-4440-bd66-70d66d3af2a7`::moving from state preparing -> state finished
>Thread-4361::DEBUG::2014-04-10 18:19:29,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4361::DEBUG::2014-04-10 18:19:29,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4361::DEBUG::2014-04-10 18:19:29,197::task::974::TaskManager.Task::(_decref) Task=`b2a1a3a1-e8ce-4440-bd66-70d66d3af2a7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:29,458::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:29,465::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342033 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:19:29,617::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:29,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379129 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:29,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:29,790::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000429679 s, 856 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:19:29,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:19:29,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000561754 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4363::DEBUG::2014-04-10 18:19:30,953::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4363::DEBUG::2014-04-10 18:19:30,954::task::579::TaskManager.Task::(_updateState) Task=`2f781737-25a1-4123-b901-d507ce73be97`::moving from state init -> state preparing
>Thread-4363::INFO::2014-04-10 18:19:30,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4363::INFO::2014-04-10 18:19:30,954::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4363::DEBUG::2014-04-10 18:19:30,954::task::1168::TaskManager.Task::(prepare) Task=`2f781737-25a1-4123-b901-d507ce73be97`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4363::DEBUG::2014-04-10 18:19:30,955::task::579::TaskManager.Task::(_updateState) Task=`2f781737-25a1-4123-b901-d507ce73be97`::moving from state preparing -> state finished
>Thread-4363::DEBUG::2014-04-10 18:19:30,955::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4363::DEBUG::2014-04-10 18:19:30,955::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4363::DEBUG::2014-04-10 18:19:30,955::task::974::TaskManager.Task::(_decref) Task=`2f781737-25a1-4123-b901-d507ce73be97`::ref 0 aborting False
>Thread-4364::DEBUG::2014-04-10 18:19:30,962::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4364::DEBUG::2014-04-10 18:19:30,963::task::579::TaskManager.Task::(_updateState) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::moving from state init -> state preparing
>Thread-4364::INFO::2014-04-10 18:19:30,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4364::DEBUG::2014-04-10 18:19:30,963::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4927cead-b02c-496e-9744-28e7a58d7181`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4364::DEBUG::2014-04-10 18:19:30,964::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4364::DEBUG::2014-04-10 18:19:30,964::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4364::DEBUG::2014-04-10 18:19:30,964::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4927cead-b02c-496e-9744-28e7a58d7181`::Granted request
>Thread-4364::DEBUG::2014-04-10 18:19:30,965::task::811::TaskManager.Task::(resourceAcquired) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4364::DEBUG::2014-04-10 18:19:30,966::task::974::TaskManager.Task::(_decref) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::ref 1 aborting False
>Thread-4364::INFO::2014-04-10 18:19:30,968::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4364::DEBUG::2014-04-10 18:19:30,968::task::1168::TaskManager.Task::(prepare) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4364::DEBUG::2014-04-10 18:19:30,968::task::579::TaskManager.Task::(_updateState) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::moving from state preparing -> state finished
>Thread-4364::DEBUG::2014-04-10 18:19:30,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4364::DEBUG::2014-04-10 18:19:30,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4364::DEBUG::2014-04-10 18:19:30,969::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4364::DEBUG::2014-04-10 18:19:30,969::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4364::DEBUG::2014-04-10 18:19:30,969::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4364::DEBUG::2014-04-10 18:19:30,969::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4364::DEBUG::2014-04-10 18:19:30,969::task::974::TaskManager.Task::(_decref) Task=`17b3d255-eaba-4ab5-a798-691af27c2572`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:39,473::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:39,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000403436 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:19:39,631::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:39,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342978 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:39,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:39,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047492 s, 775 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:19:39,986::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:19:39,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000402786 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4368::DEBUG::2014-04-10 18:19:41,061::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4368::DEBUG::2014-04-10 18:19:41,074::task::579::TaskManager.Task::(_updateState) Task=`88d4f36d-0515-4d9e-99c6-31bbce2e4170`::moving from state init -> state preparing
>Thread-4368::INFO::2014-04-10 18:19:41,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4368::INFO::2014-04-10 18:19:41,074::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4368::DEBUG::2014-04-10 18:19:41,074::task::1168::TaskManager.Task::(prepare) Task=`88d4f36d-0515-4d9e-99c6-31bbce2e4170`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4368::DEBUG::2014-04-10 18:19:41,074::task::579::TaskManager.Task::(_updateState) Task=`88d4f36d-0515-4d9e-99c6-31bbce2e4170`::moving from state preparing -> state finished
>Thread-4368::DEBUG::2014-04-10 18:19:41,075::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4368::DEBUG::2014-04-10 18:19:41,075::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4368::DEBUG::2014-04-10 18:19:41,075::task::974::TaskManager.Task::(_decref) Task=`88d4f36d-0515-4d9e-99c6-31bbce2e4170`::ref 0 aborting False
>Thread-4369::DEBUG::2014-04-10 18:19:41,081::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4369::DEBUG::2014-04-10 18:19:41,082::task::579::TaskManager.Task::(_updateState) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::moving from state init -> state preparing
>Thread-4369::INFO::2014-04-10 18:19:41,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4369::DEBUG::2014-04-10 18:19:41,083::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad089805-63f4-4cb7-9ab4-88a05c78e5c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4369::DEBUG::2014-04-10 18:19:41,083::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4369::DEBUG::2014-04-10 18:19:41,083::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4369::DEBUG::2014-04-10 18:19:41,083::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad089805-63f4-4cb7-9ab4-88a05c78e5c7`::Granted request
>Thread-4369::DEBUG::2014-04-10 18:19:41,084::task::811::TaskManager.Task::(resourceAcquired) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4369::DEBUG::2014-04-10 18:19:41,084::task::974::TaskManager.Task::(_decref) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::ref 1 aborting False
>Thread-4369::INFO::2014-04-10 18:19:41,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4369::DEBUG::2014-04-10 18:19:41,086::task::1168::TaskManager.Task::(prepare) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4369::DEBUG::2014-04-10 18:19:41,086::task::579::TaskManager.Task::(_updateState) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::moving from state preparing -> state finished
>Thread-4369::DEBUG::2014-04-10 18:19:41,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4369::DEBUG::2014-04-10 18:19:41,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4369::DEBUG::2014-04-10 18:19:41,086::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4369::DEBUG::2014-04-10 18:19:41,087::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4369::DEBUG::2014-04-10 18:19:41,087::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4369::DEBUG::2014-04-10 18:19:41,087::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4369::DEBUG::2014-04-10 18:19:41,087::task::974::TaskManager.Task::(_decref) Task=`8fb70d35-4d4e-4b61-bfad-f8f938d587d0`::ref 0 aborting False
>Thread-4371::DEBUG::2014-04-10 18:19:44,368::task::579::TaskManager.Task::(_updateState) Task=`2d25133a-0406-473a-95ab-73def798b77a`::moving from state init -> state preparing
>Thread-4371::INFO::2014-04-10 18:19:44,368::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4371::INFO::2014-04-10 18:19:44,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402786', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403436', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342978', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047492', 'lastCheck': '4.6', 'valid': True}}
>Thread-4371::DEBUG::2014-04-10 18:19:44,369::task::1168::TaskManager.Task::(prepare) Task=`2d25133a-0406-473a-95ab-73def798b77a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402786', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403436', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342978', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047492', 'lastCheck': '4.6', 'valid': True}}
>Thread-4371::DEBUG::2014-04-10 18:19:44,369::task::579::TaskManager.Task::(_updateState) Task=`2d25133a-0406-473a-95ab-73def798b77a`::moving from state preparing -> state finished
>Thread-4371::DEBUG::2014-04-10 18:19:44,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4371::DEBUG::2014-04-10 18:19:44,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4371::DEBUG::2014-04-10 18:19:44,369::task::974::TaskManager.Task::(_decref) Task=`2d25133a-0406-473a-95ab-73def798b77a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:49,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:49,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000499336 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:19:49,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:49,651::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350745 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:49,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:49,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000606626 s, 607 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:19:50,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:19:50,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000471628 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4375::DEBUG::2014-04-10 18:19:51,166::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4375::DEBUG::2014-04-10 18:19:51,166::task::579::TaskManager.Task::(_updateState) Task=`9203f21f-911c-4836-b18c-e5eac0d874d9`::moving from state init -> state preparing
>Thread-4375::INFO::2014-04-10 18:19:51,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4375::INFO::2014-04-10 18:19:51,167::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4375::DEBUG::2014-04-10 18:19:51,167::task::1168::TaskManager.Task::(prepare) Task=`9203f21f-911c-4836-b18c-e5eac0d874d9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4375::DEBUG::2014-04-10 18:19:51,167::task::579::TaskManager.Task::(_updateState) Task=`9203f21f-911c-4836-b18c-e5eac0d874d9`::moving from state preparing -> state finished
>Thread-4375::DEBUG::2014-04-10 18:19:51,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4375::DEBUG::2014-04-10 18:19:51,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4375::DEBUG::2014-04-10 18:19:51,168::task::974::TaskManager.Task::(_decref) Task=`9203f21f-911c-4836-b18c-e5eac0d874d9`::ref 0 aborting False
>Thread-4376::DEBUG::2014-04-10 18:19:51,174::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4376::DEBUG::2014-04-10 18:19:51,175::task::579::TaskManager.Task::(_updateState) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::moving from state init -> state preparing
>Thread-4376::INFO::2014-04-10 18:19:51,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4376::DEBUG::2014-04-10 18:19:51,175::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e61df29-2de6-4649-a6ac-5a7ccc0a69ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4376::DEBUG::2014-04-10 18:19:51,176::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4376::DEBUG::2014-04-10 18:19:51,176::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4376::DEBUG::2014-04-10 18:19:51,176::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e61df29-2de6-4649-a6ac-5a7ccc0a69ae`::Granted request
>Thread-4376::DEBUG::2014-04-10 18:19:51,176::task::811::TaskManager.Task::(resourceAcquired) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4376::DEBUG::2014-04-10 18:19:51,177::task::974::TaskManager.Task::(_decref) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::ref 1 aborting False
>Thread-4376::INFO::2014-04-10 18:19:51,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4376::DEBUG::2014-04-10 18:19:51,179::task::1168::TaskManager.Task::(prepare) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4376::DEBUG::2014-04-10 18:19:51,179::task::579::TaskManager.Task::(_updateState) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::moving from state preparing -> state finished
>Thread-4376::DEBUG::2014-04-10 18:19:51,179::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4376::DEBUG::2014-04-10 18:19:51,180::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4376::DEBUG::2014-04-10 18:19:51,180::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4376::DEBUG::2014-04-10 18:19:51,180::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4376::DEBUG::2014-04-10 18:19:51,180::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4376::DEBUG::2014-04-10 18:19:51,180::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4376::DEBUG::2014-04-10 18:19:51,181::task::974::TaskManager.Task::(_decref) Task=`5e8ecadf-bb76-4487-99aa-95b7cbc2b6d2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:19:59,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:19:59,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000718622 s, 934 kB/s\n'; <rc> = 0
>Thread-4379::DEBUG::2014-04-10 18:19:59,527::task::579::TaskManager.Task::(_updateState) Task=`4092d9cc-2b03-4b89-9fa1-47373f47c604`::moving from state init -> state preparing
>Thread-4379::INFO::2014-04-10 18:19:59,528::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4379::INFO::2014-04-10 18:19:59,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471628', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718622', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350745', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606626', 'lastCheck': '9.7', 'valid': True}}
>Thread-4379::DEBUG::2014-04-10 18:19:59,528::task::1168::TaskManager.Task::(prepare) Task=`4092d9cc-2b03-4b89-9fa1-47373f47c604`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471628', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718622', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350745', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606626', 'lastCheck': '9.7', 'valid': True}}
>Thread-4379::DEBUG::2014-04-10 18:19:59,529::task::579::TaskManager.Task::(_updateState) Task=`4092d9cc-2b03-4b89-9fa1-47373f47c604`::moving from state preparing -> state finished
>Thread-4379::DEBUG::2014-04-10 18:19:59,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4379::DEBUG::2014-04-10 18:19:59,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4379::DEBUG::2014-04-10 18:19:59,529::task::974::TaskManager.Task::(_decref) Task=`4092d9cc-2b03-4b89-9fa1-47373f47c604`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:19:59,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:19:59,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000409381 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:19:59,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:19:59,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000378467 s, 972 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:20:00,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:00,021::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000482158 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4381::DEBUG::2014-04-10 18:20:01,265::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-4381::DEBUG::2014-04-10 18:20:01,265::task::579::TaskManager.Task::(_updateState) Task=`debc8c3a-3459-457d-81c7-f6c00a195823`::moving from state init -> state preparing
>Thread-4381::INFO::2014-04-10 18:20:01,265::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4381::INFO::2014-04-10 18:20:01,266::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4381::DEBUG::2014-04-10 18:20:01,266::task::1168::TaskManager.Task::(prepare) Task=`debc8c3a-3459-457d-81c7-f6c00a195823`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4381::DEBUG::2014-04-10 18:20:01,266::task::579::TaskManager.Task::(_updateState) Task=`debc8c3a-3459-457d-81c7-f6c00a195823`::moving from state preparing -> state finished
>Thread-4381::DEBUG::2014-04-10 18:20:01,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4381::DEBUG::2014-04-10 18:20:01,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4381::DEBUG::2014-04-10 18:20:01,266::task::974::TaskManager.Task::(_decref) Task=`debc8c3a-3459-457d-81c7-f6c00a195823`::ref 0 aborting False
>Thread-4382::DEBUG::2014-04-10 18:20:01,273::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-4382::DEBUG::2014-04-10 18:20:01,274::task::579::TaskManager.Task::(_updateState) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::moving from state init -> state preparing
>Thread-4382::INFO::2014-04-10 18:20:01,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4382::DEBUG::2014-04-10 18:20:01,274::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b739f9d3-b3ca-40c1-b0a7-5c033a6fe6c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4382::DEBUG::2014-04-10 18:20:01,274::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4382::DEBUG::2014-04-10 18:20:01,275::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4382::DEBUG::2014-04-10 18:20:01,275::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b739f9d3-b3ca-40c1-b0a7-5c033a6fe6c7`::Granted request
>Thread-4382::DEBUG::2014-04-10 18:20:01,275::task::811::TaskManager.Task::(resourceAcquired) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4382::DEBUG::2014-04-10 18:20:01,275::task::974::TaskManager.Task::(_decref) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::ref 1 aborting False
>Thread-4382::INFO::2014-04-10 18:20:01,277::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4382::DEBUG::2014-04-10 18:20:01,277::task::1168::TaskManager.Task::(prepare) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::task::579::TaskManager.Task::(_updateState) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::moving from state preparing -> state finished
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4382::DEBUG::2014-04-10 18:20:01,278::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4382::DEBUG::2014-04-10 18:20:01,279::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4382::DEBUG::2014-04-10 18:20:01,279::task::974::TaskManager.Task::(_decref) Task=`ad2869ba-447f-4db6-bfd4-0a71757e8f69`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:09,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:20:09,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365946 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:09,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:09,678::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375774 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:09,840::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:09,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000471647 s, 780 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:20:10,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:10,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468549 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4386::DEBUG::2014-04-10 18:20:11,356::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4386::DEBUG::2014-04-10 18:20:11,357::task::579::TaskManager.Task::(_updateState) Task=`2a8016ce-36d5-4a60-9069-bf794db640ba`::moving from state init -> state preparing
>Thread-4386::INFO::2014-04-10 18:20:11,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4386::INFO::2014-04-10 18:20:11,358::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4386::DEBUG::2014-04-10 18:20:11,358::task::1168::TaskManager.Task::(prepare) Task=`2a8016ce-36d5-4a60-9069-bf794db640ba`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4386::DEBUG::2014-04-10 18:20:11,358::task::579::TaskManager.Task::(_updateState) Task=`2a8016ce-36d5-4a60-9069-bf794db640ba`::moving from state preparing -> state finished
>Thread-4386::DEBUG::2014-04-10 18:20:11,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4386::DEBUG::2014-04-10 18:20:11,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4386::DEBUG::2014-04-10 18:20:11,358::task::974::TaskManager.Task::(_decref) Task=`2a8016ce-36d5-4a60-9069-bf794db640ba`::ref 0 aborting False
>Thread-4387::DEBUG::2014-04-10 18:20:11,365::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4387::DEBUG::2014-04-10 18:20:11,365::task::579::TaskManager.Task::(_updateState) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::moving from state init -> state preparing
>Thread-4387::INFO::2014-04-10 18:20:11,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4387::DEBUG::2014-04-10 18:20:11,366::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03325089-2bcf-45ab-8b3e-d4b8942bbb30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4387::DEBUG::2014-04-10 18:20:11,366::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4387::DEBUG::2014-04-10 18:20:11,366::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4387::DEBUG::2014-04-10 18:20:11,366::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`03325089-2bcf-45ab-8b3e-d4b8942bbb30`::Granted request
>Thread-4387::DEBUG::2014-04-10 18:20:11,368::task::811::TaskManager.Task::(resourceAcquired) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4387::DEBUG::2014-04-10 18:20:11,368::task::974::TaskManager.Task::(_decref) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::ref 1 aborting False
>Thread-4387::INFO::2014-04-10 18:20:11,370::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4387::DEBUG::2014-04-10 18:20:11,370::task::1168::TaskManager.Task::(prepare) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4387::DEBUG::2014-04-10 18:20:11,370::task::579::TaskManager.Task::(_updateState) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::moving from state preparing -> state finished
>Thread-4387::DEBUG::2014-04-10 18:20:11,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4387::DEBUG::2014-04-10 18:20:11,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4387::DEBUG::2014-04-10 18:20:11,371::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4387::DEBUG::2014-04-10 18:20:11,371::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4387::DEBUG::2014-04-10 18:20:11,371::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4387::DEBUG::2014-04-10 18:20:11,371::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4387::DEBUG::2014-04-10 18:20:11,371::task::974::TaskManager.Task::(_decref) Task=`6afa32f6-a9a7-455e-83b6-ec4f95644171`::ref 0 aborting False
>Thread-4389::DEBUG::2014-04-10 18:20:14,721::task::579::TaskManager.Task::(_updateState) Task=`78b178d6-0753-4f5c-91ae-10039d91b273`::moving from state init -> state preparing
>Thread-4389::INFO::2014-04-10 18:20:14,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4389::INFO::2014-04-10 18:20:14,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468549', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365946', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375774', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471647', 'lastCheck': '4.9', 'valid': True}}
>Thread-4389::DEBUG::2014-04-10 18:20:14,722::task::1168::TaskManager.Task::(prepare) Task=`78b178d6-0753-4f5c-91ae-10039d91b273`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468549', 'lastCheck': '4.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365946', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375774', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471647', 'lastCheck': '4.9', 'valid': True}}
>Thread-4389::DEBUG::2014-04-10 18:20:14,722::task::579::TaskManager.Task::(_updateState) Task=`78b178d6-0753-4f5c-91ae-10039d91b273`::moving from state preparing -> state finished
>Thread-4389::DEBUG::2014-04-10 18:20:14,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4389::DEBUG::2014-04-10 18:20:14,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4389::DEBUG::2014-04-10 18:20:14,723::task::974::TaskManager.Task::(_decref) Task=`78b178d6-0753-4f5c-91ae-10039d91b273`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:19,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:20:19,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000473075 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:19,695::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:19,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00259611 s, 258 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:19,856::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:19,864::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464379 s, 792 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:20:20,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:20,051::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468208 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4393::DEBUG::2014-04-10 18:20:21,462::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-4393::DEBUG::2014-04-10 18:20:21,463::task::579::TaskManager.Task::(_updateState) Task=`cf73b1ee-9ff6-4c98-863b-f52aba5bd880`::moving from state init -> state preparing
>Thread-4393::INFO::2014-04-10 18:20:21,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4393::INFO::2014-04-10 18:20:21,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4393::DEBUG::2014-04-10 18:20:21,463::task::1168::TaskManager.Task::(prepare) Task=`cf73b1ee-9ff6-4c98-863b-f52aba5bd880`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4393::DEBUG::2014-04-10 18:20:21,464::task::579::TaskManager.Task::(_updateState) Task=`cf73b1ee-9ff6-4c98-863b-f52aba5bd880`::moving from state preparing -> state finished
>Thread-4393::DEBUG::2014-04-10 18:20:21,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4393::DEBUG::2014-04-10 18:20:21,464::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4393::DEBUG::2014-04-10 18:20:21,464::task::974::TaskManager.Task::(_decref) Task=`cf73b1ee-9ff6-4c98-863b-f52aba5bd880`::ref 0 aborting False
>Thread-4394::DEBUG::2014-04-10 18:20:21,471::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [610954fd]
>Thread-4394::DEBUG::2014-04-10 18:20:21,472::task::579::TaskManager.Task::(_updateState) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::moving from state init -> state preparing
>Thread-4394::INFO::2014-04-10 18:20:21,472::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4394::DEBUG::2014-04-10 18:20:21,473::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`80da9d67-b402-4355-bcc2-f8a3349ea4cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4394::DEBUG::2014-04-10 18:20:21,473::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4394::DEBUG::2014-04-10 18:20:21,473::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4394::DEBUG::2014-04-10 18:20:21,473::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`80da9d67-b402-4355-bcc2-f8a3349ea4cf`::Granted request
>Thread-4394::DEBUG::2014-04-10 18:20:21,474::task::811::TaskManager.Task::(resourceAcquired) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4394::DEBUG::2014-04-10 18:20:21,474::task::974::TaskManager.Task::(_decref) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::ref 1 aborting False
>Thread-4394::INFO::2014-04-10 18:20:21,476::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4394::DEBUG::2014-04-10 18:20:21,476::task::1168::TaskManager.Task::(prepare) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4394::DEBUG::2014-04-10 18:20:21,476::task::579::TaskManager.Task::(_updateState) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::moving from state preparing -> state finished
>Thread-4394::DEBUG::2014-04-10 18:20:21,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4394::DEBUG::2014-04-10 18:20:21,477::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4394::DEBUG::2014-04-10 18:20:21,477::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4394::DEBUG::2014-04-10 18:20:21,477::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4394::DEBUG::2014-04-10 18:20:21,477::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4394::DEBUG::2014-04-10 18:20:21,477::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4394::DEBUG::2014-04-10 18:20:21,478::task::974::TaskManager.Task::(_decref) Task=`f56e1a9a-7624-441a-850f-b9a7d2942953`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:29,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:20:29,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347145 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:29,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:29,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034841 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:29,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:29,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000398265 s, 924 kB/s\n'; <rc> = 0
>Thread-4397::DEBUG::2014-04-10 18:20:29,915::task::579::TaskManager.Task::(_updateState) Task=`05258cb6-0f19-4ac5-8f3f-5c449040b61b`::moving from state init -> state preparing
>Thread-4397::INFO::2014-04-10 18:20:29,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4397::INFO::2014-04-10 18:20:29,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468208', 'lastCheck': '9.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347145', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034841', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398265', 'lastCheck': '0.0', 'valid': True}}
>Thread-4397::DEBUG::2014-04-10 18:20:29,916::task::1168::TaskManager.Task::(prepare) Task=`05258cb6-0f19-4ac5-8f3f-5c449040b61b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468208', 'lastCheck': '9.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347145', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034841', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398265', 'lastCheck': '0.0', 'valid': True}}
>Thread-4397::DEBUG::2014-04-10 18:20:29,916::task::579::TaskManager.Task::(_updateState) Task=`05258cb6-0f19-4ac5-8f3f-5c449040b61b`::moving from state preparing -> state finished
>Thread-4397::DEBUG::2014-04-10 18:20:29,916::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4397::DEBUG::2014-04-10 18:20:29,916::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4397::DEBUG::2014-04-10 18:20:29,917::task::974::TaskManager.Task::(_decref) Task=`05258cb6-0f19-4ac5-8f3f-5c449040b61b`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:20:30,061::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:30,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473233 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4399::DEBUG::2014-04-10 18:20:31,561::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4399::DEBUG::2014-04-10 18:20:31,562::task::579::TaskManager.Task::(_updateState) Task=`19c71758-04a8-4133-a4dc-09446571987d`::moving from state init -> state preparing
>Thread-4399::INFO::2014-04-10 18:20:31,562::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4399::INFO::2014-04-10 18:20:31,562::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4399::DEBUG::2014-04-10 18:20:31,563::task::1168::TaskManager.Task::(prepare) Task=`19c71758-04a8-4133-a4dc-09446571987d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4399::DEBUG::2014-04-10 18:20:31,563::task::579::TaskManager.Task::(_updateState) Task=`19c71758-04a8-4133-a4dc-09446571987d`::moving from state preparing -> state finished
>Thread-4399::DEBUG::2014-04-10 18:20:31,563::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4399::DEBUG::2014-04-10 18:20:31,563::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4399::DEBUG::2014-04-10 18:20:31,563::task::974::TaskManager.Task::(_decref) Task=`19c71758-04a8-4133-a4dc-09446571987d`::ref 0 aborting False
>Thread-4400::DEBUG::2014-04-10 18:20:31,570::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4400::DEBUG::2014-04-10 18:20:31,570::task::579::TaskManager.Task::(_updateState) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::moving from state init -> state preparing
>Thread-4400::INFO::2014-04-10 18:20:31,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4400::DEBUG::2014-04-10 18:20:31,571::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f052356-782e-4283-a794-01d2a80d1505`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4400::DEBUG::2014-04-10 18:20:31,571::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4400::DEBUG::2014-04-10 18:20:31,571::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4400::DEBUG::2014-04-10 18:20:31,571::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f052356-782e-4283-a794-01d2a80d1505`::Granted request
>Thread-4400::DEBUG::2014-04-10 18:20:31,572::task::811::TaskManager.Task::(resourceAcquired) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4400::DEBUG::2014-04-10 18:20:31,572::task::974::TaskManager.Task::(_decref) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::ref 1 aborting False
>Thread-4400::INFO::2014-04-10 18:20:31,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4400::DEBUG::2014-04-10 18:20:31,574::task::1168::TaskManager.Task::(prepare) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4400::DEBUG::2014-04-10 18:20:31,574::task::579::TaskManager.Task::(_updateState) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::moving from state preparing -> state finished
>Thread-4400::DEBUG::2014-04-10 18:20:31,574::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4400::DEBUG::2014-04-10 18:20:31,574::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4400::DEBUG::2014-04-10 18:20:31,575::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4400::DEBUG::2014-04-10 18:20:31,575::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4400::DEBUG::2014-04-10 18:20:31,575::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4400::DEBUG::2014-04-10 18:20:31,575::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4400::DEBUG::2014-04-10 18:20:31,575::task::974::TaskManager.Task::(_decref) Task=`20594b47-fd4b-4bf9-91be-52c41f8b7169`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:39,556::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:20:39,585::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:20:39,613::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:20:39,673::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:20:39,701::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:20:39,701::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:20:39,701::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:20:39,724::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-466::DEBUG::2014-04-10 18:20:39,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:39,738::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:20:39,760::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:20:39,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00276711 s, 242 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:39,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:20:39,787::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:20:39,787::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:20:39,787::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:20:39,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:39,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00150796 s, 445 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:39,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:39,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000490209 s, 751 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:20:40,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:40,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000419747 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4412::DEBUG::2014-04-10 18:20:41,669::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4412::DEBUG::2014-04-10 18:20:41,669::task::579::TaskManager.Task::(_updateState) Task=`7f1df69c-490a-4587-b09b-87feed14701a`::moving from state init -> state preparing
>Thread-4412::INFO::2014-04-10 18:20:41,669::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4412::INFO::2014-04-10 18:20:41,670::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4412::DEBUG::2014-04-10 18:20:41,670::task::1168::TaskManager.Task::(prepare) Task=`7f1df69c-490a-4587-b09b-87feed14701a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4412::DEBUG::2014-04-10 18:20:41,670::task::579::TaskManager.Task::(_updateState) Task=`7f1df69c-490a-4587-b09b-87feed14701a`::moving from state preparing -> state finished
>Thread-4412::DEBUG::2014-04-10 18:20:41,670::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4412::DEBUG::2014-04-10 18:20:41,670::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4412::DEBUG::2014-04-10 18:20:41,671::task::974::TaskManager.Task::(_decref) Task=`7f1df69c-490a-4587-b09b-87feed14701a`::ref 0 aborting False
>Thread-4413::DEBUG::2014-04-10 18:20:41,677::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4413::DEBUG::2014-04-10 18:20:41,677::task::579::TaskManager.Task::(_updateState) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::moving from state init -> state preparing
>Thread-4413::INFO::2014-04-10 18:20:41,677::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4413::DEBUG::2014-04-10 18:20:41,678::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aad6c210-8330-448d-9d80-f6755ca6522c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4413::DEBUG::2014-04-10 18:20:41,678::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4413::DEBUG::2014-04-10 18:20:41,678::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4413::DEBUG::2014-04-10 18:20:41,678::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aad6c210-8330-448d-9d80-f6755ca6522c`::Granted request
>Thread-4413::DEBUG::2014-04-10 18:20:41,679::task::811::TaskManager.Task::(resourceAcquired) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4413::DEBUG::2014-04-10 18:20:41,679::task::974::TaskManager.Task::(_decref) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::ref 1 aborting False
>Thread-4413::INFO::2014-04-10 18:20:41,681::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4413::DEBUG::2014-04-10 18:20:41,681::task::1168::TaskManager.Task::(prepare) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4413::DEBUG::2014-04-10 18:20:41,681::task::579::TaskManager.Task::(_updateState) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::moving from state preparing -> state finished
>Thread-4413::DEBUG::2014-04-10 18:20:41,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4413::DEBUG::2014-04-10 18:20:41,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4413::DEBUG::2014-04-10 18:20:41,682::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4413::DEBUG::2014-04-10 18:20:41,682::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4413::DEBUG::2014-04-10 18:20:41,682::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4413::DEBUG::2014-04-10 18:20:41,682::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4413::DEBUG::2014-04-10 18:20:41,682::task::974::TaskManager.Task::(_decref) Task=`b4d8bf1c-514e-4e16-9cfb-d8ff3c861197`::ref 0 aborting False
>Thread-4415::DEBUG::2014-04-10 18:20:45,616::task::579::TaskManager.Task::(_updateState) Task=`603ecf6d-4bbc-4fd8-9887-cc609145193f`::moving from state init -> state preparing
>Thread-4415::INFO::2014-04-10 18:20:45,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4415::INFO::2014-04-10 18:20:45,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419747', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00276711', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150796', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490209', 'lastCheck': '5.7', 'valid': True}}
>Thread-4415::DEBUG::2014-04-10 18:20:45,617::task::1168::TaskManager.Task::(prepare) Task=`603ecf6d-4bbc-4fd8-9887-cc609145193f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419747', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00276711', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150796', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490209', 'lastCheck': '5.7', 'valid': True}}
>Thread-4415::DEBUG::2014-04-10 18:20:45,617::task::579::TaskManager.Task::(_updateState) Task=`603ecf6d-4bbc-4fd8-9887-cc609145193f`::moving from state preparing -> state finished
>Thread-4415::DEBUG::2014-04-10 18:20:45,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4415::DEBUG::2014-04-10 18:20:45,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4415::DEBUG::2014-04-10 18:20:45,618::task::974::TaskManager.Task::(_decref) Task=`603ecf6d-4bbc-4fd8-9887-cc609145193f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:49,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:20:49,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317114 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:49,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:49,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350315 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:49,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:49,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442339 s, 832 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:20:50,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:20:50,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429543 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4419::DEBUG::2014-04-10 18:20:51,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4419::DEBUG::2014-04-10 18:20:51,759::task::579::TaskManager.Task::(_updateState) Task=`aa1664b1-441c-404c-8622-a072891e1e57`::moving from state init -> state preparing
>Thread-4419::INFO::2014-04-10 18:20:51,759::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4419::INFO::2014-04-10 18:20:51,759::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4419::DEBUG::2014-04-10 18:20:51,759::task::1168::TaskManager.Task::(prepare) Task=`aa1664b1-441c-404c-8622-a072891e1e57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4419::DEBUG::2014-04-10 18:20:51,760::task::579::TaskManager.Task::(_updateState) Task=`aa1664b1-441c-404c-8622-a072891e1e57`::moving from state preparing -> state finished
>Thread-4419::DEBUG::2014-04-10 18:20:51,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4419::DEBUG::2014-04-10 18:20:51,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4419::DEBUG::2014-04-10 18:20:51,760::task::974::TaskManager.Task::(_decref) Task=`aa1664b1-441c-404c-8622-a072891e1e57`::ref 0 aborting False
>Thread-4420::DEBUG::2014-04-10 18:20:51,767::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4420::DEBUG::2014-04-10 18:20:51,767::task::579::TaskManager.Task::(_updateState) Task=`0191f936-3228-451f-9688-cf98431e424d`::moving from state init -> state preparing
>Thread-4420::INFO::2014-04-10 18:20:51,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4420::DEBUG::2014-04-10 18:20:51,768::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40992f2d-3542-4454-8b04-cf2890969437`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4420::DEBUG::2014-04-10 18:20:51,768::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4420::DEBUG::2014-04-10 18:20:51,769::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4420::DEBUG::2014-04-10 18:20:51,769::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40992f2d-3542-4454-8b04-cf2890969437`::Granted request
>Thread-4420::DEBUG::2014-04-10 18:20:51,770::task::811::TaskManager.Task::(resourceAcquired) Task=`0191f936-3228-451f-9688-cf98431e424d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4420::DEBUG::2014-04-10 18:20:51,771::task::974::TaskManager.Task::(_decref) Task=`0191f936-3228-451f-9688-cf98431e424d`::ref 1 aborting False
>Thread-4420::INFO::2014-04-10 18:20:51,773::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4420::DEBUG::2014-04-10 18:20:51,773::task::1168::TaskManager.Task::(prepare) Task=`0191f936-3228-451f-9688-cf98431e424d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4420::DEBUG::2014-04-10 18:20:51,773::task::579::TaskManager.Task::(_updateState) Task=`0191f936-3228-451f-9688-cf98431e424d`::moving from state preparing -> state finished
>Thread-4420::DEBUG::2014-04-10 18:20:51,773::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4420::DEBUG::2014-04-10 18:20:51,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4420::DEBUG::2014-04-10 18:20:51,774::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4420::DEBUG::2014-04-10 18:20:51,774::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4420::DEBUG::2014-04-10 18:20:51,774::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4420::DEBUG::2014-04-10 18:20:51,774::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4420::DEBUG::2014-04-10 18:20:51,775::task::974::TaskManager.Task::(_decref) Task=`0191f936-3228-451f-9688-cf98431e424d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:20:59,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:20:59,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373988 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:20:59,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:20:59,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256672 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:20:59,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:20:59,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000376306 s, 978 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:00,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:00,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000431974 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4423::DEBUG::2014-04-10 18:21:00,784::task::579::TaskManager.Task::(_updateState) Task=`72375cbb-e6c7-4154-81a9-255c51e73675`::moving from state init -> state preparing
>Thread-4423::INFO::2014-04-10 18:21:00,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4423::INFO::2014-04-10 18:21:00,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431974', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373988', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256672', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376306', 'lastCheck': '0.9', 'valid': True}}
>Thread-4423::DEBUG::2014-04-10 18:21:00,785::task::1168::TaskManager.Task::(prepare) Task=`72375cbb-e6c7-4154-81a9-255c51e73675`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431974', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373988', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256672', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376306', 'lastCheck': '0.9', 'valid': True}}
>Thread-4423::DEBUG::2014-04-10 18:21:00,785::task::579::TaskManager.Task::(_updateState) Task=`72375cbb-e6c7-4154-81a9-255c51e73675`::moving from state preparing -> state finished
>Thread-4423::DEBUG::2014-04-10 18:21:00,785::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4423::DEBUG::2014-04-10 18:21:00,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4423::DEBUG::2014-04-10 18:21:00,786::task::974::TaskManager.Task::(_decref) Task=`72375cbb-e6c7-4154-81a9-255c51e73675`::ref 0 aborting False
>Thread-4425::DEBUG::2014-04-10 18:21:01,848::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4425::DEBUG::2014-04-10 18:21:01,848::task::579::TaskManager.Task::(_updateState) Task=`20f1a5f0-ccbe-4edd-86b2-0c64bf914b94`::moving from state init -> state preparing
>Thread-4425::INFO::2014-04-10 18:21:01,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4425::INFO::2014-04-10 18:21:01,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4425::DEBUG::2014-04-10 18:21:01,849::task::1168::TaskManager.Task::(prepare) Task=`20f1a5f0-ccbe-4edd-86b2-0c64bf914b94`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4425::DEBUG::2014-04-10 18:21:01,849::task::579::TaskManager.Task::(_updateState) Task=`20f1a5f0-ccbe-4edd-86b2-0c64bf914b94`::moving from state preparing -> state finished
>Thread-4425::DEBUG::2014-04-10 18:21:01,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4425::DEBUG::2014-04-10 18:21:01,850::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4425::DEBUG::2014-04-10 18:21:01,850::task::974::TaskManager.Task::(_decref) Task=`20f1a5f0-ccbe-4edd-86b2-0c64bf914b94`::ref 0 aborting False
>Thread-4426::DEBUG::2014-04-10 18:21:01,857::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4426::DEBUG::2014-04-10 18:21:01,857::task::579::TaskManager.Task::(_updateState) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::moving from state init -> state preparing
>Thread-4426::INFO::2014-04-10 18:21:01,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4426::DEBUG::2014-04-10 18:21:01,858::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee5fff43-6332-4cef-872c-19d12592c32e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4426::DEBUG::2014-04-10 18:21:01,858::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4426::DEBUG::2014-04-10 18:21:01,858::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4426::DEBUG::2014-04-10 18:21:01,858::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee5fff43-6332-4cef-872c-19d12592c32e`::Granted request
>Thread-4426::DEBUG::2014-04-10 18:21:01,859::task::811::TaskManager.Task::(resourceAcquired) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4426::DEBUG::2014-04-10 18:21:01,859::task::974::TaskManager.Task::(_decref) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::ref 1 aborting False
>Thread-4426::INFO::2014-04-10 18:21:01,861::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4426::DEBUG::2014-04-10 18:21:01,861::task::1168::TaskManager.Task::(prepare) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::task::579::TaskManager.Task::(_updateState) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::moving from state preparing -> state finished
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4426::DEBUG::2014-04-10 18:21:01,862::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4426::DEBUG::2014-04-10 18:21:01,863::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4426::DEBUG::2014-04-10 18:21:01,863::task::974::TaskManager.Task::(_decref) Task=`fc54c746-a3a9-493c-b466-05ac00c21228`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:09,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:09,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000411417 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:09,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:09,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250288 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:09,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:21:09,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486364 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:10,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:10,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000530142 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4430::DEBUG::2014-04-10 18:21:11,938::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-4430::DEBUG::2014-04-10 18:21:11,939::task::579::TaskManager.Task::(_updateState) Task=`bbfa2b27-c4ba-4316-8062-78ae3132ea78`::moving from state init -> state preparing
>Thread-4430::INFO::2014-04-10 18:21:11,939::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4430::INFO::2014-04-10 18:21:11,940::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4430::DEBUG::2014-04-10 18:21:11,940::task::1168::TaskManager.Task::(prepare) Task=`bbfa2b27-c4ba-4316-8062-78ae3132ea78`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4430::DEBUG::2014-04-10 18:21:11,940::task::579::TaskManager.Task::(_updateState) Task=`bbfa2b27-c4ba-4316-8062-78ae3132ea78`::moving from state preparing -> state finished
>Thread-4430::DEBUG::2014-04-10 18:21:11,940::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4430::DEBUG::2014-04-10 18:21:11,940::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4430::DEBUG::2014-04-10 18:21:11,941::task::974::TaskManager.Task::(_decref) Task=`bbfa2b27-c4ba-4316-8062-78ae3132ea78`::ref 0 aborting False
>Thread-4431::DEBUG::2014-04-10 18:21:11,948::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-4431::DEBUG::2014-04-10 18:21:11,948::task::579::TaskManager.Task::(_updateState) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::moving from state init -> state preparing
>Thread-4431::INFO::2014-04-10 18:21:11,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4431::DEBUG::2014-04-10 18:21:11,949::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3a6b1c1-d3a6-42ef-b646-ada33324ba9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4431::DEBUG::2014-04-10 18:21:11,949::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4431::DEBUG::2014-04-10 18:21:11,949::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4431::DEBUG::2014-04-10 18:21:11,950::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3a6b1c1-d3a6-42ef-b646-ada33324ba9e`::Granted request
>Thread-4431::DEBUG::2014-04-10 18:21:11,950::task::811::TaskManager.Task::(resourceAcquired) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4431::DEBUG::2014-04-10 18:21:11,950::task::974::TaskManager.Task::(_decref) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::ref 1 aborting False
>Thread-4431::INFO::2014-04-10 18:21:11,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4431::DEBUG::2014-04-10 18:21:11,953::task::1168::TaskManager.Task::(prepare) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4431::DEBUG::2014-04-10 18:21:11,953::task::579::TaskManager.Task::(_updateState) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::moving from state preparing -> state finished
>Thread-4431::DEBUG::2014-04-10 18:21:11,953::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4431::DEBUG::2014-04-10 18:21:11,953::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4431::DEBUG::2014-04-10 18:21:11,953::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4431::DEBUG::2014-04-10 18:21:11,954::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4431::DEBUG::2014-04-10 18:21:11,954::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4431::DEBUG::2014-04-10 18:21:11,954::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4431::DEBUG::2014-04-10 18:21:11,954::task::974::TaskManager.Task::(_decref) Task=`c4329574-57d9-4b7d-a521-ffdcd5f1209a`::ref 0 aborting False
>Thread-4433::DEBUG::2014-04-10 18:21:15,958::task::579::TaskManager.Task::(_updateState) Task=`a3cbd09c-fc8f-4d7c-b245-863f8e5baafe`::moving from state init -> state preparing
>Thread-4433::INFO::2014-04-10 18:21:15,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4433::INFO::2014-04-10 18:21:15,959::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530142', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411417', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250288', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486364', 'lastCheck': '6.0', 'valid': True}}
>Thread-4433::DEBUG::2014-04-10 18:21:15,959::task::1168::TaskManager.Task::(prepare) Task=`a3cbd09c-fc8f-4d7c-b245-863f8e5baafe`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530142', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411417', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250288', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486364', 'lastCheck': '6.0', 'valid': True}}
>Thread-4433::DEBUG::2014-04-10 18:21:15,959::task::579::TaskManager.Task::(_updateState) Task=`a3cbd09c-fc8f-4d7c-b245-863f8e5baafe`::moving from state preparing -> state finished
>Thread-4433::DEBUG::2014-04-10 18:21:15,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4433::DEBUG::2014-04-10 18:21:15,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4433::DEBUG::2014-04-10 18:21:15,959::task::974::TaskManager.Task::(_decref) Task=`a3cbd09c-fc8f-4d7c-b245-863f8e5baafe`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:19,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:19,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000403382 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:19,855::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:19,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00144842 s, 463 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:19,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:21:19,954::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488179 s, 754 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:20,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:20,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000425988 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4436::DEBUG::2014-04-10 18:21:22,037::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-4436::DEBUG::2014-04-10 18:21:22,038::task::579::TaskManager.Task::(_updateState) Task=`a71bce26-21a1-488b-9f10-ebaf5ace1f01`::moving from state init -> state preparing
>Thread-4436::INFO::2014-04-10 18:21:22,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4436::INFO::2014-04-10 18:21:22,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4436::DEBUG::2014-04-10 18:21:22,039::task::1168::TaskManager.Task::(prepare) Task=`a71bce26-21a1-488b-9f10-ebaf5ace1f01`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4436::DEBUG::2014-04-10 18:21:22,039::task::579::TaskManager.Task::(_updateState) Task=`a71bce26-21a1-488b-9f10-ebaf5ace1f01`::moving from state preparing -> state finished
>Thread-4436::DEBUG::2014-04-10 18:21:22,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4436::DEBUG::2014-04-10 18:21:22,039::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4436::DEBUG::2014-04-10 18:21:22,039::task::974::TaskManager.Task::(_decref) Task=`a71bce26-21a1-488b-9f10-ebaf5ace1f01`::ref 0 aborting False
>Thread-4437::DEBUG::2014-04-10 18:21:22,046::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-4437::DEBUG::2014-04-10 18:21:22,047::task::579::TaskManager.Task::(_updateState) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::moving from state init -> state preparing
>Thread-4437::INFO::2014-04-10 18:21:22,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4437::DEBUG::2014-04-10 18:21:22,047::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84a681ff-4f1e-4a57-9b73-47eb54549d48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4437::DEBUG::2014-04-10 18:21:22,048::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4437::DEBUG::2014-04-10 18:21:22,048::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4437::DEBUG::2014-04-10 18:21:22,048::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84a681ff-4f1e-4a57-9b73-47eb54549d48`::Granted request
>Thread-4437::DEBUG::2014-04-10 18:21:22,048::task::811::TaskManager.Task::(resourceAcquired) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4437::DEBUG::2014-04-10 18:21:22,049::task::974::TaskManager.Task::(_decref) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::ref 1 aborting False
>Thread-4437::INFO::2014-04-10 18:21:22,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4437::DEBUG::2014-04-10 18:21:22,051::task::1168::TaskManager.Task::(prepare) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4437::DEBUG::2014-04-10 18:21:22,051::task::579::TaskManager.Task::(_updateState) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::moving from state preparing -> state finished
>Thread-4437::DEBUG::2014-04-10 18:21:22,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4437::DEBUG::2014-04-10 18:21:22,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4437::DEBUG::2014-04-10 18:21:22,052::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4437::DEBUG::2014-04-10 18:21:22,052::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4437::DEBUG::2014-04-10 18:21:22,052::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4437::DEBUG::2014-04-10 18:21:22,052::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4437::DEBUG::2014-04-10 18:21:22,052::task::974::TaskManager.Task::(_decref) Task=`90e92cf3-3721-4e78-8658-52669dea5a44`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:29,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:29,849::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379443 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:29,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:29,876::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342483 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:29,962::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:21:29,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000423359 s, 869 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:30,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:30,156::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473105 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4441::DEBUG::2014-04-10 18:21:31,133::task::579::TaskManager.Task::(_updateState) Task=`7afbeb84-2444-459a-b1f6-51c23656a167`::moving from state init -> state preparing
>Thread-4441::INFO::2014-04-10 18:21:31,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4441::INFO::2014-04-10 18:21:31,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473105', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379443', 'lastCheck': '1.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342483', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423359', 'lastCheck': '1.2', 'valid': True}}
>Thread-4441::DEBUG::2014-04-10 18:21:31,134::task::1168::TaskManager.Task::(prepare) Task=`7afbeb84-2444-459a-b1f6-51c23656a167`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473105', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379443', 'lastCheck': '1.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342483', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423359', 'lastCheck': '1.2', 'valid': True}}
>Thread-4441::DEBUG::2014-04-10 18:21:31,134::task::579::TaskManager.Task::(_updateState) Task=`7afbeb84-2444-459a-b1f6-51c23656a167`::moving from state preparing -> state finished
>Thread-4441::DEBUG::2014-04-10 18:21:31,135::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4441::DEBUG::2014-04-10 18:21:31,135::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4441::DEBUG::2014-04-10 18:21:31,135::task::974::TaskManager.Task::(_decref) Task=`7afbeb84-2444-459a-b1f6-51c23656a167`::ref 0 aborting False
>Thread-4443::DEBUG::2014-04-10 18:21:32,127::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4443::DEBUG::2014-04-10 18:21:32,128::task::579::TaskManager.Task::(_updateState) Task=`ec4fc280-78ba-4b9a-aee8-858a885d41f6`::moving from state init -> state preparing
>Thread-4443::INFO::2014-04-10 18:21:32,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4443::INFO::2014-04-10 18:21:32,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4443::DEBUG::2014-04-10 18:21:32,129::task::1168::TaskManager.Task::(prepare) Task=`ec4fc280-78ba-4b9a-aee8-858a885d41f6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4443::DEBUG::2014-04-10 18:21:32,129::task::579::TaskManager.Task::(_updateState) Task=`ec4fc280-78ba-4b9a-aee8-858a885d41f6`::moving from state preparing -> state finished
>Thread-4443::DEBUG::2014-04-10 18:21:32,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4443::DEBUG::2014-04-10 18:21:32,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4443::DEBUG::2014-04-10 18:21:32,129::task::974::TaskManager.Task::(_decref) Task=`ec4fc280-78ba-4b9a-aee8-858a885d41f6`::ref 0 aborting False
>Thread-4444::DEBUG::2014-04-10 18:21:32,136::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4444::DEBUG::2014-04-10 18:21:32,137::task::579::TaskManager.Task::(_updateState) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::moving from state init -> state preparing
>Thread-4444::INFO::2014-04-10 18:21:32,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4444::DEBUG::2014-04-10 18:21:32,137::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`69f22059-3add-4700-a208-dfb2de4a5436`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4444::DEBUG::2014-04-10 18:21:32,138::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4444::DEBUG::2014-04-10 18:21:32,138::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4444::DEBUG::2014-04-10 18:21:32,138::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`69f22059-3add-4700-a208-dfb2de4a5436`::Granted request
>Thread-4444::DEBUG::2014-04-10 18:21:32,140::task::811::TaskManager.Task::(resourceAcquired) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4444::DEBUG::2014-04-10 18:21:32,140::task::974::TaskManager.Task::(_decref) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::ref 1 aborting False
>Thread-4444::INFO::2014-04-10 18:21:32,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4444::DEBUG::2014-04-10 18:21:32,142::task::1168::TaskManager.Task::(prepare) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4444::DEBUG::2014-04-10 18:21:32,142::task::579::TaskManager.Task::(_updateState) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::moving from state preparing -> state finished
>Thread-4444::DEBUG::2014-04-10 18:21:32,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4444::DEBUG::2014-04-10 18:21:32,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4444::DEBUG::2014-04-10 18:21:32,143::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4444::DEBUG::2014-04-10 18:21:32,143::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4444::DEBUG::2014-04-10 18:21:32,143::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4444::DEBUG::2014-04-10 18:21:32,144::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4444::DEBUG::2014-04-10 18:21:32,144::task::974::TaskManager.Task::(_decref) Task=`e913ebff-c432-4de5-b0cc-2c06ccc8ef70`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:39,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:39,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316038 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:39,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:39,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248585 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:39,975::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:21:39,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000531203 s, 693 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:40,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:40,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000456553 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4448::DEBUG::2014-04-10 18:21:42,227::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-4448::DEBUG::2014-04-10 18:21:42,228::task::579::TaskManager.Task::(_updateState) Task=`3e79daac-4751-47b0-9555-2b8fb18791b7`::moving from state init -> state preparing
>Thread-4448::INFO::2014-04-10 18:21:42,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4448::INFO::2014-04-10 18:21:42,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4448::DEBUG::2014-04-10 18:21:42,228::task::1168::TaskManager.Task::(prepare) Task=`3e79daac-4751-47b0-9555-2b8fb18791b7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4448::DEBUG::2014-04-10 18:21:42,229::task::579::TaskManager.Task::(_updateState) Task=`3e79daac-4751-47b0-9555-2b8fb18791b7`::moving from state preparing -> state finished
>Thread-4448::DEBUG::2014-04-10 18:21:42,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4448::DEBUG::2014-04-10 18:21:42,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4448::DEBUG::2014-04-10 18:21:42,229::task::974::TaskManager.Task::(_decref) Task=`3e79daac-4751-47b0-9555-2b8fb18791b7`::ref 0 aborting False
>Thread-4449::DEBUG::2014-04-10 18:21:42,236::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [cc3164a]
>Thread-4449::DEBUG::2014-04-10 18:21:42,236::task::579::TaskManager.Task::(_updateState) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::moving from state init -> state preparing
>Thread-4449::INFO::2014-04-10 18:21:42,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4449::DEBUG::2014-04-10 18:21:42,237::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`836b1571-a7be-4b84-9967-cb832d3c2b56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4449::DEBUG::2014-04-10 18:21:42,237::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4449::DEBUG::2014-04-10 18:21:42,237::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4449::DEBUG::2014-04-10 18:21:42,238::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`836b1571-a7be-4b84-9967-cb832d3c2b56`::Granted request
>Thread-4449::DEBUG::2014-04-10 18:21:42,238::task::811::TaskManager.Task::(resourceAcquired) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4449::DEBUG::2014-04-10 18:21:42,238::task::974::TaskManager.Task::(_decref) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::ref 1 aborting False
>Thread-4449::INFO::2014-04-10 18:21:42,240::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4449::DEBUG::2014-04-10 18:21:42,241::task::1168::TaskManager.Task::(prepare) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4449::DEBUG::2014-04-10 18:21:42,241::task::579::TaskManager.Task::(_updateState) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::moving from state preparing -> state finished
>Thread-4449::DEBUG::2014-04-10 18:21:42,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4449::DEBUG::2014-04-10 18:21:42,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4449::DEBUG::2014-04-10 18:21:42,241::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4449::DEBUG::2014-04-10 18:21:42,242::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4449::DEBUG::2014-04-10 18:21:42,242::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4449::DEBUG::2014-04-10 18:21:42,242::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4449::DEBUG::2014-04-10 18:21:42,242::task::974::TaskManager.Task::(_decref) Task=`1b4f1a58-4f4b-4486-9d0a-88abd346db9d`::ref 0 aborting False
>Thread-4451::DEBUG::2014-04-10 18:21:46,314::task::579::TaskManager.Task::(_updateState) Task=`7698cfbf-261d-40fc-b3e7-dfc4cb44448c`::moving from state init -> state preparing
>Thread-4451::INFO::2014-04-10 18:21:46,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4451::INFO::2014-04-10 18:21:46,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456553', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316038', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248585', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531203', 'lastCheck': '6.3', 'valid': True}}
>Thread-4451::DEBUG::2014-04-10 18:21:46,314::task::1168::TaskManager.Task::(prepare) Task=`7698cfbf-261d-40fc-b3e7-dfc4cb44448c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456553', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316038', 'lastCheck': '6.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248585', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531203', 'lastCheck': '6.3', 'valid': True}}
>Thread-4451::DEBUG::2014-04-10 18:21:46,314::task::579::TaskManager.Task::(_updateState) Task=`7698cfbf-261d-40fc-b3e7-dfc4cb44448c`::moving from state preparing -> state finished
>Thread-4451::DEBUG::2014-04-10 18:21:46,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4451::DEBUG::2014-04-10 18:21:46,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4451::DEBUG::2014-04-10 18:21:46,315::task::974::TaskManager.Task::(_decref) Task=`7698cfbf-261d-40fc-b3e7-dfc4cb44448c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:49,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:49,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414667 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:49,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:49,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000249675 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:49,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:21:49,994::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000435314 s, 845 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:21:50,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:21:50,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000539598 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4454::DEBUG::2014-04-10 18:21:52,316::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4454::DEBUG::2014-04-10 18:21:52,317::task::579::TaskManager.Task::(_updateState) Task=`facbbc37-3f87-4b1e-90ce-806981daa0b2`::moving from state init -> state preparing
>Thread-4454::INFO::2014-04-10 18:21:52,317::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4454::INFO::2014-04-10 18:21:52,317::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4454::DEBUG::2014-04-10 18:21:52,318::task::1168::TaskManager.Task::(prepare) Task=`facbbc37-3f87-4b1e-90ce-806981daa0b2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4454::DEBUG::2014-04-10 18:21:52,318::task::579::TaskManager.Task::(_updateState) Task=`facbbc37-3f87-4b1e-90ce-806981daa0b2`::moving from state preparing -> state finished
>Thread-4454::DEBUG::2014-04-10 18:21:52,318::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4454::DEBUG::2014-04-10 18:21:52,318::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4454::DEBUG::2014-04-10 18:21:52,318::task::974::TaskManager.Task::(_decref) Task=`facbbc37-3f87-4b1e-90ce-806981daa0b2`::ref 0 aborting False
>Thread-4455::DEBUG::2014-04-10 18:21:52,325::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4455::DEBUG::2014-04-10 18:21:52,325::task::579::TaskManager.Task::(_updateState) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::moving from state init -> state preparing
>Thread-4455::INFO::2014-04-10 18:21:52,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4455::DEBUG::2014-04-10 18:21:52,326::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aef529a8-0c71-4d4a-9ca5-bd49fdd2b038`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4455::DEBUG::2014-04-10 18:21:52,326::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4455::DEBUG::2014-04-10 18:21:52,326::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4455::DEBUG::2014-04-10 18:21:52,327::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aef529a8-0c71-4d4a-9ca5-bd49fdd2b038`::Granted request
>Thread-4455::DEBUG::2014-04-10 18:21:52,327::task::811::TaskManager.Task::(resourceAcquired) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4455::DEBUG::2014-04-10 18:21:52,327::task::974::TaskManager.Task::(_decref) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::ref 1 aborting False
>Thread-4455::INFO::2014-04-10 18:21:52,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4455::DEBUG::2014-04-10 18:21:52,329::task::1168::TaskManager.Task::(prepare) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4455::DEBUG::2014-04-10 18:21:52,329::task::579::TaskManager.Task::(_updateState) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::moving from state preparing -> state finished
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4455::DEBUG::2014-04-10 18:21:52,330::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4455::DEBUG::2014-04-10 18:21:52,331::task::974::TaskManager.Task::(_decref) Task=`e4088657-1ae5-43ab-8901-d3c4bbb49e98`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:21:59,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:21:59,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000411238 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:21:59,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:21:59,920::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000258306 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:21:59,996::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:22:00,012::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:22:00,013::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:22:00,019::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:22:00,020::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:22:00,020::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:22:00,021::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:22:00,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:00,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000340831 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:00,196::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:00,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00038503 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4463::DEBUG::2014-04-10 18:22:01,495::task::579::TaskManager.Task::(_updateState) Task=`d8dbc466-454e-4032-9431-8d2630ef39a5`::moving from state init -> state preparing
>Thread-4463::INFO::2014-04-10 18:22:01,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4463::INFO::2014-04-10 18:22:01,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038503', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411238', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258306', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340831', 'lastCheck': '1.5', 'valid': True}}
>Thread-4463::DEBUG::2014-04-10 18:22:01,496::task::1168::TaskManager.Task::(prepare) Task=`d8dbc466-454e-4032-9431-8d2630ef39a5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038503', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411238', 'lastCheck': '1.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000258306', 'lastCheck': '1.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340831', 'lastCheck': '1.5', 'valid': True}}
>Thread-4463::DEBUG::2014-04-10 18:22:01,496::task::579::TaskManager.Task::(_updateState) Task=`d8dbc466-454e-4032-9431-8d2630ef39a5`::moving from state preparing -> state finished
>Thread-4463::DEBUG::2014-04-10 18:22:01,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4463::DEBUG::2014-04-10 18:22:01,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4463::DEBUG::2014-04-10 18:22:01,497::task::974::TaskManager.Task::(_decref) Task=`d8dbc466-454e-4032-9431-8d2630ef39a5`::ref 0 aborting False
>Thread-4465::DEBUG::2014-04-10 18:22:02,467::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4465::DEBUG::2014-04-10 18:22:02,467::task::579::TaskManager.Task::(_updateState) Task=`9f8184e2-68f8-4b1b-bd1a-fcc260917afd`::moving from state init -> state preparing
>Thread-4465::INFO::2014-04-10 18:22:02,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4465::INFO::2014-04-10 18:22:02,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4465::DEBUG::2014-04-10 18:22:02,468::task::1168::TaskManager.Task::(prepare) Task=`9f8184e2-68f8-4b1b-bd1a-fcc260917afd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4465::DEBUG::2014-04-10 18:22:02,468::task::579::TaskManager.Task::(_updateState) Task=`9f8184e2-68f8-4b1b-bd1a-fcc260917afd`::moving from state preparing -> state finished
>Thread-4465::DEBUG::2014-04-10 18:22:02,469::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4465::DEBUG::2014-04-10 18:22:02,469::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4465::DEBUG::2014-04-10 18:22:02,469::task::974::TaskManager.Task::(_decref) Task=`9f8184e2-68f8-4b1b-bd1a-fcc260917afd`::ref 0 aborting False
>Thread-4466::DEBUG::2014-04-10 18:22:02,476::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4466::DEBUG::2014-04-10 18:22:02,476::task::579::TaskManager.Task::(_updateState) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::moving from state init -> state preparing
>Thread-4466::INFO::2014-04-10 18:22:02,477::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4466::DEBUG::2014-04-10 18:22:02,477::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f950920-d620-4bef-8062-13b7b6f32746`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4466::DEBUG::2014-04-10 18:22:02,477::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4466::DEBUG::2014-04-10 18:22:02,478::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4466::DEBUG::2014-04-10 18:22:02,478::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f950920-d620-4bef-8062-13b7b6f32746`::Granted request
>Thread-4466::DEBUG::2014-04-10 18:22:02,478::task::811::TaskManager.Task::(resourceAcquired) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4466::DEBUG::2014-04-10 18:22:02,478::task::974::TaskManager.Task::(_decref) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::ref 1 aborting False
>Thread-4466::INFO::2014-04-10 18:22:02,481::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4466::DEBUG::2014-04-10 18:22:02,481::task::1168::TaskManager.Task::(prepare) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4466::DEBUG::2014-04-10 18:22:02,481::task::579::TaskManager.Task::(_updateState) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::moving from state preparing -> state finished
>Thread-4466::DEBUG::2014-04-10 18:22:02,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4466::DEBUG::2014-04-10 18:22:02,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4466::DEBUG::2014-04-10 18:22:02,482::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4466::DEBUG::2014-04-10 18:22:02,482::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4466::DEBUG::2014-04-10 18:22:02,482::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4466::DEBUG::2014-04-10 18:22:02,482::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4466::DEBUG::2014-04-10 18:22:02,482::task::974::TaskManager.Task::(_decref) Task=`1e8af433-31c1-474d-8004-91179ed29e64`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:09,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:09,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000394199 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:22:09,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:22:09,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000275527 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:22:10,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:10,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000501428 s, 734 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:10,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:10,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000506971 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4470::DEBUG::2014-04-10 18:22:12,872::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4470::DEBUG::2014-04-10 18:22:12,873::task::579::TaskManager.Task::(_updateState) Task=`db1bcf3a-0b97-4e75-86ae-dc83a7a09705`::moving from state init -> state preparing
>Thread-4470::INFO::2014-04-10 18:22:12,873::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4470::INFO::2014-04-10 18:22:12,874::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4470::DEBUG::2014-04-10 18:22:12,874::task::1168::TaskManager.Task::(prepare) Task=`db1bcf3a-0b97-4e75-86ae-dc83a7a09705`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4470::DEBUG::2014-04-10 18:22:12,874::task::579::TaskManager.Task::(_updateState) Task=`db1bcf3a-0b97-4e75-86ae-dc83a7a09705`::moving from state preparing -> state finished
>Thread-4470::DEBUG::2014-04-10 18:22:12,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4470::DEBUG::2014-04-10 18:22:12,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4470::DEBUG::2014-04-10 18:22:12,875::task::974::TaskManager.Task::(_decref) Task=`db1bcf3a-0b97-4e75-86ae-dc83a7a09705`::ref 0 aborting False
>Thread-4471::DEBUG::2014-04-10 18:22:12,881::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4471::DEBUG::2014-04-10 18:22:12,882::task::579::TaskManager.Task::(_updateState) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::moving from state init -> state preparing
>Thread-4471::INFO::2014-04-10 18:22:12,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4471::DEBUG::2014-04-10 18:22:12,883::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895b2f2f-22ac-4ff1-927d-2b36502fa962`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4471::DEBUG::2014-04-10 18:22:12,883::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4471::DEBUG::2014-04-10 18:22:12,883::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4471::DEBUG::2014-04-10 18:22:12,883::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`895b2f2f-22ac-4ff1-927d-2b36502fa962`::Granted request
>Thread-4471::DEBUG::2014-04-10 18:22:12,885::task::811::TaskManager.Task::(resourceAcquired) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4471::DEBUG::2014-04-10 18:22:12,885::task::974::TaskManager.Task::(_decref) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::ref 1 aborting False
>Thread-4471::INFO::2014-04-10 18:22:12,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4471::DEBUG::2014-04-10 18:22:12,887::task::1168::TaskManager.Task::(prepare) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4471::DEBUG::2014-04-10 18:22:12,887::task::579::TaskManager.Task::(_updateState) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::moving from state preparing -> state finished
>Thread-4471::DEBUG::2014-04-10 18:22:12,887::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4471::DEBUG::2014-04-10 18:22:12,888::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4471::DEBUG::2014-04-10 18:22:12,888::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4471::DEBUG::2014-04-10 18:22:12,888::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4471::DEBUG::2014-04-10 18:22:12,888::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4471::DEBUG::2014-04-10 18:22:12,888::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4471::DEBUG::2014-04-10 18:22:12,889::task::974::TaskManager.Task::(_decref) Task=`6ff891d3-326e-422b-9be9-aa91f7ba05ac`::ref 0 aborting False
>Thread-4473::DEBUG::2014-04-10 18:22:16,746::task::579::TaskManager.Task::(_updateState) Task=`96b0bdc7-3bf1-4449-af76-d0f30b38357f`::moving from state init -> state preparing
>Thread-4473::INFO::2014-04-10 18:22:16,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4473::INFO::2014-04-10 18:22:16,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506971', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394199', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275527', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501428', 'lastCheck': '6.7', 'valid': True}}
>Thread-4473::DEBUG::2014-04-10 18:22:16,747::task::1168::TaskManager.Task::(prepare) Task=`96b0bdc7-3bf1-4449-af76-d0f30b38357f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506971', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000394199', 'lastCheck': '6.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275527', 'lastCheck': '6.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501428', 'lastCheck': '6.7', 'valid': True}}
>Thread-4473::DEBUG::2014-04-10 18:22:16,747::task::579::TaskManager.Task::(_updateState) Task=`96b0bdc7-3bf1-4449-af76-d0f30b38357f`::moving from state preparing -> state finished
>Thread-4473::DEBUG::2014-04-10 18:22:16,747::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4473::DEBUG::2014-04-10 18:22:16,747::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4473::DEBUG::2014-04-10 18:22:16,747::task::974::TaskManager.Task::(_decref) Task=`96b0bdc7-3bf1-4449-af76-d0f30b38357f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:19,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:19,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355366 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:22:19,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:22:19,949::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316632 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:22:20,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:20,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000442452 s, 832 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:20,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:20,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000414397 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4477::DEBUG::2014-04-10 18:22:22,971::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4477::DEBUG::2014-04-10 18:22:22,972::task::579::TaskManager.Task::(_updateState) Task=`d2b13cd9-8781-4bb7-9648-a824b55f5a49`::moving from state init -> state preparing
>Thread-4477::INFO::2014-04-10 18:22:22,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4477::INFO::2014-04-10 18:22:22,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4477::DEBUG::2014-04-10 18:22:22,972::task::1168::TaskManager.Task::(prepare) Task=`d2b13cd9-8781-4bb7-9648-a824b55f5a49`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4477::DEBUG::2014-04-10 18:22:22,973::task::579::TaskManager.Task::(_updateState) Task=`d2b13cd9-8781-4bb7-9648-a824b55f5a49`::moving from state preparing -> state finished
>Thread-4477::DEBUG::2014-04-10 18:22:22,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4477::DEBUG::2014-04-10 18:22:22,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4477::DEBUG::2014-04-10 18:22:22,973::task::974::TaskManager.Task::(_decref) Task=`d2b13cd9-8781-4bb7-9648-a824b55f5a49`::ref 0 aborting False
>Thread-4478::DEBUG::2014-04-10 18:22:22,979::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4478::DEBUG::2014-04-10 18:22:22,980::task::579::TaskManager.Task::(_updateState) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::moving from state init -> state preparing
>Thread-4478::INFO::2014-04-10 18:22:22,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4478::DEBUG::2014-04-10 18:22:22,980::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`be021716-1d42-41cd-bc3a-7a5db184c441`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4478::DEBUG::2014-04-10 18:22:22,980::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4478::DEBUG::2014-04-10 18:22:22,981::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4478::DEBUG::2014-04-10 18:22:22,981::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`be021716-1d42-41cd-bc3a-7a5db184c441`::Granted request
>Thread-4478::DEBUG::2014-04-10 18:22:22,981::task::811::TaskManager.Task::(resourceAcquired) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4478::DEBUG::2014-04-10 18:22:22,981::task::974::TaskManager.Task::(_decref) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::ref 1 aborting False
>Thread-4478::INFO::2014-04-10 18:22:22,983::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4478::DEBUG::2014-04-10 18:22:22,983::task::1168::TaskManager.Task::(prepare) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::task::579::TaskManager.Task::(_updateState) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::moving from state preparing -> state finished
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4478::DEBUG::2014-04-10 18:22:22,984::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4478::DEBUG::2014-04-10 18:22:22,985::task::974::TaskManager.Task::(_decref) Task=`d3073db4-1bc6-4715-a498-f90fda6decf1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:29,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:29,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000511635 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:22:29,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:22:29,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283935 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:22:30,068::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:30,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448484 s, 821 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:30,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:30,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000444788 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4481::DEBUG::2014-04-10 18:22:31,900::task::579::TaskManager.Task::(_updateState) Task=`b783be5d-cfc4-4ff6-aade-13bf9917fa2f`::moving from state init -> state preparing
>Thread-4481::INFO::2014-04-10 18:22:31,900::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4481::INFO::2014-04-10 18:22:31,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444788', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511635', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283935', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448484', 'lastCheck': '1.8', 'valid': True}}
>Thread-4481::DEBUG::2014-04-10 18:22:31,900::task::1168::TaskManager.Task::(prepare) Task=`b783be5d-cfc4-4ff6-aade-13bf9917fa2f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444788', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511635', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283935', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448484', 'lastCheck': '1.8', 'valid': True}}
>Thread-4481::DEBUG::2014-04-10 18:22:31,900::task::579::TaskManager.Task::(_updateState) Task=`b783be5d-cfc4-4ff6-aade-13bf9917fa2f`::moving from state preparing -> state finished
>Thread-4481::DEBUG::2014-04-10 18:22:31,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4481::DEBUG::2014-04-10 18:22:31,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4481::DEBUG::2014-04-10 18:22:31,901::task::974::TaskManager.Task::(_decref) Task=`b783be5d-cfc4-4ff6-aade-13bf9917fa2f`::ref 0 aborting False
>Thread-4483::DEBUG::2014-04-10 18:22:33,063::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4483::DEBUG::2014-04-10 18:22:33,064::task::579::TaskManager.Task::(_updateState) Task=`64d2581f-5845-4f9f-971d-1c0c889ea034`::moving from state init -> state preparing
>Thread-4483::INFO::2014-04-10 18:22:33,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4483::INFO::2014-04-10 18:22:33,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4483::DEBUG::2014-04-10 18:22:33,065::task::1168::TaskManager.Task::(prepare) Task=`64d2581f-5845-4f9f-971d-1c0c889ea034`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4483::DEBUG::2014-04-10 18:22:33,065::task::579::TaskManager.Task::(_updateState) Task=`64d2581f-5845-4f9f-971d-1c0c889ea034`::moving from state preparing -> state finished
>Thread-4483::DEBUG::2014-04-10 18:22:33,065::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4483::DEBUG::2014-04-10 18:22:33,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4483::DEBUG::2014-04-10 18:22:33,065::task::974::TaskManager.Task::(_decref) Task=`64d2581f-5845-4f9f-971d-1c0c889ea034`::ref 0 aborting False
>Thread-4484::DEBUG::2014-04-10 18:22:33,072::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4484::DEBUG::2014-04-10 18:22:33,072::task::579::TaskManager.Task::(_updateState) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::moving from state init -> state preparing
>Thread-4484::INFO::2014-04-10 18:22:33,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4484::DEBUG::2014-04-10 18:22:33,073::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55a20c0c-8d8a-487d-937f-d9d264863237`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4484::DEBUG::2014-04-10 18:22:33,073::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4484::DEBUG::2014-04-10 18:22:33,073::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4484::DEBUG::2014-04-10 18:22:33,074::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55a20c0c-8d8a-487d-937f-d9d264863237`::Granted request
>Thread-4484::DEBUG::2014-04-10 18:22:33,074::task::811::TaskManager.Task::(resourceAcquired) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4484::DEBUG::2014-04-10 18:22:33,074::task::974::TaskManager.Task::(_decref) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::ref 1 aborting False
>Thread-4484::INFO::2014-04-10 18:22:33,076::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4484::DEBUG::2014-04-10 18:22:33,076::task::1168::TaskManager.Task::(prepare) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4484::DEBUG::2014-04-10 18:22:33,077::task::579::TaskManager.Task::(_updateState) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::moving from state preparing -> state finished
>Thread-4484::DEBUG::2014-04-10 18:22:33,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4484::DEBUG::2014-04-10 18:22:33,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4484::DEBUG::2014-04-10 18:22:33,077::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4484::DEBUG::2014-04-10 18:22:33,078::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4484::DEBUG::2014-04-10 18:22:33,078::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4484::DEBUG::2014-04-10 18:22:33,078::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4484::DEBUG::2014-04-10 18:22:33,078::task::974::TaskManager.Task::(_decref) Task=`1f737161-0921-449e-8ed3-3a36731801b1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:39,954::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:39,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00049291 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:22:39,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:22:39,977::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034406 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:22:40,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:40,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000438875 s, 839 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:40,256::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:40,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000476355 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4488::DEBUG::2014-04-10 18:22:43,729::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-4488::DEBUG::2014-04-10 18:22:43,730::task::579::TaskManager.Task::(_updateState) Task=`bba4dbef-984b-4337-9e9c-0a1f60a52c9c`::moving from state init -> state preparing
>Thread-4488::INFO::2014-04-10 18:22:43,730::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4488::INFO::2014-04-10 18:22:43,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4488::DEBUG::2014-04-10 18:22:43,731::task::1168::TaskManager.Task::(prepare) Task=`bba4dbef-984b-4337-9e9c-0a1f60a52c9c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4488::DEBUG::2014-04-10 18:22:43,731::task::579::TaskManager.Task::(_updateState) Task=`bba4dbef-984b-4337-9e9c-0a1f60a52c9c`::moving from state preparing -> state finished
>Thread-4488::DEBUG::2014-04-10 18:22:43,731::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4488::DEBUG::2014-04-10 18:22:43,731::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4488::DEBUG::2014-04-10 18:22:43,731::task::974::TaskManager.Task::(_decref) Task=`bba4dbef-984b-4337-9e9c-0a1f60a52c9c`::ref 0 aborting False
>Thread-4489::DEBUG::2014-04-10 18:22:43,738::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [211fe558]
>Thread-4489::DEBUG::2014-04-10 18:22:43,738::task::579::TaskManager.Task::(_updateState) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::moving from state init -> state preparing
>Thread-4489::INFO::2014-04-10 18:22:43,739::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4489::DEBUG::2014-04-10 18:22:43,739::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2075a77b-fefd-46c1-b002-5aba97dec4e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4489::DEBUG::2014-04-10 18:22:43,739::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4489::DEBUG::2014-04-10 18:22:43,739::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4489::DEBUG::2014-04-10 18:22:43,740::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2075a77b-fefd-46c1-b002-5aba97dec4e1`::Granted request
>Thread-4489::DEBUG::2014-04-10 18:22:43,740::task::811::TaskManager.Task::(resourceAcquired) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4489::DEBUG::2014-04-10 18:22:43,740::task::974::TaskManager.Task::(_decref) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::ref 1 aborting False
>Thread-4489::INFO::2014-04-10 18:22:43,742::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4489::DEBUG::2014-04-10 18:22:43,742::task::1168::TaskManager.Task::(prepare) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4489::DEBUG::2014-04-10 18:22:43,742::task::579::TaskManager.Task::(_updateState) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::moving from state preparing -> state finished
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4489::DEBUG::2014-04-10 18:22:43,743::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4489::DEBUG::2014-04-10 18:22:43,744::task::974::TaskManager.Task::(_decref) Task=`131b63ea-2b1e-4937-8aba-35eb6de81635`::ref 0 aborting False
>Thread-4491::DEBUG::2014-04-10 18:22:47,076::task::579::TaskManager.Task::(_updateState) Task=`c42b000f-fd88-430f-8fe9-05d439f3273c`::moving from state init -> state preparing
>Thread-4491::INFO::2014-04-10 18:22:47,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4491::INFO::2014-04-10 18:22:47,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476355', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049291', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034406', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438875', 'lastCheck': '7.0', 'valid': True}}
>Thread-4491::DEBUG::2014-04-10 18:22:47,076::task::1168::TaskManager.Task::(prepare) Task=`c42b000f-fd88-430f-8fe9-05d439f3273c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476355', 'lastCheck': '6.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049291', 'lastCheck': '7.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034406', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438875', 'lastCheck': '7.0', 'valid': True}}
>Thread-4491::DEBUG::2014-04-10 18:22:47,077::task::579::TaskManager.Task::(_updateState) Task=`c42b000f-fd88-430f-8fe9-05d439f3273c`::moving from state preparing -> state finished
>Thread-4491::DEBUG::2014-04-10 18:22:47,077::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4491::DEBUG::2014-04-10 18:22:47,077::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4491::DEBUG::2014-04-10 18:22:47,077::task::974::TaskManager.Task::(_decref) Task=`c42b000f-fd88-430f-8fe9-05d439f3273c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:49,971::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:49,978::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00044722 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:22:49,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:22:49,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000501041 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:22:50,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:22:50,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000427024 s, 862 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:22:50,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:22:50,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000385177 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4495::DEBUG::2014-04-10 18:22:53,883::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4495::DEBUG::2014-04-10 18:22:53,884::task::579::TaskManager.Task::(_updateState) Task=`a151d02a-68a2-454f-889e-b7e9ed8815e0`::moving from state init -> state preparing
>Thread-4495::INFO::2014-04-10 18:22:53,884::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4495::INFO::2014-04-10 18:22:53,885::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4495::DEBUG::2014-04-10 18:22:53,885::task::1168::TaskManager.Task::(prepare) Task=`a151d02a-68a2-454f-889e-b7e9ed8815e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4495::DEBUG::2014-04-10 18:22:53,885::task::579::TaskManager.Task::(_updateState) Task=`a151d02a-68a2-454f-889e-b7e9ed8815e0`::moving from state preparing -> state finished
>Thread-4495::DEBUG::2014-04-10 18:22:53,885::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4495::DEBUG::2014-04-10 18:22:53,885::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4495::DEBUG::2014-04-10 18:22:53,885::task::974::TaskManager.Task::(_decref) Task=`a151d02a-68a2-454f-889e-b7e9ed8815e0`::ref 0 aborting False
>Thread-4496::DEBUG::2014-04-10 18:22:53,892::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4496::DEBUG::2014-04-10 18:22:53,892::task::579::TaskManager.Task::(_updateState) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::moving from state init -> state preparing
>Thread-4496::INFO::2014-04-10 18:22:53,893::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4496::DEBUG::2014-04-10 18:22:53,893::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b6d43f1-6764-4998-a62a-4738f665b516`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4496::DEBUG::2014-04-10 18:22:53,893::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4496::DEBUG::2014-04-10 18:22:53,893::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4496::DEBUG::2014-04-10 18:22:53,894::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b6d43f1-6764-4998-a62a-4738f665b516`::Granted request
>Thread-4496::DEBUG::2014-04-10 18:22:53,894::task::811::TaskManager.Task::(resourceAcquired) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4496::DEBUG::2014-04-10 18:22:53,894::task::974::TaskManager.Task::(_decref) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::ref 1 aborting False
>Thread-4496::INFO::2014-04-10 18:22:53,896::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4496::DEBUG::2014-04-10 18:22:53,897::task::1168::TaskManager.Task::(prepare) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4496::DEBUG::2014-04-10 18:22:53,897::task::579::TaskManager.Task::(_updateState) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::moving from state preparing -> state finished
>Thread-4496::DEBUG::2014-04-10 18:22:53,897::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4496::DEBUG::2014-04-10 18:22:53,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4496::DEBUG::2014-04-10 18:22:53,897::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4496::DEBUG::2014-04-10 18:22:53,898::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4496::DEBUG::2014-04-10 18:22:53,898::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4496::DEBUG::2014-04-10 18:22:53,898::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4496::DEBUG::2014-04-10 18:22:53,898::task::974::TaskManager.Task::(_decref) Task=`4698de8e-8620-48e0-9f66-97cdf8eabe25`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:22:59,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:22:59,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000398292 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:00,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:00,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252689 s, 2.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:00,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:00,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481272 s, 765 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:00,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:00,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000450199 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4499::DEBUG::2014-04-10 18:23:02,679::task::579::TaskManager.Task::(_updateState) Task=`33ef1646-1c9e-4d81-94f6-a556bf520059`::moving from state init -> state preparing
>Thread-4499::INFO::2014-04-10 18:23:02,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4499::INFO::2014-04-10 18:23:02,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450199', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398292', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252689', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481272', 'lastCheck': '2.6', 'valid': True}}
>Thread-4499::DEBUG::2014-04-10 18:23:02,680::task::1168::TaskManager.Task::(prepare) Task=`33ef1646-1c9e-4d81-94f6-a556bf520059`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450199', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398292', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252689', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481272', 'lastCheck': '2.6', 'valid': True}}
>Thread-4499::DEBUG::2014-04-10 18:23:02,681::task::579::TaskManager.Task::(_updateState) Task=`33ef1646-1c9e-4d81-94f6-a556bf520059`::moving from state preparing -> state finished
>Thread-4499::DEBUG::2014-04-10 18:23:02,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4499::DEBUG::2014-04-10 18:23:02,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4499::DEBUG::2014-04-10 18:23:02,681::task::974::TaskManager.Task::(_decref) Task=`33ef1646-1c9e-4d81-94f6-a556bf520059`::ref 0 aborting False
>Thread-4501::DEBUG::2014-04-10 18:23:04,024::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4501::DEBUG::2014-04-10 18:23:04,024::task::579::TaskManager.Task::(_updateState) Task=`b55e5621-7300-4503-bbae-77f38e75dfad`::moving from state init -> state preparing
>Thread-4501::INFO::2014-04-10 18:23:04,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4501::INFO::2014-04-10 18:23:04,025::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4501::DEBUG::2014-04-10 18:23:04,025::task::1168::TaskManager.Task::(prepare) Task=`b55e5621-7300-4503-bbae-77f38e75dfad`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4501::DEBUG::2014-04-10 18:23:04,025::task::579::TaskManager.Task::(_updateState) Task=`b55e5621-7300-4503-bbae-77f38e75dfad`::moving from state preparing -> state finished
>Thread-4501::DEBUG::2014-04-10 18:23:04,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4501::DEBUG::2014-04-10 18:23:04,026::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4501::DEBUG::2014-04-10 18:23:04,026::task::974::TaskManager.Task::(_decref) Task=`b55e5621-7300-4503-bbae-77f38e75dfad`::ref 0 aborting False
>Thread-4502::DEBUG::2014-04-10 18:23:04,032::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4502::DEBUG::2014-04-10 18:23:04,032::task::579::TaskManager.Task::(_updateState) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::moving from state init -> state preparing
>Thread-4502::INFO::2014-04-10 18:23:04,033::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4502::DEBUG::2014-04-10 18:23:04,033::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f50e6bb2-7133-4157-a4a0-16772cbde1ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4502::DEBUG::2014-04-10 18:23:04,033::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4502::DEBUG::2014-04-10 18:23:04,034::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4502::DEBUG::2014-04-10 18:23:04,034::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f50e6bb2-7133-4157-a4a0-16772cbde1ec`::Granted request
>Thread-4502::DEBUG::2014-04-10 18:23:04,034::task::811::TaskManager.Task::(resourceAcquired) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4502::DEBUG::2014-04-10 18:23:04,034::task::974::TaskManager.Task::(_decref) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::ref 1 aborting False
>Thread-4502::INFO::2014-04-10 18:23:04,036::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4502::DEBUG::2014-04-10 18:23:04,037::task::1168::TaskManager.Task::(prepare) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4502::DEBUG::2014-04-10 18:23:04,037::task::579::TaskManager.Task::(_updateState) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::moving from state preparing -> state finished
>Thread-4502::DEBUG::2014-04-10 18:23:04,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4502::DEBUG::2014-04-10 18:23:04,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4502::DEBUG::2014-04-10 18:23:04,037::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4502::DEBUG::2014-04-10 18:23:04,038::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4502::DEBUG::2014-04-10 18:23:04,038::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4502::DEBUG::2014-04-10 18:23:04,038::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4502::DEBUG::2014-04-10 18:23:04,038::task::974::TaskManager.Task::(_decref) Task=`6077c834-8d5b-4297-aa53-880ed5507328`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:23:10,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:23:10,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421871 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:10,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:10,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000259644 s, 2.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:10,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:10,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470091 s, 783 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:10,304::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:10,310::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00042251 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4506::DEBUG::2014-04-10 18:23:14,131::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-4506::DEBUG::2014-04-10 18:23:14,132::task::579::TaskManager.Task::(_updateState) Task=`739d416d-49b0-4719-9e0b-8d1d190d3940`::moving from state init -> state preparing
>Thread-4506::INFO::2014-04-10 18:23:14,132::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4506::INFO::2014-04-10 18:23:14,132::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4506::DEBUG::2014-04-10 18:23:14,132::task::1168::TaskManager.Task::(prepare) Task=`739d416d-49b0-4719-9e0b-8d1d190d3940`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4506::DEBUG::2014-04-10 18:23:14,133::task::579::TaskManager.Task::(_updateState) Task=`739d416d-49b0-4719-9e0b-8d1d190d3940`::moving from state preparing -> state finished
>Thread-4506::DEBUG::2014-04-10 18:23:14,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4506::DEBUG::2014-04-10 18:23:14,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4506::DEBUG::2014-04-10 18:23:14,133::task::974::TaskManager.Task::(_decref) Task=`739d416d-49b0-4719-9e0b-8d1d190d3940`::ref 0 aborting False
>Thread-4507::DEBUG::2014-04-10 18:23:14,139::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7dac8568]
>Thread-4507::DEBUG::2014-04-10 18:23:14,140::task::579::TaskManager.Task::(_updateState) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::moving from state init -> state preparing
>Thread-4507::INFO::2014-04-10 18:23:14,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4507::DEBUG::2014-04-10 18:23:14,140::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d95f38cf-7b8e-4b5b-9717-c785791422fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4507::DEBUG::2014-04-10 18:23:14,141::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4507::DEBUG::2014-04-10 18:23:14,141::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4507::DEBUG::2014-04-10 18:23:14,141::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d95f38cf-7b8e-4b5b-9717-c785791422fa`::Granted request
>Thread-4507::DEBUG::2014-04-10 18:23:14,141::task::811::TaskManager.Task::(resourceAcquired) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4507::DEBUG::2014-04-10 18:23:14,142::task::974::TaskManager.Task::(_decref) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::ref 1 aborting False
>Thread-4507::INFO::2014-04-10 18:23:14,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4507::DEBUG::2014-04-10 18:23:14,144::task::1168::TaskManager.Task::(prepare) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4507::DEBUG::2014-04-10 18:23:14,144::task::579::TaskManager.Task::(_updateState) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::moving from state preparing -> state finished
>Thread-4507::DEBUG::2014-04-10 18:23:14,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4507::DEBUG::2014-04-10 18:23:14,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4507::DEBUG::2014-04-10 18:23:14,144::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4507::DEBUG::2014-04-10 18:23:14,145::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4507::DEBUG::2014-04-10 18:23:14,145::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4507::DEBUG::2014-04-10 18:23:14,145::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4507::DEBUG::2014-04-10 18:23:14,145::task::974::TaskManager.Task::(_decref) Task=`97d4582e-6e06-4470-9ddd-ec48485b1f0c`::ref 0 aborting False
>Thread-4509::DEBUG::2014-04-10 18:23:17,848::task::579::TaskManager.Task::(_updateState) Task=`2f96daaf-6746-4d6c-9188-faa51ae44cd4`::moving from state init -> state preparing
>Thread-4509::INFO::2014-04-10 18:23:17,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4509::INFO::2014-04-10 18:23:17,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042251', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421871', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259644', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470091', 'lastCheck': '7.7', 'valid': True}}
>Thread-4509::DEBUG::2014-04-10 18:23:17,849::task::1168::TaskManager.Task::(prepare) Task=`2f96daaf-6746-4d6c-9188-faa51ae44cd4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042251', 'lastCheck': '7.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421871', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000259644', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470091', 'lastCheck': '7.7', 'valid': True}}
>Thread-4509::DEBUG::2014-04-10 18:23:17,849::task::579::TaskManager.Task::(_updateState) Task=`2f96daaf-6746-4d6c-9188-faa51ae44cd4`::moving from state preparing -> state finished
>Thread-4509::DEBUG::2014-04-10 18:23:17,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4509::DEBUG::2014-04-10 18:23:17,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4509::DEBUG::2014-04-10 18:23:17,850::task::974::TaskManager.Task::(_decref) Task=`2f96daaf-6746-4d6c-9188-faa51ae44cd4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:23:20,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:23:20,066::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356868 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:20,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:20,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000268982 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:20,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:20,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045416 s, 810 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:20,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:20,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000444806 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4513::DEBUG::2014-04-10 18:23:24,237::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4513::DEBUG::2014-04-10 18:23:24,238::task::579::TaskManager.Task::(_updateState) Task=`ce9e5ef4-9b40-46a3-96e5-04df98aafeb4`::moving from state init -> state preparing
>Thread-4513::INFO::2014-04-10 18:23:24,238::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4513::INFO::2014-04-10 18:23:24,239::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4513::DEBUG::2014-04-10 18:23:24,239::task::1168::TaskManager.Task::(prepare) Task=`ce9e5ef4-9b40-46a3-96e5-04df98aafeb4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4513::DEBUG::2014-04-10 18:23:24,239::task::579::TaskManager.Task::(_updateState) Task=`ce9e5ef4-9b40-46a3-96e5-04df98aafeb4`::moving from state preparing -> state finished
>Thread-4513::DEBUG::2014-04-10 18:23:24,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4513::DEBUG::2014-04-10 18:23:24,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4513::DEBUG::2014-04-10 18:23:24,240::task::974::TaskManager.Task::(_decref) Task=`ce9e5ef4-9b40-46a3-96e5-04df98aafeb4`::ref 0 aborting False
>Thread-4514::DEBUG::2014-04-10 18:23:24,247::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4514::DEBUG::2014-04-10 18:23:24,247::task::579::TaskManager.Task::(_updateState) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::moving from state init -> state preparing
>Thread-4514::INFO::2014-04-10 18:23:24,247::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4514::DEBUG::2014-04-10 18:23:24,248::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a92b35a-46d7-40c9-bb4e-009b4bbd484f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4514::DEBUG::2014-04-10 18:23:24,248::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4514::DEBUG::2014-04-10 18:23:24,248::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4514::DEBUG::2014-04-10 18:23:24,248::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a92b35a-46d7-40c9-bb4e-009b4bbd484f`::Granted request
>Thread-4514::DEBUG::2014-04-10 18:23:24,249::task::811::TaskManager.Task::(resourceAcquired) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4514::DEBUG::2014-04-10 18:23:24,249::task::974::TaskManager.Task::(_decref) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::ref 1 aborting False
>Thread-4514::INFO::2014-04-10 18:23:24,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4514::DEBUG::2014-04-10 18:23:24,251::task::1168::TaskManager.Task::(prepare) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4514::DEBUG::2014-04-10 18:23:24,252::task::579::TaskManager.Task::(_updateState) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::moving from state preparing -> state finished
>Thread-4514::DEBUG::2014-04-10 18:23:24,252::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4514::DEBUG::2014-04-10 18:23:24,252::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4514::DEBUG::2014-04-10 18:23:24,252::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4514::DEBUG::2014-04-10 18:23:24,252::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4514::DEBUG::2014-04-10 18:23:24,253::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4514::DEBUG::2014-04-10 18:23:24,253::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4514::DEBUG::2014-04-10 18:23:24,253::task::974::TaskManager.Task::(_decref) Task=`e5ea2fd6-0b00-47ac-80de-4a8b6ef8696d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:23:30,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:23:30,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00027521 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:30,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:30,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029205 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:30,149::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:30,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000631074 s, 583 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:30,329::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:23:30,342::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:23:30,344::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:23:30,349::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:23:30,351::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:23:30,351::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:23:30,351::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:23:30,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:30,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000365272 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4521::DEBUG::2014-04-10 18:23:32,999::task::579::TaskManager.Task::(_updateState) Task=`6e3417af-4a12-427b-9e52-48d1ca4612f6`::moving from state init -> state preparing
>Thread-4521::INFO::2014-04-10 18:23:32,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4521::INFO::2014-04-10 18:23:33,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365272', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027521', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029205', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631074', 'lastCheck': '2.8', 'valid': True}}
>Thread-4521::DEBUG::2014-04-10 18:23:33,000::task::1168::TaskManager.Task::(prepare) Task=`6e3417af-4a12-427b-9e52-48d1ca4612f6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365272', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00027521', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029205', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631074', 'lastCheck': '2.8', 'valid': True}}
>Thread-4521::DEBUG::2014-04-10 18:23:33,000::task::579::TaskManager.Task::(_updateState) Task=`6e3417af-4a12-427b-9e52-48d1ca4612f6`::moving from state preparing -> state finished
>Thread-4521::DEBUG::2014-04-10 18:23:33,000::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4521::DEBUG::2014-04-10 18:23:33,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4521::DEBUG::2014-04-10 18:23:33,001::task::974::TaskManager.Task::(_decref) Task=`6e3417af-4a12-427b-9e52-48d1ca4612f6`::ref 0 aborting False
>Thread-4523::DEBUG::2014-04-10 18:23:34,344::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4523::DEBUG::2014-04-10 18:23:34,345::task::579::TaskManager.Task::(_updateState) Task=`df277044-2577-4be4-95a0-965256ab4f2f`::moving from state init -> state preparing
>Thread-4523::INFO::2014-04-10 18:23:34,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4523::INFO::2014-04-10 18:23:34,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4523::DEBUG::2014-04-10 18:23:34,345::task::1168::TaskManager.Task::(prepare) Task=`df277044-2577-4be4-95a0-965256ab4f2f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4523::DEBUG::2014-04-10 18:23:34,345::task::579::TaskManager.Task::(_updateState) Task=`df277044-2577-4be4-95a0-965256ab4f2f`::moving from state preparing -> state finished
>Thread-4523::DEBUG::2014-04-10 18:23:34,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4523::DEBUG::2014-04-10 18:23:34,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4523::DEBUG::2014-04-10 18:23:34,346::task::974::TaskManager.Task::(_decref) Task=`df277044-2577-4be4-95a0-965256ab4f2f`::ref 0 aborting False
>Thread-4524::DEBUG::2014-04-10 18:23:34,352::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4524::DEBUG::2014-04-10 18:23:34,352::task::579::TaskManager.Task::(_updateState) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::moving from state init -> state preparing
>Thread-4524::INFO::2014-04-10 18:23:34,352::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4524::DEBUG::2014-04-10 18:23:34,353::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f43b1ae6-ae2d-428e-ad3e-8ffa4c346c5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4524::DEBUG::2014-04-10 18:23:34,353::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4524::DEBUG::2014-04-10 18:23:34,353::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4524::DEBUG::2014-04-10 18:23:34,353::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f43b1ae6-ae2d-428e-ad3e-8ffa4c346c5a`::Granted request
>Thread-4524::DEBUG::2014-04-10 18:23:34,353::task::811::TaskManager.Task::(resourceAcquired) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4524::DEBUG::2014-04-10 18:23:34,354::task::974::TaskManager.Task::(_decref) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::ref 1 aborting False
>Thread-4524::INFO::2014-04-10 18:23:34,355::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4524::DEBUG::2014-04-10 18:23:34,355::task::1168::TaskManager.Task::(prepare) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4524::DEBUG::2014-04-10 18:23:34,356::task::579::TaskManager.Task::(_updateState) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::moving from state preparing -> state finished
>Thread-4524::DEBUG::2014-04-10 18:23:34,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4524::DEBUG::2014-04-10 18:23:34,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4524::DEBUG::2014-04-10 18:23:34,356::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4524::DEBUG::2014-04-10 18:23:34,356::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4524::DEBUG::2014-04-10 18:23:34,357::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4524::DEBUG::2014-04-10 18:23:34,357::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4524::DEBUG::2014-04-10 18:23:34,357::task::974::TaskManager.Task::(_decref) Task=`1b0d7576-ed66-45ba-bc74-d2f00a62e41c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:23:40,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:23:40,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00030159 s, 2.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:40,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:40,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:40,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00195133 s, 344 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:40,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502466 s, 732 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:40,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:40,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000496779 s, 1.3 MB/s\n'; <rc> = 0
>Thread-4528::DEBUG::2014-04-10 18:23:44,444::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4528::DEBUG::2014-04-10 18:23:44,445::task::579::TaskManager.Task::(_updateState) Task=`1378b3fc-fdc3-4612-8cee-8b1f5af91f37`::moving from state init -> state preparing
>Thread-4528::INFO::2014-04-10 18:23:44,445::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4528::INFO::2014-04-10 18:23:44,445::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4528::DEBUG::2014-04-10 18:23:44,445::task::1168::TaskManager.Task::(prepare) Task=`1378b3fc-fdc3-4612-8cee-8b1f5af91f37`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4528::DEBUG::2014-04-10 18:23:44,446::task::579::TaskManager.Task::(_updateState) Task=`1378b3fc-fdc3-4612-8cee-8b1f5af91f37`::moving from state preparing -> state finished
>Thread-4528::DEBUG::2014-04-10 18:23:44,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4528::DEBUG::2014-04-10 18:23:44,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4528::DEBUG::2014-04-10 18:23:44,446::task::974::TaskManager.Task::(_decref) Task=`1378b3fc-fdc3-4612-8cee-8b1f5af91f37`::ref 0 aborting False
>Thread-4529::DEBUG::2014-04-10 18:23:44,453::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4529::DEBUG::2014-04-10 18:23:44,453::task::579::TaskManager.Task::(_updateState) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::moving from state init -> state preparing
>Thread-4529::INFO::2014-04-10 18:23:44,453::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4529::DEBUG::2014-04-10 18:23:44,454::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6c7bdea-455c-42e5-8b02-2d6e4f5feba1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4529::DEBUG::2014-04-10 18:23:44,454::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4529::DEBUG::2014-04-10 18:23:44,454::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4529::DEBUG::2014-04-10 18:23:44,454::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6c7bdea-455c-42e5-8b02-2d6e4f5feba1`::Granted request
>Thread-4529::DEBUG::2014-04-10 18:23:44,455::task::811::TaskManager.Task::(resourceAcquired) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4529::DEBUG::2014-04-10 18:23:44,455::task::974::TaskManager.Task::(_decref) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::ref 1 aborting False
>Thread-4529::INFO::2014-04-10 18:23:44,457::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4529::DEBUG::2014-04-10 18:23:44,457::task::1168::TaskManager.Task::(prepare) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4529::DEBUG::2014-04-10 18:23:44,457::task::579::TaskManager.Task::(_updateState) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::moving from state preparing -> state finished
>Thread-4529::DEBUG::2014-04-10 18:23:44,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4529::DEBUG::2014-04-10 18:23:44,458::task::974::TaskManager.Task::(_decref) Task=`bb48b825-131d-4a89-a9cc-33579bb3ed06`::ref 0 aborting False
>Thread-4531::DEBUG::2014-04-10 18:23:48,159::task::579::TaskManager.Task::(_updateState) Task=`6c445f0a-25b4-4e51-8127-c1ba6584df1d`::moving from state init -> state preparing
>Thread-4531::INFO::2014-04-10 18:23:48,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4531::INFO::2014-04-10 18:23:48,160::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496779', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030159', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195133', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502466', 'lastCheck': '8.0', 'valid': True}}
>Thread-4531::DEBUG::2014-04-10 18:23:48,160::task::1168::TaskManager.Task::(prepare) Task=`6c445f0a-25b4-4e51-8127-c1ba6584df1d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496779', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030159', 'lastCheck': '8.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195133', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502466', 'lastCheck': '8.0', 'valid': True}}
>Thread-4531::DEBUG::2014-04-10 18:23:48,160::task::579::TaskManager.Task::(_updateState) Task=`6c445f0a-25b4-4e51-8127-c1ba6584df1d`::moving from state preparing -> state finished
>Thread-4531::DEBUG::2014-04-10 18:23:48,160::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4531::DEBUG::2014-04-10 18:23:48,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4531::DEBUG::2014-04-10 18:23:48,161::task::974::TaskManager.Task::(_decref) Task=`6c445f0a-25b4-4e51-8127-c1ba6584df1d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:23:50,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:23:50,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396717 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:23:50,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:23:50,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:23:50,253::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000352959 s, 1.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:23:50,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252775 s, 2.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:23:50,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:23:50,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000455011 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4535::DEBUG::2014-04-10 18:23:54,574::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-4535::DEBUG::2014-04-10 18:23:54,575::task::579::TaskManager.Task::(_updateState) Task=`38f277e2-a631-409e-88bb-31f2c3ffc331`::moving from state init -> state preparing
>Thread-4535::INFO::2014-04-10 18:23:54,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4535::INFO::2014-04-10 18:23:54,576::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4535::DEBUG::2014-04-10 18:23:54,576::task::1168::TaskManager.Task::(prepare) Task=`38f277e2-a631-409e-88bb-31f2c3ffc331`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4535::DEBUG::2014-04-10 18:23:54,576::task::579::TaskManager.Task::(_updateState) Task=`38f277e2-a631-409e-88bb-31f2c3ffc331`::moving from state preparing -> state finished
>Thread-4535::DEBUG::2014-04-10 18:23:54,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4535::DEBUG::2014-04-10 18:23:54,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4535::DEBUG::2014-04-10 18:23:54,576::task::974::TaskManager.Task::(_decref) Task=`38f277e2-a631-409e-88bb-31f2c3ffc331`::ref 0 aborting False
>Thread-4536::DEBUG::2014-04-10 18:23:54,583::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-4536::DEBUG::2014-04-10 18:23:54,583::task::579::TaskManager.Task::(_updateState) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::moving from state init -> state preparing
>Thread-4536::INFO::2014-04-10 18:23:54,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4536::DEBUG::2014-04-10 18:23:54,584::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25a8b143-2e84-4031-bd9c-3145efc4e0af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4536::DEBUG::2014-04-10 18:23:54,584::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4536::DEBUG::2014-04-10 18:23:54,585::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4536::DEBUG::2014-04-10 18:23:54,585::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`25a8b143-2e84-4031-bd9c-3145efc4e0af`::Granted request
>Thread-4536::DEBUG::2014-04-10 18:23:54,585::task::811::TaskManager.Task::(resourceAcquired) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4536::DEBUG::2014-04-10 18:23:54,585::task::974::TaskManager.Task::(_decref) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::ref 1 aborting False
>Thread-4536::INFO::2014-04-10 18:23:54,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4536::DEBUG::2014-04-10 18:23:54,588::task::1168::TaskManager.Task::(prepare) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4536::DEBUG::2014-04-10 18:23:54,588::task::579::TaskManager.Task::(_updateState) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::moving from state preparing -> state finished
>Thread-4536::DEBUG::2014-04-10 18:23:54,588::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4536::DEBUG::2014-04-10 18:23:54,588::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4536::DEBUG::2014-04-10 18:23:54,588::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4536::DEBUG::2014-04-10 18:23:54,589::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4536::DEBUG::2014-04-10 18:23:54,589::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4536::DEBUG::2014-04-10 18:23:54,589::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4536::DEBUG::2014-04-10 18:23:54,589::task::974::TaskManager.Task::(_decref) Task=`9aad65d1-8d52-4edd-a21c-49a545a5475a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:00,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:00,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397462 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:00,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:00,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:00,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000357085 s, 1.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:00,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000241857 s, 2.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:00,400::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:00,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000351025 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4539::DEBUG::2014-04-10 18:24:03,325::task::579::TaskManager.Task::(_updateState) Task=`dd4e2fa4-a6e8-4163-848b-599526312817`::moving from state init -> state preparing
>Thread-4539::INFO::2014-04-10 18:24:03,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4539::INFO::2014-04-10 18:24:03,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351025', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397462', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241857', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357085', 'lastCheck': '3.0', 'valid': True}}
>Thread-4539::DEBUG::2014-04-10 18:24:03,326::task::1168::TaskManager.Task::(prepare) Task=`dd4e2fa4-a6e8-4163-848b-599526312817`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000351025', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397462', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000241857', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357085', 'lastCheck': '3.0', 'valid': True}}
>Thread-4539::DEBUG::2014-04-10 18:24:03,327::task::579::TaskManager.Task::(_updateState) Task=`dd4e2fa4-a6e8-4163-848b-599526312817`::moving from state preparing -> state finished
>Thread-4539::DEBUG::2014-04-10 18:24:03,327::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4539::DEBUG::2014-04-10 18:24:03,327::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4539::DEBUG::2014-04-10 18:24:03,327::task::974::TaskManager.Task::(_decref) Task=`dd4e2fa4-a6e8-4163-848b-599526312817`::ref 0 aborting False
>Thread-4541::DEBUG::2014-04-10 18:24:04,681::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4541::DEBUG::2014-04-10 18:24:04,682::task::579::TaskManager.Task::(_updateState) Task=`0c28d9f1-3b46-4297-b607-8a3d3f46311c`::moving from state init -> state preparing
>Thread-4541::INFO::2014-04-10 18:24:04,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4541::INFO::2014-04-10 18:24:04,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4541::DEBUG::2014-04-10 18:24:04,683::task::1168::TaskManager.Task::(prepare) Task=`0c28d9f1-3b46-4297-b607-8a3d3f46311c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4541::DEBUG::2014-04-10 18:24:04,683::task::579::TaskManager.Task::(_updateState) Task=`0c28d9f1-3b46-4297-b607-8a3d3f46311c`::moving from state preparing -> state finished
>Thread-4541::DEBUG::2014-04-10 18:24:04,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4541::DEBUG::2014-04-10 18:24:04,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4541::DEBUG::2014-04-10 18:24:04,683::task::974::TaskManager.Task::(_decref) Task=`0c28d9f1-3b46-4297-b607-8a3d3f46311c`::ref 0 aborting False
>Thread-4542::DEBUG::2014-04-10 18:24:04,689::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4542::DEBUG::2014-04-10 18:24:04,690::task::579::TaskManager.Task::(_updateState) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::moving from state init -> state preparing
>Thread-4542::INFO::2014-04-10 18:24:04,690::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4542::DEBUG::2014-04-10 18:24:04,690::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e256ce2a-e5c6-47af-8c57-a63c46df0fe9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4542::DEBUG::2014-04-10 18:24:04,690::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4542::DEBUG::2014-04-10 18:24:04,691::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4542::DEBUG::2014-04-10 18:24:04,691::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e256ce2a-e5c6-47af-8c57-a63c46df0fe9`::Granted request
>Thread-4542::DEBUG::2014-04-10 18:24:04,691::task::811::TaskManager.Task::(resourceAcquired) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4542::DEBUG::2014-04-10 18:24:04,691::task::974::TaskManager.Task::(_decref) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::ref 1 aborting False
>Thread-4542::INFO::2014-04-10 18:24:04,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4542::DEBUG::2014-04-10 18:24:04,693::task::1168::TaskManager.Task::(prepare) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4542::DEBUG::2014-04-10 18:24:04,693::task::579::TaskManager.Task::(_updateState) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::moving from state preparing -> state finished
>Thread-4542::DEBUG::2014-04-10 18:24:04,693::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4542::DEBUG::2014-04-10 18:24:04,694::task::974::TaskManager.Task::(_decref) Task=`a6e483e8-bbb6-4769-b242-81508830753b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:10,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:10,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000417988 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:10,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:10,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:10,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000391477 s, 940 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:10,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244813 s, 2.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:10,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:10,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000467217 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4546::DEBUG::2014-04-10 18:24:14,773::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4546::DEBUG::2014-04-10 18:24:14,774::task::579::TaskManager.Task::(_updateState) Task=`9799fd6b-6ad2-4af4-9670-260618312afd`::moving from state init -> state preparing
>Thread-4546::INFO::2014-04-10 18:24:14,775::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4546::INFO::2014-04-10 18:24:14,775::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4546::DEBUG::2014-04-10 18:24:14,775::task::1168::TaskManager.Task::(prepare) Task=`9799fd6b-6ad2-4af4-9670-260618312afd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4546::DEBUG::2014-04-10 18:24:14,775::task::579::TaskManager.Task::(_updateState) Task=`9799fd6b-6ad2-4af4-9670-260618312afd`::moving from state preparing -> state finished
>Thread-4546::DEBUG::2014-04-10 18:24:14,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4546::DEBUG::2014-04-10 18:24:14,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4546::DEBUG::2014-04-10 18:24:14,776::task::974::TaskManager.Task::(_decref) Task=`9799fd6b-6ad2-4af4-9670-260618312afd`::ref 0 aborting False
>Thread-4547::DEBUG::2014-04-10 18:24:14,782::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4547::DEBUG::2014-04-10 18:24:14,783::task::579::TaskManager.Task::(_updateState) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::moving from state init -> state preparing
>Thread-4547::INFO::2014-04-10 18:24:14,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4547::DEBUG::2014-04-10 18:24:14,783::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a373e834-6f1b-4c18-9e75-56de3390d915`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4547::DEBUG::2014-04-10 18:24:14,783::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4547::DEBUG::2014-04-10 18:24:14,784::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4547::DEBUG::2014-04-10 18:24:14,784::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a373e834-6f1b-4c18-9e75-56de3390d915`::Granted request
>Thread-4547::DEBUG::2014-04-10 18:24:14,784::task::811::TaskManager.Task::(resourceAcquired) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4547::DEBUG::2014-04-10 18:24:14,784::task::974::TaskManager.Task::(_decref) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::ref 1 aborting False
>Thread-4547::INFO::2014-04-10 18:24:14,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4547::DEBUG::2014-04-10 18:24:14,786::task::1168::TaskManager.Task::(prepare) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::task::579::TaskManager.Task::(_updateState) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::moving from state preparing -> state finished
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4547::DEBUG::2014-04-10 18:24:14,787::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4547::DEBUG::2014-04-10 18:24:14,788::task::974::TaskManager.Task::(_decref) Task=`1ac8bcbb-993f-4f9e-aed6-84eff698461c`::ref 0 aborting False
>Thread-4549::DEBUG::2014-04-10 18:24:18,488::task::579::TaskManager.Task::(_updateState) Task=`d62dfe4f-a3d4-4921-adcd-6e1a1fb8567d`::moving from state init -> state preparing
>Thread-4549::INFO::2014-04-10 18:24:18,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4549::INFO::2014-04-10 18:24:18,489::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467217', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417988', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244813', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391477', 'lastCheck': '8.1', 'valid': True}}
>Thread-4549::DEBUG::2014-04-10 18:24:18,489::task::1168::TaskManager.Task::(prepare) Task=`d62dfe4f-a3d4-4921-adcd-6e1a1fb8567d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467217', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417988', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000244813', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391477', 'lastCheck': '8.1', 'valid': True}}
>Thread-4549::DEBUG::2014-04-10 18:24:18,489::task::579::TaskManager.Task::(_updateState) Task=`d62dfe4f-a3d4-4921-adcd-6e1a1fb8567d`::moving from state preparing -> state finished
>Thread-4549::DEBUG::2014-04-10 18:24:18,489::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4549::DEBUG::2014-04-10 18:24:18,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4549::DEBUG::2014-04-10 18:24:18,490::task::974::TaskManager.Task::(_decref) Task=`d62dfe4f-a3d4-4921-adcd-6e1a1fb8567d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:20,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:20,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283294 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:20,406::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:20,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:20,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000309926 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:20,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239658 s, 2.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:20,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:20,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000428316 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4553::DEBUG::2014-04-10 18:24:24,879::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4553::DEBUG::2014-04-10 18:24:24,879::task::579::TaskManager.Task::(_updateState) Task=`37efd6f3-97d4-41ec-b3b5-1b8c86602d7a`::moving from state init -> state preparing
>Thread-4553::INFO::2014-04-10 18:24:24,880::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4553::INFO::2014-04-10 18:24:24,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4553::DEBUG::2014-04-10 18:24:24,880::task::1168::TaskManager.Task::(prepare) Task=`37efd6f3-97d4-41ec-b3b5-1b8c86602d7a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4553::DEBUG::2014-04-10 18:24:24,880::task::579::TaskManager.Task::(_updateState) Task=`37efd6f3-97d4-41ec-b3b5-1b8c86602d7a`::moving from state preparing -> state finished
>Thread-4553::DEBUG::2014-04-10 18:24:24,880::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4553::DEBUG::2014-04-10 18:24:24,881::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4553::DEBUG::2014-04-10 18:24:24,881::task::974::TaskManager.Task::(_decref) Task=`37efd6f3-97d4-41ec-b3b5-1b8c86602d7a`::ref 0 aborting False
>Thread-4554::DEBUG::2014-04-10 18:24:24,888::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4554::DEBUG::2014-04-10 18:24:24,888::task::579::TaskManager.Task::(_updateState) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::moving from state init -> state preparing
>Thread-4554::INFO::2014-04-10 18:24:24,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4554::DEBUG::2014-04-10 18:24:24,889::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e6223f90-ca2e-4615-8313-b5b3ab7c9d12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4554::DEBUG::2014-04-10 18:24:24,889::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4554::DEBUG::2014-04-10 18:24:24,889::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4554::DEBUG::2014-04-10 18:24:24,889::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e6223f90-ca2e-4615-8313-b5b3ab7c9d12`::Granted request
>Thread-4554::DEBUG::2014-04-10 18:24:24,890::task::811::TaskManager.Task::(resourceAcquired) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4554::DEBUG::2014-04-10 18:24:24,890::task::974::TaskManager.Task::(_decref) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::ref 1 aborting False
>Thread-4554::INFO::2014-04-10 18:24:24,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4554::DEBUG::2014-04-10 18:24:24,892::task::1168::TaskManager.Task::(prepare) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4554::DEBUG::2014-04-10 18:24:24,893::task::579::TaskManager.Task::(_updateState) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::moving from state preparing -> state finished
>Thread-4554::DEBUG::2014-04-10 18:24:24,893::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4554::DEBUG::2014-04-10 18:24:24,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4554::DEBUG::2014-04-10 18:24:24,893::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4554::DEBUG::2014-04-10 18:24:24,893::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4554::DEBUG::2014-04-10 18:24:24,894::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4554::DEBUG::2014-04-10 18:24:24,894::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4554::DEBUG::2014-04-10 18:24:24,894::task::974::TaskManager.Task::(_decref) Task=`3d764b0a-fd1e-4491-808a-d9215e6eeec3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:30,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:30,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364938 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:30,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:30,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043524 s, 846 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:30,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:30,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337295 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:30,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:30,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475694 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4557::DEBUG::2014-04-10 18:24:33,645::task::579::TaskManager.Task::(_updateState) Task=`37df608c-2a4d-4fe3-8ed0-0c0512dd7aa0`::moving from state init -> state preparing
>Thread-4557::INFO::2014-04-10 18:24:33,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4557::INFO::2014-04-10 18:24:33,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475694', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364938', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337295', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043524', 'lastCheck': '3.2', 'valid': True}}
>Thread-4557::DEBUG::2014-04-10 18:24:33,646::task::1168::TaskManager.Task::(prepare) Task=`37df608c-2a4d-4fe3-8ed0-0c0512dd7aa0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475694', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364938', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337295', 'lastCheck': '3.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043524', 'lastCheck': '3.2', 'valid': True}}
>Thread-4557::DEBUG::2014-04-10 18:24:33,647::task::579::TaskManager.Task::(_updateState) Task=`37df608c-2a4d-4fe3-8ed0-0c0512dd7aa0`::moving from state preparing -> state finished
>Thread-4557::DEBUG::2014-04-10 18:24:33,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4557::DEBUG::2014-04-10 18:24:33,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4557::DEBUG::2014-04-10 18:24:33,647::task::974::TaskManager.Task::(_decref) Task=`37df608c-2a4d-4fe3-8ed0-0c0512dd7aa0`::ref 0 aborting False
>Thread-4559::DEBUG::2014-04-10 18:24:34,993::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4559::DEBUG::2014-04-10 18:24:34,994::task::579::TaskManager.Task::(_updateState) Task=`6e434eec-904d-4960-b003-ff6746ad5ce1`::moving from state init -> state preparing
>Thread-4559::INFO::2014-04-10 18:24:34,994::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4559::INFO::2014-04-10 18:24:34,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4559::DEBUG::2014-04-10 18:24:34,994::task::1168::TaskManager.Task::(prepare) Task=`6e434eec-904d-4960-b003-ff6746ad5ce1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4559::DEBUG::2014-04-10 18:24:34,995::task::579::TaskManager.Task::(_updateState) Task=`6e434eec-904d-4960-b003-ff6746ad5ce1`::moving from state preparing -> state finished
>Thread-4559::DEBUG::2014-04-10 18:24:34,995::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4559::DEBUG::2014-04-10 18:24:34,995::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4559::DEBUG::2014-04-10 18:24:34,995::task::974::TaskManager.Task::(_decref) Task=`6e434eec-904d-4960-b003-ff6746ad5ce1`::ref 0 aborting False
>Thread-4560::DEBUG::2014-04-10 18:24:35,002::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4560::DEBUG::2014-04-10 18:24:35,002::task::579::TaskManager.Task::(_updateState) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::moving from state init -> state preparing
>Thread-4560::INFO::2014-04-10 18:24:35,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4560::DEBUG::2014-04-10 18:24:35,003::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20858b27-4c6c-4573-bc1a-1854ad88043d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4560::DEBUG::2014-04-10 18:24:35,003::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4560::DEBUG::2014-04-10 18:24:35,003::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4560::DEBUG::2014-04-10 18:24:35,003::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`20858b27-4c6c-4573-bc1a-1854ad88043d`::Granted request
>Thread-4560::DEBUG::2014-04-10 18:24:35,003::task::811::TaskManager.Task::(resourceAcquired) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4560::DEBUG::2014-04-10 18:24:35,004::task::974::TaskManager.Task::(_decref) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::ref 1 aborting False
>Thread-4560::INFO::2014-04-10 18:24:35,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::task::1168::TaskManager.Task::(prepare) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::task::579::TaskManager.Task::(_updateState) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::moving from state preparing -> state finished
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4560::DEBUG::2014-04-10 18:24:35,006::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4560::DEBUG::2014-04-10 18:24:35,007::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4560::DEBUG::2014-04-10 18:24:35,007::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4560::DEBUG::2014-04-10 18:24:35,007::task::974::TaskManager.Task::(_decref) Task=`e40eab89-b31f-4dae-863b-d81b604bcf82`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:40,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:40,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003533 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:40,474::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:40,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000473684 s, 777 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:40,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:40,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348003 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:40,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:40,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479044 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4564::DEBUG::2014-04-10 18:24:45,102::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-4564::DEBUG::2014-04-10 18:24:45,103::task::579::TaskManager.Task::(_updateState) Task=`18b6476b-ad3b-4e78-8c89-0261684583a0`::moving from state init -> state preparing
>Thread-4564::INFO::2014-04-10 18:24:45,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4564::INFO::2014-04-10 18:24:45,103::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4564::DEBUG::2014-04-10 18:24:45,104::task::1168::TaskManager.Task::(prepare) Task=`18b6476b-ad3b-4e78-8c89-0261684583a0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4564::DEBUG::2014-04-10 18:24:45,104::task::579::TaskManager.Task::(_updateState) Task=`18b6476b-ad3b-4e78-8c89-0261684583a0`::moving from state preparing -> state finished
>Thread-4564::DEBUG::2014-04-10 18:24:45,104::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4564::DEBUG::2014-04-10 18:24:45,104::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4564::DEBUG::2014-04-10 18:24:45,104::task::974::TaskManager.Task::(_decref) Task=`18b6476b-ad3b-4e78-8c89-0261684583a0`::ref 0 aborting False
>Thread-4565::DEBUG::2014-04-10 18:24:45,111::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b343828]
>Thread-4565::DEBUG::2014-04-10 18:24:45,111::task::579::TaskManager.Task::(_updateState) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::moving from state init -> state preparing
>Thread-4565::INFO::2014-04-10 18:24:45,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4565::DEBUG::2014-04-10 18:24:45,112::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0797079c-150c-4837-9d0e-fa3138e20354`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4565::DEBUG::2014-04-10 18:24:45,112::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4565::DEBUG::2014-04-10 18:24:45,112::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4565::DEBUG::2014-04-10 18:24:45,113::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0797079c-150c-4837-9d0e-fa3138e20354`::Granted request
>Thread-4565::DEBUG::2014-04-10 18:24:45,113::task::811::TaskManager.Task::(resourceAcquired) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4565::DEBUG::2014-04-10 18:24:45,113::task::974::TaskManager.Task::(_decref) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::ref 1 aborting False
>Thread-4565::INFO::2014-04-10 18:24:45,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4565::DEBUG::2014-04-10 18:24:45,115::task::1168::TaskManager.Task::(prepare) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4565::DEBUG::2014-04-10 18:24:45,115::task::579::TaskManager.Task::(_updateState) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::moving from state preparing -> state finished
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4565::DEBUG::2014-04-10 18:24:45,116::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4565::DEBUG::2014-04-10 18:24:45,117::task::974::TaskManager.Task::(_decref) Task=`ed0c8564-4219-49d8-b095-62297c80af46`::ref 0 aborting False
>Thread-4567::DEBUG::2014-04-10 18:24:48,806::task::579::TaskManager.Task::(_updateState) Task=`4a72dcda-788b-4d34-8da5-56a030f1c5c0`::moving from state init -> state preparing
>Thread-4567::INFO::2014-04-10 18:24:48,807::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4567::INFO::2014-04-10 18:24:48,807::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479044', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003533', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348003', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473684', 'lastCheck': '8.3', 'valid': True}}
>Thread-4567::DEBUG::2014-04-10 18:24:48,807::task::1168::TaskManager.Task::(prepare) Task=`4a72dcda-788b-4d34-8da5-56a030f1c5c0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479044', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003533', 'lastCheck': '8.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348003', 'lastCheck': '8.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473684', 'lastCheck': '8.3', 'valid': True}}
>Thread-4567::DEBUG::2014-04-10 18:24:48,807::task::579::TaskManager.Task::(_updateState) Task=`4a72dcda-788b-4d34-8da5-56a030f1c5c0`::moving from state preparing -> state finished
>Thread-4567::DEBUG::2014-04-10 18:24:48,808::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4567::DEBUG::2014-04-10 18:24:48,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4567::DEBUG::2014-04-10 18:24:48,808::task::974::TaskManager.Task::(_decref) Task=`4a72dcda-788b-4d34-8da5-56a030f1c5c0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:24:50,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:24:50,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000483914 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:24:50,489::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:24:50,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000357127 s, 1.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:24:50,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:24:50,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000413481 s, 1.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:24:50,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:24:50,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000553218 s, 1.2 MB/s\n'; <rc> = 0
>Thread-4571::DEBUG::2014-04-10 18:24:55,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4571::DEBUG::2014-04-10 18:24:55,193::task::579::TaskManager.Task::(_updateState) Task=`cf25bdf2-a2fb-44c7-8eda-3b265a93c423`::moving from state init -> state preparing
>Thread-4571::INFO::2014-04-10 18:24:55,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4571::INFO::2014-04-10 18:24:55,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4571::DEBUG::2014-04-10 18:24:55,194::task::1168::TaskManager.Task::(prepare) Task=`cf25bdf2-a2fb-44c7-8eda-3b265a93c423`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4571::DEBUG::2014-04-10 18:24:55,194::task::579::TaskManager.Task::(_updateState) Task=`cf25bdf2-a2fb-44c7-8eda-3b265a93c423`::moving from state preparing -> state finished
>Thread-4571::DEBUG::2014-04-10 18:24:55,194::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4571::DEBUG::2014-04-10 18:24:55,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4571::DEBUG::2014-04-10 18:24:55,194::task::974::TaskManager.Task::(_decref) Task=`cf25bdf2-a2fb-44c7-8eda-3b265a93c423`::ref 0 aborting False
>Thread-4572::DEBUG::2014-04-10 18:24:55,201::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4572::DEBUG::2014-04-10 18:24:55,202::task::579::TaskManager.Task::(_updateState) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::moving from state init -> state preparing
>Thread-4572::INFO::2014-04-10 18:24:55,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4572::DEBUG::2014-04-10 18:24:55,202::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33379ef8-f0f7-4909-8374-c7fdaf2c0804`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4572::DEBUG::2014-04-10 18:24:55,203::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4572::DEBUG::2014-04-10 18:24:55,203::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4572::DEBUG::2014-04-10 18:24:55,203::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33379ef8-f0f7-4909-8374-c7fdaf2c0804`::Granted request
>Thread-4572::DEBUG::2014-04-10 18:24:55,203::task::811::TaskManager.Task::(resourceAcquired) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4572::DEBUG::2014-04-10 18:24:55,204::task::974::TaskManager.Task::(_decref) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::ref 1 aborting False
>Thread-4572::INFO::2014-04-10 18:24:55,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4572::DEBUG::2014-04-10 18:24:55,206::task::1168::TaskManager.Task::(prepare) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4572::DEBUG::2014-04-10 18:24:55,206::task::579::TaskManager.Task::(_updateState) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::moving from state preparing -> state finished
>Thread-4572::DEBUG::2014-04-10 18:24:55,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4572::DEBUG::2014-04-10 18:24:55,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4572::DEBUG::2014-04-10 18:24:55,207::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4572::DEBUG::2014-04-10 18:24:55,207::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4572::DEBUG::2014-04-10 18:24:55,207::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4572::DEBUG::2014-04-10 18:24:55,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4572::DEBUG::2014-04-10 18:24:55,208::task::974::TaskManager.Task::(_decref) Task=`f585fe4b-7eb8-449f-a7c9-5e248931fd22`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:00,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:00,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391746 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:00,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:00,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488336 s, 754 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:00,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:00,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000352285 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:25:00,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:25:00,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000414917 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4575::DEBUG::2014-04-10 18:25:03,967::task::579::TaskManager.Task::(_updateState) Task=`b5d1a7fa-8b5e-4c6d-8c25-15c39aad41e0`::moving from state init -> state preparing
>Thread-4575::INFO::2014-04-10 18:25:03,967::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4575::INFO::2014-04-10 18:25:03,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414917', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391746', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352285', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488336', 'lastCheck': '3.5', 'valid': True}}
>Thread-4575::DEBUG::2014-04-10 18:25:03,968::task::1168::TaskManager.Task::(prepare) Task=`b5d1a7fa-8b5e-4c6d-8c25-15c39aad41e0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414917', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391746', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352285', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488336', 'lastCheck': '3.5', 'valid': True}}
>Thread-4575::DEBUG::2014-04-10 18:25:03,968::task::579::TaskManager.Task::(_updateState) Task=`b5d1a7fa-8b5e-4c6d-8c25-15c39aad41e0`::moving from state preparing -> state finished
>Thread-4575::DEBUG::2014-04-10 18:25:03,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4575::DEBUG::2014-04-10 18:25:03,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4575::DEBUG::2014-04-10 18:25:03,968::task::974::TaskManager.Task::(_decref) Task=`b5d1a7fa-8b5e-4c6d-8c25-15c39aad41e0`::ref 0 aborting False
>Thread-4577::DEBUG::2014-04-10 18:25:05,290::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4577::DEBUG::2014-04-10 18:25:05,313::task::579::TaskManager.Task::(_updateState) Task=`ed87b1f4-9810-4d99-8b8f-0e688a426bfa`::moving from state init -> state preparing
>Thread-4577::INFO::2014-04-10 18:25:05,313::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4577::INFO::2014-04-10 18:25:05,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4577::DEBUG::2014-04-10 18:25:05,314::task::1168::TaskManager.Task::(prepare) Task=`ed87b1f4-9810-4d99-8b8f-0e688a426bfa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4577::DEBUG::2014-04-10 18:25:05,314::task::579::TaskManager.Task::(_updateState) Task=`ed87b1f4-9810-4d99-8b8f-0e688a426bfa`::moving from state preparing -> state finished
>Thread-4577::DEBUG::2014-04-10 18:25:05,314::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4577::DEBUG::2014-04-10 18:25:05,314::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4577::DEBUG::2014-04-10 18:25:05,314::task::974::TaskManager.Task::(_decref) Task=`ed87b1f4-9810-4d99-8b8f-0e688a426bfa`::ref 0 aborting False
>Thread-4578::DEBUG::2014-04-10 18:25:05,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4578::DEBUG::2014-04-10 18:25:05,321::task::579::TaskManager.Task::(_updateState) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::moving from state init -> state preparing
>Thread-4578::INFO::2014-04-10 18:25:05,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4578::DEBUG::2014-04-10 18:25:05,322::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c1ec591-0eed-451e-b0cf-f604040ab391`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4578::DEBUG::2014-04-10 18:25:05,322::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4578::DEBUG::2014-04-10 18:25:05,322::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4578::DEBUG::2014-04-10 18:25:05,323::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2c1ec591-0eed-451e-b0cf-f604040ab391`::Granted request
>Thread-4578::DEBUG::2014-04-10 18:25:05,323::task::811::TaskManager.Task::(resourceAcquired) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4578::DEBUG::2014-04-10 18:25:05,323::task::974::TaskManager.Task::(_decref) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::ref 1 aborting False
>Thread-4578::INFO::2014-04-10 18:25:05,325::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4578::DEBUG::2014-04-10 18:25:05,325::task::1168::TaskManager.Task::(prepare) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4578::DEBUG::2014-04-10 18:25:05,325::task::579::TaskManager.Task::(_updateState) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::moving from state preparing -> state finished
>Thread-4578::DEBUG::2014-04-10 18:25:05,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4578::DEBUG::2014-04-10 18:25:05,326::task::974::TaskManager.Task::(_decref) Task=`e29919d1-13f1-4170-a784-512cdc10f275`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:10,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:10,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402552 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:10,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:10,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447693 s, 822 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:10,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:10,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000500163 s, 1.3 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:25:10,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:25:10,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000469522 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4582::DEBUG::2014-04-10 18:25:15,431::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4582::DEBUG::2014-04-10 18:25:15,432::task::579::TaskManager.Task::(_updateState) Task=`486893b9-f392-4e4a-9e38-792361e0faaf`::moving from state init -> state preparing
>Thread-4582::INFO::2014-04-10 18:25:15,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4582::INFO::2014-04-10 18:25:15,432::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4582::DEBUG::2014-04-10 18:25:15,432::task::1168::TaskManager.Task::(prepare) Task=`486893b9-f392-4e4a-9e38-792361e0faaf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4582::DEBUG::2014-04-10 18:25:15,432::task::579::TaskManager.Task::(_updateState) Task=`486893b9-f392-4e4a-9e38-792361e0faaf`::moving from state preparing -> state finished
>Thread-4582::DEBUG::2014-04-10 18:25:15,433::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4582::DEBUG::2014-04-10 18:25:15,433::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4582::DEBUG::2014-04-10 18:25:15,433::task::974::TaskManager.Task::(_decref) Task=`486893b9-f392-4e4a-9e38-792361e0faaf`::ref 0 aborting False
>Thread-4583::DEBUG::2014-04-10 18:25:15,440::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4583::DEBUG::2014-04-10 18:25:15,440::task::579::TaskManager.Task::(_updateState) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::moving from state init -> state preparing
>Thread-4583::INFO::2014-04-10 18:25:15,441::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4583::DEBUG::2014-04-10 18:25:15,441::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e20fdc41-1056-4ff2-ad2e-134bb04f79b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4583::DEBUG::2014-04-10 18:25:15,441::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4583::DEBUG::2014-04-10 18:25:15,441::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4583::DEBUG::2014-04-10 18:25:15,441::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e20fdc41-1056-4ff2-ad2e-134bb04f79b1`::Granted request
>Thread-4583::DEBUG::2014-04-10 18:25:15,442::task::811::TaskManager.Task::(resourceAcquired) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4583::DEBUG::2014-04-10 18:25:15,442::task::974::TaskManager.Task::(_decref) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::ref 1 aborting False
>Thread-4583::INFO::2014-04-10 18:25:15,444::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4583::DEBUG::2014-04-10 18:25:15,444::task::1168::TaskManager.Task::(prepare) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4583::DEBUG::2014-04-10 18:25:15,444::task::579::TaskManager.Task::(_updateState) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::moving from state preparing -> state finished
>Thread-4583::DEBUG::2014-04-10 18:25:15,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4583::DEBUG::2014-04-10 18:25:15,445::task::974::TaskManager.Task::(_decref) Task=`d898af5a-bd84-48d8-a528-437d6f993939`::ref 0 aborting False
>Thread-4585::DEBUG::2014-04-10 18:25:19,149::task::579::TaskManager.Task::(_updateState) Task=`074c0f07-52da-41f5-8585-712a78cd053e`::moving from state init -> state preparing
>Thread-4585::INFO::2014-04-10 18:25:19,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4585::INFO::2014-04-10 18:25:19,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469522', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402552', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500163', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447693', 'lastCheck': '8.6', 'valid': True}}
>Thread-4585::DEBUG::2014-04-10 18:25:19,150::task::1168::TaskManager.Task::(prepare) Task=`074c0f07-52da-41f5-8585-712a78cd053e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469522', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402552', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500163', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447693', 'lastCheck': '8.6', 'valid': True}}
>Thread-4585::DEBUG::2014-04-10 18:25:19,150::task::579::TaskManager.Task::(_updateState) Task=`074c0f07-52da-41f5-8585-712a78cd053e`::moving from state preparing -> state finished
>Thread-4585::DEBUG::2014-04-10 18:25:19,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4585::DEBUG::2014-04-10 18:25:19,151::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4585::DEBUG::2014-04-10 18:25:19,151::task::974::TaskManager.Task::(_decref) Task=`074c0f07-52da-41f5-8585-712a78cd053e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:20,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:20,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364247 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:20,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:20,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045949 s, 801 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:20,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:20,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000406816 s, 1.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:25:20,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:25:20,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000465947 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4589::DEBUG::2014-04-10 18:25:25,553::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4589::DEBUG::2014-04-10 18:25:25,553::task::579::TaskManager.Task::(_updateState) Task=`cdbd54cf-fd92-4676-9b7a-292b86f6cad4`::moving from state init -> state preparing
>Thread-4589::INFO::2014-04-10 18:25:25,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4589::INFO::2014-04-10 18:25:25,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4589::DEBUG::2014-04-10 18:25:25,554::task::1168::TaskManager.Task::(prepare) Task=`cdbd54cf-fd92-4676-9b7a-292b86f6cad4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4589::DEBUG::2014-04-10 18:25:25,554::task::579::TaskManager.Task::(_updateState) Task=`cdbd54cf-fd92-4676-9b7a-292b86f6cad4`::moving from state preparing -> state finished
>Thread-4589::DEBUG::2014-04-10 18:25:25,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4589::DEBUG::2014-04-10 18:25:25,555::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4589::DEBUG::2014-04-10 18:25:25,555::task::974::TaskManager.Task::(_decref) Task=`cdbd54cf-fd92-4676-9b7a-292b86f6cad4`::ref 0 aborting False
>Thread-4590::DEBUG::2014-04-10 18:25:25,561::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4590::DEBUG::2014-04-10 18:25:25,561::task::579::TaskManager.Task::(_updateState) Task=`52783861-02db-4a4e-869a-2de063b9f683`::moving from state init -> state preparing
>Thread-4590::INFO::2014-04-10 18:25:25,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4590::DEBUG::2014-04-10 18:25:25,562::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`714fb26a-7f82-4402-ab14-70ad004c87d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4590::DEBUG::2014-04-10 18:25:25,562::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4590::DEBUG::2014-04-10 18:25:25,562::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4590::DEBUG::2014-04-10 18:25:25,563::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`714fb26a-7f82-4402-ab14-70ad004c87d3`::Granted request
>Thread-4590::DEBUG::2014-04-10 18:25:25,563::task::811::TaskManager.Task::(resourceAcquired) Task=`52783861-02db-4a4e-869a-2de063b9f683`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4590::DEBUG::2014-04-10 18:25:25,563::task::974::TaskManager.Task::(_decref) Task=`52783861-02db-4a4e-869a-2de063b9f683`::ref 1 aborting False
>Thread-4590::INFO::2014-04-10 18:25:25,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4590::DEBUG::2014-04-10 18:25:25,565::task::1168::TaskManager.Task::(prepare) Task=`52783861-02db-4a4e-869a-2de063b9f683`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4590::DEBUG::2014-04-10 18:25:25,565::task::579::TaskManager.Task::(_updateState) Task=`52783861-02db-4a4e-869a-2de063b9f683`::moving from state preparing -> state finished
>Thread-4590::DEBUG::2014-04-10 18:25:25,565::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4590::DEBUG::2014-04-10 18:25:25,566::task::974::TaskManager.Task::(_decref) Task=`52783861-02db-4a4e-869a-2de063b9f683`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:30,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:30,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000422084 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:30,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:30,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045762 s, 804 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:30,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:30,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00161657 s, 415 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:25:30,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:25:30,645::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000404179 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4593::DEBUG::2014-04-10 18:25:34,361::task::579::TaskManager.Task::(_updateState) Task=`e4d49532-a6a2-4b59-baa1-2ef9ae79d107`::moving from state init -> state preparing
>Thread-4593::INFO::2014-04-10 18:25:34,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4593::INFO::2014-04-10 18:25:34,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404179', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422084', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00161657', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045762', 'lastCheck': '3.8', 'valid': True}}
>Thread-4593::DEBUG::2014-04-10 18:25:34,362::task::1168::TaskManager.Task::(prepare) Task=`e4d49532-a6a2-4b59-baa1-2ef9ae79d107`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404179', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422084', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00161657', 'lastCheck': '3.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045762', 'lastCheck': '3.8', 'valid': True}}
>Thread-4593::DEBUG::2014-04-10 18:25:34,363::task::579::TaskManager.Task::(_updateState) Task=`e4d49532-a6a2-4b59-baa1-2ef9ae79d107`::moving from state preparing -> state finished
>Thread-4593::DEBUG::2014-04-10 18:25:34,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4593::DEBUG::2014-04-10 18:25:34,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4593::DEBUG::2014-04-10 18:25:34,363::task::974::TaskManager.Task::(_decref) Task=`e4d49532-a6a2-4b59-baa1-2ef9ae79d107`::ref 0 aborting False
>Thread-4595::DEBUG::2014-04-10 18:25:35,728::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4595::DEBUG::2014-04-10 18:25:35,736::task::579::TaskManager.Task::(_updateState) Task=`e2dbbcc6-6293-42c0-b33b-cde52494a7be`::moving from state init -> state preparing
>Thread-4595::INFO::2014-04-10 18:25:35,736::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4595::INFO::2014-04-10 18:25:35,736::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4595::DEBUG::2014-04-10 18:25:35,737::task::1168::TaskManager.Task::(prepare) Task=`e2dbbcc6-6293-42c0-b33b-cde52494a7be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4595::DEBUG::2014-04-10 18:25:35,737::task::579::TaskManager.Task::(_updateState) Task=`e2dbbcc6-6293-42c0-b33b-cde52494a7be`::moving from state preparing -> state finished
>Thread-4595::DEBUG::2014-04-10 18:25:35,737::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4595::DEBUG::2014-04-10 18:25:35,737::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4595::DEBUG::2014-04-10 18:25:35,737::task::974::TaskManager.Task::(_decref) Task=`e2dbbcc6-6293-42c0-b33b-cde52494a7be`::ref 0 aborting False
>Thread-4596::DEBUG::2014-04-10 18:25:35,744::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4596::DEBUG::2014-04-10 18:25:35,745::task::579::TaskManager.Task::(_updateState) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::moving from state init -> state preparing
>Thread-4596::INFO::2014-04-10 18:25:35,746::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4596::DEBUG::2014-04-10 18:25:35,746::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`308e0669-4e80-4c99-b460-0f87f88feafd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4596::DEBUG::2014-04-10 18:25:35,747::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4596::DEBUG::2014-04-10 18:25:35,747::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4596::DEBUG::2014-04-10 18:25:35,747::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`308e0669-4e80-4c99-b460-0f87f88feafd`::Granted request
>Thread-4596::DEBUG::2014-04-10 18:25:35,748::task::811::TaskManager.Task::(resourceAcquired) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4596::DEBUG::2014-04-10 18:25:35,748::task::974::TaskManager.Task::(_decref) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::ref 1 aborting False
>Thread-4596::INFO::2014-04-10 18:25:35,751::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4596::DEBUG::2014-04-10 18:25:35,751::task::1168::TaskManager.Task::(prepare) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4596::DEBUG::2014-04-10 18:25:35,751::task::579::TaskManager.Task::(_updateState) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::moving from state preparing -> state finished
>Thread-4596::DEBUG::2014-04-10 18:25:35,751::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4596::DEBUG::2014-04-10 18:25:35,751::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4596::DEBUG::2014-04-10 18:25:35,752::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4596::DEBUG::2014-04-10 18:25:35,752::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4596::DEBUG::2014-04-10 18:25:35,752::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4596::DEBUG::2014-04-10 18:25:35,752::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4596::DEBUG::2014-04-10 18:25:35,752::task::974::TaskManager.Task::(_decref) Task=`a2d99542-d6fd-44fe-8ddc-882498ec55f4`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:40,325::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:25:40,342::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:25:40,343::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:25:40,347::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:25:40,349::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:25:40,349::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:25:40,349::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:25:40,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:40,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353847 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:40,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:40,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000475695 s, 774 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:40,634::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:25:40,654::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:25:40,658::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:25:40,663::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:40,672::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:25:40,681::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::DEBUG::2014-04-10 18:25:40,681::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000422186 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::INFO::2014-04-10 18:25:40,683::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:25:40,684::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:25:40,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:40,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371503 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4608::DEBUG::2014-04-10 18:25:45,894::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4608::DEBUG::2014-04-10 18:25:45,894::task::579::TaskManager.Task::(_updateState) Task=`6519a115-a084-4617-a589-e0d8d261c0f7`::moving from state init -> state preparing
>Thread-4608::INFO::2014-04-10 18:25:45,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4608::INFO::2014-04-10 18:25:45,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4608::DEBUG::2014-04-10 18:25:45,895::task::1168::TaskManager.Task::(prepare) Task=`6519a115-a084-4617-a589-e0d8d261c0f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4608::DEBUG::2014-04-10 18:25:45,895::task::579::TaskManager.Task::(_updateState) Task=`6519a115-a084-4617-a589-e0d8d261c0f7`::moving from state preparing -> state finished
>Thread-4608::DEBUG::2014-04-10 18:25:45,895::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4608::DEBUG::2014-04-10 18:25:45,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4608::DEBUG::2014-04-10 18:25:45,896::task::974::TaskManager.Task::(_decref) Task=`6519a115-a084-4617-a589-e0d8d261c0f7`::ref 0 aborting False
>Thread-4609::DEBUG::2014-04-10 18:25:45,902::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4609::DEBUG::2014-04-10 18:25:45,902::task::579::TaskManager.Task::(_updateState) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::moving from state init -> state preparing
>Thread-4609::INFO::2014-04-10 18:25:45,903::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4609::DEBUG::2014-04-10 18:25:45,903::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a311359b-1e7e-4c16-8aaa-ef9b3170c5af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4609::DEBUG::2014-04-10 18:25:45,903::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4609::DEBUG::2014-04-10 18:25:45,903::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4609::DEBUG::2014-04-10 18:25:45,904::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a311359b-1e7e-4c16-8aaa-ef9b3170c5af`::Granted request
>Thread-4609::DEBUG::2014-04-10 18:25:45,904::task::811::TaskManager.Task::(resourceAcquired) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4609::DEBUG::2014-04-10 18:25:45,904::task::974::TaskManager.Task::(_decref) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::ref 1 aborting False
>Thread-4609::INFO::2014-04-10 18:25:45,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4609::DEBUG::2014-04-10 18:25:45,906::task::1168::TaskManager.Task::(prepare) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4609::DEBUG::2014-04-10 18:25:45,906::task::579::TaskManager.Task::(_updateState) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::moving from state preparing -> state finished
>Thread-4609::DEBUG::2014-04-10 18:25:45,906::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4609::DEBUG::2014-04-10 18:25:45,907::task::974::TaskManager.Task::(_decref) Task=`97cceaad-6ca0-47b4-b186-3c64addb68f1`::ref 0 aborting False
>Thread-4611::DEBUG::2014-04-10 18:25:49,534::task::579::TaskManager.Task::(_updateState) Task=`8f9c457f-ec4b-4a5c-b64b-d2d52484a905`::moving from state init -> state preparing
>Thread-4611::INFO::2014-04-10 18:25:49,534::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4611::INFO::2014-04-10 18:25:49,534::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422186', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353847', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371503', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475695', 'lastCheck': '9.0', 'valid': True}}
>Thread-4611::DEBUG::2014-04-10 18:25:49,534::task::1168::TaskManager.Task::(prepare) Task=`8f9c457f-ec4b-4a5c-b64b-d2d52484a905`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422186', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353847', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371503', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475695', 'lastCheck': '9.0', 'valid': True}}
>Thread-4611::DEBUG::2014-04-10 18:25:49,535::task::579::TaskManager.Task::(_updateState) Task=`8f9c457f-ec4b-4a5c-b64b-d2d52484a905`::moving from state preparing -> state finished
>Thread-4611::DEBUG::2014-04-10 18:25:49,535::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4611::DEBUG::2014-04-10 18:25:49,535::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4611::DEBUG::2014-04-10 18:25:49,535::task::974::TaskManager.Task::(_decref) Task=`8f9c457f-ec4b-4a5c-b64b-d2d52484a905`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:25:50,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:25:50,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000497471 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:25:50,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:25:50,590::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000416944 s, 883 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:25:50,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:25:50,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000473439 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:25:50,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:25:50,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00137738 s, 487 kB/s\n'; <rc> = 0
>Thread-4615::DEBUG::2014-04-10 18:25:56,139::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4615::DEBUG::2014-04-10 18:25:56,139::task::579::TaskManager.Task::(_updateState) Task=`ca8c2033-5e21-4340-8b65-ce872ab90d10`::moving from state init -> state preparing
>Thread-4615::INFO::2014-04-10 18:25:56,140::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4615::INFO::2014-04-10 18:25:56,140::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4615::DEBUG::2014-04-10 18:25:56,140::task::1168::TaskManager.Task::(prepare) Task=`ca8c2033-5e21-4340-8b65-ce872ab90d10`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4615::DEBUG::2014-04-10 18:25:56,140::task::579::TaskManager.Task::(_updateState) Task=`ca8c2033-5e21-4340-8b65-ce872ab90d10`::moving from state preparing -> state finished
>Thread-4615::DEBUG::2014-04-10 18:25:56,140::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4615::DEBUG::2014-04-10 18:25:56,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4615::DEBUG::2014-04-10 18:25:56,141::task::974::TaskManager.Task::(_decref) Task=`ca8c2033-5e21-4340-8b65-ce872ab90d10`::ref 0 aborting False
>Thread-4616::DEBUG::2014-04-10 18:25:56,147::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4616::DEBUG::2014-04-10 18:25:56,148::task::579::TaskManager.Task::(_updateState) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::moving from state init -> state preparing
>Thread-4616::INFO::2014-04-10 18:25:56,148::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4616::DEBUG::2014-04-10 18:25:56,148::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3e26a3de-30a4-42b8-92a9-c250084115f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4616::DEBUG::2014-04-10 18:25:56,149::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4616::DEBUG::2014-04-10 18:25:56,149::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4616::DEBUG::2014-04-10 18:25:56,149::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3e26a3de-30a4-42b8-92a9-c250084115f8`::Granted request
>Thread-4616::DEBUG::2014-04-10 18:25:56,149::task::811::TaskManager.Task::(resourceAcquired) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4616::DEBUG::2014-04-10 18:25:56,149::task::974::TaskManager.Task::(_decref) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::ref 1 aborting False
>Thread-4616::INFO::2014-04-10 18:25:56,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4616::DEBUG::2014-04-10 18:25:56,151::task::1168::TaskManager.Task::(prepare) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4616::DEBUG::2014-04-10 18:25:56,152::task::579::TaskManager.Task::(_updateState) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::moving from state preparing -> state finished
>Thread-4616::DEBUG::2014-04-10 18:25:56,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4616::DEBUG::2014-04-10 18:25:56,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4616::DEBUG::2014-04-10 18:25:56,152::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4616::DEBUG::2014-04-10 18:25:56,152::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4616::DEBUG::2014-04-10 18:25:56,153::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4616::DEBUG::2014-04-10 18:25:56,153::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4616::DEBUG::2014-04-10 18:25:56,153::task::974::TaskManager.Task::(_decref) Task=`2c95f230-4c14-4c88-b7d5-f8a405c42f51`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:00,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:00,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000389026 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:00,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:00,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000563372 s, 653 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:00,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:00,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0004851 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:00,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:00,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397757 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4619::DEBUG::2014-04-10 18:26:04,708::task::579::TaskManager.Task::(_updateState) Task=`1f79823f-537e-4a79-9165-958cbd8e31ee`::moving from state init -> state preparing
>Thread-4619::INFO::2014-04-10 18:26:04,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4619::INFO::2014-04-10 18:26:04,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004851', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389026', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397757', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563372', 'lastCheck': '4.1', 'valid': True}}
>Thread-4619::DEBUG::2014-04-10 18:26:04,709::task::1168::TaskManager.Task::(prepare) Task=`1f79823f-537e-4a79-9165-958cbd8e31ee`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004851', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389026', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397757', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563372', 'lastCheck': '4.1', 'valid': True}}
>Thread-4619::DEBUG::2014-04-10 18:26:04,709::task::579::TaskManager.Task::(_updateState) Task=`1f79823f-537e-4a79-9165-958cbd8e31ee`::moving from state preparing -> state finished
>Thread-4619::DEBUG::2014-04-10 18:26:04,709::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4619::DEBUG::2014-04-10 18:26:04,709::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4619::DEBUG::2014-04-10 18:26:04,709::task::974::TaskManager.Task::(_decref) Task=`1f79823f-537e-4a79-9165-958cbd8e31ee`::ref 0 aborting False
>Thread-4621::DEBUG::2014-04-10 18:26:06,241::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4621::DEBUG::2014-04-10 18:26:06,241::task::579::TaskManager.Task::(_updateState) Task=`db533bff-0fb8-441b-99a0-b1119451ca7a`::moving from state init -> state preparing
>Thread-4621::INFO::2014-04-10 18:26:06,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4621::INFO::2014-04-10 18:26:06,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4621::DEBUG::2014-04-10 18:26:06,242::task::1168::TaskManager.Task::(prepare) Task=`db533bff-0fb8-441b-99a0-b1119451ca7a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4621::DEBUG::2014-04-10 18:26:06,242::task::579::TaskManager.Task::(_updateState) Task=`db533bff-0fb8-441b-99a0-b1119451ca7a`::moving from state preparing -> state finished
>Thread-4621::DEBUG::2014-04-10 18:26:06,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4621::DEBUG::2014-04-10 18:26:06,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4621::DEBUG::2014-04-10 18:26:06,242::task::974::TaskManager.Task::(_decref) Task=`db533bff-0fb8-441b-99a0-b1119451ca7a`::ref 0 aborting False
>Thread-4622::DEBUG::2014-04-10 18:26:06,249::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4622::DEBUG::2014-04-10 18:26:06,249::task::579::TaskManager.Task::(_updateState) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::moving from state init -> state preparing
>Thread-4622::INFO::2014-04-10 18:26:06,249::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4622::DEBUG::2014-04-10 18:26:06,250::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`66efbb12-853a-4124-9f52-6c637b4d274d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4622::DEBUG::2014-04-10 18:26:06,250::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4622::DEBUG::2014-04-10 18:26:06,250::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4622::DEBUG::2014-04-10 18:26:06,250::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`66efbb12-853a-4124-9f52-6c637b4d274d`::Granted request
>Thread-4622::DEBUG::2014-04-10 18:26:06,251::task::811::TaskManager.Task::(resourceAcquired) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4622::DEBUG::2014-04-10 18:26:06,251::task::974::TaskManager.Task::(_decref) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::ref 1 aborting False
>Thread-4622::INFO::2014-04-10 18:26:06,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4622::DEBUG::2014-04-10 18:26:06,253::task::1168::TaskManager.Task::(prepare) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4622::DEBUG::2014-04-10 18:26:06,253::task::579::TaskManager.Task::(_updateState) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::moving from state preparing -> state finished
>Thread-4622::DEBUG::2014-04-10 18:26:06,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4622::DEBUG::2014-04-10 18:26:06,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4622::DEBUG::2014-04-10 18:26:06,254::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4622::DEBUG::2014-04-10 18:26:06,254::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4622::DEBUG::2014-04-10 18:26:06,254::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4622::DEBUG::2014-04-10 18:26:06,254::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4622::DEBUG::2014-04-10 18:26:06,254::task::974::TaskManager.Task::(_decref) Task=`c0d4f1f8-6330-45f0-b6a7-963cb359f93b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:10,399::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:10,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396575 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:10,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:10,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000490147 s, 751 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:10,769::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:10,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000381295 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:10,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:10,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00039373 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4626::DEBUG::2014-04-10 18:26:16,332::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4626::DEBUG::2014-04-10 18:26:16,333::task::579::TaskManager.Task::(_updateState) Task=`331081bb-7c4c-4320-85cf-abe7665576ca`::moving from state init -> state preparing
>Thread-4626::INFO::2014-04-10 18:26:16,333::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4626::INFO::2014-04-10 18:26:16,333::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4626::DEBUG::2014-04-10 18:26:16,333::task::1168::TaskManager.Task::(prepare) Task=`331081bb-7c4c-4320-85cf-abe7665576ca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4626::DEBUG::2014-04-10 18:26:16,334::task::579::TaskManager.Task::(_updateState) Task=`331081bb-7c4c-4320-85cf-abe7665576ca`::moving from state preparing -> state finished
>Thread-4626::DEBUG::2014-04-10 18:26:16,334::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4626::DEBUG::2014-04-10 18:26:16,334::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4626::DEBUG::2014-04-10 18:26:16,334::task::974::TaskManager.Task::(_decref) Task=`331081bb-7c4c-4320-85cf-abe7665576ca`::ref 0 aborting False
>Thread-4627::DEBUG::2014-04-10 18:26:16,341::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4627::DEBUG::2014-04-10 18:26:16,342::task::579::TaskManager.Task::(_updateState) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::moving from state init -> state preparing
>Thread-4627::INFO::2014-04-10 18:26:16,342::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4627::DEBUG::2014-04-10 18:26:16,343::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbab8c6e-6441-4406-8b98-e80afe888751`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4627::DEBUG::2014-04-10 18:26:16,343::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4627::DEBUG::2014-04-10 18:26:16,343::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4627::DEBUG::2014-04-10 18:26:16,343::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbab8c6e-6441-4406-8b98-e80afe888751`::Granted request
>Thread-4627::DEBUG::2014-04-10 18:26:16,344::task::811::TaskManager.Task::(resourceAcquired) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4627::DEBUG::2014-04-10 18:26:16,344::task::974::TaskManager.Task::(_decref) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::ref 1 aborting False
>Thread-4627::INFO::2014-04-10 18:26:16,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4627::DEBUG::2014-04-10 18:26:16,346::task::1168::TaskManager.Task::(prepare) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::task::579::TaskManager.Task::(_updateState) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::moving from state preparing -> state finished
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4627::DEBUG::2014-04-10 18:26:16,347::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4627::DEBUG::2014-04-10 18:26:16,348::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4627::DEBUG::2014-04-10 18:26:16,348::task::974::TaskManager.Task::(_decref) Task=`16fb316c-7a76-4ae3-bb4e-67470b25e501`::ref 0 aborting False
>Thread-4629::DEBUG::2014-04-10 18:26:19,883::task::579::TaskManager.Task::(_updateState) Task=`e6c22848-e297-412d-a355-01264d61aba5`::moving from state init -> state preparing
>Thread-4629::INFO::2014-04-10 18:26:19,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4629::INFO::2014-04-10 18:26:19,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381295', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396575', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039373', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490147', 'lastCheck': '9.3', 'valid': True}}
>Thread-4629::DEBUG::2014-04-10 18:26:19,884::task::1168::TaskManager.Task::(prepare) Task=`e6c22848-e297-412d-a355-01264d61aba5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381295', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396575', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039373', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490147', 'lastCheck': '9.3', 'valid': True}}
>Thread-4629::DEBUG::2014-04-10 18:26:19,884::task::579::TaskManager.Task::(_updateState) Task=`e6c22848-e297-412d-a355-01264d61aba5`::moving from state preparing -> state finished
>Thread-4629::DEBUG::2014-04-10 18:26:19,884::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4629::DEBUG::2014-04-10 18:26:19,884::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4629::DEBUG::2014-04-10 18:26:19,885::task::974::TaskManager.Task::(_decref) Task=`e6c22848-e297-412d-a355-01264d61aba5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:20,413::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:20,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283504 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:20,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:20,635::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000441713 s, 833 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:20,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:20,821::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000437138 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:20,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:20,841::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283236 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4633::DEBUG::2014-04-10 18:26:26,438::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4633::DEBUG::2014-04-10 18:26:26,439::task::579::TaskManager.Task::(_updateState) Task=`a708ee35-4ea1-4c42-87c3-3574d8808660`::moving from state init -> state preparing
>Thread-4633::INFO::2014-04-10 18:26:26,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4633::INFO::2014-04-10 18:26:26,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4633::DEBUG::2014-04-10 18:26:26,439::task::1168::TaskManager.Task::(prepare) Task=`a708ee35-4ea1-4c42-87c3-3574d8808660`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4633::DEBUG::2014-04-10 18:26:26,439::task::579::TaskManager.Task::(_updateState) Task=`a708ee35-4ea1-4c42-87c3-3574d8808660`::moving from state preparing -> state finished
>Thread-4633::DEBUG::2014-04-10 18:26:26,440::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4633::DEBUG::2014-04-10 18:26:26,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4633::DEBUG::2014-04-10 18:26:26,440::task::974::TaskManager.Task::(_decref) Task=`a708ee35-4ea1-4c42-87c3-3574d8808660`::ref 0 aborting False
>Thread-4634::DEBUG::2014-04-10 18:26:26,446::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4634::DEBUG::2014-04-10 18:26:26,447::task::579::TaskManager.Task::(_updateState) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::moving from state init -> state preparing
>Thread-4634::INFO::2014-04-10 18:26:26,447::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4634::DEBUG::2014-04-10 18:26:26,448::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87fc8549-16ec-4c9a-8070-0ab650fde291`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4634::DEBUG::2014-04-10 18:26:26,448::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4634::DEBUG::2014-04-10 18:26:26,448::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4634::DEBUG::2014-04-10 18:26:26,448::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`87fc8549-16ec-4c9a-8070-0ab650fde291`::Granted request
>Thread-4634::DEBUG::2014-04-10 18:26:26,448::task::811::TaskManager.Task::(resourceAcquired) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4634::DEBUG::2014-04-10 18:26:26,449::task::974::TaskManager.Task::(_decref) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::ref 1 aborting False
>Thread-4634::INFO::2014-04-10 18:26:26,450::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4634::DEBUG::2014-04-10 18:26:26,451::task::1168::TaskManager.Task::(prepare) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4634::DEBUG::2014-04-10 18:26:26,451::task::579::TaskManager.Task::(_updateState) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::moving from state preparing -> state finished
>Thread-4634::DEBUG::2014-04-10 18:26:26,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4634::DEBUG::2014-04-10 18:26:26,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4634::DEBUG::2014-04-10 18:26:26,451::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4634::DEBUG::2014-04-10 18:26:26,452::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4634::DEBUG::2014-04-10 18:26:26,452::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4634::DEBUG::2014-04-10 18:26:26,452::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4634::DEBUG::2014-04-10 18:26:26,452::task::974::TaskManager.Task::(_decref) Task=`943fc462-2d2a-4598-b732-6d5ad272b2fd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:30,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:30,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326879 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:30,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:30,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000541239 s, 680 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:30,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:30,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00050078 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:30,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:30,855::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346955 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4637::DEBUG::2014-04-10 18:26:35,048::task::579::TaskManager.Task::(_updateState) Task=`061988e9-6b00-487c-833f-f44477afc50b`::moving from state init -> state preparing
>Thread-4637::INFO::2014-04-10 18:26:35,048::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4637::INFO::2014-04-10 18:26:35,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050078', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326879', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346955', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541239', 'lastCheck': '4.4', 'valid': True}}
>Thread-4637::DEBUG::2014-04-10 18:26:35,048::task::1168::TaskManager.Task::(prepare) Task=`061988e9-6b00-487c-833f-f44477afc50b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050078', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326879', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346955', 'lastCheck': '4.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541239', 'lastCheck': '4.4', 'valid': True}}
>Thread-4637::DEBUG::2014-04-10 18:26:35,049::task::579::TaskManager.Task::(_updateState) Task=`061988e9-6b00-487c-833f-f44477afc50b`::moving from state preparing -> state finished
>Thread-4637::DEBUG::2014-04-10 18:26:35,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4637::DEBUG::2014-04-10 18:26:35,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4637::DEBUG::2014-04-10 18:26:35,049::task::974::TaskManager.Task::(_decref) Task=`061988e9-6b00-487c-833f-f44477afc50b`::ref 0 aborting False
>Thread-4639::DEBUG::2014-04-10 18:26:36,537::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4639::DEBUG::2014-04-10 18:26:36,537::task::579::TaskManager.Task::(_updateState) Task=`37373db3-ccd9-4c09-be1c-bbada4e39747`::moving from state init -> state preparing
>Thread-4639::INFO::2014-04-10 18:26:36,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4639::INFO::2014-04-10 18:26:36,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4639::DEBUG::2014-04-10 18:26:36,538::task::1168::TaskManager.Task::(prepare) Task=`37373db3-ccd9-4c09-be1c-bbada4e39747`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4639::DEBUG::2014-04-10 18:26:36,538::task::579::TaskManager.Task::(_updateState) Task=`37373db3-ccd9-4c09-be1c-bbada4e39747`::moving from state preparing -> state finished
>Thread-4639::DEBUG::2014-04-10 18:26:36,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4639::DEBUG::2014-04-10 18:26:36,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4639::DEBUG::2014-04-10 18:26:36,538::task::974::TaskManager.Task::(_decref) Task=`37373db3-ccd9-4c09-be1c-bbada4e39747`::ref 0 aborting False
>Thread-4640::DEBUG::2014-04-10 18:26:36,545::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4640::DEBUG::2014-04-10 18:26:36,545::task::579::TaskManager.Task::(_updateState) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::moving from state init -> state preparing
>Thread-4640::INFO::2014-04-10 18:26:36,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4640::DEBUG::2014-04-10 18:26:36,545::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06d71cc6-59e2-4112-a17c-3f5aba24f5ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4640::DEBUG::2014-04-10 18:26:36,546::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4640::DEBUG::2014-04-10 18:26:36,546::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4640::DEBUG::2014-04-10 18:26:36,546::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`06d71cc6-59e2-4112-a17c-3f5aba24f5ce`::Granted request
>Thread-4640::DEBUG::2014-04-10 18:26:36,546::task::811::TaskManager.Task::(resourceAcquired) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4640::DEBUG::2014-04-10 18:26:36,546::task::974::TaskManager.Task::(_decref) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::ref 1 aborting False
>Thread-4640::INFO::2014-04-10 18:26:36,548::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4640::DEBUG::2014-04-10 18:26:36,548::task::1168::TaskManager.Task::(prepare) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::task::579::TaskManager.Task::(_updateState) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::moving from state preparing -> state finished
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4640::DEBUG::2014-04-10 18:26:36,549::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4640::DEBUG::2014-04-10 18:26:36,550::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4640::DEBUG::2014-04-10 18:26:36,550::task::974::TaskManager.Task::(_decref) Task=`b4cee425-0c25-402e-a14e-1cbf2365e1fc`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:40,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:40,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000456464 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:40,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:40,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451619 s, 815 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:40,845::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:40,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480893 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:40,864::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:40,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334964 s, 2.0 MB/s\n'; <rc> = 0
>Thread-4644::DEBUG::2014-04-10 18:26:46,628::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4644::DEBUG::2014-04-10 18:26:46,628::task::579::TaskManager.Task::(_updateState) Task=`0eb94887-e619-419e-8be2-01c572027f15`::moving from state init -> state preparing
>Thread-4644::INFO::2014-04-10 18:26:46,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4644::INFO::2014-04-10 18:26:46,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4644::DEBUG::2014-04-10 18:26:46,629::task::1168::TaskManager.Task::(prepare) Task=`0eb94887-e619-419e-8be2-01c572027f15`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4644::DEBUG::2014-04-10 18:26:46,629::task::579::TaskManager.Task::(_updateState) Task=`0eb94887-e619-419e-8be2-01c572027f15`::moving from state preparing -> state finished
>Thread-4644::DEBUG::2014-04-10 18:26:46,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4644::DEBUG::2014-04-10 18:26:46,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4644::DEBUG::2014-04-10 18:26:46,630::task::974::TaskManager.Task::(_decref) Task=`0eb94887-e619-419e-8be2-01c572027f15`::ref 0 aborting False
>Thread-4645::DEBUG::2014-04-10 18:26:46,637::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4645::DEBUG::2014-04-10 18:26:46,637::task::579::TaskManager.Task::(_updateState) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::moving from state init -> state preparing
>Thread-4645::INFO::2014-04-10 18:26:46,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4645::DEBUG::2014-04-10 18:26:46,638::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`92ff8ac4-1ad4-473f-8b2f-8068b28b967d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4645::DEBUG::2014-04-10 18:26:46,638::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4645::DEBUG::2014-04-10 18:26:46,638::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4645::DEBUG::2014-04-10 18:26:46,638::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`92ff8ac4-1ad4-473f-8b2f-8068b28b967d`::Granted request
>Thread-4645::DEBUG::2014-04-10 18:26:46,638::task::811::TaskManager.Task::(resourceAcquired) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4645::DEBUG::2014-04-10 18:26:46,639::task::974::TaskManager.Task::(_decref) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::ref 1 aborting False
>Thread-4645::INFO::2014-04-10 18:26:46,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4645::DEBUG::2014-04-10 18:26:46,641::task::1168::TaskManager.Task::(prepare) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4645::DEBUG::2014-04-10 18:26:46,641::task::579::TaskManager.Task::(_updateState) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::moving from state preparing -> state finished
>Thread-4645::DEBUG::2014-04-10 18:26:46,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4645::DEBUG::2014-04-10 18:26:46,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4645::DEBUG::2014-04-10 18:26:46,642::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4645::DEBUG::2014-04-10 18:26:46,642::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4645::DEBUG::2014-04-10 18:26:46,642::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4645::DEBUG::2014-04-10 18:26:46,642::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4645::DEBUG::2014-04-10 18:26:46,642::task::974::TaskManager.Task::(_decref) Task=`bf6ea817-8563-4511-9c9d-1466665e4c68`::ref 0 aborting False
>Thread-4647::DEBUG::2014-04-10 18:26:50,273::task::579::TaskManager.Task::(_updateState) Task=`fbda15d0-7dfc-4f1f-b984-0b9604991467`::moving from state init -> state preparing
>Thread-4647::INFO::2014-04-10 18:26:50,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4647::INFO::2014-04-10 18:26:50,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480893', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456464', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334964', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451619', 'lastCheck': '9.6', 'valid': True}}
>Thread-4647::DEBUG::2014-04-10 18:26:50,274::task::1168::TaskManager.Task::(prepare) Task=`fbda15d0-7dfc-4f1f-b984-0b9604991467`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480893', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456464', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334964', 'lastCheck': '9.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451619', 'lastCheck': '9.6', 'valid': True}}
>Thread-4647::DEBUG::2014-04-10 18:26:50,274::task::579::TaskManager.Task::(_updateState) Task=`fbda15d0-7dfc-4f1f-b984-0b9604991467`::moving from state preparing -> state finished
>Thread-4647::DEBUG::2014-04-10 18:26:50,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4647::DEBUG::2014-04-10 18:26:50,274::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4647::DEBUG::2014-04-10 18:26:50,274::task::974::TaskManager.Task::(_decref) Task=`fbda15d0-7dfc-4f1f-b984-0b9604991467`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:26:50,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:26:50,470::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314844 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:26:50,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:26:50,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476254 s, 773 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:26:50,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:26:50,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000403401 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:26:50,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:26:50,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281397 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4651::DEBUG::2014-04-10 18:26:56,717::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4651::DEBUG::2014-04-10 18:26:56,717::task::579::TaskManager.Task::(_updateState) Task=`f60828e6-e1d0-478f-81ce-9fad65319869`::moving from state init -> state preparing
>Thread-4651::INFO::2014-04-10 18:26:56,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4651::INFO::2014-04-10 18:26:56,718::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4651::DEBUG::2014-04-10 18:26:56,718::task::1168::TaskManager.Task::(prepare) Task=`f60828e6-e1d0-478f-81ce-9fad65319869`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4651::DEBUG::2014-04-10 18:26:56,718::task::579::TaskManager.Task::(_updateState) Task=`f60828e6-e1d0-478f-81ce-9fad65319869`::moving from state preparing -> state finished
>Thread-4651::DEBUG::2014-04-10 18:26:56,718::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4651::DEBUG::2014-04-10 18:26:56,718::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4651::DEBUG::2014-04-10 18:26:56,719::task::974::TaskManager.Task::(_decref) Task=`f60828e6-e1d0-478f-81ce-9fad65319869`::ref 0 aborting False
>Thread-4652::DEBUG::2014-04-10 18:26:56,725::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4652::DEBUG::2014-04-10 18:26:56,725::task::579::TaskManager.Task::(_updateState) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::moving from state init -> state preparing
>Thread-4652::INFO::2014-04-10 18:26:56,725::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4652::DEBUG::2014-04-10 18:26:56,726::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee672e6e-8ff9-4fc5-bd4d-34bd705df48d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4652::DEBUG::2014-04-10 18:26:56,726::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4652::DEBUG::2014-04-10 18:26:56,726::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4652::DEBUG::2014-04-10 18:26:56,726::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ee672e6e-8ff9-4fc5-bd4d-34bd705df48d`::Granted request
>Thread-4652::DEBUG::2014-04-10 18:26:56,727::task::811::TaskManager.Task::(resourceAcquired) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4652::DEBUG::2014-04-10 18:26:56,727::task::974::TaskManager.Task::(_decref) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::ref 1 aborting False
>Thread-4652::INFO::2014-04-10 18:26:56,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4652::DEBUG::2014-04-10 18:26:56,729::task::1168::TaskManager.Task::(prepare) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::task::579::TaskManager.Task::(_updateState) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::moving from state preparing -> state finished
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4652::DEBUG::2014-04-10 18:26:56,730::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4652::DEBUG::2014-04-10 18:26:56,731::task::974::TaskManager.Task::(_decref) Task=`000438b5-4162-4f00-b671-a51b287e2f89`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:00,480::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:00,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000601566 s, 1.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:27:00,677::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:27:00,693::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:27:00,694::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:27:00,700::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:27:00,701::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:27:00,702::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:27:00,702::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:27:00,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:00,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000411947 s, 893 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:00,876::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:00,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000467447 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:27:00,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:00,899::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035756 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4659::DEBUG::2014-04-10 18:27:05,425::task::579::TaskManager.Task::(_updateState) Task=`f5698a1d-cf54-4b12-85b1-b79552f88cc0`::moving from state init -> state preparing
>Thread-4659::INFO::2014-04-10 18:27:05,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4659::INFO::2014-04-10 18:27:05,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467447', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601566', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035756', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411947', 'lastCheck': '4.7', 'valid': True}}
>Thread-4659::DEBUG::2014-04-10 18:27:05,425::task::1168::TaskManager.Task::(prepare) Task=`f5698a1d-cf54-4b12-85b1-b79552f88cc0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467447', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601566', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035756', 'lastCheck': '4.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411947', 'lastCheck': '4.7', 'valid': True}}
>Thread-4659::DEBUG::2014-04-10 18:27:05,426::task::579::TaskManager.Task::(_updateState) Task=`f5698a1d-cf54-4b12-85b1-b79552f88cc0`::moving from state preparing -> state finished
>Thread-4659::DEBUG::2014-04-10 18:27:05,426::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4659::DEBUG::2014-04-10 18:27:05,426::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4659::DEBUG::2014-04-10 18:27:05,426::task::974::TaskManager.Task::(_decref) Task=`f5698a1d-cf54-4b12-85b1-b79552f88cc0`::ref 0 aborting False
>Thread-4661::DEBUG::2014-04-10 18:27:06,806::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4661::DEBUG::2014-04-10 18:27:06,806::task::579::TaskManager.Task::(_updateState) Task=`f4de4afa-f6ad-4971-92ee-ca0065e4e318`::moving from state init -> state preparing
>Thread-4661::INFO::2014-04-10 18:27:06,806::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4661::INFO::2014-04-10 18:27:06,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4661::DEBUG::2014-04-10 18:27:06,807::task::1168::TaskManager.Task::(prepare) Task=`f4de4afa-f6ad-4971-92ee-ca0065e4e318`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4661::DEBUG::2014-04-10 18:27:06,807::task::579::TaskManager.Task::(_updateState) Task=`f4de4afa-f6ad-4971-92ee-ca0065e4e318`::moving from state preparing -> state finished
>Thread-4661::DEBUG::2014-04-10 18:27:06,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4661::DEBUG::2014-04-10 18:27:06,807::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4661::DEBUG::2014-04-10 18:27:06,807::task::974::TaskManager.Task::(_decref) Task=`f4de4afa-f6ad-4971-92ee-ca0065e4e318`::ref 0 aborting False
>Thread-4662::DEBUG::2014-04-10 18:27:06,813::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4662::DEBUG::2014-04-10 18:27:06,814::task::579::TaskManager.Task::(_updateState) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::moving from state init -> state preparing
>Thread-4662::INFO::2014-04-10 18:27:06,814::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4662::DEBUG::2014-04-10 18:27:06,815::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76b68fd0-1633-45c7-ac9f-3bab3da84042`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4662::DEBUG::2014-04-10 18:27:06,815::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4662::DEBUG::2014-04-10 18:27:06,815::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4662::DEBUG::2014-04-10 18:27:06,815::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`76b68fd0-1633-45c7-ac9f-3bab3da84042`::Granted request
>Thread-4662::DEBUG::2014-04-10 18:27:06,815::task::811::TaskManager.Task::(resourceAcquired) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4662::DEBUG::2014-04-10 18:27:06,816::task::974::TaskManager.Task::(_decref) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::ref 1 aborting False
>Thread-4662::INFO::2014-04-10 18:27:06,817::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4662::DEBUG::2014-04-10 18:27:06,818::task::1168::TaskManager.Task::(prepare) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4662::DEBUG::2014-04-10 18:27:06,818::task::579::TaskManager.Task::(_updateState) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::moving from state preparing -> state finished
>Thread-4662::DEBUG::2014-04-10 18:27:06,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4662::DEBUG::2014-04-10 18:27:06,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4662::DEBUG::2014-04-10 18:27:06,818::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4662::DEBUG::2014-04-10 18:27:06,819::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4662::DEBUG::2014-04-10 18:27:06,819::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4662::DEBUG::2014-04-10 18:27:06,819::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4662::DEBUG::2014-04-10 18:27:06,819::task::974::TaskManager.Task::(_decref) Task=`f7e6ddcb-56b3-4713-a12b-bdf719675780`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:10,497::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:10,504::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373114 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:27:10,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:10,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043876 s, 839 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:10,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:10,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000498639 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:27:10,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:10,913::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000469113 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4666::DEBUG::2014-04-10 18:27:17,230::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4666::DEBUG::2014-04-10 18:27:17,231::task::579::TaskManager.Task::(_updateState) Task=`087554f9-0ce9-4b1f-ae49-93145837544d`::moving from state init -> state preparing
>Thread-4666::INFO::2014-04-10 18:27:17,231::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4666::INFO::2014-04-10 18:27:17,231::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4666::DEBUG::2014-04-10 18:27:17,231::task::1168::TaskManager.Task::(prepare) Task=`087554f9-0ce9-4b1f-ae49-93145837544d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4666::DEBUG::2014-04-10 18:27:17,232::task::579::TaskManager.Task::(_updateState) Task=`087554f9-0ce9-4b1f-ae49-93145837544d`::moving from state preparing -> state finished
>Thread-4666::DEBUG::2014-04-10 18:27:17,232::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4666::DEBUG::2014-04-10 18:27:17,232::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4666::DEBUG::2014-04-10 18:27:17,232::task::974::TaskManager.Task::(_decref) Task=`087554f9-0ce9-4b1f-ae49-93145837544d`::ref 0 aborting False
>Thread-4667::DEBUG::2014-04-10 18:27:17,239::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4667::DEBUG::2014-04-10 18:27:17,240::task::579::TaskManager.Task::(_updateState) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::moving from state init -> state preparing
>Thread-4667::INFO::2014-04-10 18:27:17,240::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4667::DEBUG::2014-04-10 18:27:17,240::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3855cfbb-042c-4203-8e2a-95244940c69f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4667::DEBUG::2014-04-10 18:27:17,241::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4667::DEBUG::2014-04-10 18:27:17,241::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4667::DEBUG::2014-04-10 18:27:17,241::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3855cfbb-042c-4203-8e2a-95244940c69f`::Granted request
>Thread-4667::DEBUG::2014-04-10 18:27:17,241::task::811::TaskManager.Task::(resourceAcquired) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4667::DEBUG::2014-04-10 18:27:17,241::task::974::TaskManager.Task::(_decref) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::ref 1 aborting False
>Thread-4667::INFO::2014-04-10 18:27:17,243::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::task::1168::TaskManager.Task::(prepare) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::task::579::TaskManager.Task::(_updateState) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::moving from state preparing -> state finished
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4667::DEBUG::2014-04-10 18:27:17,244::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4667::DEBUG::2014-04-10 18:27:17,245::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4667::DEBUG::2014-04-10 18:27:17,245::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4667::DEBUG::2014-04-10 18:27:17,245::task::974::TaskManager.Task::(_decref) Task=`14ef1e39-ca9b-41b7-bb9c-7183ec983370`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:20,512::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:20,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000436358 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4669::DEBUG::2014-04-10 18:27:20,639::task::579::TaskManager.Task::(_updateState) Task=`20cb3c22-5efb-4ee8-a90b-a4fedfc2b35d`::moving from state init -> state preparing
>Thread-4669::INFO::2014-04-10 18:27:20,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4669::INFO::2014-04-10 18:27:20,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498639', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436358', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469113', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043876', 'lastCheck': '9.9', 'valid': True}}
>Thread-4669::DEBUG::2014-04-10 18:27:20,640::task::1168::TaskManager.Task::(prepare) Task=`20cb3c22-5efb-4ee8-a90b-a4fedfc2b35d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498639', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436358', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469113', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043876', 'lastCheck': '9.9', 'valid': True}}
>Thread-4669::DEBUG::2014-04-10 18:27:20,640::task::579::TaskManager.Task::(_updateState) Task=`20cb3c22-5efb-4ee8-a90b-a4fedfc2b35d`::moving from state preparing -> state finished
>Thread-4669::DEBUG::2014-04-10 18:27:20,640::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4669::DEBUG::2014-04-10 18:27:20,640::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4669::DEBUG::2014-04-10 18:27:20,640::task::974::TaskManager.Task::(_decref) Task=`20cb3c22-5efb-4ee8-a90b-a4fedfc2b35d`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:27:20,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:20,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484262 s, 760 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:20,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:20,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000433243 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:27:20,922::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:20,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026327 s, 2.5 MB/s\n'; <rc> = 0
>Thread-4673::DEBUG::2014-04-10 18:27:27,396::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4673::DEBUG::2014-04-10 18:27:27,397::task::579::TaskManager.Task::(_updateState) Task=`778e4225-e812-4cc1-8e6a-25679f3ab33d`::moving from state init -> state preparing
>Thread-4673::INFO::2014-04-10 18:27:27,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4673::INFO::2014-04-10 18:27:27,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4673::DEBUG::2014-04-10 18:27:27,398::task::1168::TaskManager.Task::(prepare) Task=`778e4225-e812-4cc1-8e6a-25679f3ab33d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4673::DEBUG::2014-04-10 18:27:27,398::task::579::TaskManager.Task::(_updateState) Task=`778e4225-e812-4cc1-8e6a-25679f3ab33d`::moving from state preparing -> state finished
>Thread-4673::DEBUG::2014-04-10 18:27:27,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4673::DEBUG::2014-04-10 18:27:27,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4673::DEBUG::2014-04-10 18:27:27,398::task::974::TaskManager.Task::(_decref) Task=`778e4225-e812-4cc1-8e6a-25679f3ab33d`::ref 0 aborting False
>Thread-4674::DEBUG::2014-04-10 18:27:27,404::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4674::DEBUG::2014-04-10 18:27:27,405::task::579::TaskManager.Task::(_updateState) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::moving from state init -> state preparing
>Thread-4674::INFO::2014-04-10 18:27:27,405::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4674::DEBUG::2014-04-10 18:27:27,405::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84f1b599-7717-44fb-acb9-30d716145997`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4674::DEBUG::2014-04-10 18:27:27,406::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4674::DEBUG::2014-04-10 18:27:27,406::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4674::DEBUG::2014-04-10 18:27:27,406::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`84f1b599-7717-44fb-acb9-30d716145997`::Granted request
>Thread-4674::DEBUG::2014-04-10 18:27:27,406::task::811::TaskManager.Task::(resourceAcquired) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4674::DEBUG::2014-04-10 18:27:27,406::task::974::TaskManager.Task::(_decref) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::ref 1 aborting False
>Thread-4674::INFO::2014-04-10 18:27:27,408::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4674::DEBUG::2014-04-10 18:27:27,408::task::1168::TaskManager.Task::(prepare) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4674::DEBUG::2014-04-10 18:27:27,409::task::579::TaskManager.Task::(_updateState) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::moving from state preparing -> state finished
>Thread-4674::DEBUG::2014-04-10 18:27:27,409::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4674::DEBUG::2014-04-10 18:27:27,409::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4674::DEBUG::2014-04-10 18:27:27,409::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4674::DEBUG::2014-04-10 18:27:27,409::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4674::DEBUG::2014-04-10 18:27:27,410::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4674::DEBUG::2014-04-10 18:27:27,410::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4674::DEBUG::2014-04-10 18:27:27,410::task::974::TaskManager.Task::(_decref) Task=`735efef7-dfc6-4fd7-8668-ceb884de2ffb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:30,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:30,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000318648 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:27:30,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:30,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000473127 s, 778 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:30,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:30,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470376 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:27:30,936::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:30,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314737 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4677::DEBUG::2014-04-10 18:27:35,801::task::579::TaskManager.Task::(_updateState) Task=`b1a63dca-0818-4578-8455-79c1c289ca61`::moving from state init -> state preparing
>Thread-4677::INFO::2014-04-10 18:27:35,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4677::INFO::2014-04-10 18:27:35,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470376', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318648', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314737', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473127', 'lastCheck': '5.0', 'valid': True}}
>Thread-4677::DEBUG::2014-04-10 18:27:35,802::task::1168::TaskManager.Task::(prepare) Task=`b1a63dca-0818-4578-8455-79c1c289ca61`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470376', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000318648', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314737', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473127', 'lastCheck': '5.0', 'valid': True}}
>Thread-4677::DEBUG::2014-04-10 18:27:35,802::task::579::TaskManager.Task::(_updateState) Task=`b1a63dca-0818-4578-8455-79c1c289ca61`::moving from state preparing -> state finished
>Thread-4677::DEBUG::2014-04-10 18:27:35,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4677::DEBUG::2014-04-10 18:27:35,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4677::DEBUG::2014-04-10 18:27:35,803::task::974::TaskManager.Task::(_decref) Task=`b1a63dca-0818-4578-8455-79c1c289ca61`::ref 0 aborting False
>Thread-4679::DEBUG::2014-04-10 18:27:37,487::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4679::DEBUG::2014-04-10 18:27:37,487::task::579::TaskManager.Task::(_updateState) Task=`abc4ef63-6b7f-4967-b626-0686452c3daa`::moving from state init -> state preparing
>Thread-4679::INFO::2014-04-10 18:27:37,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4679::INFO::2014-04-10 18:27:37,488::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4679::DEBUG::2014-04-10 18:27:37,488::task::1168::TaskManager.Task::(prepare) Task=`abc4ef63-6b7f-4967-b626-0686452c3daa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4679::DEBUG::2014-04-10 18:27:37,488::task::579::TaskManager.Task::(_updateState) Task=`abc4ef63-6b7f-4967-b626-0686452c3daa`::moving from state preparing -> state finished
>Thread-4679::DEBUG::2014-04-10 18:27:37,488::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4679::DEBUG::2014-04-10 18:27:37,488::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4679::DEBUG::2014-04-10 18:27:37,488::task::974::TaskManager.Task::(_decref) Task=`abc4ef63-6b7f-4967-b626-0686452c3daa`::ref 0 aborting False
>Thread-4680::DEBUG::2014-04-10 18:27:37,495::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4680::DEBUG::2014-04-10 18:27:37,495::task::579::TaskManager.Task::(_updateState) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::moving from state init -> state preparing
>Thread-4680::INFO::2014-04-10 18:27:37,495::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4680::DEBUG::2014-04-10 18:27:37,495::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f621a470-d616-4471-bed9-c5ca67fd1f8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4680::DEBUG::2014-04-10 18:27:37,496::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4680::DEBUG::2014-04-10 18:27:37,496::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4680::DEBUG::2014-04-10 18:27:37,497::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f621a470-d616-4471-bed9-c5ca67fd1f8a`::Granted request
>Thread-4680::DEBUG::2014-04-10 18:27:37,497::task::811::TaskManager.Task::(resourceAcquired) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4680::DEBUG::2014-04-10 18:27:37,497::task::974::TaskManager.Task::(_decref) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::ref 1 aborting False
>Thread-4680::INFO::2014-04-10 18:27:37,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4680::DEBUG::2014-04-10 18:27:37,499::task::1168::TaskManager.Task::(prepare) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4680::DEBUG::2014-04-10 18:27:37,499::task::579::TaskManager.Task::(_updateState) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::moving from state preparing -> state finished
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4680::DEBUG::2014-04-10 18:27:37,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4680::DEBUG::2014-04-10 18:27:37,501::task::974::TaskManager.Task::(_decref) Task=`4345e2b3-3461-43be-8a7f-3b183461130e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:40,545::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:40,552::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334844 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:27:40,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:40,769::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000467017 s, 788 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:40,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:40,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000500091 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:27:40,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:40,959::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278311 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4684::DEBUG::2014-04-10 18:27:47,628::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4684::DEBUG::2014-04-10 18:27:47,628::task::579::TaskManager.Task::(_updateState) Task=`9745b7dd-62b2-4484-b0b2-811d3bf06e48`::moving from state init -> state preparing
>Thread-4684::INFO::2014-04-10 18:27:47,629::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4684::INFO::2014-04-10 18:27:47,629::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4684::DEBUG::2014-04-10 18:27:47,629::task::1168::TaskManager.Task::(prepare) Task=`9745b7dd-62b2-4484-b0b2-811d3bf06e48`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4684::DEBUG::2014-04-10 18:27:47,629::task::579::TaskManager.Task::(_updateState) Task=`9745b7dd-62b2-4484-b0b2-811d3bf06e48`::moving from state preparing -> state finished
>Thread-4684::DEBUG::2014-04-10 18:27:47,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4684::DEBUG::2014-04-10 18:27:47,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4684::DEBUG::2014-04-10 18:27:47,630::task::974::TaskManager.Task::(_decref) Task=`9745b7dd-62b2-4484-b0b2-811d3bf06e48`::ref 0 aborting False
>Thread-4685::DEBUG::2014-04-10 18:27:47,636::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4685::DEBUG::2014-04-10 18:27:47,637::task::579::TaskManager.Task::(_updateState) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::moving from state init -> state preparing
>Thread-4685::INFO::2014-04-10 18:27:47,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4685::DEBUG::2014-04-10 18:27:47,637::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eade6e5d-95e9-4440-a5e0-7c16760bc06c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4685::DEBUG::2014-04-10 18:27:47,638::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4685::DEBUG::2014-04-10 18:27:47,638::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4685::DEBUG::2014-04-10 18:27:47,638::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eade6e5d-95e9-4440-a5e0-7c16760bc06c`::Granted request
>Thread-4685::DEBUG::2014-04-10 18:27:47,638::task::811::TaskManager.Task::(resourceAcquired) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4685::DEBUG::2014-04-10 18:27:47,638::task::974::TaskManager.Task::(_decref) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::ref 1 aborting False
>Thread-4685::INFO::2014-04-10 18:27:47,640::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4685::DEBUG::2014-04-10 18:27:47,641::task::1168::TaskManager.Task::(prepare) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4685::DEBUG::2014-04-10 18:27:47,641::task::579::TaskManager.Task::(_updateState) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::moving from state preparing -> state finished
>Thread-4685::DEBUG::2014-04-10 18:27:47,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4685::DEBUG::2014-04-10 18:27:47,641::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4685::DEBUG::2014-04-10 18:27:47,641::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4685::DEBUG::2014-04-10 18:27:47,642::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4685::DEBUG::2014-04-10 18:27:47,642::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4685::DEBUG::2014-04-10 18:27:47,642::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4685::DEBUG::2014-04-10 18:27:47,642::task::974::TaskManager.Task::(_decref) Task=`b804f89b-498b-4b7e-951a-46600b76f395`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:27:50,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:27:50,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000575248 s, 1.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:27:50,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:27:50,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000441655 s, 833 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:27:50,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:27:50,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485488 s, 1.4 MB/s\n'; <rc> = 0
>Thread-4687::DEBUG::2014-04-10 18:27:50,962::task::579::TaskManager.Task::(_updateState) Task=`734d9ba6-75d9-43a4-a84f-757dbc772781`::moving from state init -> state preparing
>Thread-4687::INFO::2014-04-10 18:27:50,963::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4687::INFO::2014-04-10 18:27:50,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485488', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575248', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278311', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441655', 'lastCheck': '0.2', 'valid': True}}
>Thread-4687::DEBUG::2014-04-10 18:27:50,966::task::1168::TaskManager.Task::(prepare) Task=`734d9ba6-75d9-43a4-a84f-757dbc772781`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485488', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575248', 'lastCheck': '0.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278311', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441655', 'lastCheck': '0.2', 'valid': True}}
>Thread-4687::DEBUG::2014-04-10 18:27:50,968::task::579::TaskManager.Task::(_updateState) Task=`734d9ba6-75d9-43a4-a84f-757dbc772781`::moving from state preparing -> state finished
>Thread-4687::DEBUG::2014-04-10 18:27:50,969::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4687::DEBUG::2014-04-10 18:27:50,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4687::DEBUG::2014-04-10 18:27:50,971::task::974::TaskManager.Task::(_decref) Task=`734d9ba6-75d9-43a4-a84f-757dbc772781`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:27:50,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:27:50,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272026 s, 2.5 MB/s\n'; <rc> = 0
>Thread-4691::DEBUG::2014-04-10 18:27:57,767::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-4691::DEBUG::2014-04-10 18:27:57,768::task::579::TaskManager.Task::(_updateState) Task=`610a8e59-80e8-47d7-a7ff-d8b9ba6c7ccb`::moving from state init -> state preparing
>Thread-4691::INFO::2014-04-10 18:27:57,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4691::INFO::2014-04-10 18:27:57,768::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4691::DEBUG::2014-04-10 18:27:57,769::task::1168::TaskManager.Task::(prepare) Task=`610a8e59-80e8-47d7-a7ff-d8b9ba6c7ccb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4691::DEBUG::2014-04-10 18:27:57,769::task::579::TaskManager.Task::(_updateState) Task=`610a8e59-80e8-47d7-a7ff-d8b9ba6c7ccb`::moving from state preparing -> state finished
>Thread-4691::DEBUG::2014-04-10 18:27:57,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4691::DEBUG::2014-04-10 18:27:57,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4691::DEBUG::2014-04-10 18:27:57,769::task::974::TaskManager.Task::(_decref) Task=`610a8e59-80e8-47d7-a7ff-d8b9ba6c7ccb`::ref 0 aborting False
>Thread-4692::DEBUG::2014-04-10 18:27:57,775::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-4692::DEBUG::2014-04-10 18:27:57,776::task::579::TaskManager.Task::(_updateState) Task=`df6ea850-2543-4a80-b778-1581360b156d`::moving from state init -> state preparing
>Thread-4692::INFO::2014-04-10 18:27:57,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4692::DEBUG::2014-04-10 18:27:57,776::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`19c86eec-c98c-4bf0-b4c6-68b04d3a2134`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4692::DEBUG::2014-04-10 18:27:57,777::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4692::DEBUG::2014-04-10 18:27:57,777::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4692::DEBUG::2014-04-10 18:27:57,777::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`19c86eec-c98c-4bf0-b4c6-68b04d3a2134`::Granted request
>Thread-4692::DEBUG::2014-04-10 18:27:57,777::task::811::TaskManager.Task::(resourceAcquired) Task=`df6ea850-2543-4a80-b778-1581360b156d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4692::DEBUG::2014-04-10 18:27:57,777::task::974::TaskManager.Task::(_decref) Task=`df6ea850-2543-4a80-b778-1581360b156d`::ref 1 aborting False
>Thread-4692::INFO::2014-04-10 18:27:57,779::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::task::1168::TaskManager.Task::(prepare) Task=`df6ea850-2543-4a80-b778-1581360b156d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::task::579::TaskManager.Task::(_updateState) Task=`df6ea850-2543-4a80-b778-1581360b156d`::moving from state preparing -> state finished
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4692::DEBUG::2014-04-10 18:27:57,780::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4692::DEBUG::2014-04-10 18:27:57,781::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4692::DEBUG::2014-04-10 18:27:57,781::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4692::DEBUG::2014-04-10 18:27:57,781::task::974::TaskManager.Task::(_decref) Task=`df6ea850-2543-4a80-b778-1581360b156d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:00,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:00,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307686 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:00,791::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:00,798::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509927 s, 722 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:00,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:00,971::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000444048 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:01,000::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:01,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000416882 s, 1.6 MB/s\n'; <rc> = 0
>Thread-4695::DEBUG::2014-04-10 18:28:06,145::task::579::TaskManager.Task::(_updateState) Task=`e21a0d46-77b0-476a-85c6-99506e91d494`::moving from state init -> state preparing
>Thread-4695::INFO::2014-04-10 18:28:06,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4695::INFO::2014-04-10 18:28:06,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444048', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307686', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416882', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509927', 'lastCheck': '5.3', 'valid': True}}
>Thread-4695::DEBUG::2014-04-10 18:28:06,146::task::1168::TaskManager.Task::(prepare) Task=`e21a0d46-77b0-476a-85c6-99506e91d494`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444048', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307686', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416882', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509927', 'lastCheck': '5.3', 'valid': True}}
>Thread-4695::DEBUG::2014-04-10 18:28:06,147::task::579::TaskManager.Task::(_updateState) Task=`e21a0d46-77b0-476a-85c6-99506e91d494`::moving from state preparing -> state finished
>Thread-4695::DEBUG::2014-04-10 18:28:06,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4695::DEBUG::2014-04-10 18:28:06,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4695::DEBUG::2014-04-10 18:28:06,147::task::974::TaskManager.Task::(_decref) Task=`e21a0d46-77b0-476a-85c6-99506e91d494`::ref 0 aborting False
>Thread-4697::DEBUG::2014-04-10 18:28:07,899::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4697::DEBUG::2014-04-10 18:28:07,900::task::579::TaskManager.Task::(_updateState) Task=`487562a6-f9fa-4b07-956f-ab684ea05b03`::moving from state init -> state preparing
>Thread-4697::INFO::2014-04-10 18:28:07,900::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4697::INFO::2014-04-10 18:28:07,900::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4697::DEBUG::2014-04-10 18:28:07,900::task::1168::TaskManager.Task::(prepare) Task=`487562a6-f9fa-4b07-956f-ab684ea05b03`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4697::DEBUG::2014-04-10 18:28:07,900::task::579::TaskManager.Task::(_updateState) Task=`487562a6-f9fa-4b07-956f-ab684ea05b03`::moving from state preparing -> state finished
>Thread-4697::DEBUG::2014-04-10 18:28:07,901::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4697::DEBUG::2014-04-10 18:28:07,901::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4697::DEBUG::2014-04-10 18:28:07,901::task::974::TaskManager.Task::(_decref) Task=`487562a6-f9fa-4b07-956f-ab684ea05b03`::ref 0 aborting False
>Thread-4698::DEBUG::2014-04-10 18:28:07,907::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4698::DEBUG::2014-04-10 18:28:07,907::task::579::TaskManager.Task::(_updateState) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::moving from state init -> state preparing
>Thread-4698::INFO::2014-04-10 18:28:07,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4698::DEBUG::2014-04-10 18:28:07,908::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ae64dbc-e71f-45bb-8e22-94cd784bc621`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4698::DEBUG::2014-04-10 18:28:07,908::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4698::DEBUG::2014-04-10 18:28:07,908::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4698::DEBUG::2014-04-10 18:28:07,909::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ae64dbc-e71f-45bb-8e22-94cd784bc621`::Granted request
>Thread-4698::DEBUG::2014-04-10 18:28:07,909::task::811::TaskManager.Task::(resourceAcquired) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4698::DEBUG::2014-04-10 18:28:07,909::task::974::TaskManager.Task::(_decref) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::ref 1 aborting False
>Thread-4698::INFO::2014-04-10 18:28:07,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4698::DEBUG::2014-04-10 18:28:07,911::task::1168::TaskManager.Task::(prepare) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4698::DEBUG::2014-04-10 18:28:07,911::task::579::TaskManager.Task::(_updateState) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::moving from state preparing -> state finished
>Thread-4698::DEBUG::2014-04-10 18:28:07,911::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4698::DEBUG::2014-04-10 18:28:07,912::task::974::TaskManager.Task::(_decref) Task=`9ba5448c-2668-4dd2-911b-a29881848cf2`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:10,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:10,611::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314412 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:10,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:10,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000471483 s, 781 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:10,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:10,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00052598 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:11,016::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:11,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314797 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4702::DEBUG::2014-04-10 18:28:18,040::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4702::DEBUG::2014-04-10 18:28:18,041::task::579::TaskManager.Task::(_updateState) Task=`400fbf0c-92a1-41de-83a8-06b3c0645685`::moving from state init -> state preparing
>Thread-4702::INFO::2014-04-10 18:28:18,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4702::INFO::2014-04-10 18:28:18,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4702::DEBUG::2014-04-10 18:28:18,041::task::1168::TaskManager.Task::(prepare) Task=`400fbf0c-92a1-41de-83a8-06b3c0645685`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4702::DEBUG::2014-04-10 18:28:18,042::task::579::TaskManager.Task::(_updateState) Task=`400fbf0c-92a1-41de-83a8-06b3c0645685`::moving from state preparing -> state finished
>Thread-4702::DEBUG::2014-04-10 18:28:18,042::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4702::DEBUG::2014-04-10 18:28:18,042::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4702::DEBUG::2014-04-10 18:28:18,042::task::974::TaskManager.Task::(_decref) Task=`400fbf0c-92a1-41de-83a8-06b3c0645685`::ref 0 aborting False
>Thread-4703::DEBUG::2014-04-10 18:28:18,049::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4703::DEBUG::2014-04-10 18:28:18,049::task::579::TaskManager.Task::(_updateState) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::moving from state init -> state preparing
>Thread-4703::INFO::2014-04-10 18:28:18,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4703::DEBUG::2014-04-10 18:28:18,050::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c73227b-13e8-4637-81d8-91078dbe0cbd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4703::DEBUG::2014-04-10 18:28:18,050::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4703::DEBUG::2014-04-10 18:28:18,050::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4703::DEBUG::2014-04-10 18:28:18,050::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c73227b-13e8-4637-81d8-91078dbe0cbd`::Granted request
>Thread-4703::DEBUG::2014-04-10 18:28:18,051::task::811::TaskManager.Task::(resourceAcquired) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4703::DEBUG::2014-04-10 18:28:18,051::task::974::TaskManager.Task::(_decref) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::ref 1 aborting False
>Thread-4703::INFO::2014-04-10 18:28:18,053::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4703::DEBUG::2014-04-10 18:28:18,053::task::1168::TaskManager.Task::(prepare) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4703::DEBUG::2014-04-10 18:28:18,053::task::579::TaskManager.Task::(_updateState) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::moving from state preparing -> state finished
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4703::DEBUG::2014-04-10 18:28:18,054::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4703::DEBUG::2014-04-10 18:28:18,055::task::974::TaskManager.Task::(_decref) Task=`e58ea18a-1603-4430-ba4b-9b09b0a3e196`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:20,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:20,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000328463 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:20,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:20,829::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486295 s, 757 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:20,994::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:20,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000485347 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:21,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:21,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308266 s, 2.2 MB/s\n'; <rc> = 0
>Thread-4705::DEBUG::2014-04-10 18:28:21,309::task::579::TaskManager.Task::(_updateState) Task=`1bd44059-6ff6-4a00-b6c2-d710acd5447d`::moving from state init -> state preparing
>Thread-4705::INFO::2014-04-10 18:28:21,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4705::INFO::2014-04-10 18:28:21,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485347', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328463', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308266', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486295', 'lastCheck': '0.5', 'valid': True}}
>Thread-4705::DEBUG::2014-04-10 18:28:21,309::task::1168::TaskManager.Task::(prepare) Task=`1bd44059-6ff6-4a00-b6c2-d710acd5447d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485347', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000328463', 'lastCheck': '0.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308266', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486295', 'lastCheck': '0.5', 'valid': True}}
>Thread-4705::DEBUG::2014-04-10 18:28:21,310::task::579::TaskManager.Task::(_updateState) Task=`1bd44059-6ff6-4a00-b6c2-d710acd5447d`::moving from state preparing -> state finished
>Thread-4705::DEBUG::2014-04-10 18:28:21,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4705::DEBUG::2014-04-10 18:28:21,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4705::DEBUG::2014-04-10 18:28:21,310::task::974::TaskManager.Task::(_decref) Task=`1bd44059-6ff6-4a00-b6c2-d710acd5447d`::ref 0 aborting False
>Thread-4709::DEBUG::2014-04-10 18:28:28,129::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4709::DEBUG::2014-04-10 18:28:28,130::task::579::TaskManager.Task::(_updateState) Task=`74170bc2-67da-4f29-8ab6-ae08c2cb1122`::moving from state init -> state preparing
>Thread-4709::INFO::2014-04-10 18:28:28,130::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4709::INFO::2014-04-10 18:28:28,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4709::DEBUG::2014-04-10 18:28:28,131::task::1168::TaskManager.Task::(prepare) Task=`74170bc2-67da-4f29-8ab6-ae08c2cb1122`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4709::DEBUG::2014-04-10 18:28:28,131::task::579::TaskManager.Task::(_updateState) Task=`74170bc2-67da-4f29-8ab6-ae08c2cb1122`::moving from state preparing -> state finished
>Thread-4709::DEBUG::2014-04-10 18:28:28,131::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4709::DEBUG::2014-04-10 18:28:28,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4709::DEBUG::2014-04-10 18:28:28,132::task::974::TaskManager.Task::(_decref) Task=`74170bc2-67da-4f29-8ab6-ae08c2cb1122`::ref 0 aborting False
>Thread-4710::DEBUG::2014-04-10 18:28:28,138::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4710::DEBUG::2014-04-10 18:28:28,138::task::579::TaskManager.Task::(_updateState) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::moving from state init -> state preparing
>Thread-4710::INFO::2014-04-10 18:28:28,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4710::DEBUG::2014-04-10 18:28:28,139::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb977ae9-4ef3-42a3-8178-f350dc0fc751`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4710::DEBUG::2014-04-10 18:28:28,139::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4710::DEBUG::2014-04-10 18:28:28,139::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4710::DEBUG::2014-04-10 18:28:28,140::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb977ae9-4ef3-42a3-8178-f350dc0fc751`::Granted request
>Thread-4710::DEBUG::2014-04-10 18:28:28,140::task::811::TaskManager.Task::(resourceAcquired) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4710::DEBUG::2014-04-10 18:28:28,140::task::974::TaskManager.Task::(_decref) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::ref 1 aborting False
>Thread-4710::INFO::2014-04-10 18:28:28,142::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4710::DEBUG::2014-04-10 18:28:28,142::task::1168::TaskManager.Task::(prepare) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4710::DEBUG::2014-04-10 18:28:28,142::task::579::TaskManager.Task::(_updateState) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::moving from state preparing -> state finished
>Thread-4710::DEBUG::2014-04-10 18:28:28,142::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4710::DEBUG::2014-04-10 18:28:28,143::task::974::TaskManager.Task::(_decref) Task=`3f4ad444-0c53-4ae2-ab12-68a24969f548`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:30,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:30,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272957 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:30,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:30,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000472002 s, 780 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:31,003::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:28:31,016::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:28:31,018::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:28:31,023::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:28:31,025::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:28:31,025::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:28:31,025::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:28:31,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:31,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459925 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:31,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:31,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310078 s, 2.2 MB/s\n'; <rc> = 0
>Thread-4717::DEBUG::2014-04-10 18:28:36,483::task::579::TaskManager.Task::(_updateState) Task=`0909453a-1da1-4e7c-97a1-558c760ae599`::moving from state init -> state preparing
>Thread-4717::INFO::2014-04-10 18:28:36,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4717::INFO::2014-04-10 18:28:36,483::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459925', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272957', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310078', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472002', 'lastCheck': '5.6', 'valid': True}}
>Thread-4717::DEBUG::2014-04-10 18:28:36,484::task::1168::TaskManager.Task::(prepare) Task=`0909453a-1da1-4e7c-97a1-558c760ae599`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459925', 'lastCheck': '5.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272957', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310078', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472002', 'lastCheck': '5.6', 'valid': True}}
>Thread-4717::DEBUG::2014-04-10 18:28:36,484::task::579::TaskManager.Task::(_updateState) Task=`0909453a-1da1-4e7c-97a1-558c760ae599`::moving from state preparing -> state finished
>Thread-4717::DEBUG::2014-04-10 18:28:36,484::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4717::DEBUG::2014-04-10 18:28:36,484::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4717::DEBUG::2014-04-10 18:28:36,484::task::974::TaskManager.Task::(_decref) Task=`0909453a-1da1-4e7c-97a1-558c760ae599`::ref 0 aborting False
>Thread-4719::DEBUG::2014-04-10 18:28:38,277::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4719::DEBUG::2014-04-10 18:28:38,277::task::579::TaskManager.Task::(_updateState) Task=`2fb01b36-4d13-4b2b-9b3d-f5c5c590a0e2`::moving from state init -> state preparing
>Thread-4719::INFO::2014-04-10 18:28:38,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4719::INFO::2014-04-10 18:28:38,278::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4719::DEBUG::2014-04-10 18:28:38,278::task::1168::TaskManager.Task::(prepare) Task=`2fb01b36-4d13-4b2b-9b3d-f5c5c590a0e2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4719::DEBUG::2014-04-10 18:28:38,278::task::579::TaskManager.Task::(_updateState) Task=`2fb01b36-4d13-4b2b-9b3d-f5c5c590a0e2`::moving from state preparing -> state finished
>Thread-4719::DEBUG::2014-04-10 18:28:38,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4719::DEBUG::2014-04-10 18:28:38,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4719::DEBUG::2014-04-10 18:28:38,279::task::974::TaskManager.Task::(_decref) Task=`2fb01b36-4d13-4b2b-9b3d-f5c5c590a0e2`::ref 0 aborting False
>Thread-4720::DEBUG::2014-04-10 18:28:38,285::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4720::DEBUG::2014-04-10 18:28:38,285::task::579::TaskManager.Task::(_updateState) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::moving from state init -> state preparing
>Thread-4720::INFO::2014-04-10 18:28:38,286::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4720::DEBUG::2014-04-10 18:28:38,286::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b6e59079-c634-4dbe-bfa5-500a99943a68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4720::DEBUG::2014-04-10 18:28:38,286::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4720::DEBUG::2014-04-10 18:28:38,286::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4720::DEBUG::2014-04-10 18:28:38,287::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b6e59079-c634-4dbe-bfa5-500a99943a68`::Granted request
>Thread-4720::DEBUG::2014-04-10 18:28:38,287::task::811::TaskManager.Task::(resourceAcquired) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4720::DEBUG::2014-04-10 18:28:38,287::task::974::TaskManager.Task::(_decref) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::ref 1 aborting False
>Thread-4720::INFO::2014-04-10 18:28:38,289::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4720::DEBUG::2014-04-10 18:28:38,289::task::1168::TaskManager.Task::(prepare) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4720::DEBUG::2014-04-10 18:28:38,289::task::579::TaskManager.Task::(_updateState) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::moving from state preparing -> state finished
>Thread-4720::DEBUG::2014-04-10 18:28:38,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4720::DEBUG::2014-04-10 18:28:38,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4720::DEBUG::2014-04-10 18:28:38,290::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4720::DEBUG::2014-04-10 18:28:38,290::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4720::DEBUG::2014-04-10 18:28:38,290::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4720::DEBUG::2014-04-10 18:28:38,290::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4720::DEBUG::2014-04-10 18:28:38,290::task::974::TaskManager.Task::(_decref) Task=`d4e61a22-ca2d-4570-9001-7c5b2f0f9f1d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:40,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:40,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336584 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:40,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:40,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000343026 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:41,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:41,050::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000383994 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:41,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:41,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283722 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4724::DEBUG::2014-04-10 18:28:48,435::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4724::DEBUG::2014-04-10 18:28:48,436::task::579::TaskManager.Task::(_updateState) Task=`55c42412-5426-4423-a914-c12ba40f1035`::moving from state init -> state preparing
>Thread-4724::INFO::2014-04-10 18:28:48,436::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4724::INFO::2014-04-10 18:28:48,436::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4724::DEBUG::2014-04-10 18:28:48,436::task::1168::TaskManager.Task::(prepare) Task=`55c42412-5426-4423-a914-c12ba40f1035`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4724::DEBUG::2014-04-10 18:28:48,436::task::579::TaskManager.Task::(_updateState) Task=`55c42412-5426-4423-a914-c12ba40f1035`::moving from state preparing -> state finished
>Thread-4724::DEBUG::2014-04-10 18:28:48,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4724::DEBUG::2014-04-10 18:28:48,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4724::DEBUG::2014-04-10 18:28:48,437::task::974::TaskManager.Task::(_decref) Task=`55c42412-5426-4423-a914-c12ba40f1035`::ref 0 aborting False
>Thread-4725::DEBUG::2014-04-10 18:28:48,443::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4725::DEBUG::2014-04-10 18:28:48,444::task::579::TaskManager.Task::(_updateState) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::moving from state init -> state preparing
>Thread-4725::INFO::2014-04-10 18:28:48,444::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4725::DEBUG::2014-04-10 18:28:48,444::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ccecea51-0052-4ff4-9616-4b5481927df1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4725::DEBUG::2014-04-10 18:28:48,444::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4725::DEBUG::2014-04-10 18:28:48,445::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4725::DEBUG::2014-04-10 18:28:48,445::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ccecea51-0052-4ff4-9616-4b5481927df1`::Granted request
>Thread-4725::DEBUG::2014-04-10 18:28:48,445::task::811::TaskManager.Task::(resourceAcquired) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4725::DEBUG::2014-04-10 18:28:48,445::task::974::TaskManager.Task::(_decref) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::ref 1 aborting False
>Thread-4725::INFO::2014-04-10 18:28:48,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4725::DEBUG::2014-04-10 18:28:48,447::task::1168::TaskManager.Task::(prepare) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4725::DEBUG::2014-04-10 18:28:48,447::task::579::TaskManager.Task::(_updateState) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::moving from state preparing -> state finished
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4725::DEBUG::2014-04-10 18:28:48,448::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4725::DEBUG::2014-04-10 18:28:48,449::task::974::TaskManager.Task::(_decref) Task=`eed21c95-6507-4328-b37b-f15a8e8b3895`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:28:50,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:28:50,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299267 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:28:50,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:28:50,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484595 s, 759 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:28:51,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:28:51,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000488994 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:28:51,081::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:28:51,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316937 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4727::DEBUG::2014-04-10 18:28:51,658::task::579::TaskManager.Task::(_updateState) Task=`bf0ff024-50cc-4e0f-b3e0-1a80090cb88d`::moving from state init -> state preparing
>Thread-4727::INFO::2014-04-10 18:28:51,659::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4727::INFO::2014-04-10 18:28:51,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488994', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299267', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316937', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484595', 'lastCheck': '0.8', 'valid': True}}
>Thread-4727::DEBUG::2014-04-10 18:28:51,659::task::1168::TaskManager.Task::(prepare) Task=`bf0ff024-50cc-4e0f-b3e0-1a80090cb88d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488994', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299267', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316937', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484595', 'lastCheck': '0.8', 'valid': True}}
>Thread-4727::DEBUG::2014-04-10 18:28:51,659::task::579::TaskManager.Task::(_updateState) Task=`bf0ff024-50cc-4e0f-b3e0-1a80090cb88d`::moving from state preparing -> state finished
>Thread-4727::DEBUG::2014-04-10 18:28:51,660::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4727::DEBUG::2014-04-10 18:28:51,660::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4727::DEBUG::2014-04-10 18:28:51,660::task::974::TaskManager.Task::(_decref) Task=`bf0ff024-50cc-4e0f-b3e0-1a80090cb88d`::ref 0 aborting False
>Thread-4731::DEBUG::2014-04-10 18:28:58,525::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4731::DEBUG::2014-04-10 18:28:58,526::task::579::TaskManager.Task::(_updateState) Task=`d69a1abe-520f-4e7d-95a3-39e65e6a2cba`::moving from state init -> state preparing
>Thread-4731::INFO::2014-04-10 18:28:58,526::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4731::INFO::2014-04-10 18:28:58,526::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4731::DEBUG::2014-04-10 18:28:58,527::task::1168::TaskManager.Task::(prepare) Task=`d69a1abe-520f-4e7d-95a3-39e65e6a2cba`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4731::DEBUG::2014-04-10 18:28:58,527::task::579::TaskManager.Task::(_updateState) Task=`d69a1abe-520f-4e7d-95a3-39e65e6a2cba`::moving from state preparing -> state finished
>Thread-4731::DEBUG::2014-04-10 18:28:58,527::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4731::DEBUG::2014-04-10 18:28:58,527::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4731::DEBUG::2014-04-10 18:28:58,527::task::974::TaskManager.Task::(_decref) Task=`d69a1abe-520f-4e7d-95a3-39e65e6a2cba`::ref 0 aborting False
>Thread-4732::DEBUG::2014-04-10 18:28:58,534::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [472a160c]
>Thread-4732::DEBUG::2014-04-10 18:28:58,534::task::579::TaskManager.Task::(_updateState) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::moving from state init -> state preparing
>Thread-4732::INFO::2014-04-10 18:28:58,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4732::DEBUG::2014-04-10 18:28:58,535::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2a1ebfd9-51d3-4483-aec9-d13a8a2f6f6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4732::DEBUG::2014-04-10 18:28:58,535::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4732::DEBUG::2014-04-10 18:28:58,535::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4732::DEBUG::2014-04-10 18:28:58,535::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2a1ebfd9-51d3-4483-aec9-d13a8a2f6f6b`::Granted request
>Thread-4732::DEBUG::2014-04-10 18:28:58,536::task::811::TaskManager.Task::(resourceAcquired) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4732::DEBUG::2014-04-10 18:28:58,536::task::974::TaskManager.Task::(_decref) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::ref 1 aborting False
>Thread-4732::INFO::2014-04-10 18:28:58,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4732::DEBUG::2014-04-10 18:28:58,538::task::1168::TaskManager.Task::(prepare) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::task::579::TaskManager.Task::(_updateState) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::moving from state preparing -> state finished
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4732::DEBUG::2014-04-10 18:28:58,539::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4732::DEBUG::2014-04-10 18:28:58,540::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4732::DEBUG::2014-04-10 18:28:58,540::task::974::TaskManager.Task::(_decref) Task=`f667db67-67f8-47a5-951d-f41113ade9a8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:00,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:00,694::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340109 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:00,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:00,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00051066 s, 721 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:01,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:01,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000525978 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:01,096::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:01,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306974 s, 2.2 MB/s\n'; <rc> = 0
>Thread-4735::DEBUG::2014-04-10 18:29:06,819::task::579::TaskManager.Task::(_updateState) Task=`9f722532-54b9-4d2b-92fc-0f41df7616bd`::moving from state init -> state preparing
>Thread-4735::INFO::2014-04-10 18:29:06,819::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4735::INFO::2014-04-10 18:29:06,820::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525978', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340109', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306974', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051066', 'lastCheck': '5.9', 'valid': True}}
>Thread-4735::DEBUG::2014-04-10 18:29:06,820::task::1168::TaskManager.Task::(prepare) Task=`9f722532-54b9-4d2b-92fc-0f41df7616bd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525978', 'lastCheck': '5.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340109', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000306974', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051066', 'lastCheck': '5.9', 'valid': True}}
>Thread-4735::DEBUG::2014-04-10 18:29:06,820::task::579::TaskManager.Task::(_updateState) Task=`9f722532-54b9-4d2b-92fc-0f41df7616bd`::moving from state preparing -> state finished
>Thread-4735::DEBUG::2014-04-10 18:29:06,820::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4735::DEBUG::2014-04-10 18:29:06,820::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4735::DEBUG::2014-04-10 18:29:06,821::task::974::TaskManager.Task::(_decref) Task=`9f722532-54b9-4d2b-92fc-0f41df7616bd`::ref 0 aborting False
>Thread-4737::DEBUG::2014-04-10 18:29:08,664::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-4737::DEBUG::2014-04-10 18:29:08,665::task::579::TaskManager.Task::(_updateState) Task=`ffaf8530-646a-4839-9a72-68850dba8984`::moving from state init -> state preparing
>Thread-4737::INFO::2014-04-10 18:29:08,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4737::INFO::2014-04-10 18:29:08,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4737::DEBUG::2014-04-10 18:29:08,666::task::1168::TaskManager.Task::(prepare) Task=`ffaf8530-646a-4839-9a72-68850dba8984`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4737::DEBUG::2014-04-10 18:29:08,666::task::579::TaskManager.Task::(_updateState) Task=`ffaf8530-646a-4839-9a72-68850dba8984`::moving from state preparing -> state finished
>Thread-4737::DEBUG::2014-04-10 18:29:08,666::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4737::DEBUG::2014-04-10 18:29:08,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4737::DEBUG::2014-04-10 18:29:08,666::task::974::TaskManager.Task::(_decref) Task=`ffaf8530-646a-4839-9a72-68850dba8984`::ref 0 aborting False
>Thread-4738::DEBUG::2014-04-10 18:29:08,673::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4f32795c]
>Thread-4738::DEBUG::2014-04-10 18:29:08,673::task::579::TaskManager.Task::(_updateState) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::moving from state init -> state preparing
>Thread-4738::INFO::2014-04-10 18:29:08,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4738::DEBUG::2014-04-10 18:29:08,674::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4b13ce2c-201e-4200-b354-ba6fdc103c7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4738::DEBUG::2014-04-10 18:29:08,674::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4738::DEBUG::2014-04-10 18:29:08,674::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4738::DEBUG::2014-04-10 18:29:08,674::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4b13ce2c-201e-4200-b354-ba6fdc103c7a`::Granted request
>Thread-4738::DEBUG::2014-04-10 18:29:08,674::task::811::TaskManager.Task::(resourceAcquired) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4738::DEBUG::2014-04-10 18:29:08,675::task::974::TaskManager.Task::(_decref) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::ref 1 aborting False
>Thread-4738::INFO::2014-04-10 18:29:08,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4738::DEBUG::2014-04-10 18:29:08,677::task::1168::TaskManager.Task::(prepare) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4738::DEBUG::2014-04-10 18:29:08,677::task::579::TaskManager.Task::(_updateState) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::moving from state preparing -> state finished
>Thread-4738::DEBUG::2014-04-10 18:29:08,677::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4738::DEBUG::2014-04-10 18:29:08,677::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4738::DEBUG::2014-04-10 18:29:08,677::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4738::DEBUG::2014-04-10 18:29:08,678::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4738::DEBUG::2014-04-10 18:29:08,678::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4738::DEBUG::2014-04-10 18:29:08,678::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4738::DEBUG::2014-04-10 18:29:08,678::task::974::TaskManager.Task::(_decref) Task=`d56561ba-c48b-4a71-937a-b14d4b51c128`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:10,702::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:10,709::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282529 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:10,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:10,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000482767 s, 762 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:11,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:11,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000535593 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:11,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:11,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272366 s, 2.5 MB/s\n'; <rc> = 0
>Thread-4742::DEBUG::2014-04-10 18:29:18,806::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-4742::DEBUG::2014-04-10 18:29:18,806::task::579::TaskManager.Task::(_updateState) Task=`d75a164f-bf70-4ff1-91b6-31abec67cd9f`::moving from state init -> state preparing
>Thread-4742::INFO::2014-04-10 18:29:18,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4742::INFO::2014-04-10 18:29:18,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4742::DEBUG::2014-04-10 18:29:18,807::task::1168::TaskManager.Task::(prepare) Task=`d75a164f-bf70-4ff1-91b6-31abec67cd9f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4742::DEBUG::2014-04-10 18:29:18,807::task::579::TaskManager.Task::(_updateState) Task=`d75a164f-bf70-4ff1-91b6-31abec67cd9f`::moving from state preparing -> state finished
>Thread-4742::DEBUG::2014-04-10 18:29:18,807::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4742::DEBUG::2014-04-10 18:29:18,808::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4742::DEBUG::2014-04-10 18:29:18,808::task::974::TaskManager.Task::(_decref) Task=`d75a164f-bf70-4ff1-91b6-31abec67cd9f`::ref 0 aborting False
>Thread-4743::DEBUG::2014-04-10 18:29:18,814::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [68dc1a40]
>Thread-4743::DEBUG::2014-04-10 18:29:18,815::task::579::TaskManager.Task::(_updateState) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::moving from state init -> state preparing
>Thread-4743::INFO::2014-04-10 18:29:18,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4743::DEBUG::2014-04-10 18:29:18,815::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ced64504-8de7-43a1-b795-485ee0a0859b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4743::DEBUG::2014-04-10 18:29:18,816::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4743::DEBUG::2014-04-10 18:29:18,816::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4743::DEBUG::2014-04-10 18:29:18,816::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ced64504-8de7-43a1-b795-485ee0a0859b`::Granted request
>Thread-4743::DEBUG::2014-04-10 18:29:18,816::task::811::TaskManager.Task::(resourceAcquired) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4743::DEBUG::2014-04-10 18:29:18,816::task::974::TaskManager.Task::(_decref) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::ref 1 aborting False
>Thread-4743::INFO::2014-04-10 18:29:18,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4743::DEBUG::2014-04-10 18:29:18,818::task::1168::TaskManager.Task::(prepare) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4743::DEBUG::2014-04-10 18:29:18,819::task::579::TaskManager.Task::(_updateState) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::moving from state preparing -> state finished
>Thread-4743::DEBUG::2014-04-10 18:29:18,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4743::DEBUG::2014-04-10 18:29:18,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4743::DEBUG::2014-04-10 18:29:18,819::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4743::DEBUG::2014-04-10 18:29:18,819::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4743::DEBUG::2014-04-10 18:29:18,820::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4743::DEBUG::2014-04-10 18:29:18,820::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4743::DEBUG::2014-04-10 18:29:18,820::task::974::TaskManager.Task::(_decref) Task=`e06de52b-7489-41b0-b1e0-0827eeab73bd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:20,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:20,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288122 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:20,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:20,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00050172 s, 733 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:21,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:21,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000603359 s, 1.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:21,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:21,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250602 s, 2.7 MB/s\n'; <rc> = 0
>Thread-4745::DEBUG::2014-04-10 18:29:22,086::task::579::TaskManager.Task::(_updateState) Task=`d2f9ec47-4263-4054-8745-a3d255e1bb43`::moving from state init -> state preparing
>Thread-4745::INFO::2014-04-10 18:29:22,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4745::INFO::2014-04-10 18:29:22,086::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603359', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288122', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250602', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050172', 'lastCheck': '1.2', 'valid': True}}
>Thread-4745::DEBUG::2014-04-10 18:29:22,086::task::1168::TaskManager.Task::(prepare) Task=`d2f9ec47-4263-4054-8745-a3d255e1bb43`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603359', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288122', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250602', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050172', 'lastCheck': '1.2', 'valid': True}}
>Thread-4745::DEBUG::2014-04-10 18:29:22,087::task::579::TaskManager.Task::(_updateState) Task=`d2f9ec47-4263-4054-8745-a3d255e1bb43`::moving from state preparing -> state finished
>Thread-4745::DEBUG::2014-04-10 18:29:22,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4745::DEBUG::2014-04-10 18:29:22,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4745::DEBUG::2014-04-10 18:29:22,087::task::974::TaskManager.Task::(_decref) Task=`d2f9ec47-4263-4054-8745-a3d255e1bb43`::ref 0 aborting False
>Thread-4749::DEBUG::2014-04-10 18:29:28,895::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4749::DEBUG::2014-04-10 18:29:28,895::task::579::TaskManager.Task::(_updateState) Task=`6c27ea18-f0df-44a7-946f-1330a8747eb8`::moving from state init -> state preparing
>Thread-4749::INFO::2014-04-10 18:29:28,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4749::INFO::2014-04-10 18:29:28,896::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4749::DEBUG::2014-04-10 18:29:28,896::task::1168::TaskManager.Task::(prepare) Task=`6c27ea18-f0df-44a7-946f-1330a8747eb8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4749::DEBUG::2014-04-10 18:29:28,896::task::579::TaskManager.Task::(_updateState) Task=`6c27ea18-f0df-44a7-946f-1330a8747eb8`::moving from state preparing -> state finished
>Thread-4749::DEBUG::2014-04-10 18:29:28,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4749::DEBUG::2014-04-10 18:29:28,897::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4749::DEBUG::2014-04-10 18:29:28,897::task::974::TaskManager.Task::(_decref) Task=`6c27ea18-f0df-44a7-946f-1330a8747eb8`::ref 0 aborting False
>Thread-4750::DEBUG::2014-04-10 18:29:28,904::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4750::DEBUG::2014-04-10 18:29:28,904::task::579::TaskManager.Task::(_updateState) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::moving from state init -> state preparing
>Thread-4750::INFO::2014-04-10 18:29:28,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4750::DEBUG::2014-04-10 18:29:28,905::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`355ea456-fd3d-403b-b01b-4773b67b6517`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4750::DEBUG::2014-04-10 18:29:28,905::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4750::DEBUG::2014-04-10 18:29:28,905::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4750::DEBUG::2014-04-10 18:29:28,905::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`355ea456-fd3d-403b-b01b-4773b67b6517`::Granted request
>Thread-4750::DEBUG::2014-04-10 18:29:28,906::task::811::TaskManager.Task::(resourceAcquired) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4750::DEBUG::2014-04-10 18:29:28,906::task::974::TaskManager.Task::(_decref) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::ref 1 aborting False
>Thread-4750::INFO::2014-04-10 18:29:28,908::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4750::DEBUG::2014-04-10 18:29:28,908::task::1168::TaskManager.Task::(prepare) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4750::DEBUG::2014-04-10 18:29:28,908::task::579::TaskManager.Task::(_updateState) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::moving from state preparing -> state finished
>Thread-4750::DEBUG::2014-04-10 18:29:28,908::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4750::DEBUG::2014-04-10 18:29:28,908::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4750::DEBUG::2014-04-10 18:29:28,909::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4750::DEBUG::2014-04-10 18:29:28,909::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4750::DEBUG::2014-04-10 18:29:28,909::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4750::DEBUG::2014-04-10 18:29:28,909::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4750::DEBUG::2014-04-10 18:29:28,909::task::974::TaskManager.Task::(_decref) Task=`0c14dacd-902f-4561-a92f-ddc84cbd9844`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:30,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:30,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032456 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:30,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:30,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481406 s, 764 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:31,117::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:31,123::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000395265 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:31,143::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:31,149::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260036 s, 2.6 MB/s\n'; <rc> = 0
>Thread-4753::DEBUG::2014-04-10 18:29:37,259::task::579::TaskManager.Task::(_updateState) Task=`dbc66edd-1ed9-44d7-8623-86729204024f`::moving from state init -> state preparing
>Thread-4753::INFO::2014-04-10 18:29:37,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4753::INFO::2014-04-10 18:29:37,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395265', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032456', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260036', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481406', 'lastCheck': '6.3', 'valid': True}}
>Thread-4753::DEBUG::2014-04-10 18:29:37,260::task::1168::TaskManager.Task::(prepare) Task=`dbc66edd-1ed9-44d7-8623-86729204024f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395265', 'lastCheck': '6.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032456', 'lastCheck': '6.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260036', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481406', 'lastCheck': '6.3', 'valid': True}}
>Thread-4753::DEBUG::2014-04-10 18:29:37,260::task::579::TaskManager.Task::(_updateState) Task=`dbc66edd-1ed9-44d7-8623-86729204024f`::moving from state preparing -> state finished
>Thread-4753::DEBUG::2014-04-10 18:29:37,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4753::DEBUG::2014-04-10 18:29:37,260::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4753::DEBUG::2014-04-10 18:29:37,261::task::974::TaskManager.Task::(_decref) Task=`dbc66edd-1ed9-44d7-8623-86729204024f`::ref 0 aborting False
>Thread-4755::DEBUG::2014-04-10 18:29:39,027::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4755::DEBUG::2014-04-10 18:29:39,027::task::579::TaskManager.Task::(_updateState) Task=`847b5197-b290-4f7a-b0c8-f63a5572f0a4`::moving from state init -> state preparing
>Thread-4755::INFO::2014-04-10 18:29:39,028::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4755::INFO::2014-04-10 18:29:39,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4755::DEBUG::2014-04-10 18:29:39,028::task::1168::TaskManager.Task::(prepare) Task=`847b5197-b290-4f7a-b0c8-f63a5572f0a4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4755::DEBUG::2014-04-10 18:29:39,028::task::579::TaskManager.Task::(_updateState) Task=`847b5197-b290-4f7a-b0c8-f63a5572f0a4`::moving from state preparing -> state finished
>Thread-4755::DEBUG::2014-04-10 18:29:39,028::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4755::DEBUG::2014-04-10 18:29:39,028::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4755::DEBUG::2014-04-10 18:29:39,029::task::974::TaskManager.Task::(_decref) Task=`847b5197-b290-4f7a-b0c8-f63a5572f0a4`::ref 0 aborting False
>Thread-4756::DEBUG::2014-04-10 18:29:39,035::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4756::DEBUG::2014-04-10 18:29:39,035::task::579::TaskManager.Task::(_updateState) Task=`da149921-c392-48ce-995e-801dc4628a6f`::moving from state init -> state preparing
>Thread-4756::INFO::2014-04-10 18:29:39,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4756::DEBUG::2014-04-10 18:29:39,036::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc3a66e5-4534-41d1-b585-be07f7194ff5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4756::DEBUG::2014-04-10 18:29:39,036::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4756::DEBUG::2014-04-10 18:29:39,036::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4756::DEBUG::2014-04-10 18:29:39,037::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc3a66e5-4534-41d1-b585-be07f7194ff5`::Granted request
>Thread-4756::DEBUG::2014-04-10 18:29:39,037::task::811::TaskManager.Task::(resourceAcquired) Task=`da149921-c392-48ce-995e-801dc4628a6f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4756::DEBUG::2014-04-10 18:29:39,037::task::974::TaskManager.Task::(_decref) Task=`da149921-c392-48ce-995e-801dc4628a6f`::ref 1 aborting False
>Thread-4756::INFO::2014-04-10 18:29:39,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4756::DEBUG::2014-04-10 18:29:39,039::task::1168::TaskManager.Task::(prepare) Task=`da149921-c392-48ce-995e-801dc4628a6f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4756::DEBUG::2014-04-10 18:29:39,039::task::579::TaskManager.Task::(_updateState) Task=`da149921-c392-48ce-995e-801dc4628a6f`::moving from state preparing -> state finished
>Thread-4756::DEBUG::2014-04-10 18:29:39,039::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4756::DEBUG::2014-04-10 18:29:39,040::task::974::TaskManager.Task::(_decref) Task=`da149921-c392-48ce-995e-801dc4628a6f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:40,750::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:40,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000487761 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:40,938::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:40,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000459378 s, 801 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:41,132::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:41,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000446804 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:41,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:41,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397157 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4760::DEBUG::2014-04-10 18:29:49,226::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4760::DEBUG::2014-04-10 18:29:49,227::task::579::TaskManager.Task::(_updateState) Task=`e62262c3-841c-44da-950f-76b0e79e8287`::moving from state init -> state preparing
>Thread-4760::INFO::2014-04-10 18:29:49,227::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4760::INFO::2014-04-10 18:29:49,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4760::DEBUG::2014-04-10 18:29:49,228::task::1168::TaskManager.Task::(prepare) Task=`e62262c3-841c-44da-950f-76b0e79e8287`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4760::DEBUG::2014-04-10 18:29:49,228::task::579::TaskManager.Task::(_updateState) Task=`e62262c3-841c-44da-950f-76b0e79e8287`::moving from state preparing -> state finished
>Thread-4760::DEBUG::2014-04-10 18:29:49,228::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4760::DEBUG::2014-04-10 18:29:49,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4760::DEBUG::2014-04-10 18:29:49,228::task::974::TaskManager.Task::(_decref) Task=`e62262c3-841c-44da-950f-76b0e79e8287`::ref 0 aborting False
>Thread-4761::DEBUG::2014-04-10 18:29:49,235::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4761::DEBUG::2014-04-10 18:29:49,235::task::579::TaskManager.Task::(_updateState) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::moving from state init -> state preparing
>Thread-4761::INFO::2014-04-10 18:29:49,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4761::DEBUG::2014-04-10 18:29:49,236::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32998783-4aab-4a43-9a2f-7cde2d6beea6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4761::DEBUG::2014-04-10 18:29:49,236::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4761::DEBUG::2014-04-10 18:29:49,236::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4761::DEBUG::2014-04-10 18:29:49,236::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32998783-4aab-4a43-9a2f-7cde2d6beea6`::Granted request
>Thread-4761::DEBUG::2014-04-10 18:29:49,237::task::811::TaskManager.Task::(resourceAcquired) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4761::DEBUG::2014-04-10 18:29:49,237::task::974::TaskManager.Task::(_decref) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::ref 1 aborting False
>Thread-4761::INFO::2014-04-10 18:29:49,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4761::DEBUG::2014-04-10 18:29:49,239::task::1168::TaskManager.Task::(prepare) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4761::DEBUG::2014-04-10 18:29:49,239::task::579::TaskManager.Task::(_updateState) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::moving from state preparing -> state finished
>Thread-4761::DEBUG::2014-04-10 18:29:49,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4761::DEBUG::2014-04-10 18:29:49,239::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4761::DEBUG::2014-04-10 18:29:49,239::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4761::DEBUG::2014-04-10 18:29:49,240::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4761::DEBUG::2014-04-10 18:29:49,240::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4761::DEBUG::2014-04-10 18:29:49,240::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4761::DEBUG::2014-04-10 18:29:49,240::task::974::TaskManager.Task::(_decref) Task=`a48f5fb6-b104-438e-a475-b4079ec3ceb8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:29:50,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:29:50,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000465659 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:29:50,953::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:29:50,960::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000463476 s, 794 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:29:51,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:29:51,153::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000474376 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:29:51,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:29:51,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364793 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4763::DEBUG::2014-04-10 18:29:52,457::task::579::TaskManager.Task::(_updateState) Task=`b7665096-906b-4bb2-94a2-834fb6d2df65`::moving from state init -> state preparing
>Thread-4763::INFO::2014-04-10 18:29:52,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4763::INFO::2014-04-10 18:29:52,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474376', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465659', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364793', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463476', 'lastCheck': '1.5', 'valid': True}}
>Thread-4763::DEBUG::2014-04-10 18:29:52,458::task::1168::TaskManager.Task::(prepare) Task=`b7665096-906b-4bb2-94a2-834fb6d2df65`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474376', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465659', 'lastCheck': '1.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364793', 'lastCheck': '1.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463476', 'lastCheck': '1.5', 'valid': True}}
>Thread-4763::DEBUG::2014-04-10 18:29:52,458::task::579::TaskManager.Task::(_updateState) Task=`b7665096-906b-4bb2-94a2-834fb6d2df65`::moving from state preparing -> state finished
>Thread-4763::DEBUG::2014-04-10 18:29:52,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4763::DEBUG::2014-04-10 18:29:52,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4763::DEBUG::2014-04-10 18:29:52,459::task::974::TaskManager.Task::(_decref) Task=`b7665096-906b-4bb2-94a2-834fb6d2df65`::ref 0 aborting False
>Thread-4767::DEBUG::2014-04-10 18:29:59,324::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4767::DEBUG::2014-04-10 18:29:59,325::task::579::TaskManager.Task::(_updateState) Task=`894ebc90-c713-4bfe-a1c2-dc6474c0195f`::moving from state init -> state preparing
>Thread-4767::INFO::2014-04-10 18:29:59,325::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4767::INFO::2014-04-10 18:29:59,325::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4767::DEBUG::2014-04-10 18:29:59,325::task::1168::TaskManager.Task::(prepare) Task=`894ebc90-c713-4bfe-a1c2-dc6474c0195f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4767::DEBUG::2014-04-10 18:29:59,325::task::579::TaskManager.Task::(_updateState) Task=`894ebc90-c713-4bfe-a1c2-dc6474c0195f`::moving from state preparing -> state finished
>Thread-4767::DEBUG::2014-04-10 18:29:59,326::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4767::DEBUG::2014-04-10 18:29:59,326::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4767::DEBUG::2014-04-10 18:29:59,326::task::974::TaskManager.Task::(_decref) Task=`894ebc90-c713-4bfe-a1c2-dc6474c0195f`::ref 0 aborting False
>Thread-4768::DEBUG::2014-04-10 18:29:59,333::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4768::DEBUG::2014-04-10 18:29:59,333::task::579::TaskManager.Task::(_updateState) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::moving from state init -> state preparing
>Thread-4768::INFO::2014-04-10 18:29:59,334::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4768::DEBUG::2014-04-10 18:29:59,334::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb5e7112-f5ab-4fe3-9f5a-74f72ac56038`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4768::DEBUG::2014-04-10 18:29:59,334::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4768::DEBUG::2014-04-10 18:29:59,334::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4768::DEBUG::2014-04-10 18:29:59,335::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb5e7112-f5ab-4fe3-9f5a-74f72ac56038`::Granted request
>Thread-4768::DEBUG::2014-04-10 18:29:59,335::task::811::TaskManager.Task::(resourceAcquired) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4768::DEBUG::2014-04-10 18:29:59,335::task::974::TaskManager.Task::(_decref) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::ref 1 aborting False
>Thread-4768::INFO::2014-04-10 18:29:59,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4768::DEBUG::2014-04-10 18:29:59,337::task::1168::TaskManager.Task::(prepare) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4768::DEBUG::2014-04-10 18:29:59,337::task::579::TaskManager.Task::(_updateState) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::moving from state preparing -> state finished
>Thread-4768::DEBUG::2014-04-10 18:29:59,337::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4768::DEBUG::2014-04-10 18:29:59,338::task::974::TaskManager.Task::(_decref) Task=`bf6b51c5-7b38-4159-8154-f8a879c33f6e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:00,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:00,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373043 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:00,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:00,976::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487159 s, 755 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:01,163::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:01,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000493867 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:01,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:01,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368421 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4771::DEBUG::2014-04-10 18:30:08,085::task::579::TaskManager.Task::(_updateState) Task=`96478bcf-e3d9-4ea7-ad41-5f7413272f4f`::moving from state init -> state preparing
>Thread-4771::INFO::2014-04-10 18:30:08,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4771::INFO::2014-04-10 18:30:08,086::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493867', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373043', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368421', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487159', 'lastCheck': '7.1', 'valid': True}}
>Thread-4771::DEBUG::2014-04-10 18:30:08,086::task::1168::TaskManager.Task::(prepare) Task=`96478bcf-e3d9-4ea7-ad41-5f7413272f4f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493867', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373043', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368421', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487159', 'lastCheck': '7.1', 'valid': True}}
>Thread-4771::DEBUG::2014-04-10 18:30:08,086::task::579::TaskManager.Task::(_updateState) Task=`96478bcf-e3d9-4ea7-ad41-5f7413272f4f`::moving from state preparing -> state finished
>Thread-4771::DEBUG::2014-04-10 18:30:08,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4771::DEBUG::2014-04-10 18:30:08,087::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4771::DEBUG::2014-04-10 18:30:08,087::task::974::TaskManager.Task::(_decref) Task=`96478bcf-e3d9-4ea7-ad41-5f7413272f4f`::ref 0 aborting False
>Thread-4773::DEBUG::2014-04-10 18:30:09,416::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4773::DEBUG::2014-04-10 18:30:09,416::task::579::TaskManager.Task::(_updateState) Task=`d233ba7b-84d8-42d0-a0db-0957bdc125e8`::moving from state init -> state preparing
>Thread-4773::INFO::2014-04-10 18:30:09,416::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4773::INFO::2014-04-10 18:30:09,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4773::DEBUG::2014-04-10 18:30:09,417::task::1168::TaskManager.Task::(prepare) Task=`d233ba7b-84d8-42d0-a0db-0957bdc125e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4773::DEBUG::2014-04-10 18:30:09,417::task::579::TaskManager.Task::(_updateState) Task=`d233ba7b-84d8-42d0-a0db-0957bdc125e8`::moving from state preparing -> state finished
>Thread-4773::DEBUG::2014-04-10 18:30:09,417::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4773::DEBUG::2014-04-10 18:30:09,417::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4773::DEBUG::2014-04-10 18:30:09,417::task::974::TaskManager.Task::(_decref) Task=`d233ba7b-84d8-42d0-a0db-0957bdc125e8`::ref 0 aborting False
>Thread-4774::DEBUG::2014-04-10 18:30:09,423::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4774::DEBUG::2014-04-10 18:30:09,424::task::579::TaskManager.Task::(_updateState) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::moving from state init -> state preparing
>Thread-4774::INFO::2014-04-10 18:30:09,424::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4774::DEBUG::2014-04-10 18:30:09,424::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8700e779-a73d-472a-b95f-ea103a7f8aa1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4774::DEBUG::2014-04-10 18:30:09,424::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4774::DEBUG::2014-04-10 18:30:09,425::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4774::DEBUG::2014-04-10 18:30:09,425::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8700e779-a73d-472a-b95f-ea103a7f8aa1`::Granted request
>Thread-4774::DEBUG::2014-04-10 18:30:09,425::task::811::TaskManager.Task::(resourceAcquired) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4774::DEBUG::2014-04-10 18:30:09,425::task::974::TaskManager.Task::(_decref) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::ref 1 aborting False
>Thread-4774::INFO::2014-04-10 18:30:09,427::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4774::DEBUG::2014-04-10 18:30:09,427::task::1168::TaskManager.Task::(prepare) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4774::DEBUG::2014-04-10 18:30:09,427::task::579::TaskManager.Task::(_updateState) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::moving from state preparing -> state finished
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4774::DEBUG::2014-04-10 18:30:09,428::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4774::DEBUG::2014-04-10 18:30:09,429::task::974::TaskManager.Task::(_decref) Task=`3d957861-ef69-40b8-9cb9-a54611504435`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:10,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:10,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377436 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:10,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:10,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00040432 s, 910 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:11,178::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:11,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000391827 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:11,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:11,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00211341 s, 317 kB/s\n'; <rc> = 0
>Thread-4778::DEBUG::2014-04-10 18:30:19,506::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-4778::DEBUG::2014-04-10 18:30:19,507::task::579::TaskManager.Task::(_updateState) Task=`0a0e1f92-9f49-4542-aee1-1abe3f9c66fe`::moving from state init -> state preparing
>Thread-4778::INFO::2014-04-10 18:30:19,507::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4778::INFO::2014-04-10 18:30:19,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4778::DEBUG::2014-04-10 18:30:19,508::task::1168::TaskManager.Task::(prepare) Task=`0a0e1f92-9f49-4542-aee1-1abe3f9c66fe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4778::DEBUG::2014-04-10 18:30:19,508::task::579::TaskManager.Task::(_updateState) Task=`0a0e1f92-9f49-4542-aee1-1abe3f9c66fe`::moving from state preparing -> state finished
>Thread-4778::DEBUG::2014-04-10 18:30:19,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4778::DEBUG::2014-04-10 18:30:19,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4778::DEBUG::2014-04-10 18:30:19,508::task::974::TaskManager.Task::(_decref) Task=`0a0e1f92-9f49-4542-aee1-1abe3f9c66fe`::ref 0 aborting False
>Thread-4779::DEBUG::2014-04-10 18:30:19,515::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [6079cede]
>Thread-4779::DEBUG::2014-04-10 18:30:19,515::task::579::TaskManager.Task::(_updateState) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::moving from state init -> state preparing
>Thread-4779::INFO::2014-04-10 18:30:19,515::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4779::DEBUG::2014-04-10 18:30:19,515::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2cdbceda-79d7-48b2-a395-09a8396bec59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4779::DEBUG::2014-04-10 18:30:19,516::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4779::DEBUG::2014-04-10 18:30:19,516::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4779::DEBUG::2014-04-10 18:30:19,516::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2cdbceda-79d7-48b2-a395-09a8396bec59`::Granted request
>Thread-4779::DEBUG::2014-04-10 18:30:19,516::task::811::TaskManager.Task::(resourceAcquired) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4779::DEBUG::2014-04-10 18:30:19,516::task::974::TaskManager.Task::(_decref) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::ref 1 aborting False
>Thread-4779::INFO::2014-04-10 18:30:19,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4779::DEBUG::2014-04-10 18:30:19,518::task::1168::TaskManager.Task::(prepare) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::task::579::TaskManager.Task::(_updateState) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::moving from state preparing -> state finished
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4779::DEBUG::2014-04-10 18:30:19,519::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4779::DEBUG::2014-04-10 18:30:19,520::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4779::DEBUG::2014-04-10 18:30:19,520::task::974::TaskManager.Task::(_decref) Task=`715aa465-ac99-48a3-8287-f60147d8422e`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:20,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:20,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363297 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:21,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:21,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000535664 s, 687 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:21,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:21,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000476998 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:21,225::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:21,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354756 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4781::DEBUG::2014-04-10 18:30:23,426::task::579::TaskManager.Task::(_updateState) Task=`8db9478d-e31f-425f-8a4a-30301f4ba912`::moving from state init -> state preparing
>Thread-4781::INFO::2014-04-10 18:30:23,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4781::INFO::2014-04-10 18:30:23,427::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476998', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363297', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354756', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535664', 'lastCheck': '2.4', 'valid': True}}
>Thread-4781::DEBUG::2014-04-10 18:30:23,427::task::1168::TaskManager.Task::(prepare) Task=`8db9478d-e31f-425f-8a4a-30301f4ba912`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476998', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363297', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354756', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535664', 'lastCheck': '2.4', 'valid': True}}
>Thread-4781::DEBUG::2014-04-10 18:30:23,427::task::579::TaskManager.Task::(_updateState) Task=`8db9478d-e31f-425f-8a4a-30301f4ba912`::moving from state preparing -> state finished
>Thread-4781::DEBUG::2014-04-10 18:30:23,427::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4781::DEBUG::2014-04-10 18:30:23,428::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4781::DEBUG::2014-04-10 18:30:23,428::task::974::TaskManager.Task::(_decref) Task=`8db9478d-e31f-425f-8a4a-30301f4ba912`::ref 0 aborting False
>Thread-4785::DEBUG::2014-04-10 18:30:29,637::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4785::DEBUG::2014-04-10 18:30:29,638::task::579::TaskManager.Task::(_updateState) Task=`ea3c3886-5235-4dd8-859b-266207334ab1`::moving from state init -> state preparing
>Thread-4785::INFO::2014-04-10 18:30:29,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4785::INFO::2014-04-10 18:30:29,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4785::DEBUG::2014-04-10 18:30:29,639::task::1168::TaskManager.Task::(prepare) Task=`ea3c3886-5235-4dd8-859b-266207334ab1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4785::DEBUG::2014-04-10 18:30:29,639::task::579::TaskManager.Task::(_updateState) Task=`ea3c3886-5235-4dd8-859b-266207334ab1`::moving from state preparing -> state finished
>Thread-4785::DEBUG::2014-04-10 18:30:29,639::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4785::DEBUG::2014-04-10 18:30:29,639::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4785::DEBUG::2014-04-10 18:30:29,639::task::974::TaskManager.Task::(_decref) Task=`ea3c3886-5235-4dd8-859b-266207334ab1`::ref 0 aborting False
>Thread-4786::DEBUG::2014-04-10 18:30:29,648::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4786::DEBUG::2014-04-10 18:30:29,648::task::579::TaskManager.Task::(_updateState) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::moving from state init -> state preparing
>Thread-4786::INFO::2014-04-10 18:30:29,649::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4786::DEBUG::2014-04-10 18:30:29,649::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`492cd046-fbd7-4afe-b434-3945389e13a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4786::DEBUG::2014-04-10 18:30:29,649::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4786::DEBUG::2014-04-10 18:30:29,650::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4786::DEBUG::2014-04-10 18:30:29,650::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`492cd046-fbd7-4afe-b434-3945389e13a9`::Granted request
>Thread-4786::DEBUG::2014-04-10 18:30:29,650::task::811::TaskManager.Task::(resourceAcquired) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4786::DEBUG::2014-04-10 18:30:29,650::task::974::TaskManager.Task::(_decref) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::ref 1 aborting False
>Thread-4786::INFO::2014-04-10 18:30:29,653::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4786::DEBUG::2014-04-10 18:30:29,653::task::1168::TaskManager.Task::(prepare) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4786::DEBUG::2014-04-10 18:30:29,653::task::579::TaskManager.Task::(_updateState) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::moving from state preparing -> state finished
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4786::DEBUG::2014-04-10 18:30:29,654::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4786::DEBUG::2014-04-10 18:30:29,655::task::974::TaskManager.Task::(_decref) Task=`c2228d7a-ef2c-4276-81a7-05755090bd0f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:30,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:30,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375489 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:31,016::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:31,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000423472 s, 869 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:31,209::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:31,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000445821 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:31,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:31,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000384919 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4789::DEBUG::2014-04-10 18:30:38,664::task::579::TaskManager.Task::(_updateState) Task=`6e7f0031-1d15-4294-b52b-4e0c76a2e642`::moving from state init -> state preparing
>Thread-4789::INFO::2014-04-10 18:30:38,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4789::INFO::2014-04-10 18:30:38,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445821', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375489', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384919', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423472', 'lastCheck': '7.6', 'valid': True}}
>Thread-4789::DEBUG::2014-04-10 18:30:38,665::task::1168::TaskManager.Task::(prepare) Task=`6e7f0031-1d15-4294-b52b-4e0c76a2e642`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445821', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375489', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384919', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423472', 'lastCheck': '7.6', 'valid': True}}
>Thread-4789::DEBUG::2014-04-10 18:30:38,665::task::579::TaskManager.Task::(_updateState) Task=`6e7f0031-1d15-4294-b52b-4e0c76a2e642`::moving from state preparing -> state finished
>Thread-4789::DEBUG::2014-04-10 18:30:38,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4789::DEBUG::2014-04-10 18:30:38,666::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4789::DEBUG::2014-04-10 18:30:38,666::task::974::TaskManager.Task::(_decref) Task=`6e7f0031-1d15-4294-b52b-4e0c76a2e642`::ref 0 aborting False
>Thread-4791::DEBUG::2014-04-10 18:30:40,004::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-4791::DEBUG::2014-04-10 18:30:40,005::task::579::TaskManager.Task::(_updateState) Task=`fb96770e-e9d5-482e-859f-e4a9a4ae4011`::moving from state init -> state preparing
>Thread-4791::INFO::2014-04-10 18:30:40,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4791::INFO::2014-04-10 18:30:40,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4791::DEBUG::2014-04-10 18:30:40,005::task::1168::TaskManager.Task::(prepare) Task=`fb96770e-e9d5-482e-859f-e4a9a4ae4011`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4791::DEBUG::2014-04-10 18:30:40,006::task::579::TaskManager.Task::(_updateState) Task=`fb96770e-e9d5-482e-859f-e4a9a4ae4011`::moving from state preparing -> state finished
>Thread-4791::DEBUG::2014-04-10 18:30:40,006::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4791::DEBUG::2014-04-10 18:30:40,006::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4791::DEBUG::2014-04-10 18:30:40,006::task::974::TaskManager.Task::(_decref) Task=`fb96770e-e9d5-482e-859f-e4a9a4ae4011`::ref 0 aborting False
>Thread-4792::DEBUG::2014-04-10 18:30:40,013::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1b3ce876]
>Thread-4792::DEBUG::2014-04-10 18:30:40,013::task::579::TaskManager.Task::(_updateState) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::moving from state init -> state preparing
>Thread-4792::INFO::2014-04-10 18:30:40,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4792::DEBUG::2014-04-10 18:30:40,014::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d1f12647-60a5-430a-b446-8f39d22b45b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4792::DEBUG::2014-04-10 18:30:40,014::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4792::DEBUG::2014-04-10 18:30:40,014::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4792::DEBUG::2014-04-10 18:30:40,015::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d1f12647-60a5-430a-b446-8f39d22b45b8`::Granted request
>Thread-4792::DEBUG::2014-04-10 18:30:40,015::task::811::TaskManager.Task::(resourceAcquired) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4792::DEBUG::2014-04-10 18:30:40,015::task::974::TaskManager.Task::(_decref) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::ref 1 aborting False
>Thread-4792::INFO::2014-04-10 18:30:40,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4792::DEBUG::2014-04-10 18:30:40,018::task::1168::TaskManager.Task::(prepare) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4792::DEBUG::2014-04-10 18:30:40,018::task::579::TaskManager.Task::(_updateState) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::moving from state preparing -> state finished
>Thread-4792::DEBUG::2014-04-10 18:30:40,018::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4792::DEBUG::2014-04-10 18:30:40,018::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4792::DEBUG::2014-04-10 18:30:40,018::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4792::DEBUG::2014-04-10 18:30:40,019::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4792::DEBUG::2014-04-10 18:30:40,019::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4792::DEBUG::2014-04-10 18:30:40,019::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4792::DEBUG::2014-04-10 18:30:40,019::task::974::TaskManager.Task::(_decref) Task=`a21b285a-f9aa-4029-8c42-4b8df7efe9b0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:40,831::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:30:40,838::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:30:40,839::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:30:40,843::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:30:40,846::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:30:40,846::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:30:40,846::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:30:40,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:40,857::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379015 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:41,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:41,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00039807 s, 924 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:41,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:41,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000487156 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:41,249::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:30:41,264::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:30:41,265::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:30:41,270::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:30:41,271::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:30:41,271::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:30:41,272::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:30:41,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:41,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036549 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4804::DEBUG::2014-04-10 18:30:50,393::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4804::DEBUG::2014-04-10 18:30:50,394::task::579::TaskManager.Task::(_updateState) Task=`64dc98eb-18cd-4627-87d6-5d96f877a05b`::moving from state init -> state preparing
>Thread-4804::INFO::2014-04-10 18:30:50,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4804::INFO::2014-04-10 18:30:50,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4804::DEBUG::2014-04-10 18:30:50,394::task::1168::TaskManager.Task::(prepare) Task=`64dc98eb-18cd-4627-87d6-5d96f877a05b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4804::DEBUG::2014-04-10 18:30:50,395::task::579::TaskManager.Task::(_updateState) Task=`64dc98eb-18cd-4627-87d6-5d96f877a05b`::moving from state preparing -> state finished
>Thread-4804::DEBUG::2014-04-10 18:30:50,395::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4804::DEBUG::2014-04-10 18:30:50,395::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4804::DEBUG::2014-04-10 18:30:50,395::task::974::TaskManager.Task::(_decref) Task=`64dc98eb-18cd-4627-87d6-5d96f877a05b`::ref 0 aborting False
>Thread-4805::DEBUG::2014-04-10 18:30:50,402::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4805::DEBUG::2014-04-10 18:30:50,402::task::579::TaskManager.Task::(_updateState) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::moving from state init -> state preparing
>Thread-4805::INFO::2014-04-10 18:30:50,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4805::DEBUG::2014-04-10 18:30:50,403::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e7d58ea8-9d17-4c72-a97e-58ca6c3a684b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4805::DEBUG::2014-04-10 18:30:50,403::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4805::DEBUG::2014-04-10 18:30:50,403::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4805::DEBUG::2014-04-10 18:30:50,404::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e7d58ea8-9d17-4c72-a97e-58ca6c3a684b`::Granted request
>Thread-4805::DEBUG::2014-04-10 18:30:50,404::task::811::TaskManager.Task::(resourceAcquired) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4805::DEBUG::2014-04-10 18:30:50,404::task::974::TaskManager.Task::(_decref) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::ref 1 aborting False
>Thread-4805::INFO::2014-04-10 18:30:50,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4805::DEBUG::2014-04-10 18:30:50,407::task::1168::TaskManager.Task::(prepare) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4805::DEBUG::2014-04-10 18:30:50,407::task::579::TaskManager.Task::(_updateState) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::moving from state preparing -> state finished
>Thread-4805::DEBUG::2014-04-10 18:30:50,407::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4805::DEBUG::2014-04-10 18:30:50,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4805::DEBUG::2014-04-10 18:30:50,408::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4805::DEBUG::2014-04-10 18:30:50,408::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4805::DEBUG::2014-04-10 18:30:50,408::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4805::DEBUG::2014-04-10 18:30:50,408::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4805::DEBUG::2014-04-10 18:30:50,408::task::974::TaskManager.Task::(_decref) Task=`ff63f8cd-cf18-4fa5-9c21-1a1ba34bd21f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:30:50,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:30:50,871::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000403548 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:30:51,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:30:51,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477097 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:30:51,240::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:30:51,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464414 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:30:51,293::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:30:51,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355082 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4807::DEBUG::2014-04-10 18:30:54,013::task::579::TaskManager.Task::(_updateState) Task=`7ae4904d-6cef-4bc6-b5de-c8f318c27961`::moving from state init -> state preparing
>Thread-4807::INFO::2014-04-10 18:30:54,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4807::INFO::2014-04-10 18:30:54,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464414', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403548', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355082', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477097', 'lastCheck': '3.0', 'valid': True}}
>Thread-4807::DEBUG::2014-04-10 18:30:54,014::task::1168::TaskManager.Task::(prepare) Task=`7ae4904d-6cef-4bc6-b5de-c8f318c27961`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464414', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403548', 'lastCheck': '3.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355082', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477097', 'lastCheck': '3.0', 'valid': True}}
>Thread-4807::DEBUG::2014-04-10 18:30:54,014::task::579::TaskManager.Task::(_updateState) Task=`7ae4904d-6cef-4bc6-b5de-c8f318c27961`::moving from state preparing -> state finished
>Thread-4807::DEBUG::2014-04-10 18:30:54,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4807::DEBUG::2014-04-10 18:30:54,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4807::DEBUG::2014-04-10 18:30:54,014::task::974::TaskManager.Task::(_decref) Task=`7ae4904d-6cef-4bc6-b5de-c8f318c27961`::ref 0 aborting False
>Thread-4811::DEBUG::2014-04-10 18:31:00,757::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4811::DEBUG::2014-04-10 18:31:00,757::task::579::TaskManager.Task::(_updateState) Task=`8fe3a335-94b8-4bb1-b25a-03fc6a087f45`::moving from state init -> state preparing
>Thread-4811::INFO::2014-04-10 18:31:00,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4811::INFO::2014-04-10 18:31:00,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4811::DEBUG::2014-04-10 18:31:00,758::task::1168::TaskManager.Task::(prepare) Task=`8fe3a335-94b8-4bb1-b25a-03fc6a087f45`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4811::DEBUG::2014-04-10 18:31:00,758::task::579::TaskManager.Task::(_updateState) Task=`8fe3a335-94b8-4bb1-b25a-03fc6a087f45`::moving from state preparing -> state finished
>Thread-4811::DEBUG::2014-04-10 18:31:00,759::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4811::DEBUG::2014-04-10 18:31:00,759::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4811::DEBUG::2014-04-10 18:31:00,759::task::974::TaskManager.Task::(_decref) Task=`8fe3a335-94b8-4bb1-b25a-03fc6a087f45`::ref 0 aborting False
>Thread-4812::DEBUG::2014-04-10 18:31:00,766::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4812::DEBUG::2014-04-10 18:31:00,766::task::579::TaskManager.Task::(_updateState) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::moving from state init -> state preparing
>Thread-4812::INFO::2014-04-10 18:31:00,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4812::DEBUG::2014-04-10 18:31:00,767::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ccf49c31-4e72-43a5-98a1-ee3881b0c9f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4812::DEBUG::2014-04-10 18:31:00,767::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4812::DEBUG::2014-04-10 18:31:00,767::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4812::DEBUG::2014-04-10 18:31:00,767::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ccf49c31-4e72-43a5-98a1-ee3881b0c9f0`::Granted request
>Thread-4812::DEBUG::2014-04-10 18:31:00,768::task::811::TaskManager.Task::(resourceAcquired) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4812::DEBUG::2014-04-10 18:31:00,768::task::974::TaskManager.Task::(_decref) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::ref 1 aborting False
>Thread-4812::INFO::2014-04-10 18:31:00,770::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4812::DEBUG::2014-04-10 18:31:00,770::task::1168::TaskManager.Task::(prepare) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4812::DEBUG::2014-04-10 18:31:00,770::task::579::TaskManager.Task::(_updateState) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::moving from state preparing -> state finished
>Thread-4812::DEBUG::2014-04-10 18:31:00,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4812::DEBUG::2014-04-10 18:31:00,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4812::DEBUG::2014-04-10 18:31:00,771::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4812::DEBUG::2014-04-10 18:31:00,771::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4812::DEBUG::2014-04-10 18:31:00,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4812::DEBUG::2014-04-10 18:31:00,772::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4812::DEBUG::2014-04-10 18:31:00,772::task::974::TaskManager.Task::(_decref) Task=`2a3ae150-9ec7-4381-97bc-204c2635d443`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:00,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:00,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350873 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:01,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:01,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000412165 s, 893 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:01,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:01,260::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000365934 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:01,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:01,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344481 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4815::DEBUG::2014-04-10 18:31:09,223::task::579::TaskManager.Task::(_updateState) Task=`f62934ed-63ad-429a-9339-7495e0f398f3`::moving from state init -> state preparing
>Thread-4815::INFO::2014-04-10 18:31:09,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4815::INFO::2014-04-10 18:31:09,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365934', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350873', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344481', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412165', 'lastCheck': '8.2', 'valid': True}}
>Thread-4815::DEBUG::2014-04-10 18:31:09,224::task::1168::TaskManager.Task::(prepare) Task=`f62934ed-63ad-429a-9339-7495e0f398f3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365934', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350873', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344481', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412165', 'lastCheck': '8.2', 'valid': True}}
>Thread-4815::DEBUG::2014-04-10 18:31:09,224::task::579::TaskManager.Task::(_updateState) Task=`f62934ed-63ad-429a-9339-7495e0f398f3`::moving from state preparing -> state finished
>Thread-4815::DEBUG::2014-04-10 18:31:09,224::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4815::DEBUG::2014-04-10 18:31:09,224::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4815::DEBUG::2014-04-10 18:31:09,224::task::974::TaskManager.Task::(_decref) Task=`f62934ed-63ad-429a-9339-7495e0f398f3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:10,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:10,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034599 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:11,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:11,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000427885 s, 860 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:11,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:11,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000430549 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:11,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:11,330::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370048 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4817::DEBUG::2014-04-10 18:31:11,521::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4817::DEBUG::2014-04-10 18:31:11,521::task::579::TaskManager.Task::(_updateState) Task=`14ac9c07-bec9-4635-8d06-00d567887ad0`::moving from state init -> state preparing
>Thread-4817::INFO::2014-04-10 18:31:11,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4817::INFO::2014-04-10 18:31:11,522::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4817::DEBUG::2014-04-10 18:31:11,522::task::1168::TaskManager.Task::(prepare) Task=`14ac9c07-bec9-4635-8d06-00d567887ad0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4817::DEBUG::2014-04-10 18:31:11,522::task::579::TaskManager.Task::(_updateState) Task=`14ac9c07-bec9-4635-8d06-00d567887ad0`::moving from state preparing -> state finished
>Thread-4817::DEBUG::2014-04-10 18:31:11,522::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4817::DEBUG::2014-04-10 18:31:11,522::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4817::DEBUG::2014-04-10 18:31:11,523::task::974::TaskManager.Task::(_decref) Task=`14ac9c07-bec9-4635-8d06-00d567887ad0`::ref 0 aborting False
>Thread-4818::DEBUG::2014-04-10 18:31:11,529::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4818::DEBUG::2014-04-10 18:31:11,529::task::579::TaskManager.Task::(_updateState) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::moving from state init -> state preparing
>Thread-4818::INFO::2014-04-10 18:31:11,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4818::DEBUG::2014-04-10 18:31:11,530::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a15e67e8-7814-4f7e-9a0c-96d1b4d618b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4818::DEBUG::2014-04-10 18:31:11,530::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4818::DEBUG::2014-04-10 18:31:11,531::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4818::DEBUG::2014-04-10 18:31:11,531::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a15e67e8-7814-4f7e-9a0c-96d1b4d618b1`::Granted request
>Thread-4818::DEBUG::2014-04-10 18:31:11,531::task::811::TaskManager.Task::(resourceAcquired) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4818::DEBUG::2014-04-10 18:31:11,531::task::974::TaskManager.Task::(_decref) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::ref 1 aborting False
>Thread-4818::INFO::2014-04-10 18:31:11,533::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4818::DEBUG::2014-04-10 18:31:11,534::task::1168::TaskManager.Task::(prepare) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4818::DEBUG::2014-04-10 18:31:11,534::task::579::TaskManager.Task::(_updateState) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::moving from state preparing -> state finished
>Thread-4818::DEBUG::2014-04-10 18:31:11,534::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4818::DEBUG::2014-04-10 18:31:11,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4818::DEBUG::2014-04-10 18:31:11,534::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4818::DEBUG::2014-04-10 18:31:11,535::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4818::DEBUG::2014-04-10 18:31:11,535::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4818::DEBUG::2014-04-10 18:31:11,535::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4818::DEBUG::2014-04-10 18:31:11,535::task::974::TaskManager.Task::(_decref) Task=`306b9902-b1df-4a13-ad69-c221b22df0ee`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:20,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:20,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000375903 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:21,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:21,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000377416 s, 975 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:21,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:21,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000426378 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:21,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:21,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000458699 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4823::DEBUG::2014-04-10 18:31:21,871::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4823::DEBUG::2014-04-10 18:31:21,872::task::579::TaskManager.Task::(_updateState) Task=`b668e4e4-fafe-4182-815d-b79bb595c1c0`::moving from state init -> state preparing
>Thread-4823::INFO::2014-04-10 18:31:21,872::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4823::INFO::2014-04-10 18:31:21,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4823::DEBUG::2014-04-10 18:31:21,873::task::1168::TaskManager.Task::(prepare) Task=`b668e4e4-fafe-4182-815d-b79bb595c1c0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4823::DEBUG::2014-04-10 18:31:21,873::task::579::TaskManager.Task::(_updateState) Task=`b668e4e4-fafe-4182-815d-b79bb595c1c0`::moving from state preparing -> state finished
>Thread-4823::DEBUG::2014-04-10 18:31:21,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4823::DEBUG::2014-04-10 18:31:21,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4823::DEBUG::2014-04-10 18:31:21,873::task::974::TaskManager.Task::(_decref) Task=`b668e4e4-fafe-4182-815d-b79bb595c1c0`::ref 0 aborting False
>Thread-4824::DEBUG::2014-04-10 18:31:21,879::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4824::DEBUG::2014-04-10 18:31:21,879::task::579::TaskManager.Task::(_updateState) Task=`4311947c-23c7-4540-b24a-ae460837a835`::moving from state init -> state preparing
>Thread-4824::INFO::2014-04-10 18:31:21,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4824::DEBUG::2014-04-10 18:31:21,880::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b33c7a65-189d-4968-9a87-1fb65d38bb7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4824::DEBUG::2014-04-10 18:31:21,880::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4824::DEBUG::2014-04-10 18:31:21,880::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4824::DEBUG::2014-04-10 18:31:21,880::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b33c7a65-189d-4968-9a87-1fb65d38bb7e`::Granted request
>Thread-4824::DEBUG::2014-04-10 18:31:21,881::task::811::TaskManager.Task::(resourceAcquired) Task=`4311947c-23c7-4540-b24a-ae460837a835`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4824::DEBUG::2014-04-10 18:31:21,881::task::974::TaskManager.Task::(_decref) Task=`4311947c-23c7-4540-b24a-ae460837a835`::ref 1 aborting False
>Thread-4824::INFO::2014-04-10 18:31:21,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4824::DEBUG::2014-04-10 18:31:21,883::task::1168::TaskManager.Task::(prepare) Task=`4311947c-23c7-4540-b24a-ae460837a835`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::task::579::TaskManager.Task::(_updateState) Task=`4311947c-23c7-4540-b24a-ae460837a835`::moving from state preparing -> state finished
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4824::DEBUG::2014-04-10 18:31:21,884::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4824::DEBUG::2014-04-10 18:31:21,885::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4824::DEBUG::2014-04-10 18:31:21,885::task::974::TaskManager.Task::(_decref) Task=`4311947c-23c7-4540-b24a-ae460837a835`::ref 0 aborting False
>Thread-4825::DEBUG::2014-04-10 18:31:24,558::task::579::TaskManager.Task::(_updateState) Task=`caf28b4a-0204-467f-ac08-9b8010274d38`::moving from state init -> state preparing
>Thread-4825::INFO::2014-04-10 18:31:24,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4825::INFO::2014-04-10 18:31:24,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426378', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375903', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458699', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377416', 'lastCheck': '3.5', 'valid': True}}
>Thread-4825::DEBUG::2014-04-10 18:31:24,559::task::1168::TaskManager.Task::(prepare) Task=`caf28b4a-0204-467f-ac08-9b8010274d38`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426378', 'lastCheck': '3.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375903', 'lastCheck': '3.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458699', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000377416', 'lastCheck': '3.5', 'valid': True}}
>Thread-4825::DEBUG::2014-04-10 18:31:24,559::task::579::TaskManager.Task::(_updateState) Task=`caf28b4a-0204-467f-ac08-9b8010274d38`::moving from state preparing -> state finished
>Thread-4825::DEBUG::2014-04-10 18:31:24,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4825::DEBUG::2014-04-10 18:31:24,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4825::DEBUG::2014-04-10 18:31:24,560::task::974::TaskManager.Task::(_decref) Task=`caf28b4a-0204-467f-ac08-9b8010274d38`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:30,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:30,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353379 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:31,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:31,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000412215 s, 893 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:31,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:31,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000472447 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:31,354::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:31,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386248 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4829::DEBUG::2014-04-10 18:31:31,976::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4829::DEBUG::2014-04-10 18:31:31,976::task::579::TaskManager.Task::(_updateState) Task=`9e3bd5f9-8382-4485-a19d-bec5d0e22164`::moving from state init -> state preparing
>Thread-4829::INFO::2014-04-10 18:31:31,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4829::INFO::2014-04-10 18:31:31,977::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4829::DEBUG::2014-04-10 18:31:31,977::task::1168::TaskManager.Task::(prepare) Task=`9e3bd5f9-8382-4485-a19d-bec5d0e22164`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4829::DEBUG::2014-04-10 18:31:31,977::task::579::TaskManager.Task::(_updateState) Task=`9e3bd5f9-8382-4485-a19d-bec5d0e22164`::moving from state preparing -> state finished
>Thread-4829::DEBUG::2014-04-10 18:31:31,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4829::DEBUG::2014-04-10 18:31:31,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4829::DEBUG::2014-04-10 18:31:31,977::task::974::TaskManager.Task::(_decref) Task=`9e3bd5f9-8382-4485-a19d-bec5d0e22164`::ref 0 aborting False
>Thread-4830::DEBUG::2014-04-10 18:31:31,983::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4830::DEBUG::2014-04-10 18:31:31,983::task::579::TaskManager.Task::(_updateState) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::moving from state init -> state preparing
>Thread-4830::INFO::2014-04-10 18:31:31,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4830::DEBUG::2014-04-10 18:31:31,984::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8723d54-3a3d-40a8-a017-dc35c7bc63b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4830::DEBUG::2014-04-10 18:31:31,984::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4830::DEBUG::2014-04-10 18:31:31,984::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4830::DEBUG::2014-04-10 18:31:31,985::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8723d54-3a3d-40a8-a017-dc35c7bc63b7`::Granted request
>Thread-4830::DEBUG::2014-04-10 18:31:31,985::task::811::TaskManager.Task::(resourceAcquired) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4830::DEBUG::2014-04-10 18:31:31,985::task::974::TaskManager.Task::(_decref) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::ref 1 aborting False
>Thread-4830::INFO::2014-04-10 18:31:31,987::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4830::DEBUG::2014-04-10 18:31:31,987::task::1168::TaskManager.Task::(prepare) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4830::DEBUG::2014-04-10 18:31:31,987::task::579::TaskManager.Task::(_updateState) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::moving from state preparing -> state finished
>Thread-4830::DEBUG::2014-04-10 18:31:31,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4830::DEBUG::2014-04-10 18:31:31,988::task::974::TaskManager.Task::(_decref) Task=`14bc20c0-91bc-4281-ab9a-0262bd8da9e6`::ref 0 aborting False
>Thread-4833::DEBUG::2014-04-10 18:31:39,724::task::579::TaskManager.Task::(_updateState) Task=`410a21a0-bba1-4fcb-b84b-97ac52811270`::moving from state init -> state preparing
>Thread-4833::INFO::2014-04-10 18:31:39,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4833::INFO::2014-04-10 18:31:39,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472447', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353379', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386248', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412215', 'lastCheck': '8.6', 'valid': True}}
>Thread-4833::DEBUG::2014-04-10 18:31:39,725::task::1168::TaskManager.Task::(prepare) Task=`410a21a0-bba1-4fcb-b84b-97ac52811270`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472447', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353379', 'lastCheck': '8.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386248', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412215', 'lastCheck': '8.6', 'valid': True}}
>Thread-4833::DEBUG::2014-04-10 18:31:39,725::task::579::TaskManager.Task::(_updateState) Task=`410a21a0-bba1-4fcb-b84b-97ac52811270`::moving from state preparing -> state finished
>Thread-4833::DEBUG::2014-04-10 18:31:39,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4833::DEBUG::2014-04-10 18:31:39,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4833::DEBUG::2014-04-10 18:31:39,726::task::974::TaskManager.Task::(_decref) Task=`410a21a0-bba1-4fcb-b84b-97ac52811270`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:40,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:40,946::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0014911 s, 450 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:41,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:41,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430613 s, 855 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:41,316::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:41,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00044806 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:41,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:41,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380588 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4835::DEBUG::2014-04-10 18:31:42,067::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4835::DEBUG::2014-04-10 18:31:42,067::task::579::TaskManager.Task::(_updateState) Task=`bd2922d0-f7b7-4415-9bf0-39faaa9c373c`::moving from state init -> state preparing
>Thread-4835::INFO::2014-04-10 18:31:42,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4835::INFO::2014-04-10 18:31:42,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4835::DEBUG::2014-04-10 18:31:42,068::task::1168::TaskManager.Task::(prepare) Task=`bd2922d0-f7b7-4415-9bf0-39faaa9c373c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4835::DEBUG::2014-04-10 18:31:42,068::task::579::TaskManager.Task::(_updateState) Task=`bd2922d0-f7b7-4415-9bf0-39faaa9c373c`::moving from state preparing -> state finished
>Thread-4835::DEBUG::2014-04-10 18:31:42,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4835::DEBUG::2014-04-10 18:31:42,069::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4835::DEBUG::2014-04-10 18:31:42,069::task::974::TaskManager.Task::(_decref) Task=`bd2922d0-f7b7-4415-9bf0-39faaa9c373c`::ref 0 aborting False
>Thread-4836::DEBUG::2014-04-10 18:31:42,074::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4836::DEBUG::2014-04-10 18:31:42,074::task::579::TaskManager.Task::(_updateState) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::moving from state init -> state preparing
>Thread-4836::INFO::2014-04-10 18:31:42,075::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4836::DEBUG::2014-04-10 18:31:42,075::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`636360f8-2c99-48f3-a0a7-20f4d64c3a03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4836::DEBUG::2014-04-10 18:31:42,075::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4836::DEBUG::2014-04-10 18:31:42,076::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4836::DEBUG::2014-04-10 18:31:42,076::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`636360f8-2c99-48f3-a0a7-20f4d64c3a03`::Granted request
>Thread-4836::DEBUG::2014-04-10 18:31:42,076::task::811::TaskManager.Task::(resourceAcquired) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4836::DEBUG::2014-04-10 18:31:42,076::task::974::TaskManager.Task::(_decref) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::ref 1 aborting False
>Thread-4836::INFO::2014-04-10 18:31:42,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4836::DEBUG::2014-04-10 18:31:42,079::task::1168::TaskManager.Task::(prepare) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4836::DEBUG::2014-04-10 18:31:42,079::task::579::TaskManager.Task::(_updateState) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::moving from state preparing -> state finished
>Thread-4836::DEBUG::2014-04-10 18:31:42,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4836::DEBUG::2014-04-10 18:31:42,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4836::DEBUG::2014-04-10 18:31:42,080::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4836::DEBUG::2014-04-10 18:31:42,080::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4836::DEBUG::2014-04-10 18:31:42,080::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4836::DEBUG::2014-04-10 18:31:42,080::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4836::DEBUG::2014-04-10 18:31:42,080::task::974::TaskManager.Task::(_decref) Task=`b730741a-2b06-40ff-ab62-fc6d28665b81`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:31:50,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:31:50,964::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366932 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:31:51,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:31:51,146::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000417142 s, 882 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:31:51,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:31:51,337::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000458742 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:31:51,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:31:51,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000391998 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4841::DEBUG::2014-04-10 18:31:52,175::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-4841::DEBUG::2014-04-10 18:31:52,176::task::579::TaskManager.Task::(_updateState) Task=`596c6db6-ae63-4fcf-9633-04da01d949d5`::moving from state init -> state preparing
>Thread-4841::INFO::2014-04-10 18:31:52,176::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4841::INFO::2014-04-10 18:31:52,176::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4841::DEBUG::2014-04-10 18:31:52,176::task::1168::TaskManager.Task::(prepare) Task=`596c6db6-ae63-4fcf-9633-04da01d949d5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4841::DEBUG::2014-04-10 18:31:52,177::task::579::TaskManager.Task::(_updateState) Task=`596c6db6-ae63-4fcf-9633-04da01d949d5`::moving from state preparing -> state finished
>Thread-4841::DEBUG::2014-04-10 18:31:52,177::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4841::DEBUG::2014-04-10 18:31:52,177::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4841::DEBUG::2014-04-10 18:31:52,177::task::974::TaskManager.Task::(_decref) Task=`596c6db6-ae63-4fcf-9633-04da01d949d5`::ref 0 aborting False
>Thread-4842::DEBUG::2014-04-10 18:31:52,182::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1e736b86]
>Thread-4842::DEBUG::2014-04-10 18:31:52,183::task::579::TaskManager.Task::(_updateState) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::moving from state init -> state preparing
>Thread-4842::INFO::2014-04-10 18:31:52,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4842::DEBUG::2014-04-10 18:31:52,184::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a99f9e87-902f-4377-97a3-ae3f1bc1df70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4842::DEBUG::2014-04-10 18:31:52,184::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4842::DEBUG::2014-04-10 18:31:52,184::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4842::DEBUG::2014-04-10 18:31:52,184::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a99f9e87-902f-4377-97a3-ae3f1bc1df70`::Granted request
>Thread-4842::DEBUG::2014-04-10 18:31:52,185::task::811::TaskManager.Task::(resourceAcquired) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4842::DEBUG::2014-04-10 18:31:52,185::task::974::TaskManager.Task::(_decref) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::ref 1 aborting False
>Thread-4842::INFO::2014-04-10 18:31:52,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4842::DEBUG::2014-04-10 18:31:52,187::task::1168::TaskManager.Task::(prepare) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4842::DEBUG::2014-04-10 18:31:52,187::task::579::TaskManager.Task::(_updateState) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::moving from state preparing -> state finished
>Thread-4842::DEBUG::2014-04-10 18:31:52,188::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4842::DEBUG::2014-04-10 18:31:52,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4842::DEBUG::2014-04-10 18:31:52,188::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4842::DEBUG::2014-04-10 18:31:52,188::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4842::DEBUG::2014-04-10 18:31:52,188::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4842::DEBUG::2014-04-10 18:31:52,189::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4842::DEBUG::2014-04-10 18:31:52,189::task::974::TaskManager.Task::(_decref) Task=`f8f2d359-3d75-4b37-819c-79b1e5c9db97`::ref 0 aborting False
>Thread-4843::DEBUG::2014-04-10 18:31:54,967::task::579::TaskManager.Task::(_updateState) Task=`bc44ad8e-49ba-4c4a-81b7-47d62642b04d`::moving from state init -> state preparing
>Thread-4843::INFO::2014-04-10 18:31:54,967::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4843::INFO::2014-04-10 18:31:54,967::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458742', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366932', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391998', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417142', 'lastCheck': '3.8', 'valid': True}}
>Thread-4843::DEBUG::2014-04-10 18:31:54,968::task::1168::TaskManager.Task::(prepare) Task=`bc44ad8e-49ba-4c4a-81b7-47d62642b04d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458742', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366932', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000391998', 'lastCheck': '3.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417142', 'lastCheck': '3.8', 'valid': True}}
>Thread-4843::DEBUG::2014-04-10 18:31:54,968::task::579::TaskManager.Task::(_updateState) Task=`bc44ad8e-49ba-4c4a-81b7-47d62642b04d`::moving from state preparing -> state finished
>Thread-4843::DEBUG::2014-04-10 18:31:54,968::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4843::DEBUG::2014-04-10 18:31:54,968::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4843::DEBUG::2014-04-10 18:31:54,968::task::974::TaskManager.Task::(_decref) Task=`bc44ad8e-49ba-4c4a-81b7-47d62642b04d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:00,977::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:00,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387975 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:32:01,148::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:32:01,166::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:32:01,167::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:32:01,172::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:32:01,174::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:32:01,174::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:32:01,174::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:32:01,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:01,198::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000341704 s, 1.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:01,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:01,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000409966 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:01,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:01,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277881 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4851::DEBUG::2014-04-10 18:32:02,330::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4851::DEBUG::2014-04-10 18:32:02,331::task::579::TaskManager.Task::(_updateState) Task=`69da81fe-2f1d-4db9-bd0a-5b3b998b8519`::moving from state init -> state preparing
>Thread-4851::INFO::2014-04-10 18:32:02,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4851::INFO::2014-04-10 18:32:02,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4851::DEBUG::2014-04-10 18:32:02,331::task::1168::TaskManager.Task::(prepare) Task=`69da81fe-2f1d-4db9-bd0a-5b3b998b8519`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4851::DEBUG::2014-04-10 18:32:02,331::task::579::TaskManager.Task::(_updateState) Task=`69da81fe-2f1d-4db9-bd0a-5b3b998b8519`::moving from state preparing -> state finished
>Thread-4851::DEBUG::2014-04-10 18:32:02,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4851::DEBUG::2014-04-10 18:32:02,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4851::DEBUG::2014-04-10 18:32:02,332::task::974::TaskManager.Task::(_decref) Task=`69da81fe-2f1d-4db9-bd0a-5b3b998b8519`::ref 0 aborting False
>Thread-4852::DEBUG::2014-04-10 18:32:02,338::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4852::DEBUG::2014-04-10 18:32:02,339::task::579::TaskManager.Task::(_updateState) Task=`b489e845-7a21-4d84-ba81-a45873577463`::moving from state init -> state preparing
>Thread-4852::INFO::2014-04-10 18:32:02,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4852::DEBUG::2014-04-10 18:32:02,340::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5974c5f5-5b4c-4c3c-a0aa-6545dd3263ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4852::DEBUG::2014-04-10 18:32:02,340::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4852::DEBUG::2014-04-10 18:32:02,340::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4852::DEBUG::2014-04-10 18:32:02,340::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5974c5f5-5b4c-4c3c-a0aa-6545dd3263ce`::Granted request
>Thread-4852::DEBUG::2014-04-10 18:32:02,340::task::811::TaskManager.Task::(resourceAcquired) Task=`b489e845-7a21-4d84-ba81-a45873577463`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4852::DEBUG::2014-04-10 18:32:02,341::task::974::TaskManager.Task::(_decref) Task=`b489e845-7a21-4d84-ba81-a45873577463`::ref 1 aborting False
>Thread-4852::INFO::2014-04-10 18:32:02,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4852::DEBUG::2014-04-10 18:32:02,343::task::1168::TaskManager.Task::(prepare) Task=`b489e845-7a21-4d84-ba81-a45873577463`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4852::DEBUG::2014-04-10 18:32:02,343::task::579::TaskManager.Task::(_updateState) Task=`b489e845-7a21-4d84-ba81-a45873577463`::moving from state preparing -> state finished
>Thread-4852::DEBUG::2014-04-10 18:32:02,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4852::DEBUG::2014-04-10 18:32:02,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4852::DEBUG::2014-04-10 18:32:02,343::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4852::DEBUG::2014-04-10 18:32:02,344::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4852::DEBUG::2014-04-10 18:32:02,344::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4852::DEBUG::2014-04-10 18:32:02,344::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4852::DEBUG::2014-04-10 18:32:02,344::task::974::TaskManager.Task::(_decref) Task=`b489e845-7a21-4d84-ba81-a45873577463`::ref 0 aborting False
>Thread-4855::DEBUG::2014-04-10 18:32:10,247::task::579::TaskManager.Task::(_updateState) Task=`4984cf4a-c06d-48db-a744-b344615de6a8`::moving from state init -> state preparing
>Thread-4855::INFO::2014-04-10 18:32:10,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4855::INFO::2014-04-10 18:32:10,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409966', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387975', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277881', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341704', 'lastCheck': '9.1', 'valid': True}}
>Thread-4855::DEBUG::2014-04-10 18:32:10,253::task::1168::TaskManager.Task::(prepare) Task=`4984cf4a-c06d-48db-a744-b344615de6a8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409966', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387975', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277881', 'lastCheck': '8.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341704', 'lastCheck': '9.1', 'valid': True}}
>Thread-4855::DEBUG::2014-04-10 18:32:10,254::task::579::TaskManager.Task::(_updateState) Task=`4984cf4a-c06d-48db-a744-b344615de6a8`::moving from state preparing -> state finished
>Thread-4855::DEBUG::2014-04-10 18:32:10,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4855::DEBUG::2014-04-10 18:32:10,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4855::DEBUG::2014-04-10 18:32:10,256::task::974::TaskManager.Task::(_decref) Task=`4984cf4a-c06d-48db-a744-b344615de6a8`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:10,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:10,997::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356081 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:32:11,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:11,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477538 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:11,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:11,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000508995 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:11,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:11,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390792 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4857::DEBUG::2014-04-10 18:32:12,785::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4857::DEBUG::2014-04-10 18:32:12,785::task::579::TaskManager.Task::(_updateState) Task=`c7d5196d-0a4d-4605-9413-8cb595489f5f`::moving from state init -> state preparing
>Thread-4857::INFO::2014-04-10 18:32:12,786::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4857::INFO::2014-04-10 18:32:12,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4857::DEBUG::2014-04-10 18:32:12,786::task::1168::TaskManager.Task::(prepare) Task=`c7d5196d-0a4d-4605-9413-8cb595489f5f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4857::DEBUG::2014-04-10 18:32:12,786::task::579::TaskManager.Task::(_updateState) Task=`c7d5196d-0a4d-4605-9413-8cb595489f5f`::moving from state preparing -> state finished
>Thread-4857::DEBUG::2014-04-10 18:32:12,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4857::DEBUG::2014-04-10 18:32:12,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4857::DEBUG::2014-04-10 18:32:12,787::task::974::TaskManager.Task::(_decref) Task=`c7d5196d-0a4d-4605-9413-8cb595489f5f`::ref 0 aborting False
>Thread-4858::DEBUG::2014-04-10 18:32:12,792::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4858::DEBUG::2014-04-10 18:32:12,793::task::579::TaskManager.Task::(_updateState) Task=`94020769-6338-435c-93ea-706a19a71176`::moving from state init -> state preparing
>Thread-4858::INFO::2014-04-10 18:32:12,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4858::DEBUG::2014-04-10 18:32:12,794::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c8ec7870-a894-490b-a530-cc90b521a681`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4858::DEBUG::2014-04-10 18:32:12,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4858::DEBUG::2014-04-10 18:32:12,794::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4858::DEBUG::2014-04-10 18:32:12,794::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c8ec7870-a894-490b-a530-cc90b521a681`::Granted request
>Thread-4858::DEBUG::2014-04-10 18:32:12,795::task::811::TaskManager.Task::(resourceAcquired) Task=`94020769-6338-435c-93ea-706a19a71176`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4858::DEBUG::2014-04-10 18:32:12,795::task::974::TaskManager.Task::(_decref) Task=`94020769-6338-435c-93ea-706a19a71176`::ref 1 aborting False
>Thread-4858::INFO::2014-04-10 18:32:12,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4858::DEBUG::2014-04-10 18:32:12,797::task::1168::TaskManager.Task::(prepare) Task=`94020769-6338-435c-93ea-706a19a71176`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4858::DEBUG::2014-04-10 18:32:12,797::task::579::TaskManager.Task::(_updateState) Task=`94020769-6338-435c-93ea-706a19a71176`::moving from state preparing -> state finished
>Thread-4858::DEBUG::2014-04-10 18:32:12,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4858::DEBUG::2014-04-10 18:32:12,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4858::DEBUG::2014-04-10 18:32:12,798::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4858::DEBUG::2014-04-10 18:32:12,798::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4858::DEBUG::2014-04-10 18:32:12,798::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4858::DEBUG::2014-04-10 18:32:12,799::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4858::DEBUG::2014-04-10 18:32:12,799::task::974::TaskManager.Task::(_decref) Task=`94020769-6338-435c-93ea-706a19a71176`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:21,005::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:21,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003938 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:32:21,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:21,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488756 s, 753 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:21,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:21,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406386 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:21,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:21,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383106 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4863::DEBUG::2014-04-10 18:32:22,918::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4863::DEBUG::2014-04-10 18:32:22,919::task::579::TaskManager.Task::(_updateState) Task=`004984f4-5754-41b5-9faf-476637131ac6`::moving from state init -> state preparing
>Thread-4863::INFO::2014-04-10 18:32:22,919::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4863::INFO::2014-04-10 18:32:22,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4863::DEBUG::2014-04-10 18:32:22,920::task::1168::TaskManager.Task::(prepare) Task=`004984f4-5754-41b5-9faf-476637131ac6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4863::DEBUG::2014-04-10 18:32:22,920::task::579::TaskManager.Task::(_updateState) Task=`004984f4-5754-41b5-9faf-476637131ac6`::moving from state preparing -> state finished
>Thread-4863::DEBUG::2014-04-10 18:32:22,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4863::DEBUG::2014-04-10 18:32:22,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4863::DEBUG::2014-04-10 18:32:22,920::task::974::TaskManager.Task::(_decref) Task=`004984f4-5754-41b5-9faf-476637131ac6`::ref 0 aborting False
>Thread-4864::DEBUG::2014-04-10 18:32:22,926::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4864::DEBUG::2014-04-10 18:32:22,926::task::579::TaskManager.Task::(_updateState) Task=`22066587-0083-4b34-9995-950bd5d5589a`::moving from state init -> state preparing
>Thread-4864::INFO::2014-04-10 18:32:22,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4864::DEBUG::2014-04-10 18:32:22,927::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ade93f96-ae0d-4981-b7d8-b6eabc460b4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4864::DEBUG::2014-04-10 18:32:22,927::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4864::DEBUG::2014-04-10 18:32:22,927::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4864::DEBUG::2014-04-10 18:32:22,927::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ade93f96-ae0d-4981-b7d8-b6eabc460b4e`::Granted request
>Thread-4864::DEBUG::2014-04-10 18:32:22,928::task::811::TaskManager.Task::(resourceAcquired) Task=`22066587-0083-4b34-9995-950bd5d5589a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4864::DEBUG::2014-04-10 18:32:22,928::task::974::TaskManager.Task::(_decref) Task=`22066587-0083-4b34-9995-950bd5d5589a`::ref 1 aborting False
>Thread-4864::INFO::2014-04-10 18:32:22,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4864::DEBUG::2014-04-10 18:32:22,930::task::1168::TaskManager.Task::(prepare) Task=`22066587-0083-4b34-9995-950bd5d5589a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4864::DEBUG::2014-04-10 18:32:22,930::task::579::TaskManager.Task::(_updateState) Task=`22066587-0083-4b34-9995-950bd5d5589a`::moving from state preparing -> state finished
>Thread-4864::DEBUG::2014-04-10 18:32:22,930::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4864::DEBUG::2014-04-10 18:32:22,930::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4864::DEBUG::2014-04-10 18:32:22,931::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4864::DEBUG::2014-04-10 18:32:22,931::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4864::DEBUG::2014-04-10 18:32:22,931::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4864::DEBUG::2014-04-10 18:32:22,931::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4864::DEBUG::2014-04-10 18:32:22,931::task::974::TaskManager.Task::(_decref) Task=`22066587-0083-4b34-9995-950bd5d5589a`::ref 0 aborting False
>Thread-4865::DEBUG::2014-04-10 18:32:25,874::task::579::TaskManager.Task::(_updateState) Task=`c2ac34ac-077f-4d41-b210-9a051f9ab816`::moving from state init -> state preparing
>Thread-4865::INFO::2014-04-10 18:32:25,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4865::INFO::2014-04-10 18:32:25,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406386', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003938', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383106', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488756', 'lastCheck': '4.6', 'valid': True}}
>Thread-4865::DEBUG::2014-04-10 18:32:25,875::task::1168::TaskManager.Task::(prepare) Task=`c2ac34ac-077f-4d41-b210-9a051f9ab816`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000406386', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003938', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383106', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488756', 'lastCheck': '4.6', 'valid': True}}
>Thread-4865::DEBUG::2014-04-10 18:32:25,875::task::579::TaskManager.Task::(_updateState) Task=`c2ac34ac-077f-4d41-b210-9a051f9ab816`::moving from state preparing -> state finished
>Thread-4865::DEBUG::2014-04-10 18:32:25,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4865::DEBUG::2014-04-10 18:32:25,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4865::DEBUG::2014-04-10 18:32:25,876::task::974::TaskManager.Task::(_decref) Task=`c2ac34ac-077f-4d41-b210-9a051f9ab816`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:31,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:31,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000393845 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:32:31,238::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:31,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000433359 s, 849 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:31,393::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:31,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000494315 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:31,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:31,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386919 s, 1.7 MB/s\n'; <rc> = 0
>Thread-4869::DEBUG::2014-04-10 18:32:33,001::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4869::DEBUG::2014-04-10 18:32:33,001::task::579::TaskManager.Task::(_updateState) Task=`34c1760a-7ec2-42aa-b164-ce37c631edd3`::moving from state init -> state preparing
>Thread-4869::INFO::2014-04-10 18:32:33,001::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4869::INFO::2014-04-10 18:32:33,002::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4869::DEBUG::2014-04-10 18:32:33,002::task::1168::TaskManager.Task::(prepare) Task=`34c1760a-7ec2-42aa-b164-ce37c631edd3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4869::DEBUG::2014-04-10 18:32:33,002::task::579::TaskManager.Task::(_updateState) Task=`34c1760a-7ec2-42aa-b164-ce37c631edd3`::moving from state preparing -> state finished
>Thread-4869::DEBUG::2014-04-10 18:32:33,002::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4869::DEBUG::2014-04-10 18:32:33,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4869::DEBUG::2014-04-10 18:32:33,002::task::974::TaskManager.Task::(_decref) Task=`34c1760a-7ec2-42aa-b164-ce37c631edd3`::ref 0 aborting False
>Thread-4870::DEBUG::2014-04-10 18:32:33,009::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [72f8820a]
>Thread-4870::DEBUG::2014-04-10 18:32:33,010::task::579::TaskManager.Task::(_updateState) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::moving from state init -> state preparing
>Thread-4870::INFO::2014-04-10 18:32:33,010::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4870::DEBUG::2014-04-10 18:32:33,010::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63058573-75a9-4df2-9449-b8b6a70772b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4870::DEBUG::2014-04-10 18:32:33,011::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4870::DEBUG::2014-04-10 18:32:33,011::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4870::DEBUG::2014-04-10 18:32:33,011::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63058573-75a9-4df2-9449-b8b6a70772b5`::Granted request
>Thread-4870::DEBUG::2014-04-10 18:32:33,011::task::811::TaskManager.Task::(resourceAcquired) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4870::DEBUG::2014-04-10 18:32:33,011::task::974::TaskManager.Task::(_decref) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::ref 1 aborting False
>Thread-4870::INFO::2014-04-10 18:32:33,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::task::1168::TaskManager.Task::(prepare) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::task::579::TaskManager.Task::(_updateState) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::moving from state preparing -> state finished
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4870::DEBUG::2014-04-10 18:32:33,014::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4870::DEBUG::2014-04-10 18:32:33,015::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4870::DEBUG::2014-04-10 18:32:33,015::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4870::DEBUG::2014-04-10 18:32:33,015::task::974::TaskManager.Task::(_decref) Task=`4bb56fdb-cf5f-44c5-8c98-76da04ed1af5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:41,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:41,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000447318 s, 1.5 MB/s\n'; <rc> = 0
>Thread-4873::DEBUG::2014-04-10 18:32:41,075::task::579::TaskManager.Task::(_updateState) Task=`1ff858af-5eb9-4f3d-8fec-38c66c39f9d1`::moving from state init -> state preparing
>Thread-4873::INFO::2014-04-10 18:32:41,075::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4873::INFO::2014-04-10 18:32:41,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494315', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447318', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386919', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433359', 'lastCheck': '9.8', 'valid': True}}
>Thread-4873::DEBUG::2014-04-10 18:32:41,076::task::1168::TaskManager.Task::(prepare) Task=`1ff858af-5eb9-4f3d-8fec-38c66c39f9d1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494315', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447318', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386919', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433359', 'lastCheck': '9.8', 'valid': True}}
>Thread-4873::DEBUG::2014-04-10 18:32:41,076::task::579::TaskManager.Task::(_updateState) Task=`1ff858af-5eb9-4f3d-8fec-38c66c39f9d1`::moving from state preparing -> state finished
>Thread-4873::DEBUG::2014-04-10 18:32:41,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4873::DEBUG::2014-04-10 18:32:41,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4873::DEBUG::2014-04-10 18:32:41,076::task::974::TaskManager.Task::(_decref) Task=`1ff858af-5eb9-4f3d-8fec-38c66c39f9d1`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:32:41,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:41,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000469957 s, 783 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:41,408::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:41,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000391033 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:41,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:41,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348577 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4875::DEBUG::2014-04-10 18:32:43,201::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4875::DEBUG::2014-04-10 18:32:43,202::task::579::TaskManager.Task::(_updateState) Task=`8bb46db8-bb79-4b0e-ace1-27401a084881`::moving from state init -> state preparing
>Thread-4875::INFO::2014-04-10 18:32:43,202::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4875::INFO::2014-04-10 18:32:43,202::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4875::DEBUG::2014-04-10 18:32:43,202::task::1168::TaskManager.Task::(prepare) Task=`8bb46db8-bb79-4b0e-ace1-27401a084881`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4875::DEBUG::2014-04-10 18:32:43,203::task::579::TaskManager.Task::(_updateState) Task=`8bb46db8-bb79-4b0e-ace1-27401a084881`::moving from state preparing -> state finished
>Thread-4875::DEBUG::2014-04-10 18:32:43,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4875::DEBUG::2014-04-10 18:32:43,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4875::DEBUG::2014-04-10 18:32:43,203::task::974::TaskManager.Task::(_decref) Task=`8bb46db8-bb79-4b0e-ace1-27401a084881`::ref 0 aborting False
>Thread-4876::DEBUG::2014-04-10 18:32:43,210::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4876::DEBUG::2014-04-10 18:32:43,210::task::579::TaskManager.Task::(_updateState) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::moving from state init -> state preparing
>Thread-4876::INFO::2014-04-10 18:32:43,211::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4876::DEBUG::2014-04-10 18:32:43,211::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1d8a8e14-3d6a-45dc-ba77-d53187e996d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4876::DEBUG::2014-04-10 18:32:43,211::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4876::DEBUG::2014-04-10 18:32:43,212::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4876::DEBUG::2014-04-10 18:32:43,212::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1d8a8e14-3d6a-45dc-ba77-d53187e996d3`::Granted request
>Thread-4876::DEBUG::2014-04-10 18:32:43,212::task::811::TaskManager.Task::(resourceAcquired) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4876::DEBUG::2014-04-10 18:32:43,212::task::974::TaskManager.Task::(_decref) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::ref 1 aborting False
>Thread-4876::INFO::2014-04-10 18:32:43,214::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4876::DEBUG::2014-04-10 18:32:43,215::task::1168::TaskManager.Task::(prepare) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4876::DEBUG::2014-04-10 18:32:43,215::task::579::TaskManager.Task::(_updateState) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::moving from state preparing -> state finished
>Thread-4876::DEBUG::2014-04-10 18:32:43,215::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4876::DEBUG::2014-04-10 18:32:43,215::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4876::DEBUG::2014-04-10 18:32:43,215::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4876::DEBUG::2014-04-10 18:32:43,216::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4876::DEBUG::2014-04-10 18:32:43,216::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4876::DEBUG::2014-04-10 18:32:43,216::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4876::DEBUG::2014-04-10 18:32:43,216::task::974::TaskManager.Task::(_decref) Task=`04b4f62a-4a70-4552-9e26-9692aa555b3c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:32:51,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:32:51,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00050417 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:32:51,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:32:51,273::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430519 s, 855 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:32:51,425::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:32:51,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429296 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:32:51,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:32:51,486::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344537 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4881::DEBUG::2014-04-10 18:32:53,380::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4881::DEBUG::2014-04-10 18:32:53,380::task::579::TaskManager.Task::(_updateState) Task=`959208fa-9837-4b34-ba7d-e8a5f074631b`::moving from state init -> state preparing
>Thread-4881::INFO::2014-04-10 18:32:53,381::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4881::INFO::2014-04-10 18:32:53,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4881::DEBUG::2014-04-10 18:32:53,381::task::1168::TaskManager.Task::(prepare) Task=`959208fa-9837-4b34-ba7d-e8a5f074631b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4881::DEBUG::2014-04-10 18:32:53,381::task::579::TaskManager.Task::(_updateState) Task=`959208fa-9837-4b34-ba7d-e8a5f074631b`::moving from state preparing -> state finished
>Thread-4881::DEBUG::2014-04-10 18:32:53,381::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4881::DEBUG::2014-04-10 18:32:53,381::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4881::DEBUG::2014-04-10 18:32:53,382::task::974::TaskManager.Task::(_decref) Task=`959208fa-9837-4b34-ba7d-e8a5f074631b`::ref 0 aborting False
>Thread-4882::DEBUG::2014-04-10 18:32:53,389::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4882::DEBUG::2014-04-10 18:32:53,389::task::579::TaskManager.Task::(_updateState) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::moving from state init -> state preparing
>Thread-4882::INFO::2014-04-10 18:32:53,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4882::DEBUG::2014-04-10 18:32:53,390::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e4a73e4-deee-4b5e-bab6-2d8575bf2c55`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4882::DEBUG::2014-04-10 18:32:53,391::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4882::DEBUG::2014-04-10 18:32:53,391::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4882::DEBUG::2014-04-10 18:32:53,391::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e4a73e4-deee-4b5e-bab6-2d8575bf2c55`::Granted request
>Thread-4882::DEBUG::2014-04-10 18:32:53,391::task::811::TaskManager.Task::(resourceAcquired) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4882::DEBUG::2014-04-10 18:32:53,391::task::974::TaskManager.Task::(_decref) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::ref 1 aborting False
>Thread-4882::INFO::2014-04-10 18:32:53,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4882::DEBUG::2014-04-10 18:32:53,393::task::1168::TaskManager.Task::(prepare) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::task::579::TaskManager.Task::(_updateState) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::moving from state preparing -> state finished
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4882::DEBUG::2014-04-10 18:32:53,394::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4882::DEBUG::2014-04-10 18:32:53,395::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4882::DEBUG::2014-04-10 18:32:53,395::task::974::TaskManager.Task::(_decref) Task=`2aed7084-105f-4c89-b4ad-07250fdb7efd`::ref 0 aborting False
>Thread-4883::DEBUG::2014-04-10 18:32:56,282::task::579::TaskManager.Task::(_updateState) Task=`aa6bb264-a9f3-4298-99f7-27a4dc134808`::moving from state init -> state preparing
>Thread-4883::INFO::2014-04-10 18:32:56,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4883::INFO::2014-04-10 18:32:56,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429296', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050417', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344537', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430519', 'lastCheck': '5.0', 'valid': True}}
>Thread-4883::DEBUG::2014-04-10 18:32:56,283::task::1168::TaskManager.Task::(prepare) Task=`aa6bb264-a9f3-4298-99f7-27a4dc134808`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429296', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050417', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344537', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430519', 'lastCheck': '5.0', 'valid': True}}
>Thread-4883::DEBUG::2014-04-10 18:32:56,283::task::579::TaskManager.Task::(_updateState) Task=`aa6bb264-a9f3-4298-99f7-27a4dc134808`::moving from state preparing -> state finished
>Thread-4883::DEBUG::2014-04-10 18:32:56,283::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4883::DEBUG::2014-04-10 18:32:56,284::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4883::DEBUG::2014-04-10 18:32:56,284::task::974::TaskManager.Task::(_decref) Task=`aa6bb264-a9f3-4298-99f7-27a4dc134808`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:01,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:01,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370833 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:01,281::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:01,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000434525 s, 847 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:33:01,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:01,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000579668 s, 1.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:01,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:01,500::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036896 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4887::DEBUG::2014-04-10 18:33:03,504::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-4887::DEBUG::2014-04-10 18:33:03,505::task::579::TaskManager.Task::(_updateState) Task=`9a3a5c69-ee1d-44f8-bab9-e3a9b26da600`::moving from state init -> state preparing
>Thread-4887::INFO::2014-04-10 18:33:03,505::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4887::INFO::2014-04-10 18:33:03,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4887::DEBUG::2014-04-10 18:33:03,506::task::1168::TaskManager.Task::(prepare) Task=`9a3a5c69-ee1d-44f8-bab9-e3a9b26da600`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4887::DEBUG::2014-04-10 18:33:03,506::task::579::TaskManager.Task::(_updateState) Task=`9a3a5c69-ee1d-44f8-bab9-e3a9b26da600`::moving from state preparing -> state finished
>Thread-4887::DEBUG::2014-04-10 18:33:03,506::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4887::DEBUG::2014-04-10 18:33:03,506::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4887::DEBUG::2014-04-10 18:33:03,506::task::974::TaskManager.Task::(_decref) Task=`9a3a5c69-ee1d-44f8-bab9-e3a9b26da600`::ref 0 aborting False
>Thread-4888::DEBUG::2014-04-10 18:33:03,512::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [60c81cea]
>Thread-4888::DEBUG::2014-04-10 18:33:03,512::task::579::TaskManager.Task::(_updateState) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::moving from state init -> state preparing
>Thread-4888::INFO::2014-04-10 18:33:03,512::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4888::DEBUG::2014-04-10 18:33:03,513::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51f66d8f-c5b1-4afc-b98b-bc16547342fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4888::DEBUG::2014-04-10 18:33:03,513::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4888::DEBUG::2014-04-10 18:33:03,513::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4888::DEBUG::2014-04-10 18:33:03,513::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51f66d8f-c5b1-4afc-b98b-bc16547342fc`::Granted request
>Thread-4888::DEBUG::2014-04-10 18:33:03,514::task::811::TaskManager.Task::(resourceAcquired) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4888::DEBUG::2014-04-10 18:33:03,514::task::974::TaskManager.Task::(_decref) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::ref 1 aborting False
>Thread-4888::INFO::2014-04-10 18:33:03,516::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4888::DEBUG::2014-04-10 18:33:03,516::task::1168::TaskManager.Task::(prepare) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4888::DEBUG::2014-04-10 18:33:03,516::task::579::TaskManager.Task::(_updateState) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::moving from state preparing -> state finished
>Thread-4888::DEBUG::2014-04-10 18:33:03,516::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4888::DEBUG::2014-04-10 18:33:03,516::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4888::DEBUG::2014-04-10 18:33:03,517::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4888::DEBUG::2014-04-10 18:33:03,517::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4888::DEBUG::2014-04-10 18:33:03,517::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4888::DEBUG::2014-04-10 18:33:03,517::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4888::DEBUG::2014-04-10 18:33:03,517::task::974::TaskManager.Task::(_decref) Task=`26dab716-4134-43a0-95e9-fab797e54e57`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:11,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:11,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364954 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:11,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:11,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431256 s, 853 kB/s\n'; <rc> = 0
>Thread-4891::DEBUG::2014-04-10 18:33:11,443::task::579::TaskManager.Task::(_updateState) Task=`de41c36d-1179-4f43-9a2f-2a8866bb8af7`::moving from state init -> state preparing
>Thread-4891::INFO::2014-04-10 18:33:11,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4891::INFO::2014-04-10 18:33:11,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579668', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364954', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036896', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431256', 'lastCheck': '0.1', 'valid': True}}
>Thread-4891::DEBUG::2014-04-10 18:33:11,444::task::1168::TaskManager.Task::(prepare) Task=`de41c36d-1179-4f43-9a2f-2a8866bb8af7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579668', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364954', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036896', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431256', 'lastCheck': '0.1', 'valid': True}}
>Thread-4891::DEBUG::2014-04-10 18:33:11,444::task::579::TaskManager.Task::(_updateState) Task=`de41c36d-1179-4f43-9a2f-2a8866bb8af7`::moving from state preparing -> state finished
>Thread-4891::DEBUG::2014-04-10 18:33:11,445::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4891::DEBUG::2014-04-10 18:33:11,445::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4891::DEBUG::2014-04-10 18:33:11,445::task::974::TaskManager.Task::(_decref) Task=`de41c36d-1179-4f43-9a2f-2a8866bb8af7`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:33:11,454::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:11,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000437677 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:11,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:11,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336246 s, 2.0 MB/s\n'; <rc> = 0
>Thread-4893::DEBUG::2014-04-10 18:33:13,630::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-4893::DEBUG::2014-04-10 18:33:13,630::task::579::TaskManager.Task::(_updateState) Task=`2fafb8cf-584f-4f42-976e-dae7d03e1360`::moving from state init -> state preparing
>Thread-4893::INFO::2014-04-10 18:33:13,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4893::INFO::2014-04-10 18:33:13,631::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4893::DEBUG::2014-04-10 18:33:13,631::task::1168::TaskManager.Task::(prepare) Task=`2fafb8cf-584f-4f42-976e-dae7d03e1360`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4893::DEBUG::2014-04-10 18:33:13,631::task::579::TaskManager.Task::(_updateState) Task=`2fafb8cf-584f-4f42-976e-dae7d03e1360`::moving from state preparing -> state finished
>Thread-4893::DEBUG::2014-04-10 18:33:13,631::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4893::DEBUG::2014-04-10 18:33:13,632::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4893::DEBUG::2014-04-10 18:33:13,632::task::974::TaskManager.Task::(_decref) Task=`2fafb8cf-584f-4f42-976e-dae7d03e1360`::ref 0 aborting False
>Thread-4894::DEBUG::2014-04-10 18:33:13,639::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [40980259]
>Thread-4894::DEBUG::2014-04-10 18:33:13,639::task::579::TaskManager.Task::(_updateState) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::moving from state init -> state preparing
>Thread-4894::INFO::2014-04-10 18:33:13,640::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4894::DEBUG::2014-04-10 18:33:13,640::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51a04d4e-fce4-407c-8e3c-3fb37bbaab95`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4894::DEBUG::2014-04-10 18:33:13,640::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4894::DEBUG::2014-04-10 18:33:13,641::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4894::DEBUG::2014-04-10 18:33:13,641::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`51a04d4e-fce4-407c-8e3c-3fb37bbaab95`::Granted request
>Thread-4894::DEBUG::2014-04-10 18:33:13,641::task::811::TaskManager.Task::(resourceAcquired) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4894::DEBUG::2014-04-10 18:33:13,641::task::974::TaskManager.Task::(_decref) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::ref 1 aborting False
>Thread-4894::INFO::2014-04-10 18:33:13,643::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4894::DEBUG::2014-04-10 18:33:13,644::task::1168::TaskManager.Task::(prepare) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4894::DEBUG::2014-04-10 18:33:13,644::task::579::TaskManager.Task::(_updateState) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::moving from state preparing -> state finished
>Thread-4894::DEBUG::2014-04-10 18:33:13,644::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4894::DEBUG::2014-04-10 18:33:13,644::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4894::DEBUG::2014-04-10 18:33:13,644::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4894::DEBUG::2014-04-10 18:33:13,645::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4894::DEBUG::2014-04-10 18:33:13,645::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4894::DEBUG::2014-04-10 18:33:13,645::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4894::DEBUG::2014-04-10 18:33:13,645::task::974::TaskManager.Task::(_decref) Task=`6d77fb99-bed2-4a5a-afb8-2a14f58748eb`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:21,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:21,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00043544 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:21,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:21,315::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000416873 s, 883 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:33:21,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:21,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000367363 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:21,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:21,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342277 s, 2.0 MB/s\n'; <rc> = 0
>Thread-4898::DEBUG::2014-04-10 18:33:24,135::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4898::DEBUG::2014-04-10 18:33:24,135::task::579::TaskManager.Task::(_updateState) Task=`d2b6f117-956d-494b-aec1-347888e1ba89`::moving from state init -> state preparing
>Thread-4898::INFO::2014-04-10 18:33:24,135::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4898::INFO::2014-04-10 18:33:24,136::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4898::DEBUG::2014-04-10 18:33:24,136::task::1168::TaskManager.Task::(prepare) Task=`d2b6f117-956d-494b-aec1-347888e1ba89`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4898::DEBUG::2014-04-10 18:33:24,136::task::579::TaskManager.Task::(_updateState) Task=`d2b6f117-956d-494b-aec1-347888e1ba89`::moving from state preparing -> state finished
>Thread-4898::DEBUG::2014-04-10 18:33:24,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4898::DEBUG::2014-04-10 18:33:24,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4898::DEBUG::2014-04-10 18:33:24,136::task::974::TaskManager.Task::(_decref) Task=`d2b6f117-956d-494b-aec1-347888e1ba89`::ref 0 aborting False
>Thread-4899::DEBUG::2014-04-10 18:33:24,143::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-4899::DEBUG::2014-04-10 18:33:24,143::task::579::TaskManager.Task::(_updateState) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::moving from state init -> state preparing
>Thread-4899::INFO::2014-04-10 18:33:24,143::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4899::DEBUG::2014-04-10 18:33:24,144::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9e8259a-82bf-4ebb-856b-67631e452321`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4899::DEBUG::2014-04-10 18:33:24,144::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4899::DEBUG::2014-04-10 18:33:24,144::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4899::DEBUG::2014-04-10 18:33:24,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e9e8259a-82bf-4ebb-856b-67631e452321`::Granted request
>Thread-4899::DEBUG::2014-04-10 18:33:24,145::task::811::TaskManager.Task::(resourceAcquired) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4899::DEBUG::2014-04-10 18:33:24,145::task::974::TaskManager.Task::(_decref) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::ref 1 aborting False
>Thread-4899::INFO::2014-04-10 18:33:24,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4899::DEBUG::2014-04-10 18:33:24,147::task::1168::TaskManager.Task::(prepare) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4899::DEBUG::2014-04-10 18:33:24,147::task::579::TaskManager.Task::(_updateState) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::moving from state preparing -> state finished
>Thread-4899::DEBUG::2014-04-10 18:33:24,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4899::DEBUG::2014-04-10 18:33:24,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4899::DEBUG::2014-04-10 18:33:24,148::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4899::DEBUG::2014-04-10 18:33:24,148::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4899::DEBUG::2014-04-10 18:33:24,148::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4899::DEBUG::2014-04-10 18:33:24,148::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4899::DEBUG::2014-04-10 18:33:24,148::task::974::TaskManager.Task::(_decref) Task=`5dc25a05-fe74-494f-8b77-2679ead20425`::ref 0 aborting False
>Thread-4901::DEBUG::2014-04-10 18:33:28,626::task::579::TaskManager.Task::(_updateState) Task=`e4571740-bf80-46db-b285-36170701eb03`::moving from state init -> state preparing
>Thread-4901::INFO::2014-04-10 18:33:28,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4901::INFO::2014-04-10 18:33:28,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367363', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043544', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342277', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416873', 'lastCheck': '7.3', 'valid': True}}
>Thread-4901::DEBUG::2014-04-10 18:33:28,627::task::1168::TaskManager.Task::(prepare) Task=`e4571740-bf80-46db-b285-36170701eb03`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367363', 'lastCheck': '7.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043544', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342277', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416873', 'lastCheck': '7.3', 'valid': True}}
>Thread-4901::DEBUG::2014-04-10 18:33:28,627::task::579::TaskManager.Task::(_updateState) Task=`e4571740-bf80-46db-b285-36170701eb03`::moving from state preparing -> state finished
>Thread-4901::DEBUG::2014-04-10 18:33:28,627::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4901::DEBUG::2014-04-10 18:33:28,627::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4901::DEBUG::2014-04-10 18:33:28,627::task::974::TaskManager.Task::(_decref) Task=`e4571740-bf80-46db-b285-36170701eb03`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:31,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:31,132::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395795 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:31,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:31,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000460033 s, 800 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:33:31,486::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:33:31,501::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:33:31,502::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:33:31,510::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:33:31,511::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:33:31,512::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:33:31,512::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:33:31,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:31,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000320619 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:31,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:31,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000232535 s, 2.9 MB/s\n'; <rc> = 0
>Thread-4908::DEBUG::2014-04-10 18:33:34,235::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4908::DEBUG::2014-04-10 18:33:34,235::task::579::TaskManager.Task::(_updateState) Task=`1098a9eb-c060-4ea3-ba34-78aba63db3da`::moving from state init -> state preparing
>Thread-4908::INFO::2014-04-10 18:33:34,236::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4908::INFO::2014-04-10 18:33:34,236::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4908::DEBUG::2014-04-10 18:33:34,236::task::1168::TaskManager.Task::(prepare) Task=`1098a9eb-c060-4ea3-ba34-78aba63db3da`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4908::DEBUG::2014-04-10 18:33:34,236::task::579::TaskManager.Task::(_updateState) Task=`1098a9eb-c060-4ea3-ba34-78aba63db3da`::moving from state preparing -> state finished
>Thread-4908::DEBUG::2014-04-10 18:33:34,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4908::DEBUG::2014-04-10 18:33:34,237::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4908::DEBUG::2014-04-10 18:33:34,237::task::974::TaskManager.Task::(_decref) Task=`1098a9eb-c060-4ea3-ba34-78aba63db3da`::ref 0 aborting False
>Thread-4909::DEBUG::2014-04-10 18:33:34,243::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [ecbeb05]
>Thread-4909::DEBUG::2014-04-10 18:33:34,243::task::579::TaskManager.Task::(_updateState) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::moving from state init -> state preparing
>Thread-4909::INFO::2014-04-10 18:33:34,244::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4909::DEBUG::2014-04-10 18:33:34,244::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41194411-fa0e-4918-99b4-2c3a4cede654`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4909::DEBUG::2014-04-10 18:33:34,244::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4909::DEBUG::2014-04-10 18:33:34,244::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4909::DEBUG::2014-04-10 18:33:34,245::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`41194411-fa0e-4918-99b4-2c3a4cede654`::Granted request
>Thread-4909::DEBUG::2014-04-10 18:33:34,245::task::811::TaskManager.Task::(resourceAcquired) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4909::DEBUG::2014-04-10 18:33:34,245::task::974::TaskManager.Task::(_decref) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::ref 1 aborting False
>Thread-4909::INFO::2014-04-10 18:33:34,247::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4909::DEBUG::2014-04-10 18:33:34,247::task::1168::TaskManager.Task::(prepare) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4909::DEBUG::2014-04-10 18:33:34,247::task::579::TaskManager.Task::(_updateState) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::moving from state preparing -> state finished
>Thread-4909::DEBUG::2014-04-10 18:33:34,247::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4909::DEBUG::2014-04-10 18:33:34,248::task::974::TaskManager.Task::(_decref) Task=`c9f37d95-c8e8-459d-a5b6-3d2b60c75a42`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:41,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:41,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000441328 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:41,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:41,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00042286 s, 870 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:33:41,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:41,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000390126 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:41,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:41,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032378 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4913::DEBUG::2014-04-10 18:33:43,770::task::579::TaskManager.Task::(_updateState) Task=`fe781294-4ff3-4293-b86a-3f1fefa6d9de`::moving from state init -> state preparing
>Thread-4913::INFO::2014-04-10 18:33:43,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4913::INFO::2014-04-10 18:33:43,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390126', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441328', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032378', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042286', 'lastCheck': '2.4', 'valid': True}}
>Thread-4913::DEBUG::2014-04-10 18:33:43,771::task::1168::TaskManager.Task::(prepare) Task=`fe781294-4ff3-4293-b86a-3f1fefa6d9de`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390126', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441328', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032378', 'lastCheck': '2.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042286', 'lastCheck': '2.4', 'valid': True}}
>Thread-4913::DEBUG::2014-04-10 18:33:43,771::task::579::TaskManager.Task::(_updateState) Task=`fe781294-4ff3-4293-b86a-3f1fefa6d9de`::moving from state preparing -> state finished
>Thread-4913::DEBUG::2014-04-10 18:33:43,772::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4913::DEBUG::2014-04-10 18:33:43,772::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4913::DEBUG::2014-04-10 18:33:43,772::task::974::TaskManager.Task::(_decref) Task=`fe781294-4ff3-4293-b86a-3f1fefa6d9de`::ref 0 aborting False
>Thread-4915::DEBUG::2014-04-10 18:33:44,490::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4915::DEBUG::2014-04-10 18:33:44,491::task::579::TaskManager.Task::(_updateState) Task=`9585d006-f39d-4ff3-98bb-51b285611fef`::moving from state init -> state preparing
>Thread-4915::INFO::2014-04-10 18:33:44,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4915::INFO::2014-04-10 18:33:44,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4915::DEBUG::2014-04-10 18:33:44,491::task::1168::TaskManager.Task::(prepare) Task=`9585d006-f39d-4ff3-98bb-51b285611fef`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4915::DEBUG::2014-04-10 18:33:44,491::task::579::TaskManager.Task::(_updateState) Task=`9585d006-f39d-4ff3-98bb-51b285611fef`::moving from state preparing -> state finished
>Thread-4915::DEBUG::2014-04-10 18:33:44,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4915::DEBUG::2014-04-10 18:33:44,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4915::DEBUG::2014-04-10 18:33:44,492::task::974::TaskManager.Task::(_decref) Task=`9585d006-f39d-4ff3-98bb-51b285611fef`::ref 0 aborting False
>Thread-4916::DEBUG::2014-04-10 18:33:44,497::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4916::DEBUG::2014-04-10 18:33:44,497::task::579::TaskManager.Task::(_updateState) Task=`4872ef44-a873-4189-965f-1c889593c78d`::moving from state init -> state preparing
>Thread-4916::INFO::2014-04-10 18:33:44,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4916::DEBUG::2014-04-10 18:33:44,498::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d2dc7824-6ec7-4069-8c46-4fce4fbf577e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4916::DEBUG::2014-04-10 18:33:44,498::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4916::DEBUG::2014-04-10 18:33:44,498::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4916::DEBUG::2014-04-10 18:33:44,498::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d2dc7824-6ec7-4069-8c46-4fce4fbf577e`::Granted request
>Thread-4916::DEBUG::2014-04-10 18:33:44,499::task::811::TaskManager.Task::(resourceAcquired) Task=`4872ef44-a873-4189-965f-1c889593c78d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4916::DEBUG::2014-04-10 18:33:44,499::task::974::TaskManager.Task::(_decref) Task=`4872ef44-a873-4189-965f-1c889593c78d`::ref 1 aborting False
>Thread-4916::INFO::2014-04-10 18:33:44,501::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4916::DEBUG::2014-04-10 18:33:44,501::task::1168::TaskManager.Task::(prepare) Task=`4872ef44-a873-4189-965f-1c889593c78d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4916::DEBUG::2014-04-10 18:33:44,501::task::579::TaskManager.Task::(_updateState) Task=`4872ef44-a873-4189-965f-1c889593c78d`::moving from state preparing -> state finished
>Thread-4916::DEBUG::2014-04-10 18:33:44,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4916::DEBUG::2014-04-10 18:33:44,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4916::DEBUG::2014-04-10 18:33:44,502::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4916::DEBUG::2014-04-10 18:33:44,502::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4916::DEBUG::2014-04-10 18:33:44,502::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4916::DEBUG::2014-04-10 18:33:44,502::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4916::DEBUG::2014-04-10 18:33:44,502::task::974::TaskManager.Task::(_decref) Task=`4872ef44-a873-4189-965f-1c889593c78d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:33:51,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:33:51,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266178 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:33:51,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:33:51,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000387086 s, 951 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:33:51,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:33:51,553::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000463426 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:33:51,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:33:51,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034577 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4920::DEBUG::2014-04-10 18:33:54,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4920::DEBUG::2014-04-10 18:33:54,591::task::579::TaskManager.Task::(_updateState) Task=`ee8adcb8-0dca-4641-85eb-ffe13a792e86`::moving from state init -> state preparing
>Thread-4920::INFO::2014-04-10 18:33:54,591::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4920::INFO::2014-04-10 18:33:54,591::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4920::DEBUG::2014-04-10 18:33:54,591::task::1168::TaskManager.Task::(prepare) Task=`ee8adcb8-0dca-4641-85eb-ffe13a792e86`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4920::DEBUG::2014-04-10 18:33:54,591::task::579::TaskManager.Task::(_updateState) Task=`ee8adcb8-0dca-4641-85eb-ffe13a792e86`::moving from state preparing -> state finished
>Thread-4920::DEBUG::2014-04-10 18:33:54,592::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4920::DEBUG::2014-04-10 18:33:54,592::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4920::DEBUG::2014-04-10 18:33:54,592::task::974::TaskManager.Task::(_decref) Task=`ee8adcb8-0dca-4641-85eb-ffe13a792e86`::ref 0 aborting False
>Thread-4921::DEBUG::2014-04-10 18:33:54,597::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4921::DEBUG::2014-04-10 18:33:54,597::task::579::TaskManager.Task::(_updateState) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::moving from state init -> state preparing
>Thread-4921::INFO::2014-04-10 18:33:54,598::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4921::DEBUG::2014-04-10 18:33:54,598::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`943c23de-2b6a-4b60-af42-1d8c4e00a6fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4921::DEBUG::2014-04-10 18:33:54,598::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4921::DEBUG::2014-04-10 18:33:54,598::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4921::DEBUG::2014-04-10 18:33:54,599::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`943c23de-2b6a-4b60-af42-1d8c4e00a6fc`::Granted request
>Thread-4921::DEBUG::2014-04-10 18:33:54,599::task::811::TaskManager.Task::(resourceAcquired) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4921::DEBUG::2014-04-10 18:33:54,599::task::974::TaskManager.Task::(_decref) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::ref 1 aborting False
>Thread-4921::INFO::2014-04-10 18:33:54,601::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4921::DEBUG::2014-04-10 18:33:54,601::task::1168::TaskManager.Task::(prepare) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4921::DEBUG::2014-04-10 18:33:54,601::task::579::TaskManager.Task::(_updateState) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::moving from state preparing -> state finished
>Thread-4921::DEBUG::2014-04-10 18:33:54,601::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4921::DEBUG::2014-04-10 18:33:54,602::task::974::TaskManager.Task::(_decref) Task=`b821fd17-57dd-487c-aa3e-83d8eabf9c58`::ref 0 aborting False
>Thread-4923::DEBUG::2014-04-10 18:33:58,930::task::579::TaskManager.Task::(_updateState) Task=`71786057-4f74-491a-82b1-0d06d178390a`::moving from state init -> state preparing
>Thread-4923::INFO::2014-04-10 18:33:58,930::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4923::INFO::2014-04-10 18:33:58,931::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463426', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266178', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034577', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387086', 'lastCheck': '7.6', 'valid': True}}
>Thread-4923::DEBUG::2014-04-10 18:33:58,931::task::1168::TaskManager.Task::(prepare) Task=`71786057-4f74-491a-82b1-0d06d178390a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463426', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266178', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034577', 'lastCheck': '7.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387086', 'lastCheck': '7.6', 'valid': True}}
>Thread-4923::DEBUG::2014-04-10 18:33:58,931::task::579::TaskManager.Task::(_updateState) Task=`71786057-4f74-491a-82b1-0d06d178390a`::moving from state preparing -> state finished
>Thread-4923::DEBUG::2014-04-10 18:33:58,931::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4923::DEBUG::2014-04-10 18:33:58,931::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4923::DEBUG::2014-04-10 18:33:58,931::task::974::TaskManager.Task::(_decref) Task=`71786057-4f74-491a-82b1-0d06d178390a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:01,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:01,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317334 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:01,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:01,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000363438 s, 1.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:01,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:01,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000459438 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:01,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:01,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000377811 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4926::DEBUG::2014-04-10 18:34:04,730::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4926::DEBUG::2014-04-10 18:34:04,731::task::579::TaskManager.Task::(_updateState) Task=`7f05defd-4ab9-4949-a20e-6108f02586b4`::moving from state init -> state preparing
>Thread-4926::INFO::2014-04-10 18:34:04,731::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4926::INFO::2014-04-10 18:34:04,731::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4926::DEBUG::2014-04-10 18:34:04,731::task::1168::TaskManager.Task::(prepare) Task=`7f05defd-4ab9-4949-a20e-6108f02586b4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4926::DEBUG::2014-04-10 18:34:04,732::task::579::TaskManager.Task::(_updateState) Task=`7f05defd-4ab9-4949-a20e-6108f02586b4`::moving from state preparing -> state finished
>Thread-4926::DEBUG::2014-04-10 18:34:04,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4926::DEBUG::2014-04-10 18:34:04,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4926::DEBUG::2014-04-10 18:34:04,732::task::974::TaskManager.Task::(_decref) Task=`7f05defd-4ab9-4949-a20e-6108f02586b4`::ref 0 aborting False
>Thread-4927::DEBUG::2014-04-10 18:34:04,739::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4927::DEBUG::2014-04-10 18:34:04,739::task::579::TaskManager.Task::(_updateState) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::moving from state init -> state preparing
>Thread-4927::INFO::2014-04-10 18:34:04,739::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4927::DEBUG::2014-04-10 18:34:04,740::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`86eeace0-ba6f-44b3-b81c-133d64c16eb6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4927::DEBUG::2014-04-10 18:34:04,740::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4927::DEBUG::2014-04-10 18:34:04,740::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4927::DEBUG::2014-04-10 18:34:04,740::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`86eeace0-ba6f-44b3-b81c-133d64c16eb6`::Granted request
>Thread-4927::DEBUG::2014-04-10 18:34:04,741::task::811::TaskManager.Task::(resourceAcquired) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4927::DEBUG::2014-04-10 18:34:04,741::task::974::TaskManager.Task::(_decref) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::ref 1 aborting False
>Thread-4927::INFO::2014-04-10 18:34:04,743::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4927::DEBUG::2014-04-10 18:34:04,743::task::1168::TaskManager.Task::(prepare) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4927::DEBUG::2014-04-10 18:34:04,743::task::579::TaskManager.Task::(_updateState) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::moving from state preparing -> state finished
>Thread-4927::DEBUG::2014-04-10 18:34:04,743::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4927::DEBUG::2014-04-10 18:34:04,743::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4927::DEBUG::2014-04-10 18:34:04,744::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4927::DEBUG::2014-04-10 18:34:04,744::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4927::DEBUG::2014-04-10 18:34:04,744::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4927::DEBUG::2014-04-10 18:34:04,744::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4927::DEBUG::2014-04-10 18:34:04,744::task::974::TaskManager.Task::(_decref) Task=`5b3db160-fa93-41b2-983f-efc560ec0d6a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:11,190::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:11,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361446 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:11,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:11,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000408413 s, 901 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:11,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:11,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000580215 s, 1.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:11,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:11,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368633 s, 1.8 MB/s\n'; <rc> = 0
>Thread-4931::DEBUG::2014-04-10 18:34:14,122::task::579::TaskManager.Task::(_updateState) Task=`dbcd1278-4c92-492b-b870-6185efaadd4f`::moving from state init -> state preparing
>Thread-4931::INFO::2014-04-10 18:34:14,123::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4931::INFO::2014-04-10 18:34:14,123::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580215', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361446', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368633', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408413', 'lastCheck': '2.7', 'valid': True}}
>Thread-4931::DEBUG::2014-04-10 18:34:14,123::task::1168::TaskManager.Task::(prepare) Task=`dbcd1278-4c92-492b-b870-6185efaadd4f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580215', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361446', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368633', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408413', 'lastCheck': '2.7', 'valid': True}}
>Thread-4931::DEBUG::2014-04-10 18:34:14,123::task::579::TaskManager.Task::(_updateState) Task=`dbcd1278-4c92-492b-b870-6185efaadd4f`::moving from state preparing -> state finished
>Thread-4931::DEBUG::2014-04-10 18:34:14,124::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4931::DEBUG::2014-04-10 18:34:14,124::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4931::DEBUG::2014-04-10 18:34:14,124::task::974::TaskManager.Task::(_decref) Task=`dbcd1278-4c92-492b-b870-6185efaadd4f`::ref 0 aborting False
>Thread-4933::DEBUG::2014-04-10 18:34:14,846::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4933::DEBUG::2014-04-10 18:34:14,846::task::579::TaskManager.Task::(_updateState) Task=`f7622343-41d3-456f-a19f-346dad21f15e`::moving from state init -> state preparing
>Thread-4933::INFO::2014-04-10 18:34:14,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4933::INFO::2014-04-10 18:34:14,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4933::DEBUG::2014-04-10 18:34:14,847::task::1168::TaskManager.Task::(prepare) Task=`f7622343-41d3-456f-a19f-346dad21f15e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4933::DEBUG::2014-04-10 18:34:14,847::task::579::TaskManager.Task::(_updateState) Task=`f7622343-41d3-456f-a19f-346dad21f15e`::moving from state preparing -> state finished
>Thread-4933::DEBUG::2014-04-10 18:34:14,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4933::DEBUG::2014-04-10 18:34:14,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4933::DEBUG::2014-04-10 18:34:14,848::task::974::TaskManager.Task::(_decref) Task=`f7622343-41d3-456f-a19f-346dad21f15e`::ref 0 aborting False
>Thread-4934::DEBUG::2014-04-10 18:34:14,855::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4934::DEBUG::2014-04-10 18:34:14,855::task::579::TaskManager.Task::(_updateState) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::moving from state init -> state preparing
>Thread-4934::INFO::2014-04-10 18:34:14,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4934::DEBUG::2014-04-10 18:34:14,856::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`10ebc7b7-f839-448b-9a7a-f3ad4832e986`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4934::DEBUG::2014-04-10 18:34:14,856::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4934::DEBUG::2014-04-10 18:34:14,856::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4934::DEBUG::2014-04-10 18:34:14,856::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`10ebc7b7-f839-448b-9a7a-f3ad4832e986`::Granted request
>Thread-4934::DEBUG::2014-04-10 18:34:14,857::task::811::TaskManager.Task::(resourceAcquired) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4934::DEBUG::2014-04-10 18:34:14,857::task::974::TaskManager.Task::(_decref) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::ref 1 aborting False
>Thread-4934::INFO::2014-04-10 18:34:14,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4934::DEBUG::2014-04-10 18:34:14,859::task::1168::TaskManager.Task::(prepare) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4934::DEBUG::2014-04-10 18:34:14,859::task::579::TaskManager.Task::(_updateState) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::moving from state preparing -> state finished
>Thread-4934::DEBUG::2014-04-10 18:34:14,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4934::DEBUG::2014-04-10 18:34:14,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4934::DEBUG::2014-04-10 18:34:14,859::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4934::DEBUG::2014-04-10 18:34:14,860::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4934::DEBUG::2014-04-10 18:34:14,860::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4934::DEBUG::2014-04-10 18:34:14,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4934::DEBUG::2014-04-10 18:34:14,860::task::974::TaskManager.Task::(_decref) Task=`34a94e41-ac5c-4743-88c7-5a975b1b4ec7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:21,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:21,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319644 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:21,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:21,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000458136 s, 803 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:21,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:21,597::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000430258 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:21,623::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:21,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356285 s, 1.9 MB/s\n'; <rc> = 0
>Thread-4938::DEBUG::2014-04-10 18:34:24,995::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4938::DEBUG::2014-04-10 18:34:24,996::task::579::TaskManager.Task::(_updateState) Task=`d2742b08-0644-489f-afe9-24bc873f3464`::moving from state init -> state preparing
>Thread-4938::INFO::2014-04-10 18:34:24,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4938::INFO::2014-04-10 18:34:24,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4938::DEBUG::2014-04-10 18:34:24,997::task::1168::TaskManager.Task::(prepare) Task=`d2742b08-0644-489f-afe9-24bc873f3464`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4938::DEBUG::2014-04-10 18:34:24,997::task::579::TaskManager.Task::(_updateState) Task=`d2742b08-0644-489f-afe9-24bc873f3464`::moving from state preparing -> state finished
>Thread-4938::DEBUG::2014-04-10 18:34:24,997::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4938::DEBUG::2014-04-10 18:34:24,997::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4938::DEBUG::2014-04-10 18:34:24,997::task::974::TaskManager.Task::(_decref) Task=`d2742b08-0644-489f-afe9-24bc873f3464`::ref 0 aborting False
>Thread-4939::DEBUG::2014-04-10 18:34:25,004::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1f5f93bd]
>Thread-4939::DEBUG::2014-04-10 18:34:25,004::task::579::TaskManager.Task::(_updateState) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::moving from state init -> state preparing
>Thread-4939::INFO::2014-04-10 18:34:25,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4939::DEBUG::2014-04-10 18:34:25,005::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3647d67-b8f9-4bfd-88d3-c376376ed888`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4939::DEBUG::2014-04-10 18:34:25,005::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4939::DEBUG::2014-04-10 18:34:25,005::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4939::DEBUG::2014-04-10 18:34:25,005::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3647d67-b8f9-4bfd-88d3-c376376ed888`::Granted request
>Thread-4939::DEBUG::2014-04-10 18:34:25,006::task::811::TaskManager.Task::(resourceAcquired) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4939::DEBUG::2014-04-10 18:34:25,006::task::974::TaskManager.Task::(_decref) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::ref 1 aborting False
>Thread-4939::INFO::2014-04-10 18:34:25,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::task::1168::TaskManager.Task::(prepare) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::task::579::TaskManager.Task::(_updateState) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::moving from state preparing -> state finished
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4939::DEBUG::2014-04-10 18:34:25,008::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4939::DEBUG::2014-04-10 18:34:25,009::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4939::DEBUG::2014-04-10 18:34:25,009::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4939::DEBUG::2014-04-10 18:34:25,009::task::974::TaskManager.Task::(_decref) Task=`95726cee-6508-41dc-a95e-f9a61ee9908b`::ref 0 aborting False
>Thread-4941::DEBUG::2014-04-10 18:34:29,289::task::579::TaskManager.Task::(_updateState) Task=`116a648c-2ff5-4937-abf8-5011b0bf91a5`::moving from state init -> state preparing
>Thread-4941::INFO::2014-04-10 18:34:29,289::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4941::INFO::2014-04-10 18:34:29,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430258', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319644', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356285', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458136', 'lastCheck': '7.9', 'valid': True}}
>Thread-4941::DEBUG::2014-04-10 18:34:29,290::task::1168::TaskManager.Task::(prepare) Task=`116a648c-2ff5-4937-abf8-5011b0bf91a5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430258', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319644', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356285', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458136', 'lastCheck': '7.9', 'valid': True}}
>Thread-4941::DEBUG::2014-04-10 18:34:29,290::task::579::TaskManager.Task::(_updateState) Task=`116a648c-2ff5-4937-abf8-5011b0bf91a5`::moving from state preparing -> state finished
>Thread-4941::DEBUG::2014-04-10 18:34:29,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4941::DEBUG::2014-04-10 18:34:29,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4941::DEBUG::2014-04-10 18:34:29,290::task::974::TaskManager.Task::(_decref) Task=`116a648c-2ff5-4937-abf8-5011b0bf91a5`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:31,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:31,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313497 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:31,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:31,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000525759 s, 700 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:31,607::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:31,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000449356 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:31,637::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:31,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000312829 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4944::DEBUG::2014-04-10 18:34:35,215::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4944::DEBUG::2014-04-10 18:34:35,216::task::579::TaskManager.Task::(_updateState) Task=`bf97b756-fdda-4d39-a5a7-3a3fbc264f63`::moving from state init -> state preparing
>Thread-4944::INFO::2014-04-10 18:34:35,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4944::INFO::2014-04-10 18:34:35,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4944::DEBUG::2014-04-10 18:34:35,216::task::1168::TaskManager.Task::(prepare) Task=`bf97b756-fdda-4d39-a5a7-3a3fbc264f63`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4944::DEBUG::2014-04-10 18:34:35,217::task::579::TaskManager.Task::(_updateState) Task=`bf97b756-fdda-4d39-a5a7-3a3fbc264f63`::moving from state preparing -> state finished
>Thread-4944::DEBUG::2014-04-10 18:34:35,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4944::DEBUG::2014-04-10 18:34:35,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4944::DEBUG::2014-04-10 18:34:35,217::task::974::TaskManager.Task::(_decref) Task=`bf97b756-fdda-4d39-a5a7-3a3fbc264f63`::ref 0 aborting False
>Thread-4945::DEBUG::2014-04-10 18:34:35,222::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4945::DEBUG::2014-04-10 18:34:35,223::task::579::TaskManager.Task::(_updateState) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::moving from state init -> state preparing
>Thread-4945::INFO::2014-04-10 18:34:35,223::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4945::DEBUG::2014-04-10 18:34:35,223::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31c51560-4d70-4d88-80dd-1e9a6627e080`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4945::DEBUG::2014-04-10 18:34:35,224::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4945::DEBUG::2014-04-10 18:34:35,224::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4945::DEBUG::2014-04-10 18:34:35,224::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31c51560-4d70-4d88-80dd-1e9a6627e080`::Granted request
>Thread-4945::DEBUG::2014-04-10 18:34:35,224::task::811::TaskManager.Task::(resourceAcquired) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4945::DEBUG::2014-04-10 18:34:35,224::task::974::TaskManager.Task::(_decref) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::ref 1 aborting False
>Thread-4945::INFO::2014-04-10 18:34:35,226::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4945::DEBUG::2014-04-10 18:34:35,226::task::1168::TaskManager.Task::(prepare) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::task::579::TaskManager.Task::(_updateState) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::moving from state preparing -> state finished
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4945::DEBUG::2014-04-10 18:34:35,227::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4945::DEBUG::2014-04-10 18:34:35,228::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4945::DEBUG::2014-04-10 18:34:35,228::task::974::TaskManager.Task::(_decref) Task=`91af150d-54ef-4a27-9b3b-0afbbc708927`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:41,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:41,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000285348 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:41,420::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:41,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00037241 s, 988 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:41,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:41,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000439138 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:41,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:41,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000231899 s, 2.9 MB/s\n'; <rc> = 0
>Thread-4949::DEBUG::2014-04-10 18:34:44,683::task::579::TaskManager.Task::(_updateState) Task=`48d8f6f1-6b06-408c-bdab-884b47e6ffa0`::moving from state init -> state preparing
>Thread-4949::INFO::2014-04-10 18:34:44,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4949::INFO::2014-04-10 18:34:44,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439138', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285348', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231899', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037241', 'lastCheck': '3.3', 'valid': True}}
>Thread-4949::DEBUG::2014-04-10 18:34:44,684::task::1168::TaskManager.Task::(prepare) Task=`48d8f6f1-6b06-408c-bdab-884b47e6ffa0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439138', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285348', 'lastCheck': '3.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000231899', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037241', 'lastCheck': '3.3', 'valid': True}}
>Thread-4949::DEBUG::2014-04-10 18:34:44,684::task::579::TaskManager.Task::(_updateState) Task=`48d8f6f1-6b06-408c-bdab-884b47e6ffa0`::moving from state preparing -> state finished
>Thread-4949::DEBUG::2014-04-10 18:34:44,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4949::DEBUG::2014-04-10 18:34:44,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4949::DEBUG::2014-04-10 18:34:44,685::task::974::TaskManager.Task::(_decref) Task=`48d8f6f1-6b06-408c-bdab-884b47e6ffa0`::ref 0 aborting False
>Thread-4951::DEBUG::2014-04-10 18:34:45,356::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4951::DEBUG::2014-04-10 18:34:45,357::task::579::TaskManager.Task::(_updateState) Task=`6fca795d-f222-4c53-8b64-fa407475352c`::moving from state init -> state preparing
>Thread-4951::INFO::2014-04-10 18:34:45,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4951::INFO::2014-04-10 18:34:45,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4951::DEBUG::2014-04-10 18:34:45,357::task::1168::TaskManager.Task::(prepare) Task=`6fca795d-f222-4c53-8b64-fa407475352c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4951::DEBUG::2014-04-10 18:34:45,358::task::579::TaskManager.Task::(_updateState) Task=`6fca795d-f222-4c53-8b64-fa407475352c`::moving from state preparing -> state finished
>Thread-4951::DEBUG::2014-04-10 18:34:45,358::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4951::DEBUG::2014-04-10 18:34:45,358::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4951::DEBUG::2014-04-10 18:34:45,358::task::974::TaskManager.Task::(_decref) Task=`6fca795d-f222-4c53-8b64-fa407475352c`::ref 0 aborting False
>Thread-4952::DEBUG::2014-04-10 18:34:45,364::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4952::DEBUG::2014-04-10 18:34:45,364::task::579::TaskManager.Task::(_updateState) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::moving from state init -> state preparing
>Thread-4952::INFO::2014-04-10 18:34:45,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4952::DEBUG::2014-04-10 18:34:45,365::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff81233b-7806-4326-ba59-9e1fc77b7380`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4952::DEBUG::2014-04-10 18:34:45,365::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4952::DEBUG::2014-04-10 18:34:45,365::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4952::DEBUG::2014-04-10 18:34:45,366::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff81233b-7806-4326-ba59-9e1fc77b7380`::Granted request
>Thread-4952::DEBUG::2014-04-10 18:34:45,366::task::811::TaskManager.Task::(resourceAcquired) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4952::DEBUG::2014-04-10 18:34:45,366::task::974::TaskManager.Task::(_decref) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::ref 1 aborting False
>Thread-4952::INFO::2014-04-10 18:34:45,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4952::DEBUG::2014-04-10 18:34:45,368::task::1168::TaskManager.Task::(prepare) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081809920', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4952::DEBUG::2014-04-10 18:34:45,368::task::579::TaskManager.Task::(_updateState) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::moving from state preparing -> state finished
>Thread-4952::DEBUG::2014-04-10 18:34:45,368::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4952::DEBUG::2014-04-10 18:34:45,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4952::DEBUG::2014-04-10 18:34:45,369::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4952::DEBUG::2014-04-10 18:34:45,369::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4952::DEBUG::2014-04-10 18:34:45,369::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4952::DEBUG::2014-04-10 18:34:45,369::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4952::DEBUG::2014-04-10 18:34:45,369::task::974::TaskManager.Task::(_decref) Task=`34ae82c1-5a74-40e2-bf52-759cdee9aaa1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:34:51,256::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:34:51,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347735 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:34:51,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:34:51,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00049045 s, 750 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:34:51,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:34:51,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000523379 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:34:51,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:34:51,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329143 s, 2.0 MB/s\n'; <rc> = 0
>Thread-4956::DEBUG::2014-04-10 18:34:55,442::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4956::DEBUG::2014-04-10 18:34:55,443::task::579::TaskManager.Task::(_updateState) Task=`753962f7-61f3-4cf9-b3b1-b2e9bd3f8811`::moving from state init -> state preparing
>Thread-4956::INFO::2014-04-10 18:34:55,443::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4956::INFO::2014-04-10 18:34:55,443::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4956::DEBUG::2014-04-10 18:34:55,443::task::1168::TaskManager.Task::(prepare) Task=`753962f7-61f3-4cf9-b3b1-b2e9bd3f8811`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4956::DEBUG::2014-04-10 18:34:55,443::task::579::TaskManager.Task::(_updateState) Task=`753962f7-61f3-4cf9-b3b1-b2e9bd3f8811`::moving from state preparing -> state finished
>Thread-4956::DEBUG::2014-04-10 18:34:55,444::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4956::DEBUG::2014-04-10 18:34:55,444::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4956::DEBUG::2014-04-10 18:34:55,444::task::974::TaskManager.Task::(_decref) Task=`753962f7-61f3-4cf9-b3b1-b2e9bd3f8811`::ref 0 aborting False
>Thread-4957::DEBUG::2014-04-10 18:34:55,450::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4957::DEBUG::2014-04-10 18:34:55,451::task::579::TaskManager.Task::(_updateState) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::moving from state init -> state preparing
>Thread-4957::INFO::2014-04-10 18:34:55,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4957::DEBUG::2014-04-10 18:34:55,451::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a06691fe-bb87-4bb9-976c-ad625392a192`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4957::DEBUG::2014-04-10 18:34:55,452::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4957::DEBUG::2014-04-10 18:34:55,452::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4957::DEBUG::2014-04-10 18:34:55,452::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a06691fe-bb87-4bb9-976c-ad625392a192`::Granted request
>Thread-4957::DEBUG::2014-04-10 18:34:55,452::task::811::TaskManager.Task::(resourceAcquired) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4957::DEBUG::2014-04-10 18:34:55,452::task::974::TaskManager.Task::(_decref) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::ref 1 aborting False
>Thread-4957::INFO::2014-04-10 18:34:55,454::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4957::DEBUG::2014-04-10 18:34:55,454::task::1168::TaskManager.Task::(prepare) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::task::579::TaskManager.Task::(_updateState) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::moving from state preparing -> state finished
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4957::DEBUG::2014-04-10 18:34:55,455::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4957::DEBUG::2014-04-10 18:34:55,456::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4957::DEBUG::2014-04-10 18:34:55,456::task::974::TaskManager.Task::(_decref) Task=`997dac11-9ad9-4009-92dc-8bd812e7150b`::ref 0 aborting False
>Thread-4959::DEBUG::2014-04-10 18:35:00,257::task::579::TaskManager.Task::(_updateState) Task=`93c6c7c9-0cc3-4ddf-8d5d-a09dc8c1ec69`::moving from state init -> state preparing
>Thread-4959::INFO::2014-04-10 18:35:00,257::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4959::INFO::2014-04-10 18:35:00,257::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523379', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347735', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329143', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049045', 'lastCheck': '8.8', 'valid': True}}
>Thread-4959::DEBUG::2014-04-10 18:35:00,257::task::1168::TaskManager.Task::(prepare) Task=`93c6c7c9-0cc3-4ddf-8d5d-a09dc8c1ec69`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523379', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347735', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329143', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049045', 'lastCheck': '8.8', 'valid': True}}
>Thread-4959::DEBUG::2014-04-10 18:35:00,258::task::579::TaskManager.Task::(_updateState) Task=`93c6c7c9-0cc3-4ddf-8d5d-a09dc8c1ec69`::moving from state preparing -> state finished
>Thread-4959::DEBUG::2014-04-10 18:35:00,258::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4959::DEBUG::2014-04-10 18:35:00,258::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4959::DEBUG::2014-04-10 18:35:00,258::task::974::TaskManager.Task::(_decref) Task=`93c6c7c9-0cc3-4ddf-8d5d-a09dc8c1ec69`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:01,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:01,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031736 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:01,450::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:01,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489918 s, 751 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:01,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:01,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000598998 s, 1.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:01,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:01,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283728 s, 2.4 MB/s\n'; <rc> = 0
>Thread-4962::DEBUG::2014-04-10 18:35:05,555::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4962::DEBUG::2014-04-10 18:35:05,561::task::579::TaskManager.Task::(_updateState) Task=`0092c853-0378-4df4-a6d9-7a584158ebeb`::moving from state init -> state preparing
>Thread-4962::INFO::2014-04-10 18:35:05,561::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4962::INFO::2014-04-10 18:35:05,562::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4962::DEBUG::2014-04-10 18:35:05,562::task::1168::TaskManager.Task::(prepare) Task=`0092c853-0378-4df4-a6d9-7a584158ebeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4962::DEBUG::2014-04-10 18:35:05,562::task::579::TaskManager.Task::(_updateState) Task=`0092c853-0378-4df4-a6d9-7a584158ebeb`::moving from state preparing -> state finished
>Thread-4962::DEBUG::2014-04-10 18:35:05,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4962::DEBUG::2014-04-10 18:35:05,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4962::DEBUG::2014-04-10 18:35:05,563::task::974::TaskManager.Task::(_decref) Task=`0092c853-0378-4df4-a6d9-7a584158ebeb`::ref 0 aborting False
>Thread-4963::DEBUG::2014-04-10 18:35:05,572::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-4963::DEBUG::2014-04-10 18:35:05,572::task::579::TaskManager.Task::(_updateState) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::moving from state init -> state preparing
>Thread-4963::INFO::2014-04-10 18:35:05,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4963::DEBUG::2014-04-10 18:35:05,573::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0dc86be3-0198-434b-b9ac-865f3027d506`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4963::DEBUG::2014-04-10 18:35:05,573::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4963::DEBUG::2014-04-10 18:35:05,573::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4963::DEBUG::2014-04-10 18:35:05,573::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0dc86be3-0198-434b-b9ac-865f3027d506`::Granted request
>Thread-4963::DEBUG::2014-04-10 18:35:05,574::task::811::TaskManager.Task::(resourceAcquired) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4963::DEBUG::2014-04-10 18:35:05,574::task::974::TaskManager.Task::(_decref) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::ref 1 aborting False
>Thread-4963::INFO::2014-04-10 18:35:05,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4963::DEBUG::2014-04-10 18:35:05,576::task::1168::TaskManager.Task::(prepare) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4963::DEBUG::2014-04-10 18:35:05,576::task::579::TaskManager.Task::(_updateState) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::moving from state preparing -> state finished
>Thread-4963::DEBUG::2014-04-10 18:35:05,576::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4963::DEBUG::2014-04-10 18:35:05,576::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4963::DEBUG::2014-04-10 18:35:05,576::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4963::DEBUG::2014-04-10 18:35:05,577::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4963::DEBUG::2014-04-10 18:35:05,577::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4963::DEBUG::2014-04-10 18:35:05,577::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4963::DEBUG::2014-04-10 18:35:05,577::task::974::TaskManager.Task::(_decref) Task=`ccdf7645-9415-401c-bf2b-8524e5c6c230`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:11,289::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:11,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331914 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:11,465::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:11,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489201 s, 752 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:11,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:11,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000480212 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:11,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:11,714::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307293 s, 2.2 MB/s\n'; <rc> = 0
>Thread-4967::DEBUG::2014-04-10 18:35:15,629::task::579::TaskManager.Task::(_updateState) Task=`df1d989e-ca0b-4d40-aec9-bf16d30d1a0b`::moving from state init -> state preparing
>Thread-4967::INFO::2014-04-10 18:35:15,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4967::INFO::2014-04-10 18:35:15,629::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480212', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331914', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307293', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489201', 'lastCheck': '4.2', 'valid': True}}
>Thread-4967::DEBUG::2014-04-10 18:35:15,630::task::1168::TaskManager.Task::(prepare) Task=`df1d989e-ca0b-4d40-aec9-bf16d30d1a0b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480212', 'lastCheck': '4.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331914', 'lastCheck': '4.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307293', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489201', 'lastCheck': '4.2', 'valid': True}}
>Thread-4967::DEBUG::2014-04-10 18:35:15,630::task::579::TaskManager.Task::(_updateState) Task=`df1d989e-ca0b-4d40-aec9-bf16d30d1a0b`::moving from state preparing -> state finished
>Thread-4967::DEBUG::2014-04-10 18:35:15,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4967::DEBUG::2014-04-10 18:35:15,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4967::DEBUG::2014-04-10 18:35:15,630::task::974::TaskManager.Task::(_decref) Task=`df1d989e-ca0b-4d40-aec9-bf16d30d1a0b`::ref 0 aborting False
>Thread-4969::DEBUG::2014-04-10 18:35:16,812::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4969::DEBUG::2014-04-10 18:35:16,822::task::579::TaskManager.Task::(_updateState) Task=`eff2923c-178f-4c9d-b221-976ce74c5c2c`::moving from state init -> state preparing
>Thread-4969::INFO::2014-04-10 18:35:16,822::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4969::INFO::2014-04-10 18:35:16,822::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4969::DEBUG::2014-04-10 18:35:16,822::task::1168::TaskManager.Task::(prepare) Task=`eff2923c-178f-4c9d-b221-976ce74c5c2c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4969::DEBUG::2014-04-10 18:35:16,823::task::579::TaskManager.Task::(_updateState) Task=`eff2923c-178f-4c9d-b221-976ce74c5c2c`::moving from state preparing -> state finished
>Thread-4969::DEBUG::2014-04-10 18:35:16,823::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4969::DEBUG::2014-04-10 18:35:16,823::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4969::DEBUG::2014-04-10 18:35:16,824::task::974::TaskManager.Task::(_decref) Task=`eff2923c-178f-4c9d-b221-976ce74c5c2c`::ref 0 aborting False
>Thread-4970::DEBUG::2014-04-10 18:35:16,831::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4970::DEBUG::2014-04-10 18:35:16,831::task::579::TaskManager.Task::(_updateState) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::moving from state init -> state preparing
>Thread-4970::INFO::2014-04-10 18:35:16,832::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4970::DEBUG::2014-04-10 18:35:16,832::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c971ad01-67b6-4eb1-85c7-f6bf64ffbe28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4970::DEBUG::2014-04-10 18:35:16,832::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4970::DEBUG::2014-04-10 18:35:16,833::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4970::DEBUG::2014-04-10 18:35:16,833::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c971ad01-67b6-4eb1-85c7-f6bf64ffbe28`::Granted request
>Thread-4970::DEBUG::2014-04-10 18:35:16,833::task::811::TaskManager.Task::(resourceAcquired) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4970::DEBUG::2014-04-10 18:35:16,833::task::974::TaskManager.Task::(_decref) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::ref 1 aborting False
>Thread-4970::INFO::2014-04-10 18:35:16,836::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4970::DEBUG::2014-04-10 18:35:16,836::task::1168::TaskManager.Task::(prepare) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4970::DEBUG::2014-04-10 18:35:16,836::task::579::TaskManager.Task::(_updateState) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::moving from state preparing -> state finished
>Thread-4970::DEBUG::2014-04-10 18:35:16,836::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4970::DEBUG::2014-04-10 18:35:16,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4970::DEBUG::2014-04-10 18:35:16,837::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4970::DEBUG::2014-04-10 18:35:16,837::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4970::DEBUG::2014-04-10 18:35:16,837::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4970::DEBUG::2014-04-10 18:35:16,837::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4970::DEBUG::2014-04-10 18:35:16,838::task::974::TaskManager.Task::(_decref) Task=`bd115539-2d31-4fc6-816c-32eae26feea6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:21,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:21,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380161 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:21,481::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:21,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480094 s, 767 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:21,681::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:21,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00052541 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:21,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:21,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000315092 s, 2.1 MB/s\n'; <rc> = 0
>Thread-4974::DEBUG::2014-04-10 18:35:26,999::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4974::DEBUG::2014-04-10 18:35:27,000::task::579::TaskManager.Task::(_updateState) Task=`0ec7fb99-25a6-40b4-bf43-c9f9da08c5ce`::moving from state init -> state preparing
>Thread-4974::INFO::2014-04-10 18:35:27,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4974::INFO::2014-04-10 18:35:27,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4974::DEBUG::2014-04-10 18:35:27,001::task::1168::TaskManager.Task::(prepare) Task=`0ec7fb99-25a6-40b4-bf43-c9f9da08c5ce`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4974::DEBUG::2014-04-10 18:35:27,001::task::579::TaskManager.Task::(_updateState) Task=`0ec7fb99-25a6-40b4-bf43-c9f9da08c5ce`::moving from state preparing -> state finished
>Thread-4974::DEBUG::2014-04-10 18:35:27,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4974::DEBUG::2014-04-10 18:35:27,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4974::DEBUG::2014-04-10 18:35:27,002::task::974::TaskManager.Task::(_decref) Task=`0ec7fb99-25a6-40b4-bf43-c9f9da08c5ce`::ref 0 aborting False
>Thread-4975::DEBUG::2014-04-10 18:35:27,008::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4975::DEBUG::2014-04-10 18:35:27,008::task::579::TaskManager.Task::(_updateState) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::moving from state init -> state preparing
>Thread-4975::INFO::2014-04-10 18:35:27,009::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4975::DEBUG::2014-04-10 18:35:27,009::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f997fc2-a22b-4d74-8436-0e15d226d40e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4975::DEBUG::2014-04-10 18:35:27,009::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4975::DEBUG::2014-04-10 18:35:27,010::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4975::DEBUG::2014-04-10 18:35:27,010::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7f997fc2-a22b-4d74-8436-0e15d226d40e`::Granted request
>Thread-4975::DEBUG::2014-04-10 18:35:27,011::task::811::TaskManager.Task::(resourceAcquired) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4975::DEBUG::2014-04-10 18:35:27,011::task::974::TaskManager.Task::(_decref) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::ref 1 aborting False
>Thread-4975::INFO::2014-04-10 18:35:27,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4975::DEBUG::2014-04-10 18:35:27,013::task::1168::TaskManager.Task::(prepare) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4975::DEBUG::2014-04-10 18:35:27,014::task::579::TaskManager.Task::(_updateState) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::moving from state preparing -> state finished
>Thread-4975::DEBUG::2014-04-10 18:35:27,014::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4975::DEBUG::2014-04-10 18:35:27,014::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4975::DEBUG::2014-04-10 18:35:27,014::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4975::DEBUG::2014-04-10 18:35:27,014::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4975::DEBUG::2014-04-10 18:35:27,015::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4975::DEBUG::2014-04-10 18:35:27,015::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4975::DEBUG::2014-04-10 18:35:27,015::task::974::TaskManager.Task::(_decref) Task=`64193c27-ae1e-405e-99f6-af77e343bf1c`::ref 0 aborting False
>Thread-4977::DEBUG::2014-04-10 18:35:30,851::task::579::TaskManager.Task::(_updateState) Task=`de41c4b4-13be-4cb7-b88a-a27b8fd4da2f`::moving from state init -> state preparing
>Thread-4977::INFO::2014-04-10 18:35:30,852::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4977::INFO::2014-04-10 18:35:30,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052541', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380161', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315092', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480094', 'lastCheck': '9.4', 'valid': True}}
>Thread-4977::DEBUG::2014-04-10 18:35:30,852::task::1168::TaskManager.Task::(prepare) Task=`de41c4b4-13be-4cb7-b88a-a27b8fd4da2f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052541', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380161', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315092', 'lastCheck': '9.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480094', 'lastCheck': '9.4', 'valid': True}}
>Thread-4977::DEBUG::2014-04-10 18:35:30,852::task::579::TaskManager.Task::(_updateState) Task=`de41c4b4-13be-4cb7-b88a-a27b8fd4da2f`::moving from state preparing -> state finished
>Thread-4977::DEBUG::2014-04-10 18:35:30,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4977::DEBUG::2014-04-10 18:35:30,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4977::DEBUG::2014-04-10 18:35:30,853::task::974::TaskManager.Task::(_decref) Task=`de41c4b4-13be-4cb7-b88a-a27b8fd4da2f`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:31,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:31,329::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003028 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:31,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:31,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000477557 s, 771 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:31,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:31,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000410583 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:31,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:31,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332129 s, 2.0 MB/s\n'; <rc> = 0
>Thread-4981::DEBUG::2014-04-10 18:35:37,225::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4981::DEBUG::2014-04-10 18:35:37,226::task::579::TaskManager.Task::(_updateState) Task=`a8de1768-7693-4591-91f9-a0fc7efe825b`::moving from state init -> state preparing
>Thread-4981::INFO::2014-04-10 18:35:37,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4981::INFO::2014-04-10 18:35:37,227::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4981::DEBUG::2014-04-10 18:35:37,227::task::1168::TaskManager.Task::(prepare) Task=`a8de1768-7693-4591-91f9-a0fc7efe825b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4981::DEBUG::2014-04-10 18:35:37,227::task::579::TaskManager.Task::(_updateState) Task=`a8de1768-7693-4591-91f9-a0fc7efe825b`::moving from state preparing -> state finished
>Thread-4981::DEBUG::2014-04-10 18:35:37,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4981::DEBUG::2014-04-10 18:35:37,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4981::DEBUG::2014-04-10 18:35:37,227::task::974::TaskManager.Task::(_decref) Task=`a8de1768-7693-4591-91f9-a0fc7efe825b`::ref 0 aborting False
>Thread-4982::DEBUG::2014-04-10 18:35:37,234::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4982::DEBUG::2014-04-10 18:35:37,235::task::579::TaskManager.Task::(_updateState) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::moving from state init -> state preparing
>Thread-4982::INFO::2014-04-10 18:35:37,235::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4982::DEBUG::2014-04-10 18:35:37,235::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5ebd5571-c0a0-4460-982d-613b70037402`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4982::DEBUG::2014-04-10 18:35:37,236::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4982::DEBUG::2014-04-10 18:35:37,236::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4982::DEBUG::2014-04-10 18:35:37,236::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5ebd5571-c0a0-4460-982d-613b70037402`::Granted request
>Thread-4982::DEBUG::2014-04-10 18:35:37,237::task::811::TaskManager.Task::(resourceAcquired) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4982::DEBUG::2014-04-10 18:35:37,237::task::974::TaskManager.Task::(_decref) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::ref 1 aborting False
>Thread-4982::INFO::2014-04-10 18:35:37,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4982::DEBUG::2014-04-10 18:35:37,239::task::1168::TaskManager.Task::(prepare) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4982::DEBUG::2014-04-10 18:35:37,239::task::579::TaskManager.Task::(_updateState) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::moving from state preparing -> state finished
>Thread-4982::DEBUG::2014-04-10 18:35:37,239::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4982::DEBUG::2014-04-10 18:35:37,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4982::DEBUG::2014-04-10 18:35:37,240::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4982::DEBUG::2014-04-10 18:35:37,240::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4982::DEBUG::2014-04-10 18:35:37,240::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4982::DEBUG::2014-04-10 18:35:37,240::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4982::DEBUG::2014-04-10 18:35:37,241::task::974::TaskManager.Task::(_decref) Task=`fc2d3472-10dd-47df-9e5d-2b4c20f14137`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:41,333::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:35:41,349::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:35:41,350::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:35:41,355::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:35:41,356::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:35:41,356::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:35:41,356::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:35:41,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:41,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00022644 s, 3.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:41,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:41,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484976 s, 759 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:41,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:41,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000425896 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:41,749::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:35:41,765::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:35:41,766::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:35:41,771::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:35:41,772::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:35:41,773::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:35:41,773::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:35:41,778::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:41,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267992 s, 2.5 MB/s\n'; <rc> = 0
>Thread-4993::DEBUG::2014-04-10 18:35:46,108::task::579::TaskManager.Task::(_updateState) Task=`d611920d-3b4a-4a17-bd8f-3c4b32e64d72`::moving from state init -> state preparing
>Thread-4993::INFO::2014-04-10 18:35:46,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-4993::INFO::2014-04-10 18:35:46,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425896', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022644', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267992', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484976', 'lastCheck': '4.6', 'valid': True}}
>Thread-4993::DEBUG::2014-04-10 18:35:46,108::task::1168::TaskManager.Task::(prepare) Task=`d611920d-3b4a-4a17-bd8f-3c4b32e64d72`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425896', 'lastCheck': '4.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022644', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267992', 'lastCheck': '4.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484976', 'lastCheck': '4.6', 'valid': True}}
>Thread-4993::DEBUG::2014-04-10 18:35:46,109::task::579::TaskManager.Task::(_updateState) Task=`d611920d-3b4a-4a17-bd8f-3c4b32e64d72`::moving from state preparing -> state finished
>Thread-4993::DEBUG::2014-04-10 18:35:46,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4993::DEBUG::2014-04-10 18:35:46,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4993::DEBUG::2014-04-10 18:35:46,109::task::974::TaskManager.Task::(_decref) Task=`d611920d-3b4a-4a17-bd8f-3c4b32e64d72`::ref 0 aborting False
>Thread-4995::DEBUG::2014-04-10 18:35:47,316::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4995::DEBUG::2014-04-10 18:35:47,316::task::579::TaskManager.Task::(_updateState) Task=`4cede9ea-bb4e-4b06-8668-749471ab790d`::moving from state init -> state preparing
>Thread-4995::INFO::2014-04-10 18:35:47,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4995::INFO::2014-04-10 18:35:47,317::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4995::DEBUG::2014-04-10 18:35:47,317::task::1168::TaskManager.Task::(prepare) Task=`4cede9ea-bb4e-4b06-8668-749471ab790d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-4995::DEBUG::2014-04-10 18:35:47,317::task::579::TaskManager.Task::(_updateState) Task=`4cede9ea-bb4e-4b06-8668-749471ab790d`::moving from state preparing -> state finished
>Thread-4995::DEBUG::2014-04-10 18:35:47,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-4995::DEBUG::2014-04-10 18:35:47,317::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4995::DEBUG::2014-04-10 18:35:47,318::task::974::TaskManager.Task::(_decref) Task=`4cede9ea-bb4e-4b06-8668-749471ab790d`::ref 0 aborting False
>Thread-4996::DEBUG::2014-04-10 18:35:47,324::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-4996::DEBUG::2014-04-10 18:35:47,325::task::579::TaskManager.Task::(_updateState) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::moving from state init -> state preparing
>Thread-4996::INFO::2014-04-10 18:35:47,325::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-4996::DEBUG::2014-04-10 18:35:47,326::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`95eac5d7-b469-4e7c-990a-e9fbc978fc75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-4996::DEBUG::2014-04-10 18:35:47,326::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-4996::DEBUG::2014-04-10 18:35:47,326::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-4996::DEBUG::2014-04-10 18:35:47,326::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`95eac5d7-b469-4e7c-990a-e9fbc978fc75`::Granted request
>Thread-4996::DEBUG::2014-04-10 18:35:47,326::task::811::TaskManager.Task::(resourceAcquired) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-4996::DEBUG::2014-04-10 18:35:47,327::task::974::TaskManager.Task::(_decref) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::ref 1 aborting False
>Thread-4996::INFO::2014-04-10 18:35:47,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4996::DEBUG::2014-04-10 18:35:47,329::task::1168::TaskManager.Task::(prepare) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-4996::DEBUG::2014-04-10 18:35:47,329::task::579::TaskManager.Task::(_updateState) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::moving from state preparing -> state finished
>Thread-4996::DEBUG::2014-04-10 18:35:47,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-4996::DEBUG::2014-04-10 18:35:47,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-4996::DEBUG::2014-04-10 18:35:47,329::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-4996::DEBUG::2014-04-10 18:35:47,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-4996::DEBUG::2014-04-10 18:35:47,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-4996::DEBUG::2014-04-10 18:35:47,330::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-4996::DEBUG::2014-04-10 18:35:47,330::task::974::TaskManager.Task::(_decref) Task=`2ffdac7e-d3c7-4ae1-b95b-238031f26069`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:35:51,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:35:51,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273904 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:35:51,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:35:51,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000560189 s, 657 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:35:51,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:35:51,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000434893 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:35:51,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:35:51,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269803 s, 2.5 MB/s\n'; <rc> = 0
>Thread-5000::DEBUG::2014-04-10 18:35:57,624::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5000::DEBUG::2014-04-10 18:35:57,624::task::579::TaskManager.Task::(_updateState) Task=`8c1a0f50-eb03-407b-8b55-e71b066d6344`::moving from state init -> state preparing
>Thread-5000::INFO::2014-04-10 18:35:57,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5000::INFO::2014-04-10 18:35:57,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5000::DEBUG::2014-04-10 18:35:57,625::task::1168::TaskManager.Task::(prepare) Task=`8c1a0f50-eb03-407b-8b55-e71b066d6344`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5000::DEBUG::2014-04-10 18:35:57,625::task::579::TaskManager.Task::(_updateState) Task=`8c1a0f50-eb03-407b-8b55-e71b066d6344`::moving from state preparing -> state finished
>Thread-5000::DEBUG::2014-04-10 18:35:57,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5000::DEBUG::2014-04-10 18:35:57,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5000::DEBUG::2014-04-10 18:35:57,626::task::974::TaskManager.Task::(_decref) Task=`8c1a0f50-eb03-407b-8b55-e71b066d6344`::ref 0 aborting False
>Thread-5001::DEBUG::2014-04-10 18:35:57,633::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5001::DEBUG::2014-04-10 18:35:57,633::task::579::TaskManager.Task::(_updateState) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::moving from state init -> state preparing
>Thread-5001::INFO::2014-04-10 18:35:57,634::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5001::DEBUG::2014-04-10 18:35:57,634::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`526e3c1d-db42-4360-81ff-0e788a319b75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5001::DEBUG::2014-04-10 18:35:57,634::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5001::DEBUG::2014-04-10 18:35:57,635::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5001::DEBUG::2014-04-10 18:35:57,635::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`526e3c1d-db42-4360-81ff-0e788a319b75`::Granted request
>Thread-5001::DEBUG::2014-04-10 18:35:57,635::task::811::TaskManager.Task::(resourceAcquired) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5001::DEBUG::2014-04-10 18:35:57,635::task::974::TaskManager.Task::(_decref) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::ref 1 aborting False
>Thread-5001::INFO::2014-04-10 18:35:57,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5001::DEBUG::2014-04-10 18:35:57,638::task::1168::TaskManager.Task::(prepare) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5001::DEBUG::2014-04-10 18:35:57,638::task::579::TaskManager.Task::(_updateState) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::moving from state preparing -> state finished
>Thread-5001::DEBUG::2014-04-10 18:35:57,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5001::DEBUG::2014-04-10 18:35:57,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5001::DEBUG::2014-04-10 18:35:57,639::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5001::DEBUG::2014-04-10 18:35:57,639::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5001::DEBUG::2014-04-10 18:35:57,639::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5001::DEBUG::2014-04-10 18:35:57,639::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5001::DEBUG::2014-04-10 18:35:57,639::task::974::TaskManager.Task::(_decref) Task=`2b8b514c-5760-40be-b0bf-bc973dbd404e`::ref 0 aborting False
>Thread-5003::DEBUG::2014-04-10 18:36:01,387::task::579::TaskManager.Task::(_updateState) Task=`d1aebbab-bed3-4e48-b8b9-c051c345928b`::moving from state init -> state preparing
>Thread-5003::INFO::2014-04-10 18:36:01,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5003::INFO::2014-04-10 18:36:01,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434893', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273904', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269803', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560189', 'lastCheck': '9.9', 'valid': True}}
>Thread-5003::DEBUG::2014-04-10 18:36:01,387::task::1168::TaskManager.Task::(prepare) Task=`d1aebbab-bed3-4e48-b8b9-c051c345928b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434893', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000273904', 'lastCheck': '10.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269803', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560189', 'lastCheck': '9.9', 'valid': True}}
>Thread-5003::DEBUG::2014-04-10 18:36:01,388::task::579::TaskManager.Task::(_updateState) Task=`d1aebbab-bed3-4e48-b8b9-c051c345928b`::moving from state preparing -> state finished
>Thread-5003::DEBUG::2014-04-10 18:36:01,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5003::DEBUG::2014-04-10 18:36:01,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5003::DEBUG::2014-04-10 18:36:01,388::task::974::TaskManager.Task::(_decref) Task=`d1aebbab-bed3-4e48-b8b9-c051c345928b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:01,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:01,418::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317281 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:01,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:01,546::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000472684 s, 779 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:01,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:01,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000479117 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:36:01,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:01,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031604 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5007::DEBUG::2014-04-10 18:36:07,846::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5007::DEBUG::2014-04-10 18:36:07,847::task::579::TaskManager.Task::(_updateState) Task=`09b4eef6-f648-4d2b-b021-5bf6a47b5fe3`::moving from state init -> state preparing
>Thread-5007::INFO::2014-04-10 18:36:07,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5007::INFO::2014-04-10 18:36:07,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5007::DEBUG::2014-04-10 18:36:07,847::task::1168::TaskManager.Task::(prepare) Task=`09b4eef6-f648-4d2b-b021-5bf6a47b5fe3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5007::DEBUG::2014-04-10 18:36:07,848::task::579::TaskManager.Task::(_updateState) Task=`09b4eef6-f648-4d2b-b021-5bf6a47b5fe3`::moving from state preparing -> state finished
>Thread-5007::DEBUG::2014-04-10 18:36:07,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5007::DEBUG::2014-04-10 18:36:07,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5007::DEBUG::2014-04-10 18:36:07,848::task::974::TaskManager.Task::(_decref) Task=`09b4eef6-f648-4d2b-b021-5bf6a47b5fe3`::ref 0 aborting False
>Thread-5008::DEBUG::2014-04-10 18:36:07,855::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5008::DEBUG::2014-04-10 18:36:07,855::task::579::TaskManager.Task::(_updateState) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::moving from state init -> state preparing
>Thread-5008::INFO::2014-04-10 18:36:07,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5008::DEBUG::2014-04-10 18:36:07,856::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7cecc38-28f5-4fed-94e6-a70a969f64a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5008::DEBUG::2014-04-10 18:36:07,856::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5008::DEBUG::2014-04-10 18:36:07,856::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5008::DEBUG::2014-04-10 18:36:07,856::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7cecc38-28f5-4fed-94e6-a70a969f64a1`::Granted request
>Thread-5008::DEBUG::2014-04-10 18:36:07,858::task::811::TaskManager.Task::(resourceAcquired) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5008::DEBUG::2014-04-10 18:36:07,858::task::974::TaskManager.Task::(_decref) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::ref 1 aborting False
>Thread-5008::INFO::2014-04-10 18:36:07,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5008::DEBUG::2014-04-10 18:36:07,860::task::1168::TaskManager.Task::(prepare) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5008::DEBUG::2014-04-10 18:36:07,861::task::579::TaskManager.Task::(_updateState) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::moving from state preparing -> state finished
>Thread-5008::DEBUG::2014-04-10 18:36:07,861::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5008::DEBUG::2014-04-10 18:36:07,861::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5008::DEBUG::2014-04-10 18:36:07,861::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5008::DEBUG::2014-04-10 18:36:07,861::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5008::DEBUG::2014-04-10 18:36:07,862::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5008::DEBUG::2014-04-10 18:36:07,862::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5008::DEBUG::2014-04-10 18:36:07,862::task::974::TaskManager.Task::(_decref) Task=`685df9b7-d466-4fa2-a86a-35abc5e64d3c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:11,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:11,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295523 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:11,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:11,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000567963 s, 648 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:11,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:11,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464283 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:36:11,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:11,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033219 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5011::DEBUG::2014-04-10 18:36:16,640::task::579::TaskManager.Task::(_updateState) Task=`069ca7bd-ec00-47a0-a979-564fe124142a`::moving from state init -> state preparing
>Thread-5011::INFO::2014-04-10 18:36:16,640::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5011::INFO::2014-04-10 18:36:16,641::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464283', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295523', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033219', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567963', 'lastCheck': '5.1', 'valid': True}}
>Thread-5011::DEBUG::2014-04-10 18:36:16,641::task::1168::TaskManager.Task::(prepare) Task=`069ca7bd-ec00-47a0-a979-564fe124142a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464283', 'lastCheck': '4.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295523', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00033219', 'lastCheck': '4.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567963', 'lastCheck': '5.1', 'valid': True}}
>Thread-5011::DEBUG::2014-04-10 18:36:16,641::task::579::TaskManager.Task::(_updateState) Task=`069ca7bd-ec00-47a0-a979-564fe124142a`::moving from state preparing -> state finished
>Thread-5011::DEBUG::2014-04-10 18:36:16,641::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5011::DEBUG::2014-04-10 18:36:16,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5011::DEBUG::2014-04-10 18:36:16,642::task::974::TaskManager.Task::(_decref) Task=`069ca7bd-ec00-47a0-a979-564fe124142a`::ref 0 aborting False
>Thread-5013::DEBUG::2014-04-10 18:36:17,936::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5013::DEBUG::2014-04-10 18:36:17,936::task::579::TaskManager.Task::(_updateState) Task=`deb8f7fb-fef8-44b7-ac43-f682df292f8e`::moving from state init -> state preparing
>Thread-5013::INFO::2014-04-10 18:36:17,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5013::INFO::2014-04-10 18:36:17,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5013::DEBUG::2014-04-10 18:36:17,937::task::1168::TaskManager.Task::(prepare) Task=`deb8f7fb-fef8-44b7-ac43-f682df292f8e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5013::DEBUG::2014-04-10 18:36:17,937::task::579::TaskManager.Task::(_updateState) Task=`deb8f7fb-fef8-44b7-ac43-f682df292f8e`::moving from state preparing -> state finished
>Thread-5013::DEBUG::2014-04-10 18:36:17,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5013::DEBUG::2014-04-10 18:36:17,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5013::DEBUG::2014-04-10 18:36:17,938::task::974::TaskManager.Task::(_decref) Task=`deb8f7fb-fef8-44b7-ac43-f682df292f8e`::ref 0 aborting False
>Thread-5014::DEBUG::2014-04-10 18:36:17,944::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5014::DEBUG::2014-04-10 18:36:17,944::task::579::TaskManager.Task::(_updateState) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::moving from state init -> state preparing
>Thread-5014::INFO::2014-04-10 18:36:17,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5014::DEBUG::2014-04-10 18:36:17,945::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f46b07-dcc1-45d9-870b-f6c56aa01094`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5014::DEBUG::2014-04-10 18:36:17,945::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5014::DEBUG::2014-04-10 18:36:17,945::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5014::DEBUG::2014-04-10 18:36:17,945::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9f46b07-dcc1-45d9-870b-f6c56aa01094`::Granted request
>Thread-5014::DEBUG::2014-04-10 18:36:17,946::task::811::TaskManager.Task::(resourceAcquired) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5014::DEBUG::2014-04-10 18:36:17,946::task::974::TaskManager.Task::(_decref) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::ref 1 aborting False
>Thread-5014::INFO::2014-04-10 18:36:17,948::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5014::DEBUG::2014-04-10 18:36:17,948::task::1168::TaskManager.Task::(prepare) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5014::DEBUG::2014-04-10 18:36:17,948::task::579::TaskManager.Task::(_updateState) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::moving from state preparing -> state finished
>Thread-5014::DEBUG::2014-04-10 18:36:17,948::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5014::DEBUG::2014-04-10 18:36:17,948::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5014::DEBUG::2014-04-10 18:36:17,949::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5014::DEBUG::2014-04-10 18:36:17,949::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5014::DEBUG::2014-04-10 18:36:17,949::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5014::DEBUG::2014-04-10 18:36:17,949::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5014::DEBUG::2014-04-10 18:36:17,949::task::974::TaskManager.Task::(_decref) Task=`5c487a00-690f-4de4-bd67-96ea3ce11a2a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:21,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:21,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277134 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:21,570::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:21,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00046089 s, 798 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:21,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:21,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000468824 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:36:21,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:21,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000275422 s, 2.4 MB/s\n'; <rc> = 0
>Thread-5018::DEBUG::2014-04-10 18:36:28,028::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-5018::DEBUG::2014-04-10 18:36:28,028::task::579::TaskManager.Task::(_updateState) Task=`df82b6da-dba5-4ca7-a44c-d36e3b72c763`::moving from state init -> state preparing
>Thread-5018::INFO::2014-04-10 18:36:28,029::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5018::INFO::2014-04-10 18:36:28,029::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5018::DEBUG::2014-04-10 18:36:28,029::task::1168::TaskManager.Task::(prepare) Task=`df82b6da-dba5-4ca7-a44c-d36e3b72c763`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5018::DEBUG::2014-04-10 18:36:28,029::task::579::TaskManager.Task::(_updateState) Task=`df82b6da-dba5-4ca7-a44c-d36e3b72c763`::moving from state preparing -> state finished
>Thread-5018::DEBUG::2014-04-10 18:36:28,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5018::DEBUG::2014-04-10 18:36:28,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5018::DEBUG::2014-04-10 18:36:28,030::task::974::TaskManager.Task::(_decref) Task=`df82b6da-dba5-4ca7-a44c-d36e3b72c763`::ref 0 aborting False
>Thread-5019::DEBUG::2014-04-10 18:36:28,046::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45e79bf3]
>Thread-5019::DEBUG::2014-04-10 18:36:28,046::task::579::TaskManager.Task::(_updateState) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::moving from state init -> state preparing
>Thread-5019::INFO::2014-04-10 18:36:28,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5019::DEBUG::2014-04-10 18:36:28,047::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8efdc906-8d8a-4a73-b0ce-24651960a51d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5019::DEBUG::2014-04-10 18:36:28,047::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5019::DEBUG::2014-04-10 18:36:28,048::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5019::DEBUG::2014-04-10 18:36:28,048::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8efdc906-8d8a-4a73-b0ce-24651960a51d`::Granted request
>Thread-5019::DEBUG::2014-04-10 18:36:28,048::task::811::TaskManager.Task::(resourceAcquired) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5019::DEBUG::2014-04-10 18:36:28,048::task::974::TaskManager.Task::(_decref) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::ref 1 aborting False
>Thread-5019::INFO::2014-04-10 18:36:28,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5019::DEBUG::2014-04-10 18:36:28,051::task::1168::TaskManager.Task::(prepare) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5019::DEBUG::2014-04-10 18:36:28,051::task::579::TaskManager.Task::(_updateState) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::moving from state preparing -> state finished
>Thread-5019::DEBUG::2014-04-10 18:36:28,051::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5019::DEBUG::2014-04-10 18:36:28,051::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5019::DEBUG::2014-04-10 18:36:28,052::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5019::DEBUG::2014-04-10 18:36:28,052::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5019::DEBUG::2014-04-10 18:36:28,052::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5019::DEBUG::2014-04-10 18:36:28,052::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5019::DEBUG::2014-04-10 18:36:28,052::task::974::TaskManager.Task::(_decref) Task=`9642a2d3-5aac-4e03-8881-70d5b59128dd`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:31,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:31,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330926 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:31,585::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:31,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000623652 s, 590 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:31,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:31,788::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000465374 s, 1.4 MB/s\n'; <rc> = 0
>Thread-5021::DEBUG::2014-04-10 18:36:31,814::task::579::TaskManager.Task::(_updateState) Task=`3e06e635-8f41-4593-8832-c085a1800e87`::moving from state init -> state preparing
>Thread-5021::INFO::2014-04-10 18:36:31,814::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5021::INFO::2014-04-10 18:36:31,815::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465374', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330926', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275422', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623652', 'lastCheck': '0.2', 'valid': True}}
>Thread-5021::DEBUG::2014-04-10 18:36:31,815::task::1168::TaskManager.Task::(prepare) Task=`3e06e635-8f41-4593-8832-c085a1800e87`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465374', 'lastCheck': '0.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330926', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000275422', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623652', 'lastCheck': '0.2', 'valid': True}}
>Thread-5021::DEBUG::2014-04-10 18:36:31,815::task::579::TaskManager.Task::(_updateState) Task=`3e06e635-8f41-4593-8832-c085a1800e87`::moving from state preparing -> state finished
>Thread-5021::DEBUG::2014-04-10 18:36:31,815::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5021::DEBUG::2014-04-10 18:36:31,815::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5021::DEBUG::2014-04-10 18:36:31,816::task::974::TaskManager.Task::(_decref) Task=`3e06e635-8f41-4593-8832-c085a1800e87`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:36:31,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:31,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334349 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5025::DEBUG::2014-04-10 18:36:38,149::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5025::DEBUG::2014-04-10 18:36:38,149::task::579::TaskManager.Task::(_updateState) Task=`11b87feb-08fc-4445-b495-63ce75280df2`::moving from state init -> state preparing
>Thread-5025::INFO::2014-04-10 18:36:38,150::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5025::INFO::2014-04-10 18:36:38,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5025::DEBUG::2014-04-10 18:36:38,150::task::1168::TaskManager.Task::(prepare) Task=`11b87feb-08fc-4445-b495-63ce75280df2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5025::DEBUG::2014-04-10 18:36:38,150::task::579::TaskManager.Task::(_updateState) Task=`11b87feb-08fc-4445-b495-63ce75280df2`::moving from state preparing -> state finished
>Thread-5025::DEBUG::2014-04-10 18:36:38,150::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5025::DEBUG::2014-04-10 18:36:38,151::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5025::DEBUG::2014-04-10 18:36:38,151::task::974::TaskManager.Task::(_decref) Task=`11b87feb-08fc-4445-b495-63ce75280df2`::ref 0 aborting False
>Thread-5026::DEBUG::2014-04-10 18:36:38,157::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5026::DEBUG::2014-04-10 18:36:38,157::task::579::TaskManager.Task::(_updateState) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::moving from state init -> state preparing
>Thread-5026::INFO::2014-04-10 18:36:38,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5026::DEBUG::2014-04-10 18:36:38,159::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b684c9b1-350d-4e3f-a7a2-6654ed064940`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5026::DEBUG::2014-04-10 18:36:38,159::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5026::DEBUG::2014-04-10 18:36:38,159::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5026::DEBUG::2014-04-10 18:36:38,159::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b684c9b1-350d-4e3f-a7a2-6654ed064940`::Granted request
>Thread-5026::DEBUG::2014-04-10 18:36:38,160::task::811::TaskManager.Task::(resourceAcquired) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5026::DEBUG::2014-04-10 18:36:38,160::task::974::TaskManager.Task::(_decref) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::ref 1 aborting False
>Thread-5026::INFO::2014-04-10 18:36:38,162::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5026::DEBUG::2014-04-10 18:36:38,162::task::1168::TaskManager.Task::(prepare) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5026::DEBUG::2014-04-10 18:36:38,162::task::579::TaskManager.Task::(_updateState) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::moving from state preparing -> state finished
>Thread-5026::DEBUG::2014-04-10 18:36:38,162::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5026::DEBUG::2014-04-10 18:36:38,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5026::DEBUG::2014-04-10 18:36:38,163::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5026::DEBUG::2014-04-10 18:36:38,163::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5026::DEBUG::2014-04-10 18:36:38,163::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5026::DEBUG::2014-04-10 18:36:38,163::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5026::DEBUG::2014-04-10 18:36:38,163::task::974::TaskManager.Task::(_decref) Task=`8ae27f67-8574-46ad-a0f8-6de4882d0a8c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:41,478::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:41,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263841 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:41,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:41,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000469268 s, 784 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:41,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:41,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448343 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:36:41,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:41,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317819 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5029::DEBUG::2014-04-10 18:36:46,981::task::579::TaskManager.Task::(_updateState) Task=`631b8420-16ef-4834-b66a-c141ef2a8fdf`::moving from state init -> state preparing
>Thread-5029::INFO::2014-04-10 18:36:46,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5029::INFO::2014-04-10 18:36:46,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448343', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263841', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317819', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469268', 'lastCheck': '5.4', 'valid': True}}
>Thread-5029::DEBUG::2014-04-10 18:36:46,982::task::1168::TaskManager.Task::(prepare) Task=`631b8420-16ef-4834-b66a-c141ef2a8fdf`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448343', 'lastCheck': '5.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000263841', 'lastCheck': '5.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317819', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469268', 'lastCheck': '5.4', 'valid': True}}
>Thread-5029::DEBUG::2014-04-10 18:36:46,982::task::579::TaskManager.Task::(_updateState) Task=`631b8420-16ef-4834-b66a-c141ef2a8fdf`::moving from state preparing -> state finished
>Thread-5029::DEBUG::2014-04-10 18:36:46,982::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5029::DEBUG::2014-04-10 18:36:46,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5029::DEBUG::2014-04-10 18:36:46,982::task::974::TaskManager.Task::(_decref) Task=`631b8420-16ef-4834-b66a-c141ef2a8fdf`::ref 0 aborting False
>Thread-5031::DEBUG::2014-04-10 18:36:48,671::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5031::DEBUG::2014-04-10 18:36:48,672::task::579::TaskManager.Task::(_updateState) Task=`45fe5382-e27b-4a95-8568-1e3778b6ac72`::moving from state init -> state preparing
>Thread-5031::INFO::2014-04-10 18:36:48,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5031::INFO::2014-04-10 18:36:48,672::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5031::DEBUG::2014-04-10 18:36:48,673::task::1168::TaskManager.Task::(prepare) Task=`45fe5382-e27b-4a95-8568-1e3778b6ac72`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5031::DEBUG::2014-04-10 18:36:48,673::task::579::TaskManager.Task::(_updateState) Task=`45fe5382-e27b-4a95-8568-1e3778b6ac72`::moving from state preparing -> state finished
>Thread-5031::DEBUG::2014-04-10 18:36:48,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5031::DEBUG::2014-04-10 18:36:48,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5031::DEBUG::2014-04-10 18:36:48,673::task::974::TaskManager.Task::(_decref) Task=`45fe5382-e27b-4a95-8568-1e3778b6ac72`::ref 0 aborting False
>Thread-5032::DEBUG::2014-04-10 18:36:48,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5032::DEBUG::2014-04-10 18:36:48,680::task::579::TaskManager.Task::(_updateState) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::moving from state init -> state preparing
>Thread-5032::INFO::2014-04-10 18:36:48,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5032::DEBUG::2014-04-10 18:36:48,680::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0a9b87cd-0678-4e8d-bf83-e9fa27ee9230`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5032::DEBUG::2014-04-10 18:36:48,681::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5032::DEBUG::2014-04-10 18:36:48,681::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5032::DEBUG::2014-04-10 18:36:48,681::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0a9b87cd-0678-4e8d-bf83-e9fa27ee9230`::Granted request
>Thread-5032::DEBUG::2014-04-10 18:36:48,682::task::811::TaskManager.Task::(resourceAcquired) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5032::DEBUG::2014-04-10 18:36:48,682::task::974::TaskManager.Task::(_decref) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::ref 1 aborting False
>Thread-5032::INFO::2014-04-10 18:36:48,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5032::DEBUG::2014-04-10 18:36:48,684::task::1168::TaskManager.Task::(prepare) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::task::579::TaskManager.Task::(_updateState) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::moving from state preparing -> state finished
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5032::DEBUG::2014-04-10 18:36:48,685::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5032::DEBUG::2014-04-10 18:36:48,686::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5032::DEBUG::2014-04-10 18:36:48,686::task::974::TaskManager.Task::(_decref) Task=`7db50370-b282-4af3-bd81-5d3dddf5ece0`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:36:51,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:36:51,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340445 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:36:51,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:36:51,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000570714 s, 645 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:36:51,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:36:51,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000416023 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:36:51,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:36:51,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260706 s, 2.6 MB/s\n'; <rc> = 0
>Thread-5036::DEBUG::2014-04-10 18:36:58,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5036::DEBUG::2014-04-10 18:36:58,756::task::579::TaskManager.Task::(_updateState) Task=`27f0b180-3351-4b75-b686-fdfb1bd531a1`::moving from state init -> state preparing
>Thread-5036::INFO::2014-04-10 18:36:58,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5036::INFO::2014-04-10 18:36:58,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5036::DEBUG::2014-04-10 18:36:58,757::task::1168::TaskManager.Task::(prepare) Task=`27f0b180-3351-4b75-b686-fdfb1bd531a1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5036::DEBUG::2014-04-10 18:36:58,757::task::579::TaskManager.Task::(_updateState) Task=`27f0b180-3351-4b75-b686-fdfb1bd531a1`::moving from state preparing -> state finished
>Thread-5036::DEBUG::2014-04-10 18:36:58,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5036::DEBUG::2014-04-10 18:36:58,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5036::DEBUG::2014-04-10 18:36:58,758::task::974::TaskManager.Task::(_decref) Task=`27f0b180-3351-4b75-b686-fdfb1bd531a1`::ref 0 aborting False
>Thread-5037::DEBUG::2014-04-10 18:36:58,764::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5037::DEBUG::2014-04-10 18:36:58,765::task::579::TaskManager.Task::(_updateState) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::moving from state init -> state preparing
>Thread-5037::INFO::2014-04-10 18:36:58,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5037::DEBUG::2014-04-10 18:36:58,766::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a87f3e8-45c6-4d90-9557-68ee91711401`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5037::DEBUG::2014-04-10 18:36:58,766::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5037::DEBUG::2014-04-10 18:36:58,766::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5037::DEBUG::2014-04-10 18:36:58,766::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1a87f3e8-45c6-4d90-9557-68ee91711401`::Granted request
>Thread-5037::DEBUG::2014-04-10 18:36:58,767::task::811::TaskManager.Task::(resourceAcquired) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5037::DEBUG::2014-04-10 18:36:58,767::task::974::TaskManager.Task::(_decref) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::ref 1 aborting False
>Thread-5037::INFO::2014-04-10 18:36:58,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5037::DEBUG::2014-04-10 18:36:58,769::task::1168::TaskManager.Task::(prepare) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5037::DEBUG::2014-04-10 18:36:58,770::task::579::TaskManager.Task::(_updateState) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::moving from state preparing -> state finished
>Thread-5037::DEBUG::2014-04-10 18:36:58,770::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5037::DEBUG::2014-04-10 18:36:58,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5037::DEBUG::2014-04-10 18:36:58,770::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5037::DEBUG::2014-04-10 18:36:58,770::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5037::DEBUG::2014-04-10 18:36:58,771::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5037::DEBUG::2014-04-10 18:36:58,771::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5037::DEBUG::2014-04-10 18:36:58,771::task::974::TaskManager.Task::(_decref) Task=`510f7675-c96e-49c8-86b7-1f84260b3dee`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:01,517::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:01,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276486 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:01,622::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:37:01,640::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:37:01,641::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:37:01,646::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:37:01,648::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:37:01,648::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:37:01,648::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:37:01,654::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:01,660::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466861 s, 788 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:01,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:01,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000444498 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:01,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:01,914::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303065 s, 2.2 MB/s\n'; <rc> = 0
>Thread-5043::DEBUG::2014-04-10 18:37:02,145::task::579::TaskManager.Task::(_updateState) Task=`257dfef2-7395-468c-b276-bb41f6b24bc0`::moving from state init -> state preparing
>Thread-5043::INFO::2014-04-10 18:37:02,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5043::INFO::2014-04-10 18:37:02,146::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444498', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276486', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303065', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466861', 'lastCheck': '0.5', 'valid': True}}
>Thread-5043::DEBUG::2014-04-10 18:37:02,146::task::1168::TaskManager.Task::(prepare) Task=`257dfef2-7395-468c-b276-bb41f6b24bc0`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444498', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000276486', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303065', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466861', 'lastCheck': '0.5', 'valid': True}}
>Thread-5043::DEBUG::2014-04-10 18:37:02,146::task::579::TaskManager.Task::(_updateState) Task=`257dfef2-7395-468c-b276-bb41f6b24bc0`::moving from state preparing -> state finished
>Thread-5043::DEBUG::2014-04-10 18:37:02,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5043::DEBUG::2014-04-10 18:37:02,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5043::DEBUG::2014-04-10 18:37:02,147::task::974::TaskManager.Task::(_decref) Task=`257dfef2-7395-468c-b276-bb41f6b24bc0`::ref 0 aborting False
>Thread-5047::DEBUG::2014-04-10 18:37:08,862::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5047::DEBUG::2014-04-10 18:37:08,862::task::579::TaskManager.Task::(_updateState) Task=`15d7e2f6-a3a3-414b-aba1-9db229acf41a`::moving from state init -> state preparing
>Thread-5047::INFO::2014-04-10 18:37:08,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5047::INFO::2014-04-10 18:37:08,863::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5047::DEBUG::2014-04-10 18:37:08,863::task::1168::TaskManager.Task::(prepare) Task=`15d7e2f6-a3a3-414b-aba1-9db229acf41a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5047::DEBUG::2014-04-10 18:37:08,863::task::579::TaskManager.Task::(_updateState) Task=`15d7e2f6-a3a3-414b-aba1-9db229acf41a`::moving from state preparing -> state finished
>Thread-5047::DEBUG::2014-04-10 18:37:08,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5047::DEBUG::2014-04-10 18:37:08,863::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5047::DEBUG::2014-04-10 18:37:08,863::task::974::TaskManager.Task::(_decref) Task=`15d7e2f6-a3a3-414b-aba1-9db229acf41a`::ref 0 aborting False
>Thread-5048::DEBUG::2014-04-10 18:37:08,871::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5048::DEBUG::2014-04-10 18:37:08,871::task::579::TaskManager.Task::(_updateState) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::moving from state init -> state preparing
>Thread-5048::INFO::2014-04-10 18:37:08,872::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5048::DEBUG::2014-04-10 18:37:08,872::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`caeb6c33-ec9c-4a16-b8fc-9e6ae440d072`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5048::DEBUG::2014-04-10 18:37:08,872::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5048::DEBUG::2014-04-10 18:37:08,873::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5048::DEBUG::2014-04-10 18:37:08,873::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`caeb6c33-ec9c-4a16-b8fc-9e6ae440d072`::Granted request
>Thread-5048::DEBUG::2014-04-10 18:37:08,873::task::811::TaskManager.Task::(resourceAcquired) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5048::DEBUG::2014-04-10 18:37:08,873::task::974::TaskManager.Task::(_decref) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::ref 1 aborting False
>Thread-5048::INFO::2014-04-10 18:37:08,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5048::DEBUG::2014-04-10 18:37:08,875::task::1168::TaskManager.Task::(prepare) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5048::DEBUG::2014-04-10 18:37:08,875::task::579::TaskManager.Task::(_updateState) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::moving from state preparing -> state finished
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5048::DEBUG::2014-04-10 18:37:08,876::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5048::DEBUG::2014-04-10 18:37:08,877::task::974::TaskManager.Task::(_decref) Task=`d3fb7c40-e5a0-4ee2-a7de-a2738b677ae6`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:11,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:11,538::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284567 s, 2.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:11,668::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:11,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000552913 s, 666 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:11,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:11,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000470175 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:11,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:11,930::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331202 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5051::DEBUG::2014-04-10 18:37:17,314::task::579::TaskManager.Task::(_updateState) Task=`cfd1f961-ec11-40c2-8c74-9d0ac6121a4e`::moving from state init -> state preparing
>Thread-5051::INFO::2014-04-10 18:37:17,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5051::INFO::2014-04-10 18:37:17,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470175', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284567', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331202', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552913', 'lastCheck': '5.6', 'valid': True}}
>Thread-5051::DEBUG::2014-04-10 18:37:17,314::task::1168::TaskManager.Task::(prepare) Task=`cfd1f961-ec11-40c2-8c74-9d0ac6121a4e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470175', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284567', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331202', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552913', 'lastCheck': '5.6', 'valid': True}}
>Thread-5051::DEBUG::2014-04-10 18:37:17,315::task::579::TaskManager.Task::(_updateState) Task=`cfd1f961-ec11-40c2-8c74-9d0ac6121a4e`::moving from state preparing -> state finished
>Thread-5051::DEBUG::2014-04-10 18:37:17,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5051::DEBUG::2014-04-10 18:37:17,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5051::DEBUG::2014-04-10 18:37:17,315::task::974::TaskManager.Task::(_decref) Task=`cfd1f961-ec11-40c2-8c74-9d0ac6121a4e`::ref 0 aborting False
>Thread-5053::DEBUG::2014-04-10 18:37:19,010::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-5053::DEBUG::2014-04-10 18:37:19,010::task::579::TaskManager.Task::(_updateState) Task=`b231eb06-e964-491a-b2a4-b59e3bf1d3e1`::moving from state init -> state preparing
>Thread-5053::INFO::2014-04-10 18:37:19,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5053::INFO::2014-04-10 18:37:19,011::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5053::DEBUG::2014-04-10 18:37:19,011::task::1168::TaskManager.Task::(prepare) Task=`b231eb06-e964-491a-b2a4-b59e3bf1d3e1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5053::DEBUG::2014-04-10 18:37:19,011::task::579::TaskManager.Task::(_updateState) Task=`b231eb06-e964-491a-b2a4-b59e3bf1d3e1`::moving from state preparing -> state finished
>Thread-5053::DEBUG::2014-04-10 18:37:19,011::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5053::DEBUG::2014-04-10 18:37:19,011::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5053::DEBUG::2014-04-10 18:37:19,011::task::974::TaskManager.Task::(_decref) Task=`b231eb06-e964-491a-b2a4-b59e3bf1d3e1`::ref 0 aborting False
>Thread-5054::DEBUG::2014-04-10 18:37:19,016::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4902995d]
>Thread-5054::DEBUG::2014-04-10 18:37:19,017::task::579::TaskManager.Task::(_updateState) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::moving from state init -> state preparing
>Thread-5054::INFO::2014-04-10 18:37:19,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5054::DEBUG::2014-04-10 18:37:19,018::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`482624f0-7b82-4f32-8bef-1b1c51dd7e59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5054::DEBUG::2014-04-10 18:37:19,018::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5054::DEBUG::2014-04-10 18:37:19,018::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5054::DEBUG::2014-04-10 18:37:19,018::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`482624f0-7b82-4f32-8bef-1b1c51dd7e59`::Granted request
>Thread-5054::DEBUG::2014-04-10 18:37:19,018::task::811::TaskManager.Task::(resourceAcquired) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5054::DEBUG::2014-04-10 18:37:19,019::task::974::TaskManager.Task::(_decref) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::ref 1 aborting False
>Thread-5054::INFO::2014-04-10 18:37:19,021::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5054::DEBUG::2014-04-10 18:37:19,021::task::1168::TaskManager.Task::(prepare) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5054::DEBUG::2014-04-10 18:37:19,021::task::579::TaskManager.Task::(_updateState) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::moving from state preparing -> state finished
>Thread-5054::DEBUG::2014-04-10 18:37:19,021::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5054::DEBUG::2014-04-10 18:37:19,021::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5054::DEBUG::2014-04-10 18:37:19,021::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5054::DEBUG::2014-04-10 18:37:19,022::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5054::DEBUG::2014-04-10 18:37:19,022::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5054::DEBUG::2014-04-10 18:37:19,022::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5054::DEBUG::2014-04-10 18:37:19,022::task::974::TaskManager.Task::(_decref) Task=`3adee44b-d7ec-48f5-b45e-54ab0eeb6d1a`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:21,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:21,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000315488 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:21,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:21,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000499346 s, 737 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:21,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:21,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.0004845 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:21,939::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:21,946::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270329 s, 2.5 MB/s\n'; <rc> = 0
>Thread-5058::DEBUG::2014-04-10 18:37:29,409::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-5058::DEBUG::2014-04-10 18:37:29,410::task::579::TaskManager.Task::(_updateState) Task=`9999e436-db36-4374-a59c-c2f5780c88db`::moving from state init -> state preparing
>Thread-5058::INFO::2014-04-10 18:37:29,410::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5058::INFO::2014-04-10 18:37:29,410::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5058::DEBUG::2014-04-10 18:37:29,411::task::1168::TaskManager.Task::(prepare) Task=`9999e436-db36-4374-a59c-c2f5780c88db`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5058::DEBUG::2014-04-10 18:37:29,411::task::579::TaskManager.Task::(_updateState) Task=`9999e436-db36-4374-a59c-c2f5780c88db`::moving from state preparing -> state finished
>Thread-5058::DEBUG::2014-04-10 18:37:29,411::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5058::DEBUG::2014-04-10 18:37:29,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5058::DEBUG::2014-04-10 18:37:29,411::task::974::TaskManager.Task::(_decref) Task=`9999e436-db36-4374-a59c-c2f5780c88db`::ref 0 aborting False
>Thread-5059::DEBUG::2014-04-10 18:37:29,418::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1befbc1e]
>Thread-5059::DEBUG::2014-04-10 18:37:29,419::task::579::TaskManager.Task::(_updateState) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::moving from state init -> state preparing
>Thread-5059::INFO::2014-04-10 18:37:29,419::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5059::DEBUG::2014-04-10 18:37:29,419::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb5e582d-c3b0-4b23-a716-2973b88aaedf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5059::DEBUG::2014-04-10 18:37:29,420::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5059::DEBUG::2014-04-10 18:37:29,420::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5059::DEBUG::2014-04-10 18:37:29,420::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb5e582d-c3b0-4b23-a716-2973b88aaedf`::Granted request
>Thread-5059::DEBUG::2014-04-10 18:37:29,421::task::811::TaskManager.Task::(resourceAcquired) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5059::DEBUG::2014-04-10 18:37:29,421::task::974::TaskManager.Task::(_decref) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::ref 1 aborting False
>Thread-5059::INFO::2014-04-10 18:37:29,423::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5059::DEBUG::2014-04-10 18:37:29,423::task::1168::TaskManager.Task::(prepare) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::task::579::TaskManager.Task::(_updateState) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::moving from state preparing -> state finished
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5059::DEBUG::2014-04-10 18:37:29,424::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5059::DEBUG::2014-04-10 18:37:29,425::task::974::TaskManager.Task::(_decref) Task=`746a072f-e25f-4d5b-b23e-039ae32ad093`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:31,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:31,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269713 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:31,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:31,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048941 s, 752 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:31,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:31,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000483256 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:31,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:31,962::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307344 s, 2.2 MB/s\n'; <rc> = 0
>Thread-5061::DEBUG::2014-04-10 18:37:32,565::task::579::TaskManager.Task::(_updateState) Task=`f7e5c07b-43a4-4c2a-bd13-60d1f05c2063`::moving from state init -> state preparing
>Thread-5061::INFO::2014-04-10 18:37:32,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5061::INFO::2014-04-10 18:37:32,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483256', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269713', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307344', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048941', 'lastCheck': '0.9', 'valid': True}}
>Thread-5061::DEBUG::2014-04-10 18:37:32,566::task::1168::TaskManager.Task::(prepare) Task=`f7e5c07b-43a4-4c2a-bd13-60d1f05c2063`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483256', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269713', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307344', 'lastCheck': '0.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048941', 'lastCheck': '0.9', 'valid': True}}
>Thread-5061::DEBUG::2014-04-10 18:37:32,566::task::579::TaskManager.Task::(_updateState) Task=`f7e5c07b-43a4-4c2a-bd13-60d1f05c2063`::moving from state preparing -> state finished
>Thread-5061::DEBUG::2014-04-10 18:37:32,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5061::DEBUG::2014-04-10 18:37:32,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5061::DEBUG::2014-04-10 18:37:32,566::task::974::TaskManager.Task::(_decref) Task=`f7e5c07b-43a4-4c2a-bd13-60d1f05c2063`::ref 0 aborting False
>Thread-5065::DEBUG::2014-04-10 18:37:39,511::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5065::DEBUG::2014-04-10 18:37:39,512::task::579::TaskManager.Task::(_updateState) Task=`cd24b737-3a49-4f49-933e-2d641cbe008f`::moving from state init -> state preparing
>Thread-5065::INFO::2014-04-10 18:37:39,512::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5065::INFO::2014-04-10 18:37:39,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5065::DEBUG::2014-04-10 18:37:39,513::task::1168::TaskManager.Task::(prepare) Task=`cd24b737-3a49-4f49-933e-2d641cbe008f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5065::DEBUG::2014-04-10 18:37:39,513::task::579::TaskManager.Task::(_updateState) Task=`cd24b737-3a49-4f49-933e-2d641cbe008f`::moving from state preparing -> state finished
>Thread-5065::DEBUG::2014-04-10 18:37:39,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5065::DEBUG::2014-04-10 18:37:39,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5065::DEBUG::2014-04-10 18:37:39,514::task::974::TaskManager.Task::(_decref) Task=`cd24b737-3a49-4f49-933e-2d641cbe008f`::ref 0 aborting False
>Thread-5066::DEBUG::2014-04-10 18:37:39,520::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5066::DEBUG::2014-04-10 18:37:39,520::task::579::TaskManager.Task::(_updateState) Task=`b6021192-6d30-481f-a211-1113ce85d905`::moving from state init -> state preparing
>Thread-5066::INFO::2014-04-10 18:37:39,521::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5066::DEBUG::2014-04-10 18:37:39,521::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`199c27f2-c255-4f62-bf1d-46cae81ad6dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5066::DEBUG::2014-04-10 18:37:39,521::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5066::DEBUG::2014-04-10 18:37:39,522::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5066::DEBUG::2014-04-10 18:37:39,522::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`199c27f2-c255-4f62-bf1d-46cae81ad6dd`::Granted request
>Thread-5066::DEBUG::2014-04-10 18:37:39,522::task::811::TaskManager.Task::(resourceAcquired) Task=`b6021192-6d30-481f-a211-1113ce85d905`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5066::DEBUG::2014-04-10 18:37:39,522::task::974::TaskManager.Task::(_decref) Task=`b6021192-6d30-481f-a211-1113ce85d905`::ref 1 aborting False
>Thread-5066::INFO::2014-04-10 18:37:39,524::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5066::DEBUG::2014-04-10 18:37:39,524::task::1168::TaskManager.Task::(prepare) Task=`b6021192-6d30-481f-a211-1113ce85d905`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5066::DEBUG::2014-04-10 18:37:39,524::task::579::TaskManager.Task::(_updateState) Task=`b6021192-6d30-481f-a211-1113ce85d905`::moving from state preparing -> state finished
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5066::DEBUG::2014-04-10 18:37:39,525::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5066::DEBUG::2014-04-10 18:37:39,526::task::974::TaskManager.Task::(_decref) Task=`b6021192-6d30-481f-a211-1113ce85d905`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:41,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:41,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304661 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:41,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:41,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488674 s, 753 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:41,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:41,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000472075 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:41,972::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:41,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332538 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5069::DEBUG::2014-04-10 18:37:47,745::task::579::TaskManager.Task::(_updateState) Task=`e658280e-b69c-40d4-8f3b-b0f4a062e0be`::moving from state init -> state preparing
>Thread-5069::INFO::2014-04-10 18:37:47,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5069::INFO::2014-04-10 18:37:47,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472075', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304661', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332538', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488674', 'lastCheck': '6.0', 'valid': True}}
>Thread-5069::DEBUG::2014-04-10 18:37:47,746::task::1168::TaskManager.Task::(prepare) Task=`e658280e-b69c-40d4-8f3b-b0f4a062e0be`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472075', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000304661', 'lastCheck': '6.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332538', 'lastCheck': '5.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488674', 'lastCheck': '6.0', 'valid': True}}
>Thread-5069::DEBUG::2014-04-10 18:37:47,746::task::579::TaskManager.Task::(_updateState) Task=`e658280e-b69c-40d4-8f3b-b0f4a062e0be`::moving from state preparing -> state finished
>Thread-5069::DEBUG::2014-04-10 18:37:47,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5069::DEBUG::2014-04-10 18:37:47,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5069::DEBUG::2014-04-10 18:37:47,747::task::974::TaskManager.Task::(_decref) Task=`e658280e-b69c-40d4-8f3b-b0f4a062e0be`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:37:51,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:37:51,605::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353944 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:37:51,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:37:51,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000410797 s, 896 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:37:51,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:37:51,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000428093 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:37:51,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:37:51,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00202558 s, 331 kB/s\n'; <rc> = 0
>Thread-5072::DEBUG::2014-04-10 18:37:52,030::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-5072::DEBUG::2014-04-10 18:37:52,031::task::579::TaskManager.Task::(_updateState) Task=`cbba79e3-1b79-4658-8128-cd2f71a097fa`::moving from state init -> state preparing
>Thread-5072::INFO::2014-04-10 18:37:52,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5072::INFO::2014-04-10 18:37:52,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5072::DEBUG::2014-04-10 18:37:52,032::task::1168::TaskManager.Task::(prepare) Task=`cbba79e3-1b79-4658-8128-cd2f71a097fa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5072::DEBUG::2014-04-10 18:37:52,032::task::579::TaskManager.Task::(_updateState) Task=`cbba79e3-1b79-4658-8128-cd2f71a097fa`::moving from state preparing -> state finished
>Thread-5072::DEBUG::2014-04-10 18:37:52,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5072::DEBUG::2014-04-10 18:37:52,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5072::DEBUG::2014-04-10 18:37:52,032::task::974::TaskManager.Task::(_decref) Task=`cbba79e3-1b79-4658-8128-cd2f71a097fa`::ref 0 aborting False
>Thread-5073::DEBUG::2014-04-10 18:37:52,039::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [29d39d31]
>Thread-5073::DEBUG::2014-04-10 18:37:52,040::task::579::TaskManager.Task::(_updateState) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::moving from state init -> state preparing
>Thread-5073::INFO::2014-04-10 18:37:52,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5073::DEBUG::2014-04-10 18:37:52,041::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b4e0689a-8fe6-4ee6-a3cd-b00a793a3964`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5073::DEBUG::2014-04-10 18:37:52,041::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5073::DEBUG::2014-04-10 18:37:52,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5073::DEBUG::2014-04-10 18:37:52,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b4e0689a-8fe6-4ee6-a3cd-b00a793a3964`::Granted request
>Thread-5073::DEBUG::2014-04-10 18:37:52,042::task::811::TaskManager.Task::(resourceAcquired) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5073::DEBUG::2014-04-10 18:37:52,042::task::974::TaskManager.Task::(_decref) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::ref 1 aborting False
>Thread-5073::INFO::2014-04-10 18:37:52,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5073::DEBUG::2014-04-10 18:37:52,044::task::1168::TaskManager.Task::(prepare) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5073::DEBUG::2014-04-10 18:37:52,044::task::579::TaskManager.Task::(_updateState) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::moving from state preparing -> state finished
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5073::DEBUG::2014-04-10 18:37:52,045::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5073::DEBUG::2014-04-10 18:37:52,046::task::974::TaskManager.Task::(_decref) Task=`9930146c-799a-4aaa-86a7-db8e0dd21a2b`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:01,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:01,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037927 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:01,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:01,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451051 s, 816 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:01,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:01,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000442727 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:02,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:02,012::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031219 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5077::DEBUG::2014-04-10 18:38:02,136::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-5077::DEBUG::2014-04-10 18:38:02,136::task::579::TaskManager.Task::(_updateState) Task=`57f6aaa0-94bb-4543-9e2e-d4da9da448cd`::moving from state init -> state preparing
>Thread-5077::INFO::2014-04-10 18:38:02,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5077::INFO::2014-04-10 18:38:02,137::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5077::DEBUG::2014-04-10 18:38:02,137::task::1168::TaskManager.Task::(prepare) Task=`57f6aaa0-94bb-4543-9e2e-d4da9da448cd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5077::DEBUG::2014-04-10 18:38:02,137::task::579::TaskManager.Task::(_updateState) Task=`57f6aaa0-94bb-4543-9e2e-d4da9da448cd`::moving from state preparing -> state finished
>Thread-5077::DEBUG::2014-04-10 18:38:02,137::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5077::DEBUG::2014-04-10 18:38:02,138::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5077::DEBUG::2014-04-10 18:38:02,138::task::974::TaskManager.Task::(_decref) Task=`57f6aaa0-94bb-4543-9e2e-d4da9da448cd`::ref 0 aborting False
>Thread-5078::DEBUG::2014-04-10 18:38:02,143::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2610ec1f]
>Thread-5078::DEBUG::2014-04-10 18:38:02,143::task::579::TaskManager.Task::(_updateState) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::moving from state init -> state preparing
>Thread-5078::INFO::2014-04-10 18:38:02,143::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5078::DEBUG::2014-04-10 18:38:02,144::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb1f0d1f-c8db-4cbd-9658-217155e11c50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5078::DEBUG::2014-04-10 18:38:02,144::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5078::DEBUG::2014-04-10 18:38:02,144::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5078::DEBUG::2014-04-10 18:38:02,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb1f0d1f-c8db-4cbd-9658-217155e11c50`::Granted request
>Thread-5078::DEBUG::2014-04-10 18:38:02,144::task::811::TaskManager.Task::(resourceAcquired) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5078::DEBUG::2014-04-10 18:38:02,145::task::974::TaskManager.Task::(_decref) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::ref 1 aborting False
>Thread-5078::INFO::2014-04-10 18:38:02,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5078::DEBUG::2014-04-10 18:38:02,147::task::1168::TaskManager.Task::(prepare) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5078::DEBUG::2014-04-10 18:38:02,147::task::579::TaskManager.Task::(_updateState) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::moving from state preparing -> state finished
>Thread-5078::DEBUG::2014-04-10 18:38:02,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5078::DEBUG::2014-04-10 18:38:02,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5078::DEBUG::2014-04-10 18:38:02,147::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5078::DEBUG::2014-04-10 18:38:02,148::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5078::DEBUG::2014-04-10 18:38:02,148::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5078::DEBUG::2014-04-10 18:38:02,148::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5078::DEBUG::2014-04-10 18:38:02,148::task::974::TaskManager.Task::(_decref) Task=`51181bec-dcef-4e7a-8927-0f8abb1ac493`::ref 0 aborting False
>Thread-5079::DEBUG::2014-04-10 18:38:03,057::task::579::TaskManager.Task::(_updateState) Task=`39e08c52-f7e3-4bdf-b57c-0ebef277efa3`::moving from state init -> state preparing
>Thread-5079::INFO::2014-04-10 18:38:03,057::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5079::INFO::2014-04-10 18:38:03,057::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442727', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037927', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031219', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451051', 'lastCheck': '1.3', 'valid': True}}
>Thread-5079::DEBUG::2014-04-10 18:38:03,057::task::1168::TaskManager.Task::(prepare) Task=`39e08c52-f7e3-4bdf-b57c-0ebef277efa3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442727', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037927', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031219', 'lastCheck': '1.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451051', 'lastCheck': '1.3', 'valid': True}}
>Thread-5079::DEBUG::2014-04-10 18:38:03,058::task::579::TaskManager.Task::(_updateState) Task=`39e08c52-f7e3-4bdf-b57c-0ebef277efa3`::moving from state preparing -> state finished
>Thread-5079::DEBUG::2014-04-10 18:38:03,058::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5079::DEBUG::2014-04-10 18:38:03,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5079::DEBUG::2014-04-10 18:38:03,058::task::974::TaskManager.Task::(_decref) Task=`39e08c52-f7e3-4bdf-b57c-0ebef277efa3`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:11,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:11,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397051 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:11,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:11,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000440615 s, 835 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:11,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:11,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000526039 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:12,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:12,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382714 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5083::DEBUG::2014-04-10 18:38:12,219::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5083::DEBUG::2014-04-10 18:38:12,220::task::579::TaskManager.Task::(_updateState) Task=`18665df1-6da2-49fd-b086-87665f899519`::moving from state init -> state preparing
>Thread-5083::INFO::2014-04-10 18:38:12,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5083::INFO::2014-04-10 18:38:12,221::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5083::DEBUG::2014-04-10 18:38:12,221::task::1168::TaskManager.Task::(prepare) Task=`18665df1-6da2-49fd-b086-87665f899519`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5083::DEBUG::2014-04-10 18:38:12,221::task::579::TaskManager.Task::(_updateState) Task=`18665df1-6da2-49fd-b086-87665f899519`::moving from state preparing -> state finished
>Thread-5083::DEBUG::2014-04-10 18:38:12,221::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5083::DEBUG::2014-04-10 18:38:12,221::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5083::DEBUG::2014-04-10 18:38:12,221::task::974::TaskManager.Task::(_decref) Task=`18665df1-6da2-49fd-b086-87665f899519`::ref 0 aborting False
>Thread-5084::DEBUG::2014-04-10 18:38:12,228::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5084::DEBUG::2014-04-10 18:38:12,229::task::579::TaskManager.Task::(_updateState) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::moving from state init -> state preparing
>Thread-5084::INFO::2014-04-10 18:38:12,229::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5084::DEBUG::2014-04-10 18:38:12,230::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1cceb71-1f07-4313-9e39-10321d41ecbc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5084::DEBUG::2014-04-10 18:38:12,230::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5084::DEBUG::2014-04-10 18:38:12,230::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5084::DEBUG::2014-04-10 18:38:12,230::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1cceb71-1f07-4313-9e39-10321d41ecbc`::Granted request
>Thread-5084::DEBUG::2014-04-10 18:38:12,232::task::811::TaskManager.Task::(resourceAcquired) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5084::DEBUG::2014-04-10 18:38:12,232::task::974::TaskManager.Task::(_decref) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::ref 1 aborting False
>Thread-5084::INFO::2014-04-10 18:38:12,234::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5084::DEBUG::2014-04-10 18:38:12,234::task::1168::TaskManager.Task::(prepare) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5084::DEBUG::2014-04-10 18:38:12,235::task::579::TaskManager.Task::(_updateState) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::moving from state preparing -> state finished
>Thread-5084::DEBUG::2014-04-10 18:38:12,235::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5084::DEBUG::2014-04-10 18:38:12,235::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5084::DEBUG::2014-04-10 18:38:12,235::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5084::DEBUG::2014-04-10 18:38:12,235::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5084::DEBUG::2014-04-10 18:38:12,236::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5084::DEBUG::2014-04-10 18:38:12,236::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5084::DEBUG::2014-04-10 18:38:12,236::task::974::TaskManager.Task::(_decref) Task=`f82de0ba-e5e5-4a5f-bac3-9597300c3bf0`::ref 0 aborting False
>Thread-5087::DEBUG::2014-04-10 18:38:18,319::task::579::TaskManager.Task::(_updateState) Task=`d9c13666-f07c-4e17-8ae0-45936caa2ad1`::moving from state init -> state preparing
>Thread-5087::INFO::2014-04-10 18:38:18,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5087::INFO::2014-04-10 18:38:18,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526039', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397051', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382714', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440615', 'lastCheck': '6.6', 'valid': True}}
>Thread-5087::DEBUG::2014-04-10 18:38:18,320::task::1168::TaskManager.Task::(prepare) Task=`d9c13666-f07c-4e17-8ae0-45936caa2ad1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526039', 'lastCheck': '6.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397051', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382714', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440615', 'lastCheck': '6.6', 'valid': True}}
>Thread-5087::DEBUG::2014-04-10 18:38:18,320::task::579::TaskManager.Task::(_updateState) Task=`d9c13666-f07c-4e17-8ae0-45936caa2ad1`::moving from state preparing -> state finished
>Thread-5087::DEBUG::2014-04-10 18:38:18,320::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5087::DEBUG::2014-04-10 18:38:18,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5087::DEBUG::2014-04-10 18:38:18,320::task::974::TaskManager.Task::(_decref) Task=`d9c13666-f07c-4e17-8ae0-45936caa2ad1`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:21,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:21,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362062 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:21,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:21,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000382318 s, 963 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:21,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:21,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000520629 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:22,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:22,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383037 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5090::DEBUG::2014-04-10 18:38:22,326::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-5090::DEBUG::2014-04-10 18:38:22,327::task::579::TaskManager.Task::(_updateState) Task=`333927e2-892c-4f62-b0d9-e7bebc914cf8`::moving from state init -> state preparing
>Thread-5090::INFO::2014-04-10 18:38:22,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5090::INFO::2014-04-10 18:38:22,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5090::DEBUG::2014-04-10 18:38:22,328::task::1168::TaskManager.Task::(prepare) Task=`333927e2-892c-4f62-b0d9-e7bebc914cf8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5090::DEBUG::2014-04-10 18:38:22,328::task::579::TaskManager.Task::(_updateState) Task=`333927e2-892c-4f62-b0d9-e7bebc914cf8`::moving from state preparing -> state finished
>Thread-5090::DEBUG::2014-04-10 18:38:22,328::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5090::DEBUG::2014-04-10 18:38:22,328::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5090::DEBUG::2014-04-10 18:38:22,329::task::974::TaskManager.Task::(_decref) Task=`333927e2-892c-4f62-b0d9-e7bebc914cf8`::ref 0 aborting False
>Thread-5091::DEBUG::2014-04-10 18:38:22,336::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3ae99cbf]
>Thread-5091::DEBUG::2014-04-10 18:38:22,336::task::579::TaskManager.Task::(_updateState) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::moving from state init -> state preparing
>Thread-5091::INFO::2014-04-10 18:38:22,336::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5091::DEBUG::2014-04-10 18:38:22,337::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a182b254-4b64-4159-bad5-fc16308edb53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5091::DEBUG::2014-04-10 18:38:22,337::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5091::DEBUG::2014-04-10 18:38:22,337::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5091::DEBUG::2014-04-10 18:38:22,337::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a182b254-4b64-4159-bad5-fc16308edb53`::Granted request
>Thread-5091::DEBUG::2014-04-10 18:38:22,338::task::811::TaskManager.Task::(resourceAcquired) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5091::DEBUG::2014-04-10 18:38:22,338::task::974::TaskManager.Task::(_decref) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::ref 1 aborting False
>Thread-5091::INFO::2014-04-10 18:38:22,340::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5091::DEBUG::2014-04-10 18:38:22,340::task::1168::TaskManager.Task::(prepare) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5091::DEBUG::2014-04-10 18:38:22,340::task::579::TaskManager.Task::(_updateState) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::moving from state preparing -> state finished
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5091::DEBUG::2014-04-10 18:38:22,341::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5091::DEBUG::2014-04-10 18:38:22,342::task::974::TaskManager.Task::(_decref) Task=`635a658b-b1dc-49d2-8e83-44382f49b8af`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:31,657::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:31,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000408404 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:31,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:31,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000440191 s, 836 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:31,955::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:38:31,970::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:38:31,971::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:38:31,977::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-467::DEBUG::2014-04-10 18:38:31,979::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:38:31,979::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:38:31,979::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:38:31,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:31,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000464785 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:32,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:32,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032025 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5099::DEBUG::2014-04-10 18:38:32,417::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-5099::DEBUG::2014-04-10 18:38:32,417::task::579::TaskManager.Task::(_updateState) Task=`34091aad-0bd6-4328-8527-842f23f4536d`::moving from state init -> state preparing
>Thread-5099::INFO::2014-04-10 18:38:32,417::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5099::INFO::2014-04-10 18:38:32,418::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5099::DEBUG::2014-04-10 18:38:32,418::task::1168::TaskManager.Task::(prepare) Task=`34091aad-0bd6-4328-8527-842f23f4536d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5099::DEBUG::2014-04-10 18:38:32,418::task::579::TaskManager.Task::(_updateState) Task=`34091aad-0bd6-4328-8527-842f23f4536d`::moving from state preparing -> state finished
>Thread-5099::DEBUG::2014-04-10 18:38:32,418::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5099::DEBUG::2014-04-10 18:38:32,418::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5099::DEBUG::2014-04-10 18:38:32,418::task::974::TaskManager.Task::(_decref) Task=`34091aad-0bd6-4328-8527-842f23f4536d`::ref 0 aborting False
>Thread-5100::DEBUG::2014-04-10 18:38:32,425::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f576adf]
>Thread-5100::DEBUG::2014-04-10 18:38:32,425::task::579::TaskManager.Task::(_updateState) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::moving from state init -> state preparing
>Thread-5100::INFO::2014-04-10 18:38:32,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5100::DEBUG::2014-04-10 18:38:32,426::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5c155060-44b4-43e9-bace-b234d54cfe1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5100::DEBUG::2014-04-10 18:38:32,426::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5100::DEBUG::2014-04-10 18:38:32,426::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5100::DEBUG::2014-04-10 18:38:32,426::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5c155060-44b4-43e9-bace-b234d54cfe1d`::Granted request
>Thread-5100::DEBUG::2014-04-10 18:38:32,427::task::811::TaskManager.Task::(resourceAcquired) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5100::DEBUG::2014-04-10 18:38:32,427::task::974::TaskManager.Task::(_decref) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::ref 1 aborting False
>Thread-5100::INFO::2014-04-10 18:38:32,429::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5100::DEBUG::2014-04-10 18:38:32,429::task::1168::TaskManager.Task::(prepare) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5100::DEBUG::2014-04-10 18:38:32,429::task::579::TaskManager.Task::(_updateState) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::moving from state preparing -> state finished
>Thread-5100::DEBUG::2014-04-10 18:38:32,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5100::DEBUG::2014-04-10 18:38:32,430::task::974::TaskManager.Task::(_decref) Task=`e52e2536-46a4-4917-97b8-d277d59b55ab`::ref 0 aborting False
>Thread-5101::DEBUG::2014-04-10 18:38:33,858::task::579::TaskManager.Task::(_updateState) Task=`262e3f1b-ec9f-45be-8c9b-4bd65dcf9781`::moving from state init -> state preparing
>Thread-5101::INFO::2014-04-10 18:38:33,858::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5101::INFO::2014-04-10 18:38:33,858::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464785', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408404', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032025', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440191', 'lastCheck': '2.1', 'valid': True}}
>Thread-5101::DEBUG::2014-04-10 18:38:33,858::task::1168::TaskManager.Task::(prepare) Task=`262e3f1b-ec9f-45be-8c9b-4bd65dcf9781`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464785', 'lastCheck': '1.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408404', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032025', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440191', 'lastCheck': '2.1', 'valid': True}}
>Thread-5101::DEBUG::2014-04-10 18:38:33,858::task::579::TaskManager.Task::(_updateState) Task=`262e3f1b-ec9f-45be-8c9b-4bd65dcf9781`::moving from state preparing -> state finished
>Thread-5101::DEBUG::2014-04-10 18:38:33,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5101::DEBUG::2014-04-10 18:38:33,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5101::DEBUG::2014-04-10 18:38:33,859::task::974::TaskManager.Task::(_decref) Task=`262e3f1b-ec9f-45be-8c9b-4bd65dcf9781`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:41,673::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:41,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000408634 s, 1.6 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:41,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:41,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000428645 s, 859 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:41,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:42,004::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000481806 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:42,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:42,075::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000293829 s, 2.3 MB/s\n'; <rc> = 0
>Thread-5105::DEBUG::2014-04-10 18:38:42,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-5105::DEBUG::2014-04-10 18:38:42,523::task::579::TaskManager.Task::(_updateState) Task=`2256b66e-41ad-48c6-9600-07277f10c822`::moving from state init -> state preparing
>Thread-5105::INFO::2014-04-10 18:38:42,524::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5105::INFO::2014-04-10 18:38:42,524::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5105::DEBUG::2014-04-10 18:38:42,524::task::1168::TaskManager.Task::(prepare) Task=`2256b66e-41ad-48c6-9600-07277f10c822`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5105::DEBUG::2014-04-10 18:38:42,524::task::579::TaskManager.Task::(_updateState) Task=`2256b66e-41ad-48c6-9600-07277f10c822`::moving from state preparing -> state finished
>Thread-5105::DEBUG::2014-04-10 18:38:42,524::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5105::DEBUG::2014-04-10 18:38:42,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5105::DEBUG::2014-04-10 18:38:42,525::task::974::TaskManager.Task::(_decref) Task=`2256b66e-41ad-48c6-9600-07277f10c822`::ref 0 aborting False
>Thread-5106::DEBUG::2014-04-10 18:38:42,531::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1a9b4afc]
>Thread-5106::DEBUG::2014-04-10 18:38:42,532::task::579::TaskManager.Task::(_updateState) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::moving from state init -> state preparing
>Thread-5106::INFO::2014-04-10 18:38:42,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5106::DEBUG::2014-04-10 18:38:42,532::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`da010b59-b2c6-474c-a15d-efcdb4d13553`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5106::DEBUG::2014-04-10 18:38:42,532::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5106::DEBUG::2014-04-10 18:38:42,533::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5106::DEBUG::2014-04-10 18:38:42,533::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`da010b59-b2c6-474c-a15d-efcdb4d13553`::Granted request
>Thread-5106::DEBUG::2014-04-10 18:38:42,533::task::811::TaskManager.Task::(resourceAcquired) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5106::DEBUG::2014-04-10 18:38:42,533::task::974::TaskManager.Task::(_decref) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::ref 1 aborting False
>Thread-5106::INFO::2014-04-10 18:38:42,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5106::DEBUG::2014-04-10 18:38:42,536::task::1168::TaskManager.Task::(prepare) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5106::DEBUG::2014-04-10 18:38:42,536::task::579::TaskManager.Task::(_updateState) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::moving from state preparing -> state finished
>Thread-5106::DEBUG::2014-04-10 18:38:42,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5106::DEBUG::2014-04-10 18:38:42,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5106::DEBUG::2014-04-10 18:38:42,537::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5106::DEBUG::2014-04-10 18:38:42,537::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5106::DEBUG::2014-04-10 18:38:42,537::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5106::DEBUG::2014-04-10 18:38:42,537::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5106::DEBUG::2014-04-10 18:38:42,537::task::974::TaskManager.Task::(_decref) Task=`ab23b96a-aa4b-4f8c-92ae-cc2043310f61`::ref 0 aborting False
>Thread-5109::DEBUG::2014-04-10 18:38:49,023::task::579::TaskManager.Task::(_updateState) Task=`06e6802c-b675-476a-ac3f-929cfd84ab6c`::moving from state init -> state preparing
>Thread-5109::INFO::2014-04-10 18:38:49,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5109::INFO::2014-04-10 18:38:49,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481806', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408634', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293829', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428645', 'lastCheck': '7.2', 'valid': True}}
>Thread-5109::DEBUG::2014-04-10 18:38:49,024::task::1168::TaskManager.Task::(prepare) Task=`06e6802c-b675-476a-ac3f-929cfd84ab6c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481806', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408634', 'lastCheck': '7.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000293829', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428645', 'lastCheck': '7.2', 'valid': True}}
>Thread-5109::DEBUG::2014-04-10 18:38:49,024::task::579::TaskManager.Task::(_updateState) Task=`06e6802c-b675-476a-ac3f-929cfd84ab6c`::moving from state preparing -> state finished
>Thread-5109::DEBUG::2014-04-10 18:38:49,024::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5109::DEBUG::2014-04-10 18:38:49,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5109::DEBUG::2014-04-10 18:38:49,025::task::974::TaskManager.Task::(_decref) Task=`06e6802c-b675-476a-ac3f-929cfd84ab6c`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:38:51,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:38:51,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354621 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:38:51,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:38:51,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000605635 s, 608 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:38:52,014::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:38:52,019::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000475738 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:38:52,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:38:52,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000404212 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5112::DEBUG::2014-04-10 18:38:52,613::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5112::DEBUG::2014-04-10 18:38:52,614::task::579::TaskManager.Task::(_updateState) Task=`6ac29a23-cd6a-4124-adf7-a29347c8e061`::moving from state init -> state preparing
>Thread-5112::INFO::2014-04-10 18:38:52,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5112::INFO::2014-04-10 18:38:52,614::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5112::DEBUG::2014-04-10 18:38:52,614::task::1168::TaskManager.Task::(prepare) Task=`6ac29a23-cd6a-4124-adf7-a29347c8e061`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5112::DEBUG::2014-04-10 18:38:52,615::task::579::TaskManager.Task::(_updateState) Task=`6ac29a23-cd6a-4124-adf7-a29347c8e061`::moving from state preparing -> state finished
>Thread-5112::DEBUG::2014-04-10 18:38:52,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5112::DEBUG::2014-04-10 18:38:52,615::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5112::DEBUG::2014-04-10 18:38:52,615::task::974::TaskManager.Task::(_decref) Task=`6ac29a23-cd6a-4124-adf7-a29347c8e061`::ref 0 aborting False
>Thread-5113::DEBUG::2014-04-10 18:38:52,622::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5113::DEBUG::2014-04-10 18:38:52,622::task::579::TaskManager.Task::(_updateState) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::moving from state init -> state preparing
>Thread-5113::INFO::2014-04-10 18:38:52,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5113::DEBUG::2014-04-10 18:38:52,623::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`21577582-3807-4433-91ca-a7b75b305448`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5113::DEBUG::2014-04-10 18:38:52,623::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5113::DEBUG::2014-04-10 18:38:52,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5113::DEBUG::2014-04-10 18:38:52,624::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`21577582-3807-4433-91ca-a7b75b305448`::Granted request
>Thread-5113::DEBUG::2014-04-10 18:38:52,625::task::811::TaskManager.Task::(resourceAcquired) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5113::DEBUG::2014-04-10 18:38:52,625::task::974::TaskManager.Task::(_decref) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::ref 1 aborting False
>Thread-5113::INFO::2014-04-10 18:38:52,628::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5113::DEBUG::2014-04-10 18:38:52,628::task::1168::TaskManager.Task::(prepare) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5113::DEBUG::2014-04-10 18:38:52,628::task::579::TaskManager.Task::(_updateState) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::moving from state preparing -> state finished
>Thread-5113::DEBUG::2014-04-10 18:38:52,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5113::DEBUG::2014-04-10 18:38:52,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5113::DEBUG::2014-04-10 18:38:52,629::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5113::DEBUG::2014-04-10 18:38:52,629::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5113::DEBUG::2014-04-10 18:38:52,629::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5113::DEBUG::2014-04-10 18:38:52,629::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5113::DEBUG::2014-04-10 18:38:52,629::task::974::TaskManager.Task::(_decref) Task=`510eccfd-1273-42c8-90dc-239e2b93b78d`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:39:01,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:01,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339311 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:01,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:01,838::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000450336 s, 817 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:02,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:02,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000486944 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:02,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:02,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000425802 s, 1.6 MB/s\n'; <rc> = 0
>Thread-5117::DEBUG::2014-04-10 18:39:02,729::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5117::DEBUG::2014-04-10 18:39:02,743::task::579::TaskManager.Task::(_updateState) Task=`3cd3829a-d2a3-4db4-8eb4-1c4af3086282`::moving from state init -> state preparing
>Thread-5117::INFO::2014-04-10 18:39:02,743::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5117::INFO::2014-04-10 18:39:02,743::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5117::DEBUG::2014-04-10 18:39:02,743::task::1168::TaskManager.Task::(prepare) Task=`3cd3829a-d2a3-4db4-8eb4-1c4af3086282`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5117::DEBUG::2014-04-10 18:39:02,744::task::579::TaskManager.Task::(_updateState) Task=`3cd3829a-d2a3-4db4-8eb4-1c4af3086282`::moving from state preparing -> state finished
>Thread-5117::DEBUG::2014-04-10 18:39:02,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5117::DEBUG::2014-04-10 18:39:02,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5117::DEBUG::2014-04-10 18:39:02,744::task::974::TaskManager.Task::(_decref) Task=`3cd3829a-d2a3-4db4-8eb4-1c4af3086282`::ref 0 aborting False
>Thread-5118::DEBUG::2014-04-10 18:39:02,751::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5118::DEBUG::2014-04-10 18:39:02,752::task::579::TaskManager.Task::(_updateState) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::moving from state init -> state preparing
>Thread-5118::INFO::2014-04-10 18:39:02,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5118::DEBUG::2014-04-10 18:39:02,752::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`deca12d6-8bf5-4302-9671-a9e51dac3fd8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5118::DEBUG::2014-04-10 18:39:02,753::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5118::DEBUG::2014-04-10 18:39:02,753::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5118::DEBUG::2014-04-10 18:39:02,753::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`deca12d6-8bf5-4302-9671-a9e51dac3fd8`::Granted request
>Thread-5118::DEBUG::2014-04-10 18:39:02,753::task::811::TaskManager.Task::(resourceAcquired) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5118::DEBUG::2014-04-10 18:39:02,754::task::974::TaskManager.Task::(_decref) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::ref 1 aborting False
>Thread-5118::INFO::2014-04-10 18:39:02,756::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5118::DEBUG::2014-04-10 18:39:02,756::task::1168::TaskManager.Task::(prepare) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5118::DEBUG::2014-04-10 18:39:02,756::task::579::TaskManager.Task::(_updateState) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::moving from state preparing -> state finished
>Thread-5118::DEBUG::2014-04-10 18:39:02,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5118::DEBUG::2014-04-10 18:39:02,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5118::DEBUG::2014-04-10 18:39:02,757::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5118::DEBUG::2014-04-10 18:39:02,757::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5118::DEBUG::2014-04-10 18:39:02,757::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5118::DEBUG::2014-04-10 18:39:02,757::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5118::DEBUG::2014-04-10 18:39:02,758::task::974::TaskManager.Task::(_decref) Task=`c058d125-31f2-4d61-bd8b-27fdaf87b1f8`::ref 0 aborting False
>Thread-5119::DEBUG::2014-04-10 18:39:04,185::task::579::TaskManager.Task::(_updateState) Task=`c5bc9856-e30d-44de-a2f3-068761533ead`::moving from state init -> state preparing
>Thread-5119::INFO::2014-04-10 18:39:04,185::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5119::INFO::2014-04-10 18:39:04,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486944', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339311', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425802', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450336', 'lastCheck': '2.3', 'valid': True}}
>Thread-5119::DEBUG::2014-04-10 18:39:04,186::task::1168::TaskManager.Task::(prepare) Task=`c5bc9856-e30d-44de-a2f3-068761533ead`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486944', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000339311', 'lastCheck': '2.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425802', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450336', 'lastCheck': '2.3', 'valid': True}}
>Thread-5119::DEBUG::2014-04-10 18:39:04,186::task::579::TaskManager.Task::(_updateState) Task=`c5bc9856-e30d-44de-a2f3-068761533ead`::moving from state preparing -> state finished
>Thread-5119::DEBUG::2014-04-10 18:39:04,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5119::DEBUG::2014-04-10 18:39:04,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5119::DEBUG::2014-04-10 18:39:04,187::task::974::TaskManager.Task::(_decref) Task=`c5bc9856-e30d-44de-a2f3-068761533ead`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:39:11,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:11,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374104 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:11,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:11,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000452928 s, 812 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:12,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:12,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000566322 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:12,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:12,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000352818 s, 1.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:39:21,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:21,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367857 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:21,862::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:21,869::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000551234 s, 668 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:22,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:22,062::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000525006 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:22,132::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:22,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035536 s, 1.9 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:39:31,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:31,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000435409 s, 1.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:31,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:31,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000453271 s, 812 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:32,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:32,077::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000450815 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:32,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:32,155::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036807 s, 1.8 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:39:41,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:41,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296805 s, 2.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:41,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:41,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466779 s, 788 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:42,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:42,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000467442 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:42,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:42,171::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373249 s, 1.8 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:39:51,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:39:51,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000316366 s, 2.1 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:39:51,905::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:39:51,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000475804 s, 773 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:39:52,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:39:52,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00046518 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:39:52,181::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:39:52,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280529 s, 2.4 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:40:16,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:40:16,108::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:16,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:40:16,126::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:40:16,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299666 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:40:16,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00039358 s, 935 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:16,178::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281615 s, 2.4 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:40:16,182::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000323443 s, 2.0 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:40:26,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:40:26,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000391389 s, 940 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:40:26,300::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:26,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:40:26,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:40:26,348::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000273738 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:26,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321151 s, 2.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:40:26,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000472358 s, 1.4 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:40:36,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:40:36,268::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000451876 s, 814 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:40:36,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:40:36,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000292012 s, 2.3 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:40:36,496::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:36,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:40:36,525::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000379614 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:36,530::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271468 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:40:46,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:40:46,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00053656 s, 686 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:40:46,463::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:40:46,478::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:40:46,480::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:40:46,486::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:40:46,488::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:40:46,488::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:40:46,488::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:40:46,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:40:46,500::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341767 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:46,542::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:40:46,573::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:40:46,577::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-467::DEBUG::2014-04-10 18:40:46,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:46,592::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-467::DEBUG::2014-04-10 18:40:46,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000348927 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:46,602::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:40:46,604::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:40:46,605::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-468::DEBUG::2014-04-10 18:40:46,623::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:46,630::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376948 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:40:56,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:40:56,297::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000525652 s, 700 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:40:56,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:40:56,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396557 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:40:56,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:40:56,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000462382 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:40:56,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:40:56,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371045 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:06,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:06,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000585874 s, 628 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:06,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:06,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000304043 s, 2.2 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:06,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:06,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00044797 s, 1.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:06,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:06,681::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390496 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:16,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:16,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000494239 s, 745 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:16,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:16,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366264 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:16,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:16,683::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000477286 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:16,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:16,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390163 s, 1.7 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:26,333::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:26,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486238 s, 757 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:26,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:26,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356326 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:26,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:26,708::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000554541 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:26,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:26,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0002656 s, 2.5 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:36,347::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:36,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493043 s, 746 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:36,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:36,579::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000381948 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:36,727::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:36,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000660859 s, 997 kB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:36,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:36,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000363814 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:46,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:46,368::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478512 s, 769 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:46,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:46,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362269 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:46,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:46,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000542937 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:46,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:46,790::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306055 s, 2.2 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:41:56,376::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:41:56,381::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000472086 s, 780 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:41:56,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:41:56,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000458811 s, 1.5 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:41:56,779::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:41:56,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000506626 s, 1.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:41:56,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:41:56,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379079 s, 1.8 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:42:06,384::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:42:06,401::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:42:06,402::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:42:06,408::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:42:06,409::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:42:06,409::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:42:06,410::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:42:06,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:06,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00045001 s, 818 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:06,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:06,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367837 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:06,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:06,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00048499 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:06,815::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:06,821::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003583 s, 1.9 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:42:16,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:16,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000589626 s, 624 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:16,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:16,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369069 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:16,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:16,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000481994 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:16,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:16,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321642 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5135::DEBUG::2014-04-10 18:42:17,677::task::579::TaskManager.Task::(_updateState) Task=`bb576acc-6737-49b3-a206-fda3eee3470e`::moving from state init -> state preparing
>Thread-5135::INFO::2014-04-10 18:42:17,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5135::INFO::2014-04-10 18:42:17,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481994', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369069', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321642', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589626', 'lastCheck': '1.2', 'valid': True}}
>Thread-5135::DEBUG::2014-04-10 18:42:17,678::task::1168::TaskManager.Task::(prepare) Task=`bb576acc-6737-49b3-a206-fda3eee3470e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481994', 'lastCheck': '0.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369069', 'lastCheck': '1.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321642', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589626', 'lastCheck': '1.2', 'valid': True}}
>Thread-5135::DEBUG::2014-04-10 18:42:17,678::task::579::TaskManager.Task::(_updateState) Task=`bb576acc-6737-49b3-a206-fda3eee3470e`::moving from state preparing -> state finished
>Thread-5135::DEBUG::2014-04-10 18:42:17,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5135::DEBUG::2014-04-10 18:42:17,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5135::DEBUG::2014-04-10 18:42:17,679::task::974::TaskManager.Task::(_decref) Task=`bb576acc-6737-49b3-a206-fda3eee3470e`::ref 0 aborting False
>Thread-5136::DEBUG::2014-04-10 18:42:17,919::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {}
>Thread-5136::DEBUG::2014-04-10 18:42:17,921::utils::505::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-5136::DEBUG::2014-04-10 18:42:17,930::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-5136::DEBUG::2014-04-10 18:42:17,962::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:libvirt'}], 'FC': []}, 'packages2': {'kernel': {'release': '456.el6.x86_64', 'buildtime': 1396920867.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6', 'buildtime': 1381834773L, 'version': '0.12.4'}, 'vdsm': {'release': '0.13.el6ev', 'buildtime': 1395572343L, 'version': '4.13.2'}, 'qemu-kvm': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'libvirt': {'release': '31.el6', 'buildtime': 1396956996L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz', 'hooks': {'before_vm_start': {'50_qemucmdline': {'md5': 'a884929ad6f5eb039887157288867409'}, '50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}, '10_faqemu': {'md5': '5bf2bb20a269b3f87e35adeb173ff5e8'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'after_device_migrate_destination': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_device_create': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'after_device_create': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_nic_hotplug': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_nic_hotplug': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'gateway': '10.66.111.254', 'netmask': '255.255.248.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'mtu': '1500', 'netmask': '255.255.248.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.66.111.254', 'ports': ['eth0']}}, 'uuid': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:85', 'cfg': {'UUID': '12a4e2bf-6097-40a1-b63e-d011f33e6a0a', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:85', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:84', 'cfg': {'UUID': '5d727cbd-fa15-4e3b-974e-73b003650876', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:84', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:83', 'cfg': {'UUID': '1a5fab89-fb19-451a-8c23-c74c9177ba4b', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:83', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:82', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': '6C:AE:8B:20:80:82', 'DEVICE': 'eth0'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.13', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:libvirt', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '48117', 'cpuSpeed': '2001.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.66.4.132'}}
>Thread-5137::DEBUG::2014-04-10 18:42:18,073::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getHardwareInfo with () {}
>Thread-5137::DEBUG::2014-04-10 18:42:18,090::BindingXMLRPC::982::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'System x3650 M4 -[7915I31]-', 'systemSerialNumber': '06FHNX8', 'systemFamily': 'System X', 'systemVersion': '0A', 'systemUUID': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'systemManufacturer': 'IBM'}}
>Thread-5140::DEBUG::2014-04-10 18:42:24,358::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-5140::DEBUG::2014-04-10 18:42:24,358::task::579::TaskManager.Task::(_updateState) Task=`211c7c65-3657-4333-87f8-e4857921a4e4`::moving from state init -> state preparing
>Thread-5140::INFO::2014-04-10 18:42:24,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5140::INFO::2014-04-10 18:42:24,359::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5140::DEBUG::2014-04-10 18:42:24,359::task::1168::TaskManager.Task::(prepare) Task=`211c7c65-3657-4333-87f8-e4857921a4e4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5140::DEBUG::2014-04-10 18:42:24,359::task::579::TaskManager.Task::(_updateState) Task=`211c7c65-3657-4333-87f8-e4857921a4e4`::moving from state preparing -> state finished
>Thread-5140::DEBUG::2014-04-10 18:42:24,359::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5140::DEBUG::2014-04-10 18:42:24,359::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5140::DEBUG::2014-04-10 18:42:24,360::task::974::TaskManager.Task::(_decref) Task=`211c7c65-3657-4333-87f8-e4857921a4e4`::ref 0 aborting False
>Thread-5141::DEBUG::2014-04-10 18:42:24,455::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-5141::DEBUG::2014-04-10 18:42:24,455::task::579::TaskManager.Task::(_updateState) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::moving from state init -> state preparing
>Thread-5141::INFO::2014-04-10 18:42:24,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5141::DEBUG::2014-04-10 18:42:24,456::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6fbe3486-5341-4ad2-ae7b-dc0365e8c8b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5141::DEBUG::2014-04-10 18:42:24,456::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5141::DEBUG::2014-04-10 18:42:24,456::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5141::DEBUG::2014-04-10 18:42:24,456::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6fbe3486-5341-4ad2-ae7b-dc0365e8c8b8`::Granted request
>Thread-5141::DEBUG::2014-04-10 18:42:24,457::task::811::TaskManager.Task::(resourceAcquired) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5141::DEBUG::2014-04-10 18:42:24,457::task::974::TaskManager.Task::(_decref) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::ref 1 aborting False
>Thread-5141::INFO::2014-04-10 18:42:24,459::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5141::DEBUG::2014-04-10 18:42:24,459::task::1168::TaskManager.Task::(prepare) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5141::DEBUG::2014-04-10 18:42:24,459::task::579::TaskManager.Task::(_updateState) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::moving from state preparing -> state finished
>Thread-5141::DEBUG::2014-04-10 18:42:24,459::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5141::DEBUG::2014-04-10 18:42:24,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5141::DEBUG::2014-04-10 18:42:24,460::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5141::DEBUG::2014-04-10 18:42:24,460::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5141::DEBUG::2014-04-10 18:42:24,460::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5141::DEBUG::2014-04-10 18:42:24,460::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5141::DEBUG::2014-04-10 18:42:24,460::task::974::TaskManager.Task::(_decref) Task=`7afca4e9-75df-47f6-94d4-a0994e172e7f`::ref 0 aborting False
>Thread-5142::DEBUG::2014-04-10 18:42:24,736::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-5142::DEBUG::2014-04-10 18:42:24,737::task::579::TaskManager.Task::(_updateState) Task=`f14375b9-f2b0-4ed9-ba22-3dfa3e7119a6`::moving from state init -> state preparing
>Thread-5142::INFO::2014-04-10 18:42:24,737::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None)
>Thread-5142::DEBUG::2014-04-10 18:42:24,737::taskManager::181::TaskManager::(getAllTasksInfo) Entry.
>Thread-5142::DEBUG::2014-04-10 18:42:24,737::taskManager::192::TaskManager::(getAllTasksInfo) Return. Response: {}
>Thread-5142::INFO::2014-04-10 18:42:24,737::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}}
>Thread-5142::DEBUG::2014-04-10 18:42:24,738::task::1168::TaskManager.Task::(prepare) Task=`f14375b9-f2b0-4ed9-ba22-3dfa3e7119a6`::finished: {'allTasksInfo': {}}
>Thread-5142::DEBUG::2014-04-10 18:42:24,738::task::579::TaskManager.Task::(_updateState) Task=`f14375b9-f2b0-4ed9-ba22-3dfa3e7119a6`::moving from state preparing -> state finished
>Thread-5142::DEBUG::2014-04-10 18:42:24,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5142::DEBUG::2014-04-10 18:42:24,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5142::DEBUG::2014-04-10 18:42:24,738::task::974::TaskManager.Task::(_decref) Task=`f14375b9-f2b0-4ed9-ba22-3dfa3e7119a6`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:42:26,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:26,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487926 s, 754 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:26,652::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:26,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000356014 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:26,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:26,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000484678 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:26,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:26,852::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344558 s, 1.9 MB/s\n'; <rc> = 0
>Thread-5146::DEBUG::2014-04-10 18:42:34,721::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5146::DEBUG::2014-04-10 18:42:34,722::task::579::TaskManager.Task::(_updateState) Task=`6c08548b-affd-48ca-9451-2e2ca4c46e11`::moving from state init -> state preparing
>Thread-5146::INFO::2014-04-10 18:42:34,722::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5146::INFO::2014-04-10 18:42:34,723::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5146::DEBUG::2014-04-10 18:42:34,723::task::1168::TaskManager.Task::(prepare) Task=`6c08548b-affd-48ca-9451-2e2ca4c46e11`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5146::DEBUG::2014-04-10 18:42:34,723::task::579::TaskManager.Task::(_updateState) Task=`6c08548b-affd-48ca-9451-2e2ca4c46e11`::moving from state preparing -> state finished
>Thread-5146::DEBUG::2014-04-10 18:42:34,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5146::DEBUG::2014-04-10 18:42:34,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5146::DEBUG::2014-04-10 18:42:34,723::task::974::TaskManager.Task::(_decref) Task=`6c08548b-affd-48ca-9451-2e2ca4c46e11`::ref 0 aborting False
>Thread-5147::DEBUG::2014-04-10 18:42:34,752::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5147::DEBUG::2014-04-10 18:42:34,752::task::579::TaskManager.Task::(_updateState) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::moving from state init -> state preparing
>Thread-5147::INFO::2014-04-10 18:42:34,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5147::DEBUG::2014-04-10 18:42:34,753::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c81bff7-4eb4-41e2-85dd-6e24a4b419cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5147::DEBUG::2014-04-10 18:42:34,753::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5147::DEBUG::2014-04-10 18:42:34,753::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5147::DEBUG::2014-04-10 18:42:34,753::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c81bff7-4eb4-41e2-85dd-6e24a4b419cc`::Granted request
>Thread-5147::DEBUG::2014-04-10 18:42:34,754::task::811::TaskManager.Task::(resourceAcquired) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5147::DEBUG::2014-04-10 18:42:34,754::task::974::TaskManager.Task::(_decref) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::ref 1 aborting False
>Thread-5147::INFO::2014-04-10 18:42:34,756::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5147::DEBUG::2014-04-10 18:42:34,756::task::1168::TaskManager.Task::(prepare) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5147::DEBUG::2014-04-10 18:42:34,756::task::579::TaskManager.Task::(_updateState) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::moving from state preparing -> state finished
>Thread-5147::DEBUG::2014-04-10 18:42:34,756::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5147::DEBUG::2014-04-10 18:42:34,756::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5147::DEBUG::2014-04-10 18:42:34,757::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5147::DEBUG::2014-04-10 18:42:34,757::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5147::DEBUG::2014-04-10 18:42:34,757::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5147::DEBUG::2014-04-10 18:42:34,757::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5147::DEBUG::2014-04-10 18:42:34,757::task::974::TaskManager.Task::(_decref) Task=`6afb1485-b483-42e5-8742-b057b3bb4eed`::ref 0 aborting False
>Thread-5148::DEBUG::2014-04-10 18:42:34,958::task::579::TaskManager.Task::(_updateState) Task=`152489e4-0263-41a9-b86d-52f2c90cdcb9`::moving from state init -> state preparing
>Thread-5148::INFO::2014-04-10 18:42:34,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5148::INFO::2014-04-10 18:42:34,959::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484678', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356014', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344558', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487926', 'lastCheck': '8.5', 'valid': True}}
>Thread-5148::DEBUG::2014-04-10 18:42:34,959::task::1168::TaskManager.Task::(prepare) Task=`152489e4-0263-41a9-b86d-52f2c90cdcb9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484678', 'lastCheck': '8.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000356014', 'lastCheck': '8.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344558', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487926', 'lastCheck': '8.5', 'valid': True}}
>Thread-5148::DEBUG::2014-04-10 18:42:34,959::task::579::TaskManager.Task::(_updateState) Task=`152489e4-0263-41a9-b86d-52f2c90cdcb9`::moving from state preparing -> state finished
>Thread-5148::DEBUG::2014-04-10 18:42:34,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5148::DEBUG::2014-04-10 18:42:34,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5148::DEBUG::2014-04-10 18:42:34,959::task::974::TaskManager.Task::(_decref) Task=`152489e4-0263-41a9-b86d-52f2c90cdcb9`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:42:36,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:36,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000545376 s, 675 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:36,668::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:36,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367496 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:36,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:36,849::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000569303 s, 1.2 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:36,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:36,867::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000380061 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5153::DEBUG::2014-04-10 18:42:44,850::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5153::DEBUG::2014-04-10 18:42:44,851::task::579::TaskManager.Task::(_updateState) Task=`3cb75d00-988b-4576-b959-f4a162b231f9`::moving from state init -> state preparing
>Thread-5153::INFO::2014-04-10 18:42:44,851::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5153::INFO::2014-04-10 18:42:44,852::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5153::DEBUG::2014-04-10 18:42:44,852::task::1168::TaskManager.Task::(prepare) Task=`3cb75d00-988b-4576-b959-f4a162b231f9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5153::DEBUG::2014-04-10 18:42:44,852::task::579::TaskManager.Task::(_updateState) Task=`3cb75d00-988b-4576-b959-f4a162b231f9`::moving from state preparing -> state finished
>Thread-5153::DEBUG::2014-04-10 18:42:44,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5153::DEBUG::2014-04-10 18:42:44,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5153::DEBUG::2014-04-10 18:42:44,852::task::974::TaskManager.Task::(_decref) Task=`3cb75d00-988b-4576-b959-f4a162b231f9`::ref 0 aborting False
>Thread-5154::DEBUG::2014-04-10 18:42:44,868::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5154::DEBUG::2014-04-10 18:42:44,868::task::579::TaskManager.Task::(_updateState) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::moving from state init -> state preparing
>Thread-5154::INFO::2014-04-10 18:42:44,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5154::DEBUG::2014-04-10 18:42:44,869::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7efae00-c7e0-4149-b18e-a39e0f8048ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5154::DEBUG::2014-04-10 18:42:44,869::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5154::DEBUG::2014-04-10 18:42:44,869::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5154::DEBUG::2014-04-10 18:42:44,869::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b7efae00-c7e0-4149-b18e-a39e0f8048ce`::Granted request
>Thread-5154::DEBUG::2014-04-10 18:42:44,870::task::811::TaskManager.Task::(resourceAcquired) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5154::DEBUG::2014-04-10 18:42:44,870::task::974::TaskManager.Task::(_decref) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::ref 1 aborting False
>Thread-5154::INFO::2014-04-10 18:42:44,872::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5154::DEBUG::2014-04-10 18:42:44,872::task::1168::TaskManager.Task::(prepare) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5154::DEBUG::2014-04-10 18:42:44,872::task::579::TaskManager.Task::(_updateState) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::moving from state preparing -> state finished
>Thread-5154::DEBUG::2014-04-10 18:42:44,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5154::DEBUG::2014-04-10 18:42:44,873::task::974::TaskManager.Task::(_decref) Task=`073a0098-0bc0-425b-8cee-9679ff8aecf3`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:42:46,472::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:46,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000375283 s, 981 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:46,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:46,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310456 s, 2.2 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:46,859::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:46,864::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000417146 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:46,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:46,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338534 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5156::DEBUG::2014-04-10 18:42:50,738::task::579::TaskManager.Task::(_updateState) Task=`b60152bf-4d02-499c-b707-b537e7f1fb06`::moving from state init -> state preparing
>Thread-5156::INFO::2014-04-10 18:42:50,738::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5156::INFO::2014-04-10 18:42:50,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417146', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310456', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338534', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375283', 'lastCheck': '4.3', 'valid': True}}
>Thread-5156::DEBUG::2014-04-10 18:42:50,739::task::1168::TaskManager.Task::(prepare) Task=`b60152bf-4d02-499c-b707-b537e7f1fb06`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417146', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000310456', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338534', 'lastCheck': '3.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375283', 'lastCheck': '4.3', 'valid': True}}
>Thread-5156::DEBUG::2014-04-10 18:42:50,739::task::579::TaskManager.Task::(_updateState) Task=`b60152bf-4d02-499c-b707-b537e7f1fb06`::moving from state preparing -> state finished
>Thread-5156::DEBUG::2014-04-10 18:42:50,739::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5156::DEBUG::2014-04-10 18:42:50,739::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5156::DEBUG::2014-04-10 18:42:50,739::task::974::TaskManager.Task::(_decref) Task=`b60152bf-4d02-499c-b707-b537e7f1fb06`::ref 0 aborting False
>Thread-5159::DEBUG::2014-04-10 18:42:55,035::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5159::DEBUG::2014-04-10 18:42:55,035::task::579::TaskManager.Task::(_updateState) Task=`ed546330-8187-421c-8765-fec66f64a2d5`::moving from state init -> state preparing
>Thread-5159::INFO::2014-04-10 18:42:55,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5159::INFO::2014-04-10 18:42:55,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5159::DEBUG::2014-04-10 18:42:55,036::task::1168::TaskManager.Task::(prepare) Task=`ed546330-8187-421c-8765-fec66f64a2d5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5159::DEBUG::2014-04-10 18:42:55,036::task::579::TaskManager.Task::(_updateState) Task=`ed546330-8187-421c-8765-fec66f64a2d5`::moving from state preparing -> state finished
>Thread-5159::DEBUG::2014-04-10 18:42:55,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5159::DEBUG::2014-04-10 18:42:55,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5159::DEBUG::2014-04-10 18:42:55,037::task::974::TaskManager.Task::(_decref) Task=`ed546330-8187-421c-8765-fec66f64a2d5`::ref 0 aborting False
>Thread-5160::DEBUG::2014-04-10 18:42:55,066::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5160::DEBUG::2014-04-10 18:42:55,066::task::579::TaskManager.Task::(_updateState) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::moving from state init -> state preparing
>Thread-5160::INFO::2014-04-10 18:42:55,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5160::DEBUG::2014-04-10 18:42:55,067::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`196602ae-bb6f-421b-a2dd-bbbcd3795d06`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5160::DEBUG::2014-04-10 18:42:55,067::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5160::DEBUG::2014-04-10 18:42:55,067::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5160::DEBUG::2014-04-10 18:42:55,068::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`196602ae-bb6f-421b-a2dd-bbbcd3795d06`::Granted request
>Thread-5160::DEBUG::2014-04-10 18:42:55,068::task::811::TaskManager.Task::(resourceAcquired) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5160::DEBUG::2014-04-10 18:42:55,068::task::974::TaskManager.Task::(_decref) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::ref 1 aborting False
>Thread-5160::INFO::2014-04-10 18:42:55,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5160::DEBUG::2014-04-10 18:42:55,070::task::1168::TaskManager.Task::(prepare) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5160::DEBUG::2014-04-10 18:42:55,070::task::579::TaskManager.Task::(_updateState) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::moving from state preparing -> state finished
>Thread-5160::DEBUG::2014-04-10 18:42:55,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5160::DEBUG::2014-04-10 18:42:55,071::task::974::TaskManager.Task::(_decref) Task=`44606048-2e5b-428d-81c3-3bf608a58edf`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:42:56,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:42:56,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000399024 s, 922 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:42:56,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:42:56,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367284 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:42:56,874::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:42:56,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000382196 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:42:56,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:42:56,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369026 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5164::DEBUG::2014-04-10 18:43:05,259::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5164::DEBUG::2014-04-10 18:43:05,259::task::579::TaskManager.Task::(_updateState) Task=`31004058-2b17-47dd-9fa0-9dc7b2e9f1ee`::moving from state init -> state preparing
>Thread-5164::INFO::2014-04-10 18:43:05,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5164::INFO::2014-04-10 18:43:05,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5164::DEBUG::2014-04-10 18:43:05,260::task::1168::TaskManager.Task::(prepare) Task=`31004058-2b17-47dd-9fa0-9dc7b2e9f1ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5164::DEBUG::2014-04-10 18:43:05,260::task::579::TaskManager.Task::(_updateState) Task=`31004058-2b17-47dd-9fa0-9dc7b2e9f1ee`::moving from state preparing -> state finished
>Thread-5164::DEBUG::2014-04-10 18:43:05,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5164::DEBUG::2014-04-10 18:43:05,260::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5164::DEBUG::2014-04-10 18:43:05,261::task::974::TaskManager.Task::(_decref) Task=`31004058-2b17-47dd-9fa0-9dc7b2e9f1ee`::ref 0 aborting False
>Thread-5165::DEBUG::2014-04-10 18:43:05,274::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5165::DEBUG::2014-04-10 18:43:05,274::task::579::TaskManager.Task::(_updateState) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::moving from state init -> state preparing
>Thread-5165::INFO::2014-04-10 18:43:05,275::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5165::DEBUG::2014-04-10 18:43:05,275::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5eed73fa-9f7b-4f33-a655-91ed44e5b6cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5165::DEBUG::2014-04-10 18:43:05,275::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5165::DEBUG::2014-04-10 18:43:05,275::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5165::DEBUG::2014-04-10 18:43:05,276::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5eed73fa-9f7b-4f33-a655-91ed44e5b6cd`::Granted request
>Thread-5165::DEBUG::2014-04-10 18:43:05,276::task::811::TaskManager.Task::(resourceAcquired) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5165::DEBUG::2014-04-10 18:43:05,276::task::974::TaskManager.Task::(_decref) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::ref 1 aborting False
>Thread-5165::INFO::2014-04-10 18:43:05,278::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5165::DEBUG::2014-04-10 18:43:05,278::task::1168::TaskManager.Task::(prepare) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5165::DEBUG::2014-04-10 18:43:05,278::task::579::TaskManager.Task::(_updateState) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::moving from state preparing -> state finished
>Thread-5165::DEBUG::2014-04-10 18:43:05,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5165::DEBUG::2014-04-10 18:43:05,279::task::974::TaskManager.Task::(_decref) Task=`e5bf0049-fc69-4cbb-93b6-a16fad44a868`::ref 0 aborting False
>Thread-5166::DEBUG::2014-04-10 18:43:06,205::task::579::TaskManager.Task::(_updateState) Task=`40413c27-c481-457f-a6ce-1778bf70bc64`::moving from state init -> state preparing
>Thread-5166::INFO::2014-04-10 18:43:06,206::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5166::INFO::2014-04-10 18:43:06,206::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382196', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367284', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369026', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399024', 'lastCheck': '9.7', 'valid': True}}
>Thread-5166::DEBUG::2014-04-10 18:43:06,206::task::1168::TaskManager.Task::(prepare) Task=`40413c27-c481-457f-a6ce-1778bf70bc64`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382196', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367284', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369026', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399024', 'lastCheck': '9.7', 'valid': True}}
>Thread-5166::DEBUG::2014-04-10 18:43:06,206::task::579::TaskManager.Task::(_updateState) Task=`40413c27-c481-457f-a6ce-1778bf70bc64`::moving from state preparing -> state finished
>Thread-5166::DEBUG::2014-04-10 18:43:06,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5166::DEBUG::2014-04-10 18:43:06,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5166::DEBUG::2014-04-10 18:43:06,207::task::974::TaskManager.Task::(_decref) Task=`40413c27-c481-457f-a6ce-1778bf70bc64`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:06,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:06,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000379962 s, 969 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:06,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:06,718::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000388319 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:06,889::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:06,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000406098 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:43:06,906::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:43:06,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277465 s, 2.4 MB/s\n'; <rc> = 0
>Thread-5170::DEBUG::2014-04-10 18:43:15,430::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5170::DEBUG::2014-04-10 18:43:15,431::task::579::TaskManager.Task::(_updateState) Task=`a492e73c-9dc4-42d9-9872-177026b1385b`::moving from state init -> state preparing
>Thread-5170::INFO::2014-04-10 18:43:15,431::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5170::INFO::2014-04-10 18:43:15,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5170::DEBUG::2014-04-10 18:43:15,431::task::1168::TaskManager.Task::(prepare) Task=`a492e73c-9dc4-42d9-9872-177026b1385b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5170::DEBUG::2014-04-10 18:43:15,431::task::579::TaskManager.Task::(_updateState) Task=`a492e73c-9dc4-42d9-9872-177026b1385b`::moving from state preparing -> state finished
>Thread-5170::DEBUG::2014-04-10 18:43:15,432::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5170::DEBUG::2014-04-10 18:43:15,432::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5170::DEBUG::2014-04-10 18:43:15,432::task::974::TaskManager.Task::(_decref) Task=`a492e73c-9dc4-42d9-9872-177026b1385b`::ref 0 aborting False
>Thread-5171::DEBUG::2014-04-10 18:43:15,452::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5171::DEBUG::2014-04-10 18:43:15,452::task::579::TaskManager.Task::(_updateState) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::moving from state init -> state preparing
>Thread-5171::INFO::2014-04-10 18:43:15,453::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5171::DEBUG::2014-04-10 18:43:15,453::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d435a0d-4395-4a8b-9ee5-820155015374`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5171::DEBUG::2014-04-10 18:43:15,453::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5171::DEBUG::2014-04-10 18:43:15,454::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5171::DEBUG::2014-04-10 18:43:15,454::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5d435a0d-4395-4a8b-9ee5-820155015374`::Granted request
>Thread-5171::DEBUG::2014-04-10 18:43:15,454::task::811::TaskManager.Task::(resourceAcquired) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5171::DEBUG::2014-04-10 18:43:15,454::task::974::TaskManager.Task::(_decref) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::ref 1 aborting False
>Thread-5171::INFO::2014-04-10 18:43:15,456::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5171::DEBUG::2014-04-10 18:43:15,457::task::1168::TaskManager.Task::(prepare) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5171::DEBUG::2014-04-10 18:43:15,457::task::579::TaskManager.Task::(_updateState) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::moving from state preparing -> state finished
>Thread-5171::DEBUG::2014-04-10 18:43:15,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5171::DEBUG::2014-04-10 18:43:15,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5171::DEBUG::2014-04-10 18:43:15,457::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5171::DEBUG::2014-04-10 18:43:15,458::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5171::DEBUG::2014-04-10 18:43:15,458::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5171::DEBUG::2014-04-10 18:43:15,458::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5171::DEBUG::2014-04-10 18:43:15,458::task::974::TaskManager.Task::(_decref) Task=`a4979186-2ccb-4242-8d8b-81d53f3ae97e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:16,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:16,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366852 s, 1.0 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:16,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:16,733::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000397697 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:16,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:16,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000366947 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:43:16,921::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:43:16,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000384027 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5174::DEBUG::2014-04-10 18:43:21,554::task::579::TaskManager.Task::(_updateState) Task=`65c9fe47-2513-44c6-8364-c7634001806b`::moving from state init -> state preparing
>Thread-5174::INFO::2014-04-10 18:43:21,554::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5174::INFO::2014-04-10 18:43:21,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366947', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397697', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384027', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366852', 'lastCheck': '5.0', 'valid': True}}
>Thread-5174::DEBUG::2014-04-10 18:43:21,555::task::1168::TaskManager.Task::(prepare) Task=`65c9fe47-2513-44c6-8364-c7634001806b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366947', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397697', 'lastCheck': '4.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000384027', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366852', 'lastCheck': '5.0', 'valid': True}}
>Thread-5174::DEBUG::2014-04-10 18:43:21,555::task::579::TaskManager.Task::(_updateState) Task=`65c9fe47-2513-44c6-8364-c7634001806b`::moving from state preparing -> state finished
>Thread-5174::DEBUG::2014-04-10 18:43:21,555::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5174::DEBUG::2014-04-10 18:43:21,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5174::DEBUG::2014-04-10 18:43:21,556::task::974::TaskManager.Task::(_decref) Task=`65c9fe47-2513-44c6-8364-c7634001806b`::ref 0 aborting False
>Thread-5177::DEBUG::2014-04-10 18:43:25,569::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5177::DEBUG::2014-04-10 18:43:25,570::task::579::TaskManager.Task::(_updateState) Task=`be4bad81-e1e4-4b33-9919-2a7bdba62985`::moving from state init -> state preparing
>Thread-5177::INFO::2014-04-10 18:43:25,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5177::INFO::2014-04-10 18:43:25,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5177::DEBUG::2014-04-10 18:43:25,571::task::1168::TaskManager.Task::(prepare) Task=`be4bad81-e1e4-4b33-9919-2a7bdba62985`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5177::DEBUG::2014-04-10 18:43:25,571::task::579::TaskManager.Task::(_updateState) Task=`be4bad81-e1e4-4b33-9919-2a7bdba62985`::moving from state preparing -> state finished
>Thread-5177::DEBUG::2014-04-10 18:43:25,571::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5177::DEBUG::2014-04-10 18:43:25,571::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5177::DEBUG::2014-04-10 18:43:25,571::task::974::TaskManager.Task::(_decref) Task=`be4bad81-e1e4-4b33-9919-2a7bdba62985`::ref 0 aborting False
>Thread-5178::DEBUG::2014-04-10 18:43:25,583::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5178::DEBUG::2014-04-10 18:43:25,583::task::579::TaskManager.Task::(_updateState) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::moving from state init -> state preparing
>Thread-5178::INFO::2014-04-10 18:43:25,583::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5178::DEBUG::2014-04-10 18:43:25,584::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a8caa6a4-b7ce-413a-a3eb-6b50174bc1dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5178::DEBUG::2014-04-10 18:43:25,584::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5178::DEBUG::2014-04-10 18:43:25,584::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5178::DEBUG::2014-04-10 18:43:25,584::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a8caa6a4-b7ce-413a-a3eb-6b50174bc1dc`::Granted request
>Thread-5178::DEBUG::2014-04-10 18:43:25,585::task::811::TaskManager.Task::(resourceAcquired) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5178::DEBUG::2014-04-10 18:43:25,585::task::974::TaskManager.Task::(_decref) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::ref 1 aborting False
>Thread-5178::INFO::2014-04-10 18:43:25,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5178::DEBUG::2014-04-10 18:43:25,587::task::1168::TaskManager.Task::(prepare) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5178::DEBUG::2014-04-10 18:43:25,587::task::579::TaskManager.Task::(_updateState) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::moving from state preparing -> state finished
>Thread-5178::DEBUG::2014-04-10 18:43:25,587::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5178::DEBUG::2014-04-10 18:43:25,587::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5178::DEBUG::2014-04-10 18:43:25,588::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5178::DEBUG::2014-04-10 18:43:25,588::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5178::DEBUG::2014-04-10 18:43:25,588::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5178::DEBUG::2014-04-10 18:43:25,588::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5178::DEBUG::2014-04-10 18:43:25,588::task::974::TaskManager.Task::(_decref) Task=`ec29c2e0-919a-4483-9943-fbaedbda8d3f`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:26,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:26,540::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000440561 s, 835 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:26,742::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:26,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359354 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:26,919::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:26,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00046375 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:43:26,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:43:26,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332156 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5181::DEBUG::2014-04-10 18:43:33,205::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [45ec87b5]
>Thread-5181::DEBUG::2014-04-10 18:43:33,206::task::579::TaskManager.Task::(_updateState) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::moving from state init -> state preparing
>Thread-5181::INFO::2014-04-10 18:43:33,206::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='fe90abc5-8638-40e8-b394-9082b3217731', postZero='false', force='false')
>Thread-5181::DEBUG::2014-04-10 18:43:33,206::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.fe90abc5-8638-40e8-b394-9082b3217731`ReqID=`c3a1330b-432f-4163-917e-bb0516fdfc4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage'
>Thread-5181::DEBUG::2014-04-10 18:43:33,207::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731' for lock type 'exclusive'
>Thread-5181::DEBUG::2014-04-10 18:43:33,207::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731' is free. Now locking as 'exclusive' (1 active user)
>Thread-5181::DEBUG::2014-04-10 18:43:33,207::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.fe90abc5-8638-40e8-b394-9082b3217731`ReqID=`c3a1330b-432f-4163-917e-bb0516fdfc4e`::Granted request
>Thread-5181::DEBUG::2014-04-10 18:43:33,207::task::811::TaskManager.Task::(resourceAcquired) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_resourcesAcquired: Storage.fe90abc5-8638-40e8-b394-9082b3217731 (exclusive)
>Thread-5181::DEBUG::2014-04-10 18:43:33,207::task::974::TaskManager.Task::(_decref) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::ref 1 aborting False
>Thread-5181::DEBUG::2014-04-10 18:43:33,208::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`7d1e0fcf-9df1-498f-916c-ed8920ae5b60`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage'
>Thread-5181::DEBUG::2014-04-10 18:43:33,208::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'shared'
>Thread-5181::DEBUG::2014-04-10 18:43:33,208::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'shared' (1 active user)
>Thread-5181::DEBUG::2014-04-10 18:43:33,208::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`7d1e0fcf-9df1-498f-916c-ed8920ae5b60`::Granted request
>Thread-5181::DEBUG::2014-04-10 18:43:33,208::task::811::TaskManager.Task::(resourceAcquired) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_resourcesAcquired: Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (shared)
>Thread-5181::DEBUG::2014-04-10 18:43:33,209::task::974::TaskManager.Task::(_decref) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::ref 1 aborting False
>Thread-5181::DEBUG::2014-04-10 18:43:33,377::task::736::TaskManager.Task::(_save) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8.temp
>Thread-5181::DEBUG::2014-04-10 18:43:33,435::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_fe90abc5-8638-40e8-b394-9082b3217731 for task 3dbc2fba-0d3c-473d-afca-ee32615bdae8 
>Thread-5181::INFO::2014-04-10 18:43:33,436::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
>Thread-5181::DEBUG::2014-04-10 18:43:33,436::task::1163::TaskManager.Task::(prepare) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::Prepare: 1 jobs exist, move to acquiring
>Thread-5181::DEBUG::2014-04-10 18:43:33,436::task::579::TaskManager.Task::(_updateState) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::moving from state preparing -> state acquiring
>Thread-5181::DEBUG::2014-04-10 18:43:33,436::task::736::TaskManager.Task::(_save) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8.temp
>Thread-5181::DEBUG::2014-04-10 18:43:33,445::task::579::TaskManager.Task::(_updateState) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::moving from state acquiring -> state queued
>Thread-5181::DEBUG::2014-04-10 18:43:33,445::task::736::TaskManager.Task::(_save) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8.temp
>Thread-5181::DEBUG::2014-04-10 18:43:33,454::taskManager::50::TaskManager::(_queueTask) queuing task: 3dbc2fba-0d3c-473d-afca-ee32615bdae8
>Thread-5181::DEBUG::2014-04-10 18:43:33,454::taskManager::56::TaskManager::(_queueTask) task queued: 3dbc2fba-0d3c-473d-afca-ee32615bdae8
>Thread-2::DEBUG::2014-04-10 18:43:33,454::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-5181::DEBUG::2014-04-10 18:43:33,454::task::1165::TaskManager.Task::(prepare) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::returning
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,455::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 3dbc2fba-0d3c-473d-afca-ee32615bdae8 running: <bound method Task.commit of <storage.task.Task instance at 0x7f3734117908>> with: None
>Thread-5181::DEBUG::2014-04-10 18:43:33,455::task::974::TaskManager.Task::(_decref) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::ref 0 aborting False
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,455::task::1176::TaskManager.Task::(commit) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::committing task: 3dbc2fba-0d3c-473d-afca-ee32615bdae8
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,456::task::579::TaskManager.Task::(_updateState) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::moving from state queued -> state running
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,457::task::736::TaskManager.Task::(_save) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8.temp
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,466::task::889::TaskManager.Task::(_runJobs) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::Task.run: running job 0: deleteImage_fe90abc5-8638-40e8-b394-9082b3217731: <function <lambda> at 0x7f37340f7a28> (args: () kwargs: {})
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,466::task::315::TaskManager.Task::(run) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::Job.run: running deleteImage_fe90abc5-8638-40e8-b394-9082b3217731: <function <lambda> at 0x7f37340f7a28> (args: () kwargs: {}) callback None
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,466::task::579::TaskManager.Task::(_updateState) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::moving from state running -> state finished
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,466::task::736::TaskManager.Task::(_save) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8 temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/3dbc2fba-0d3c-473d-afca-ee32615bdae8.temp
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': < ResourceRef 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', isValid: 'True' obj: 'None'>, 'Storage.fe90abc5-8638-40e8-b394-9082b3217731': < ResourceRef 'Storage.fe90abc5-8638-40e8-b394-9082b3217731', isValid: 'True' obj: 'None'>}
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,476::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,477::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,477::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,477::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,477::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731'
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,477::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731' (0 active users)
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,478::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731' is free, finding out if anyone is waiting for it.
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,478::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.fe90abc5-8638-40e8-b394-9082b3217731', Clearing records.
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,478::task::897::TaskManager.Task::(_runJobs) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::Task.run: exit - success: result True
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,478::task::974::TaskManager.Task::(_decref) Task=`3dbc2fba-0d3c-473d-afca-ee32615bdae8`::ref 0 aborting False
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:43:33,478::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-5183::DEBUG::2014-04-10 18:43:35,744::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5183::DEBUG::2014-04-10 18:43:35,745::task::579::TaskManager.Task::(_updateState) Task=`922a4908-7a71-432b-8c04-70003a4e2a37`::moving from state init -> state preparing
>Thread-5183::INFO::2014-04-10 18:43:35,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5183::INFO::2014-04-10 18:43:35,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5183::DEBUG::2014-04-10 18:43:35,746::task::1168::TaskManager.Task::(prepare) Task=`922a4908-7a71-432b-8c04-70003a4e2a37`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5183::DEBUG::2014-04-10 18:43:35,746::task::579::TaskManager.Task::(_updateState) Task=`922a4908-7a71-432b-8c04-70003a4e2a37`::moving from state preparing -> state finished
>Thread-5183::DEBUG::2014-04-10 18:43:35,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5183::DEBUG::2014-04-10 18:43:35,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5183::DEBUG::2014-04-10 18:43:35,746::task::974::TaskManager.Task::(_decref) Task=`922a4908-7a71-432b-8c04-70003a4e2a37`::ref 0 aborting False
>Thread-5184::DEBUG::2014-04-10 18:43:35,759::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5184::DEBUG::2014-04-10 18:43:35,759::task::579::TaskManager.Task::(_updateState) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::moving from state init -> state preparing
>Thread-5184::INFO::2014-04-10 18:43:35,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5184::DEBUG::2014-04-10 18:43:35,760::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbf9b914-8cb6-43c8-b12a-3f58be146d28`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5184::DEBUG::2014-04-10 18:43:35,760::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5184::DEBUG::2014-04-10 18:43:35,760::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5184::DEBUG::2014-04-10 18:43:35,760::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbf9b914-8cb6-43c8-b12a-3f58be146d28`::Granted request
>Thread-5184::DEBUG::2014-04-10 18:43:35,761::task::811::TaskManager.Task::(resourceAcquired) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5184::DEBUG::2014-04-10 18:43:35,761::task::974::TaskManager.Task::(_decref) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::ref 1 aborting False
>Thread-5184::INFO::2014-04-10 18:43:35,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5184::DEBUG::2014-04-10 18:43:35,763::task::1168::TaskManager.Task::(prepare) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76827066368', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5184::DEBUG::2014-04-10 18:43:35,763::task::579::TaskManager.Task::(_updateState) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::moving from state preparing -> state finished
>Thread-5184::DEBUG::2014-04-10 18:43:35,763::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5184::DEBUG::2014-04-10 18:43:35,763::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5184::DEBUG::2014-04-10 18:43:35,764::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5184::DEBUG::2014-04-10 18:43:35,764::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5184::DEBUG::2014-04-10 18:43:35,764::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5184::DEBUG::2014-04-10 18:43:35,764::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5184::DEBUG::2014-04-10 18:43:35,764::task::974::TaskManager.Task::(_decref) Task=`745bf4e4-affe-40b4-a3b4-ab37d782a033`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:36,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:36,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00042534 s, 865 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:36,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:36,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00132008 s, 508 kB/s\n'; <rc> = 0
>Thread-5185::DEBUG::2014-04-10 18:43:36,837::task::579::TaskManager.Task::(_updateState) Task=`30d70228-b66c-4245-a7fe-fb0dd6c5bee4`::moving from state init -> state preparing
>Thread-5185::INFO::2014-04-10 18:43:36,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5185::INFO::2014-04-10 18:43:36,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046375', 'lastCheck': '9.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132008', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332156', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042534', 'lastCheck': '0.3', 'valid': True}}
>Thread-5185::DEBUG::2014-04-10 18:43:36,838::task::1168::TaskManager.Task::(prepare) Task=`30d70228-b66c-4245-a7fe-fb0dd6c5bee4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046375', 'lastCheck': '9.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132008', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332156', 'lastCheck': '9.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042534', 'lastCheck': '0.3', 'valid': True}}
>Thread-5185::DEBUG::2014-04-10 18:43:36,838::task::579::TaskManager.Task::(_updateState) Task=`30d70228-b66c-4245-a7fe-fb0dd6c5bee4`::moving from state preparing -> state finished
>Thread-5185::DEBUG::2014-04-10 18:43:36,838::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5185::DEBUG::2014-04-10 18:43:36,838::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5185::DEBUG::2014-04-10 18:43:36,838::task::974::TaskManager.Task::(_decref) Task=`30d70228-b66c-4245-a7fe-fb0dd6c5bee4`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 18:43:36,927::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:43:36,948::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:43:36,951::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:43:36,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:36,965::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-468::DEBUG::2014-04-10 18:43:36,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370548 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:36,974::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-467::INFO::2014-04-10 18:43:36,974::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-467::INFO::2014-04-10 18:43:36,976::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:43:36,991::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:36,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000389025 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5193::DEBUG::2014-04-10 18:43:43,361::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5193::DEBUG::2014-04-10 18:43:43,361::task::579::TaskManager.Task::(_updateState) Task=`ef82419c-f9b6-49bb-8c84-aba4c4bb60d0`::moving from state init -> state preparing
>Thread-5193::INFO::2014-04-10 18:43:43,362::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-5193::DEBUG::2014-04-10 18:43:43,362::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-5193::DEBUG::2014-04-10 18:43:43,362::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 3dbc2fba-0d3c-473d-afca-ee32615bdae8
>Thread-5193::DEBUG::2014-04-10 18:43:43,362::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3dbc2fba-0d3c-473d-afca-ee32615bdae8'}
>Thread-5193::DEBUG::2014-04-10 18:43:43,362::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'3dbc2fba-0d3c-473d-afca-ee32615bdae8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3dbc2fba-0d3c-473d-afca-ee32615bdae8'}}
>Thread-5193::INFO::2014-04-10 18:43:43,362::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3dbc2fba-0d3c-473d-afca-ee32615bdae8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3dbc2fba-0d3c-473d-afca-ee32615bdae8'}}}
>Thread-5193::DEBUG::2014-04-10 18:43:43,363::task::1168::TaskManager.Task::(prepare) Task=`ef82419c-f9b6-49bb-8c84-aba4c4bb60d0`::finished: {'allTasksStatus': {'3dbc2fba-0d3c-473d-afca-ee32615bdae8': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3dbc2fba-0d3c-473d-afca-ee32615bdae8'}}}
>Thread-5193::DEBUG::2014-04-10 18:43:43,363::task::579::TaskManager.Task::(_updateState) Task=`ef82419c-f9b6-49bb-8c84-aba4c4bb60d0`::moving from state preparing -> state finished
>Thread-5193::DEBUG::2014-04-10 18:43:43,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5193::DEBUG::2014-04-10 18:43:43,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5193::DEBUG::2014-04-10 18:43:43,363::task::974::TaskManager.Task::(_decref) Task=`ef82419c-f9b6-49bb-8c84-aba4c4bb60d0`::ref 0 aborting False
>Thread-5194::DEBUG::2014-04-10 18:43:43,663::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5194::DEBUG::2014-04-10 18:43:43,663::task::579::TaskManager.Task::(_updateState) Task=`e776a964-ef94-4ae0-aabf-de7b2ff86b5f`::moving from state init -> state preparing
>Thread-5194::INFO::2014-04-10 18:43:43,663::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3dbc2fba-0d3c-473d-afca-ee32615bdae8', spUUID=None, options=None)
>Thread-5194::DEBUG::2014-04-10 18:43:43,664::taskManager::161::TaskManager::(clearTask) Entry. taskID: 3dbc2fba-0d3c-473d-afca-ee32615bdae8
>Thread-5194::DEBUG::2014-04-10 18:43:43,668::taskManager::166::TaskManager::(clearTask) Return.
>Thread-5194::INFO::2014-04-10 18:43:43,669::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-5194::DEBUG::2014-04-10 18:43:43,669::task::1168::TaskManager.Task::(prepare) Task=`e776a964-ef94-4ae0-aabf-de7b2ff86b5f`::finished: None
>Thread-5194::DEBUG::2014-04-10 18:43:43,669::task::579::TaskManager.Task::(_updateState) Task=`e776a964-ef94-4ae0-aabf-de7b2ff86b5f`::moving from state preparing -> state finished
>Thread-5194::DEBUG::2014-04-10 18:43:43,669::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5194::DEBUG::2014-04-10 18:43:43,669::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5194::DEBUG::2014-04-10 18:43:43,669::task::974::TaskManager.Task::(_decref) Task=`e776a964-ef94-4ae0-aabf-de7b2ff86b5f`::ref 0 aborting False
>Thread-5195::DEBUG::2014-04-10 18:43:45,850::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5195::DEBUG::2014-04-10 18:43:45,851::task::579::TaskManager.Task::(_updateState) Task=`5bb9d965-45d1-46a5-a0c8-413f5c0aa4ae`::moving from state init -> state preparing
>Thread-5195::INFO::2014-04-10 18:43:45,851::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5195::INFO::2014-04-10 18:43:45,851::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5195::DEBUG::2014-04-10 18:43:45,852::task::1168::TaskManager.Task::(prepare) Task=`5bb9d965-45d1-46a5-a0c8-413f5c0aa4ae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5195::DEBUG::2014-04-10 18:43:45,852::task::579::TaskManager.Task::(_updateState) Task=`5bb9d965-45d1-46a5-a0c8-413f5c0aa4ae`::moving from state preparing -> state finished
>Thread-5195::DEBUG::2014-04-10 18:43:45,852::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5195::DEBUG::2014-04-10 18:43:45,852::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5195::DEBUG::2014-04-10 18:43:45,852::task::974::TaskManager.Task::(_decref) Task=`5bb9d965-45d1-46a5-a0c8-413f5c0aa4ae`::ref 0 aborting False
>Thread-5196::DEBUG::2014-04-10 18:43:45,863::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5196::DEBUG::2014-04-10 18:43:45,863::task::579::TaskManager.Task::(_updateState) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::moving from state init -> state preparing
>Thread-5196::INFO::2014-04-10 18:43:45,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5196::DEBUG::2014-04-10 18:43:45,864::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`adf21df4-46b6-4833-9d6e-0bb737d4d69a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5196::DEBUG::2014-04-10 18:43:45,864::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5196::DEBUG::2014-04-10 18:43:45,864::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5196::DEBUG::2014-04-10 18:43:45,864::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`adf21df4-46b6-4833-9d6e-0bb737d4d69a`::Granted request
>Thread-5196::DEBUG::2014-04-10 18:43:45,865::task::811::TaskManager.Task::(resourceAcquired) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5196::DEBUG::2014-04-10 18:43:45,865::task::974::TaskManager.Task::(_decref) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::ref 1 aborting False
>Thread-5196::INFO::2014-04-10 18:43:45,867::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5196::DEBUG::2014-04-10 18:43:45,867::task::1168::TaskManager.Task::(prepare) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5196::DEBUG::2014-04-10 18:43:45,867::task::579::TaskManager.Task::(_updateState) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::moving from state preparing -> state finished
>Thread-5196::DEBUG::2014-04-10 18:43:45,867::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5196::DEBUG::2014-04-10 18:43:45,867::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5196::DEBUG::2014-04-10 18:43:45,868::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5196::DEBUG::2014-04-10 18:43:45,868::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5196::DEBUG::2014-04-10 18:43:45,868::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5196::DEBUG::2014-04-10 18:43:45,868::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5196::DEBUG::2014-04-10 18:43:45,868::task::974::TaskManager.Task::(_decref) Task=`c6f31987-08ff-4cf3-8d07-8229505bf69e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:46,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:46,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000415404 s, 886 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:46,776::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:46,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359298 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:43:46,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:43:46,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368882 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:47,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:47,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000429328 s, 1.5 MB/s\n'; <rc> = 0
>Thread-5199::DEBUG::2014-04-10 18:43:52,112::task::579::TaskManager.Task::(_updateState) Task=`0659d3bf-4200-4d9f-b132-4a1b93c27699`::moving from state init -> state preparing
>Thread-5199::INFO::2014-04-10 18:43:52,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5199::INFO::2014-04-10 18:43:52,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429328', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359298', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368882', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415404', 'lastCheck': '5.5', 'valid': True}}
>Thread-5199::DEBUG::2014-04-10 18:43:52,113::task::1168::TaskManager.Task::(prepare) Task=`0659d3bf-4200-4d9f-b132-4a1b93c27699`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429328', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359298', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368882', 'lastCheck': '5.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000415404', 'lastCheck': '5.5', 'valid': True}}
>Thread-5199::DEBUG::2014-04-10 18:43:52,113::task::579::TaskManager.Task::(_updateState) Task=`0659d3bf-4200-4d9f-b132-4a1b93c27699`::moving from state preparing -> state finished
>Thread-5199::DEBUG::2014-04-10 18:43:52,113::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5199::DEBUG::2014-04-10 18:43:52,113::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5199::DEBUG::2014-04-10 18:43:52,114::task::974::TaskManager.Task::(_decref) Task=`0659d3bf-4200-4d9f-b132-4a1b93c27699`::ref 0 aborting False
>Thread-5202::DEBUG::2014-04-10 18:43:55,959::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5202::DEBUG::2014-04-10 18:43:55,959::task::579::TaskManager.Task::(_updateState) Task=`a4ae9501-651d-4488-9db9-df24eb5efec5`::moving from state init -> state preparing
>Thread-5202::INFO::2014-04-10 18:43:55,959::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5202::INFO::2014-04-10 18:43:55,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5202::DEBUG::2014-04-10 18:43:55,960::task::1168::TaskManager.Task::(prepare) Task=`a4ae9501-651d-4488-9db9-df24eb5efec5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5202::DEBUG::2014-04-10 18:43:55,960::task::579::TaskManager.Task::(_updateState) Task=`a4ae9501-651d-4488-9db9-df24eb5efec5`::moving from state preparing -> state finished
>Thread-5202::DEBUG::2014-04-10 18:43:55,960::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5202::DEBUG::2014-04-10 18:43:55,960::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5202::DEBUG::2014-04-10 18:43:55,960::task::974::TaskManager.Task::(_decref) Task=`a4ae9501-651d-4488-9db9-df24eb5efec5`::ref 0 aborting False
>Thread-5203::DEBUG::2014-04-10 18:43:55,974::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5203::DEBUG::2014-04-10 18:43:55,974::task::579::TaskManager.Task::(_updateState) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::moving from state init -> state preparing
>Thread-5203::INFO::2014-04-10 18:43:55,974::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5203::DEBUG::2014-04-10 18:43:55,975::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`453e4c9c-1e42-497f-b7ac-40f8c9804147`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5203::DEBUG::2014-04-10 18:43:55,975::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5203::DEBUG::2014-04-10 18:43:55,975::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5203::DEBUG::2014-04-10 18:43:55,975::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`453e4c9c-1e42-497f-b7ac-40f8c9804147`::Granted request
>Thread-5203::DEBUG::2014-04-10 18:43:55,976::task::811::TaskManager.Task::(resourceAcquired) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5203::DEBUG::2014-04-10 18:43:55,976::task::974::TaskManager.Task::(_decref) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::ref 1 aborting False
>Thread-5203::INFO::2014-04-10 18:43:55,978::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5203::DEBUG::2014-04-10 18:43:55,978::task::1168::TaskManager.Task::(prepare) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5203::DEBUG::2014-04-10 18:43:55,978::task::579::TaskManager.Task::(_updateState) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::moving from state preparing -> state finished
>Thread-5203::DEBUG::2014-04-10 18:43:55,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5203::DEBUG::2014-04-10 18:43:55,978::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5203::DEBUG::2014-04-10 18:43:55,979::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5203::DEBUG::2014-04-10 18:43:55,979::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5203::DEBUG::2014-04-10 18:43:55,979::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5203::DEBUG::2014-04-10 18:43:55,979::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5203::DEBUG::2014-04-10 18:43:55,979::task::974::TaskManager.Task::(_decref) Task=`078646ff-e14c-4279-bac6-7c9b96c8d56e`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:43:56,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:43:56,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000390073 s, 943 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:43:56,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:43:56,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000378579 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:43:57,006::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:43:57,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383646 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:43:57,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:43:57,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398704 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5207::DEBUG::2014-04-10 18:44:06,081::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5207::DEBUG::2014-04-10 18:44:06,082::task::579::TaskManager.Task::(_updateState) Task=`07536b1c-fd8d-4fe0-96cb-b6db072bb6f7`::moving from state init -> state preparing
>Thread-5207::INFO::2014-04-10 18:44:06,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5207::INFO::2014-04-10 18:44:06,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5207::DEBUG::2014-04-10 18:44:06,083::task::1168::TaskManager.Task::(prepare) Task=`07536b1c-fd8d-4fe0-96cb-b6db072bb6f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5207::DEBUG::2014-04-10 18:44:06,083::task::579::TaskManager.Task::(_updateState) Task=`07536b1c-fd8d-4fe0-96cb-b6db072bb6f7`::moving from state preparing -> state finished
>Thread-5207::DEBUG::2014-04-10 18:44:06,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5207::DEBUG::2014-04-10 18:44:06,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5207::DEBUG::2014-04-10 18:44:06,084::task::974::TaskManager.Task::(_decref) Task=`07536b1c-fd8d-4fe0-96cb-b6db072bb6f7`::ref 0 aborting False
>Thread-5208::DEBUG::2014-04-10 18:44:06,096::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5208::DEBUG::2014-04-10 18:44:06,096::task::579::TaskManager.Task::(_updateState) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::moving from state init -> state preparing
>Thread-5208::INFO::2014-04-10 18:44:06,096::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5208::DEBUG::2014-04-10 18:44:06,097::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b71dd82-fdb5-4d04-9897-e26e8d0bed10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5208::DEBUG::2014-04-10 18:44:06,097::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5208::DEBUG::2014-04-10 18:44:06,097::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5208::DEBUG::2014-04-10 18:44:06,097::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9b71dd82-fdb5-4d04-9897-e26e8d0bed10`::Granted request
>Thread-5208::DEBUG::2014-04-10 18:44:06,098::task::811::TaskManager.Task::(resourceAcquired) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5208::DEBUG::2014-04-10 18:44:06,098::task::974::TaskManager.Task::(_decref) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::ref 1 aborting False
>Thread-5208::INFO::2014-04-10 18:44:06,100::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5208::DEBUG::2014-04-10 18:44:06,100::task::1168::TaskManager.Task::(prepare) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081875456', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5208::DEBUG::2014-04-10 18:44:06,100::task::579::TaskManager.Task::(_updateState) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::moving from state preparing -> state finished
>Thread-5208::DEBUG::2014-04-10 18:44:06,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5208::DEBUG::2014-04-10 18:44:06,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5208::DEBUG::2014-04-10 18:44:06,101::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5208::DEBUG::2014-04-10 18:44:06,101::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5208::DEBUG::2014-04-10 18:44:06,101::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5208::DEBUG::2014-04-10 18:44:06,101::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5208::DEBUG::2014-04-10 18:44:06,101::task::974::TaskManager.Task::(_decref) Task=`c28c655a-4803-4e41-bb90-5b08b5d517d0`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:06,595::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:44:06,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000346242 s, 1.1 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:44:06,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:06,814::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345511 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:07,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:07,025::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344521 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:07,041::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:07,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000376071 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5209::DEBUG::2014-04-10 18:44:07,403::task::579::TaskManager.Task::(_updateState) Task=`2f2993b0-4d93-47cb-a479-852529d3a0a4`::moving from state init -> state preparing
>Thread-5209::INFO::2014-04-10 18:44:07,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5209::INFO::2014-04-10 18:44:07,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376071', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345511', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344521', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346242', 'lastCheck': '0.8', 'valid': True}}
>Thread-5209::DEBUG::2014-04-10 18:44:07,404::task::1168::TaskManager.Task::(prepare) Task=`2f2993b0-4d93-47cb-a479-852529d3a0a4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376071', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345511', 'lastCheck': '0.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000344521', 'lastCheck': '0.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346242', 'lastCheck': '0.8', 'valid': True}}
>Thread-5209::DEBUG::2014-04-10 18:44:07,404::task::579::TaskManager.Task::(_updateState) Task=`2f2993b0-4d93-47cb-a479-852529d3a0a4`::moving from state preparing -> state finished
>Thread-5209::DEBUG::2014-04-10 18:44:07,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5209::DEBUG::2014-04-10 18:44:07,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5209::DEBUG::2014-04-10 18:44:07,404::task::974::TaskManager.Task::(_decref) Task=`2f2993b0-4d93-47cb-a479-852529d3a0a4`::ref 0 aborting False
>Thread-5212::DEBUG::2014-04-10 18:44:12,027::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c959e75]
>Thread-5212::DEBUG::2014-04-10 18:44:12,037::task::579::TaskManager.Task::(_updateState) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::moving from state init -> state preparing
>Thread-5212::INFO::2014-04-10 18:44:12,037::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', size='5368709120', volFormat=5, preallocate=2, diskType=2, volUUID='24018d18-27a2-462e-94df-c84585e4a0df', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000')
>Thread-5212::DEBUG::2014-04-10 18:44:12,038::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`319960bd-e5da-4015-b28b-30082329b345`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1484' at 'createVolume'
>Thread-5212::DEBUG::2014-04-10 18:44:12,038::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-5212::DEBUG::2014-04-10 18:44:12,038::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-5212::DEBUG::2014-04-10 18:44:12,038::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`319960bd-e5da-4015-b28b-30082329b345`::Granted request
>Thread-5212::DEBUG::2014-04-10 18:44:12,039::task::811::TaskManager.Task::(resourceAcquired) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-5212::DEBUG::2014-04-10 18:44:12,039::task::974::TaskManager.Task::(_decref) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::ref 1 aborting False
>Thread-5212::DEBUG::2014-04-10 18:44:12,041::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>Thread-5212::DEBUG::2014-04-10 18:44:12,048::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 239abfeb-962e-4489-8931-bc77e49bef3b 
>Thread-5212::INFO::2014-04-10 18:44:12,048::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None
>Thread-5212::DEBUG::2014-04-10 18:44:12,049::task::1163::TaskManager.Task::(prepare) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::Prepare: 1 jobs exist, move to acquiring
>Thread-5212::DEBUG::2014-04-10 18:44:12,049::task::579::TaskManager.Task::(_updateState) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::moving from state preparing -> state acquiring
>Thread-5212::DEBUG::2014-04-10 18:44:12,049::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>Thread-5212::DEBUG::2014-04-10 18:44:12,059::task::579::TaskManager.Task::(_updateState) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::moving from state acquiring -> state queued
>Thread-5212::DEBUG::2014-04-10 18:44:12,060::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>Thread-5212::DEBUG::2014-04-10 18:44:12,069::taskManager::50::TaskManager::(_queueTask) queuing task: 239abfeb-962e-4489-8931-bc77e49bef3b
>Thread-5212::DEBUG::2014-04-10 18:44:12,069::taskManager::56::TaskManager::(_queueTask) task queued: 239abfeb-962e-4489-8931-bc77e49bef3b
>3dbc2fba-0d3c-473d-afca-ee32615bdae8::DEBUG::2014-04-10 18:44:12,070::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-5212::DEBUG::2014-04-10 18:44:12,070::task::1165::TaskManager.Task::(prepare) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::returning
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,072::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 239abfeb-962e-4489-8931-bc77e49bef3b running: <bound method Task.commit of <storage.task.Task instance at 0x7f37341bdbd8>> with: None
>Thread-5212::DEBUG::2014-04-10 18:44:12,073::task::974::TaskManager.Task::(_decref) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::ref 0 aborting False
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,073::task::1176::TaskManager.Task::(commit) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::committing task: 239abfeb-962e-4489-8931-bc77e49bef3b
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,076::task::579::TaskManager.Task::(_updateState) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::moving from state queued -> state running
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,079::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,088::task::889::TaskManager.Task::(_runJobs) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f373829a250>> (args: ('dbec8cee-b5e4-4011-9dd5-7c122389a878', 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 10485760, 5, 2, 2, '24018d18-27a2-462e-94df-c84585e4a0df', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {})
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,089::task::315::TaskManager.Task::(run) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f373829a250>> (args: ('dbec8cee-b5e4-4011-9dd5-7c122389a878', 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 10485760, 5, 2, 2, '24018d18-27a2-462e-94df-c84585e4a0df', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,089::resourceManager::197::ResourceManager.Request::(__init__) ResName=`dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202`ReqID=`c3a2a0e2-3d8d-4be5-aa7d-105875fc62ea`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1895' at 'createVolume'
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,089::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202' for lock type 'exclusive'
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,119::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image ca8224e3-4aff-4e35-87f6-c12059aeb202 does not exist in domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,119::resourceManager::600::ResourceManager::(registerResource) Resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202' is free. Now locking as 'exclusive' (1 active user)
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,119::resourceManager::237::ResourceManager.Request::(grant) ResName=`dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202`ReqID=`c3a2a0e2-3d8d-4be5-aa7d-105875fc62ea`::Granted request
>239abfeb-962e-4489-8931-bc77e49bef3b::INFO::2014-04-10 18:44:12,120::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202 for image's volumes
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,120::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::INFO::2014-04-10 18:44:12,184::volume::446::Storage.Volume::(create) Creating volume 24018d18-27a2-462e-94df-c84585e4a0df
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,184::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,239::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::INFO::2014-04-10 18:44:12,401::fileVolume::151::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df with size = 10485760 sectors
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,403::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,450::fileVolume::382::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=24018d18-27a2-462e-94df-c84585e4a0df sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878, metaId=('/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df',)
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,463::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,514::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202'
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,514::resourceManager::634::ResourceManager::(releaseResource) Released resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202' (0 active users)
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,514::resourceManager::640::ResourceManager::(releaseResource) Resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202' is free, finding out if anyone is waiting for it.
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,515::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS.ca8224e3-4aff-4e35-87f6-c12059aeb202', Clearing records.
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,515::task::579::TaskManager.Task::(_updateState) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::moving from state running -> state finished
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,515::task::736::TaskManager.Task::(_save) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/239abfeb-962e-4489-8931-bc77e49bef3b.temp
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,568::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,568::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,568::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,569::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,569::task::897::TaskManager.Task::(_runJobs) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::Task.run: exit - success: result {'uuid': '24018d18-27a2-462e-94df-c84585e4a0df'}
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,569::task::974::TaskManager.Task::(_decref) Task=`239abfeb-962e-4489-8931-bc77e49bef3b`::ref 0 aborting False
>239abfeb-962e-4489-8931-bc77e49bef3b::DEBUG::2014-04-10 18:44:12,569::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-5213::DEBUG::2014-04-10 18:44:13,503::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5213::DEBUG::2014-04-10 18:44:13,504::task::579::TaskManager.Task::(_updateState) Task=`cbce84a7-428d-4f0b-91db-5974d369f164`::moving from state init -> state preparing
>Thread-5213::INFO::2014-04-10 18:44:13,504::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-5213::DEBUG::2014-04-10 18:44:13,504::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-5213::DEBUG::2014-04-10 18:44:13,504::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 239abfeb-962e-4489-8931-bc77e49bef3b
>Thread-5213::DEBUG::2014-04-10 18:44:13,504::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '239abfeb-962e-4489-8931-bc77e49bef3b'}
>Thread-5213::DEBUG::2014-04-10 18:44:13,504::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'239abfeb-962e-4489-8931-bc77e49bef3b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '239abfeb-962e-4489-8931-bc77e49bef3b'}}
>Thread-5213::INFO::2014-04-10 18:44:13,505::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'239abfeb-962e-4489-8931-bc77e49bef3b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '239abfeb-962e-4489-8931-bc77e49bef3b'}}}
>Thread-5213::DEBUG::2014-04-10 18:44:13,505::task::1168::TaskManager.Task::(prepare) Task=`cbce84a7-428d-4f0b-91db-5974d369f164`::finished: {'allTasksStatus': {'239abfeb-962e-4489-8931-bc77e49bef3b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '239abfeb-962e-4489-8931-bc77e49bef3b'}}}
>Thread-5213::DEBUG::2014-04-10 18:44:13,505::task::579::TaskManager.Task::(_updateState) Task=`cbce84a7-428d-4f0b-91db-5974d369f164`::moving from state preparing -> state finished
>Thread-5213::DEBUG::2014-04-10 18:44:13,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5213::DEBUG::2014-04-10 18:44:13,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5213::DEBUG::2014-04-10 18:44:13,505::task::974::TaskManager.Task::(_decref) Task=`cbce84a7-428d-4f0b-91db-5974d369f164`::ref 0 aborting False
>Thread-5215::DEBUG::2014-04-10 18:44:13,620::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3c959e75]
>Thread-5215::DEBUG::2014-04-10 18:44:13,620::task::579::TaskManager.Task::(_updateState) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::moving from state init -> state preparing
>Thread-5215::INFO::2014-04-10 18:44:13,621::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-5215::DEBUG::2014-04-10 18:44:13,621::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`6217b2c5-4fb5-4cfd-97f6-d50d48ef2390`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3104' at 'getVolumeInfo'
>Thread-5215::DEBUG::2014-04-10 18:44:13,621::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-5215::DEBUG::2014-04-10 18:44:13,621::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-5215::DEBUG::2014-04-10 18:44:13,622::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`6217b2c5-4fb5-4cfd-97f6-d50d48ef2390`::Granted request
>Thread-5215::DEBUG::2014-04-10 18:44:13,622::task::811::TaskManager.Task::(resourceAcquired) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-5215::DEBUG::2014-04-10 18:44:13,622::task::974::TaskManager.Task::(_decref) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::ref 1 aborting False
>Thread-5215::DEBUG::2014-04-10 18:44:13,623::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 24018d18-27a2-462e-94df-c84585e4a0df
>Thread-5215::INFO::2014-04-10 18:44:13,625::volume::883::Storage.Volume::(getInfo) Info request: sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 imgUUID=ca8224e3-4aff-4e35-87f6-c12059aeb202 volUUID = 24018d18-27a2-462e-94df-c84585e4a0df 
>Thread-5215::DEBUG::2014-04-10 18:44:13,669::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 24018d18-27a2-462e-94df-c84585e4a0df
>Thread-5215::DEBUG::2014-04-10 18:44:13,674::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 24018d18-27a2-462e-94df-c84585e4a0df
>Thread-5215::INFO::2014-04-10 18:44:13,679::volume::912::Storage.Volume::(getInfo) dbec8cee-b5e4-4011-9dd5-7c122389a878/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df info is {'status': 'OK', 'domain': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'ctime': '1397126652', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1397126652', 'apparentsize': '5368709120', 'children': [], 'pool': '', 'capacity': '5368709120', 'uuid': '24018d18-27a2-462e-94df-c84585e4a0df', 'truesize': '0', 'type': 'SPARSE'}
>Thread-5215::INFO::2014-04-10 18:44:13,679::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'ctime': '1397126652', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1397126652', 'apparentsize': '5368709120', 'children': [], 'pool': '', 'capacity': '5368709120', 'uuid': '24018d18-27a2-462e-94df-c84585e4a0df', 'truesize': '0', 'type': 'SPARSE'}}
>Thread-5215::DEBUG::2014-04-10 18:44:13,679::task::1168::TaskManager.Task::(prepare) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::finished: {'info': {'status': 'OK', 'domain': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'ctime': '1397126652', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1397126652', 'apparentsize': '5368709120', 'children': [], 'pool': '', 'capacity': '5368709120', 'uuid': '24018d18-27a2-462e-94df-c84585e4a0df', 'truesize': '0', 'type': 'SPARSE'}}
>Thread-5215::DEBUG::2014-04-10 18:44:13,679::task::579::TaskManager.Task::(_updateState) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::moving from state preparing -> state finished
>Thread-5215::DEBUG::2014-04-10 18:44:13,680::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-5215::DEBUG::2014-04-10 18:44:13,680::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5215::DEBUG::2014-04-10 18:44:13,680::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-5215::DEBUG::2014-04-10 18:44:13,680::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-5215::DEBUG::2014-04-10 18:44:13,680::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-5215::DEBUG::2014-04-10 18:44:13,681::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-5215::DEBUG::2014-04-10 18:44:13,681::task::974::TaskManager.Task::(_decref) Task=`774cd961-b07e-4f06-bf10-97e002f3841b`::ref 0 aborting False
>Thread-5216::DEBUG::2014-04-10 18:44:13,754::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5216::DEBUG::2014-04-10 18:44:13,755::task::579::TaskManager.Task::(_updateState) Task=`662c08c1-7c40-4aaa-ae45-d40b7eac0d1f`::moving from state init -> state preparing
>Thread-5216::INFO::2014-04-10 18:44:13,755::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='239abfeb-962e-4489-8931-bc77e49bef3b', spUUID=None, options=None)
>Thread-5216::DEBUG::2014-04-10 18:44:13,755::taskManager::161::TaskManager::(clearTask) Entry. taskID: 239abfeb-962e-4489-8931-bc77e49bef3b
>Thread-5216::DEBUG::2014-04-10 18:44:13,759::taskManager::166::TaskManager::(clearTask) Return.
>Thread-5216::INFO::2014-04-10 18:44:13,759::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-5216::DEBUG::2014-04-10 18:44:13,759::task::1168::TaskManager.Task::(prepare) Task=`662c08c1-7c40-4aaa-ae45-d40b7eac0d1f`::finished: None
>Thread-5216::DEBUG::2014-04-10 18:44:13,759::task::579::TaskManager.Task::(_updateState) Task=`662c08c1-7c40-4aaa-ae45-d40b7eac0d1f`::moving from state preparing -> state finished
>Thread-5216::DEBUG::2014-04-10 18:44:13,760::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5216::DEBUG::2014-04-10 18:44:13,760::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5216::DEBUG::2014-04-10 18:44:13,760::task::974::TaskManager.Task::(_decref) Task=`662c08c1-7c40-4aaa-ae45-d40b7eac0d1f`::ref 0 aborting False
>Thread-5217::DEBUG::2014-04-10 18:44:16,196::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5217::DEBUG::2014-04-10 18:44:16,196::task::579::TaskManager.Task::(_updateState) Task=`b3bfc9aa-ba49-4a8f-a435-bc012893aa84`::moving from state init -> state preparing
>Thread-5217::INFO::2014-04-10 18:44:16,197::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5217::INFO::2014-04-10 18:44:16,197::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5217::DEBUG::2014-04-10 18:44:16,197::task::1168::TaskManager.Task::(prepare) Task=`b3bfc9aa-ba49-4a8f-a435-bc012893aa84`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5217::DEBUG::2014-04-10 18:44:16,197::task::579::TaskManager.Task::(_updateState) Task=`b3bfc9aa-ba49-4a8f-a435-bc012893aa84`::moving from state preparing -> state finished
>Thread-5217::DEBUG::2014-04-10 18:44:16,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5217::DEBUG::2014-04-10 18:44:16,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5217::DEBUG::2014-04-10 18:44:16,198::task::974::TaskManager.Task::(_decref) Task=`b3bfc9aa-ba49-4a8f-a435-bc012893aa84`::ref 0 aborting False
>Thread-5218::DEBUG::2014-04-10 18:44:16,208::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5218::DEBUG::2014-04-10 18:44:16,208::task::579::TaskManager.Task::(_updateState) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::moving from state init -> state preparing
>Thread-5218::INFO::2014-04-10 18:44:16,209::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5218::DEBUG::2014-04-10 18:44:16,209::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`71adca1a-c012-4847-941d-960a0d9c39e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5218::DEBUG::2014-04-10 18:44:16,209::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5218::DEBUG::2014-04-10 18:44:16,209::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5218::DEBUG::2014-04-10 18:44:16,209::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`71adca1a-c012-4847-941d-960a0d9c39e1`::Granted request
>Thread-5218::DEBUG::2014-04-10 18:44:16,210::task::811::TaskManager.Task::(resourceAcquired) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5218::DEBUG::2014-04-10 18:44:16,210::task::974::TaskManager.Task::(_decref) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::ref 1 aborting False
>Thread-5218::INFO::2014-04-10 18:44:16,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5218::DEBUG::2014-04-10 18:44:16,212::task::1168::TaskManager.Task::(prepare) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081940992', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5218::DEBUG::2014-04-10 18:44:16,212::task::579::TaskManager.Task::(_updateState) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::moving from state preparing -> state finished
>Thread-5218::DEBUG::2014-04-10 18:44:16,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5218::DEBUG::2014-04-10 18:44:16,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5218::DEBUG::2014-04-10 18:44:16,213::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5218::DEBUG::2014-04-10 18:44:16,213::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5218::DEBUG::2014-04-10 18:44:16,213::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5218::DEBUG::2014-04-10 18:44:16,213::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5218::DEBUG::2014-04-10 18:44:16,213::task::974::TaskManager.Task::(_decref) Task=`f2bedc02-2f5e-4f6b-b820-af738241bb60`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:16,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:44:16,617::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000438202 s, 840 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:44:16,824::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:16,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346476 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:17,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:17,039::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000382145 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:17,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:17,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000402069 s, 1.6 MB/s\n'; <rc> = 0
>Thread-5221::DEBUG::2014-04-10 18:44:20,949::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [321c53d2]
>Thread-5221::DEBUG::2014-04-10 18:44:20,949::task::579::TaskManager.Task::(_updateState) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::moving from state init -> state preparing
>Thread-5221::INFO::2014-04-10 18:44:20,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5221::DEBUG::2014-04-10 18:44:20,950::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4a64ec4a-a1da-49c1-9b76-1e2806d70b9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5221::DEBUG::2014-04-10 18:44:20,950::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5221::DEBUG::2014-04-10 18:44:20,951::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5221::DEBUG::2014-04-10 18:44:20,951::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4a64ec4a-a1da-49c1-9b76-1e2806d70b9c`::Granted request
>Thread-5221::DEBUG::2014-04-10 18:44:20,951::task::811::TaskManager.Task::(resourceAcquired) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5221::DEBUG::2014-04-10 18:44:20,951::task::974::TaskManager.Task::(_decref) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::ref 1 aborting False
>Thread-5221::INFO::2014-04-10 18:44:20,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5221::DEBUG::2014-04-10 18:44:20,953::task::1168::TaskManager.Task::(prepare) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::task::579::TaskManager.Task::(_updateState) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::moving from state preparing -> state finished
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5221::DEBUG::2014-04-10 18:44:20,954::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5221::DEBUG::2014-04-10 18:44:20,955::task::974::TaskManager.Task::(_decref) Task=`36acf18b-75d3-4ae6-86aa-8faec7800fb2`::ref 0 aborting False
>Thread-5222::DEBUG::2014-04-10 18:44:21,124::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmCreate with ({'custom': {}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Conroe', 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'specParams': {}, 'readonly': 'false', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa'}], 'smp': '1', 'vmType': 'kvm', 'smartcardEnable': 'false', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'vm1', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [321c53d2]
>Thread-5222::INFO::2014-04-10 18:44:21,127::API::648::vds::(_getNetworkIp) network None: using 0
>Thread-5222::INFO::2014-04-10 18:44:21,127::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>Thread-5223::DEBUG::2014-04-10 18:44:21,129::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Start
>Thread-5222::DEBUG::2014-04-10 18:44:21,129::clientIF::407::vds::(createVm) Total desktops after creation of 350aed0d-0065-47c3-81db-3ae5dc8dbf53 is 1
>Thread-5223::DEBUG::2014-04-10 18:44:21,130::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations acquired
>Thread-5222::DEBUG::2014-04-10 18:44:21,130::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'type': 'disk', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'specParams': {}, 'readonly': 'false', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'optional': 'false'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5'}, {'device': 'scsi', 'specParams': {}, 'model': 'virtio-scsi', 'type': 'controller', 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'display': 'qxl', 'nice': '0'}}
>Thread-5223::INFO::2014-04-10 18:44:21,130::vm::3011::vm.Vm::(_run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::VM wrapper has started
>Thread-5223::DEBUG::2014-04-10 18:44:21,133::task::579::TaskManager.Task::(_updateState) Task=`d4f29abb-51d6-4b1e-9d03-20fb8d9b999d`::moving from state init -> state preparing
>Thread-5223::INFO::2014-04-10 18:44:21,133::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-5223::INFO::2014-04-10 18:44:21,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5223::DEBUG::2014-04-10 18:44:21,136::task::1168::TaskManager.Task::(prepare) Task=`d4f29abb-51d6-4b1e-9d03-20fb8d9b999d`::finished: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5223::DEBUG::2014-04-10 18:44:21,136::task::579::TaskManager.Task::(_updateState) Task=`d4f29abb-51d6-4b1e-9d03-20fb8d9b999d`::moving from state preparing -> state finished
>Thread-5223::DEBUG::2014-04-10 18:44:21,136::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5223::DEBUG::2014-04-10 18:44:21,136::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5223::DEBUG::2014-04-10 18:44:21,136::task::974::TaskManager.Task::(_decref) Task=`d4f29abb-51d6-4b1e-9d03-20fb8d9b999d`::ref 0 aborting False
>Thread-5223::INFO::2014-04-10 18:44:21,137::clientIF::353::vds::(prepareVolumePath) prepared volume path: 
>Thread-5223::DEBUG::2014-04-10 18:44:21,137::task::579::TaskManager.Task::(_updateState) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::moving from state init -> state preparing
>Thread-5223::INFO::2014-04-10 18:44:21,137::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', leafUUID='24018d18-27a2-462e-94df-c84585e4a0df')
>Thread-5223::DEBUG::2014-04-10 18:44:21,137::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`4ff4db9f-c94d-48d2-84be-849989274bf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage'
>Thread-5223::DEBUG::2014-04-10 18:44:21,138::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-5223::DEBUG::2014-04-10 18:44:21,138::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-5223::DEBUG::2014-04-10 18:44:21,138::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`4ff4db9f-c94d-48d2-84be-849989274bf6`::Granted request
>Thread-5223::DEBUG::2014-04-10 18:44:21,138::task::811::TaskManager.Task::(resourceAcquired) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-5223::DEBUG::2014-04-10 18:44:21,138::task::974::TaskManager.Task::(_decref) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::ref 1 aborting False
>Thread-5223::DEBUG::2014-04-10 18:44:21,142::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 24018d18-27a2-462e-94df-c84585e4a0df
>Thread-5223::INFO::2014-04-10 18:44:21,144::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'imgVolumesInfo': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}]}
>Thread-5223::DEBUG::2014-04-10 18:44:21,144::task::1168::TaskManager.Task::(prepare) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::finished: {'info': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'imgVolumesInfo': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}]}
>Thread-5223::DEBUG::2014-04-10 18:44:21,144::task::579::TaskManager.Task::(_updateState) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::moving from state preparing -> state finished
>Thread-5223::DEBUG::2014-04-10 18:44:21,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-5223::DEBUG::2014-04-10 18:44:21,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5223::DEBUG::2014-04-10 18:44:21,144::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-5223::DEBUG::2014-04-10 18:44:21,145::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-5223::DEBUG::2014-04-10 18:44:21,145::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-5223::DEBUG::2014-04-10 18:44:21,145::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-5223::DEBUG::2014-04-10 18:44:21,145::task::974::TaskManager.Task::(_decref) Task=`49de5e85-287b-4d06-a6c4-03c204f9af1c`::ref 0 aborting False
>Thread-5223::INFO::2014-04-10 18:44:21,145::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df
>Thread-5223::DEBUG::2014-04-10 18:44:21,155::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/10_faqemu' (cwd None)
>Thread-5223::DEBUG::2014-04-10 18:44:21,210::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-5223::INFO::2014-04-10 18:44:21,210::hooks::100::root::(_runHooksDir) 
>Thread-5223::DEBUG::2014-04-10 18:44:21,210::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_qemucmdline' (cwd None)
>Thread-5223::DEBUG::2014-04-10 18:44:21,268::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-5223::INFO::2014-04-10 18:44:21,268::hooks::100::root::(_runHooksDir) 
>Thread-5223::DEBUG::2014-04-10 18:44:21,268::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
>Thread-5223::DEBUG::2014-04-10 18:44:21,320::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-5223::INFO::2014-04-10 18:44:21,321::hooks::100::root::(_runHooksDir) 
>Thread-5223::DEBUG::2014-04-10 18:44:21,321::vm::3073::vm.Vm::(_run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::<?xml version="1.0" encoding="utf-8"?>
><domain type="kvm">
>	<name>vm1</name>
>	<uuid>350aed0d-0065-47c3-81db-3ae5dc8dbf53</uuid>
>	<memory>1048576</memory>
>	<currentMemory>1048576</currentMemory>
>	<vcpu>1</vcpu>
>	<memtune>
>		<min_guarantee>1048576</min_guarantee>
>	</memtune>
>	<devices>
>		<channel type="unix">
>			<target name="com.redhat.rhevm.vdsm" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm"/>
>		</channel>
>		<channel type="unix">
>			<target name="org.qemu.guest_agent.0" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.org.qemu.guest_agent.0"/>
>		</channel>
>		<input bus="ps2" type="mouse"/>
>		<channel type="spicevmc">
>			<target name="com.redhat.spice.0" type="virtio"/>
>		</channel>
>		<graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice">
>			<channel mode="secure" name="main"/>
>			<channel mode="secure" name="inputs"/>
>			<channel mode="secure" name="cursor"/>
>			<channel mode="secure" name="playback"/>
>			<channel mode="secure" name="record"/>
>			<channel mode="secure" name="display"/>
>			<channel mode="secure" name="usbredir"/>
>			<channel mode="secure" name="smartcard"/>
>		</graphics>
>		<controller model="virtio-scsi" type="scsi"/>
>		<video>
>			<model heads="1" type="qxl" vram="32768"/>
>		</video>
>		<interface type="bridge">
>			<mac address="00:01:a4:a5:a5:07"/>
>			<model type="virtio"/>
>			<source bridge="rhevm"/>
>			<filterref filter="vdsm-no-mac-spoofing"/>
>			<link state="up"/>
>		</interface>
>		<disk device="cdrom" snapshot="no" type="file">
>			<source file="" startupPolicy="optional"/>
>			<target bus="ide" dev="hdc"/>
>			<readonly/>
>			<serial/>
>		</disk>
>		<disk device="disk" snapshot="no" type="file">
>			<source file="/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df"/>
>			<target bus="virtio" dev="vda"/>
>			<serial>ca8224e3-4aff-4e35-87f6-c12059aeb202</serial>
>			<driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/>
>		</disk>
>		<memballoon model="virtio"/>
>	</devices>
>	<os>
>		<type arch="x86_64" machine="rhel6.5.0">hvm</type>
>		<smbios mode="sysinfo"/>
>	</os>
>	<sysinfo type="smbios">
>		<system>
>			<entry name="manufacturer">Red Hat</entry>
>			<entry name="product">RHEV Hypervisor</entry>
>			<entry name="version">6Server-6.5.0.1.el6</entry>
>			<entry name="serial">94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082</entry>
>			<entry name="uuid">350aed0d-0065-47c3-81db-3ae5dc8dbf53</entry>
>		</system>
>	</sysinfo>
>	<clock adjustment="0" offset="variable">
>		<timer name="rtc" tickpolicy="catchup"/>
>	</clock>
>	<features>
>		<acpi/>
>	</features>
>	<cpu match="exact">
>		<model>Conroe</model>
>		<topology cores="1" sockets="1" threads="1"/>
>	</cpu>
></domain>
>
>libvirtEventLoop::DEBUG::2014-04-10 18:44:21,948::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::event Started detail 0 opaque None
>Thread-5223::DEBUG::2014-04-10 18:44:22,048::sampling::285::vm.Vm::(start) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Start statistics collection
>Thread-5225::DEBUG::2014-04-10 18:44:22,049::sampling::314::vm.Vm::(run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Stats thread started
>Thread-5225::DEBUG::2014-04-10 18:44:22,050::task::579::TaskManager.Task::(_updateState) Task=`49662f5d-b35e-491b-b117-3ab5c174e207`::moving from state init -> state preparing
>Thread-5225::INFO::2014-04-10 18:44:22,051::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-5225::INFO::2014-04-10 18:44:22,052::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:44:22,053::task::1168::TaskManager.Task::(prepare) Task=`49662f5d-b35e-491b-b117-3ab5c174e207`::finished: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:44:22,053::task::579::TaskManager.Task::(_updateState) Task=`49662f5d-b35e-491b-b117-3ab5c174e207`::moving from state preparing -> state finished
>Thread-5225::DEBUG::2014-04-10 18:44:22,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5225::DEBUG::2014-04-10 18:44:22,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5225::DEBUG::2014-04-10 18:44:22,053::task::974::TaskManager.Task::(_decref) Task=`49662f5d-b35e-491b-b117-3ab5c174e207`::ref 0 aborting False
>Thread-5223::DEBUG::2014-04-10 18:44:22,064::vmChannels::194::vds::(register) Add fileno 64 to listener's channels.
>Thread-5223::WARNING::2014-04-10 18:44:22,065::vm::3578::vm.Vm::(_readPauseCode) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_readPauseCode unsupported by libvirt vm
>Thread-5223::DEBUG::2014-04-10 18:44:22,103::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations released
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,529::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,530::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,530::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,530::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,530::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,530::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,532::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,532::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,532::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,533::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,533::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:22,533::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:44:22,656::vmChannels::102::vds::(_do_add_channels) fileno 64 was added to unconnected channels.
>VM Channels Listener::DEBUG::2014-04-10 18:44:22,656::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 64.
>VM Channels Listener::DEBUG::2014-04-10 18:44:22,656::guestIF::147::vm.Vm::(_connect) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Attempting connection to /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 18:44:22,656::guestIF::150::vm.Vm::(_connect) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Connected to /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 18:44:22,657::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 64 succeeded.
>Thread-5226::DEBUG::2014-04-10 18:44:22,660::task::579::TaskManager.Task::(_updateState) Task=`75a73864-8d4d-4c01-a663-e73a9e17dd87`::moving from state init -> state preparing
>Thread-5226::INFO::2014-04-10 18:44:22,660::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5226::INFO::2014-04-10 18:44:22,660::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402069', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346476', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382145', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438202', 'lastCheck': '6.0', 'valid': True}}
>Thread-5226::DEBUG::2014-04-10 18:44:22,661::task::1168::TaskManager.Task::(prepare) Task=`75a73864-8d4d-4c01-a663-e73a9e17dd87`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402069', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346476', 'lastCheck': '5.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382145', 'lastCheck': '5.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438202', 'lastCheck': '6.0', 'valid': True}}
>Thread-5226::DEBUG::2014-04-10 18:44:22,661::task::579::TaskManager.Task::(_updateState) Task=`75a73864-8d4d-4c01-a663-e73a9e17dd87`::moving from state preparing -> state finished
>Thread-5226::DEBUG::2014-04-10 18:44:22,661::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5226::DEBUG::2014-04-10 18:44:22,661::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5226::DEBUG::2014-04-10 18:44:22,661::task::974::TaskManager.Task::(_decref) Task=`75a73864-8d4d-4c01-a663-e73a9e17dd87`::ref 0 aborting False
>Thread-5227::DEBUG::2014-04-10 18:44:22,695::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-5227::DEBUG::2014-04-10 18:44:22,695::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>Thread-5227::DEBUG::2014-04-10 18:44:22,695::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5227::DEBUG::2014-04-10 18:44:22,695::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5227::DEBUG::2014-04-10 18:44:22,695::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5227::DEBUG::2014-04-10 18:44:22,696::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,987::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5230::DEBUG::2014-04-10 18:44:25,987::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-5230::DEBUG::2014-04-10 18:44:25,988::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,988::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,988::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,988::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,988::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5230::DEBUG::2014-04-10 18:44:25,989::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:01:a4:a5:a5:07', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.87', 'elapsedTime': '4', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-5231::DEBUG::2014-04-10 18:44:26,303::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5231::DEBUG::2014-04-10 18:44:26,303::task::579::TaskManager.Task::(_updateState) Task=`b0fdc5e1-1ba8-42c6-bb99-f265131895ff`::moving from state init -> state preparing
>Thread-5231::INFO::2014-04-10 18:44:26,304::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5231::INFO::2014-04-10 18:44:26,304::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5231::DEBUG::2014-04-10 18:44:26,304::task::1168::TaskManager.Task::(prepare) Task=`b0fdc5e1-1ba8-42c6-bb99-f265131895ff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5231::DEBUG::2014-04-10 18:44:26,304::task::579::TaskManager.Task::(_updateState) Task=`b0fdc5e1-1ba8-42c6-bb99-f265131895ff`::moving from state preparing -> state finished
>Thread-5231::DEBUG::2014-04-10 18:44:26,304::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5231::DEBUG::2014-04-10 18:44:26,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5231::DEBUG::2014-04-10 18:44:26,305::task::974::TaskManager.Task::(_decref) Task=`b0fdc5e1-1ba8-42c6-bb99-f265131895ff`::ref 0 aborting False
>Thread-5232::DEBUG::2014-04-10 18:44:26,317::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5232::DEBUG::2014-04-10 18:44:26,317::task::579::TaskManager.Task::(_updateState) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::moving from state init -> state preparing
>Thread-5232::INFO::2014-04-10 18:44:26,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5232::DEBUG::2014-04-10 18:44:26,318::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b748af9-f63a-45bd-b313-0fff71696bc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5232::DEBUG::2014-04-10 18:44:26,318::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5232::DEBUG::2014-04-10 18:44:26,318::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5232::DEBUG::2014-04-10 18:44:26,319::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b748af9-f63a-45bd-b313-0fff71696bc0`::Granted request
>Thread-5232::DEBUG::2014-04-10 18:44:26,319::task::811::TaskManager.Task::(resourceAcquired) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5232::DEBUG::2014-04-10 18:44:26,319::task::974::TaskManager.Task::(_decref) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::ref 1 aborting False
>Thread-5232::INFO::2014-04-10 18:44:26,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5232::DEBUG::2014-04-10 18:44:26,321::task::1168::TaskManager.Task::(prepare) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5232::DEBUG::2014-04-10 18:44:26,321::task::579::TaskManager.Task::(_updateState) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::moving from state preparing -> state finished
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5232::DEBUG::2014-04-10 18:44:26,322::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5232::DEBUG::2014-04-10 18:44:26,323::task::974::TaskManager.Task::(_decref) Task=`5c0e4bcd-2202-4209-b7f5-b89f1eadfc7d`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:26,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:44:26,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00043834 s, 840 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:44:26,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:26,855::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00033401 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:27,067::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:27,074::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317924 s, 2.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:27,084::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:27,090::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000391045 s, 1.7 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,535::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,535::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,536::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,537::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,537::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,537::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,538::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:27,538::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5234::DEBUG::2014-04-10 18:44:29,040::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5234::DEBUG::2014-04-10 18:44:29,041::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-5234::DEBUG::2014-04-10 18:44:29,041::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5234::DEBUG::2014-04-10 18:44:29,041::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5234::DEBUG::2014-04-10 18:44:29,041::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5234::DEBUG::2014-04-10 18:44:29,041::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5234::DEBUG::2014-04-10 18:44:29,043::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.90', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-5236::DEBUG::2014-04-10 18:44:32,108::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5236::DEBUG::2014-04-10 18:44:32,109::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-5236::DEBUG::2014-04-10 18:44:32,109::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5236::DEBUG::2014-04-10 18:44:32,109::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5236::DEBUG::2014-04-10 18:44:32,110::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5236::DEBUG::2014-04-10 18:44:32,110::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5236::DEBUG::2014-04-10 18:44:32,111::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.97', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,540::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,540::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,540::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,541::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,541::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,542::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,542::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,542::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,543::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:32,543::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5238::DEBUG::2014-04-10 18:44:35,193::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5238::DEBUG::2014-04-10 18:44:35,194::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>Thread-5238::DEBUG::2014-04-10 18:44:35,194::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5238::DEBUG::2014-04-10 18:44:35,194::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5238::DEBUG::2014-04-10 18:44:35,194::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5238::DEBUG::2014-04-10 18:44:35,194::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5238::DEBUG::2014-04-10 18:44:35,195::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.05', 'elapsedTime': '14', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-5239::DEBUG::2014-04-10 18:44:36,402::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5239::DEBUG::2014-04-10 18:44:36,403::task::579::TaskManager.Task::(_updateState) Task=`2e957e02-a5c8-4e8c-8b9e-ac30fab8cdd0`::moving from state init -> state preparing
>Thread-5239::INFO::2014-04-10 18:44:36,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5239::INFO::2014-04-10 18:44:36,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5239::DEBUG::2014-04-10 18:44:36,404::task::1168::TaskManager.Task::(prepare) Task=`2e957e02-a5c8-4e8c-8b9e-ac30fab8cdd0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5239::DEBUG::2014-04-10 18:44:36,404::task::579::TaskManager.Task::(_updateState) Task=`2e957e02-a5c8-4e8c-8b9e-ac30fab8cdd0`::moving from state preparing -> state finished
>Thread-5239::DEBUG::2014-04-10 18:44:36,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5239::DEBUG::2014-04-10 18:44:36,404::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5239::DEBUG::2014-04-10 18:44:36,404::task::974::TaskManager.Task::(_decref) Task=`2e957e02-a5c8-4e8c-8b9e-ac30fab8cdd0`::ref 0 aborting False
>Thread-5240::DEBUG::2014-04-10 18:44:36,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5240::DEBUG::2014-04-10 18:44:36,416::task::579::TaskManager.Task::(_updateState) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::moving from state init -> state preparing
>Thread-5240::INFO::2014-04-10 18:44:36,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5240::DEBUG::2014-04-10 18:44:36,416::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`efc9b1ae-163e-4f54-8360-682df4bc5cc8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5240::DEBUG::2014-04-10 18:44:36,417::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5240::DEBUG::2014-04-10 18:44:36,417::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5240::DEBUG::2014-04-10 18:44:36,417::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`efc9b1ae-163e-4f54-8360-682df4bc5cc8`::Granted request
>Thread-5240::DEBUG::2014-04-10 18:44:36,417::task::811::TaskManager.Task::(resourceAcquired) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5240::DEBUG::2014-04-10 18:44:36,417::task::974::TaskManager.Task::(_decref) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::ref 1 aborting False
>Thread-5240::INFO::2014-04-10 18:44:36,419::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5240::DEBUG::2014-04-10 18:44:36,419::task::1168::TaskManager.Task::(prepare) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5240::DEBUG::2014-04-10 18:44:36,420::task::579::TaskManager.Task::(_updateState) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::moving from state preparing -> state finished
>Thread-5240::DEBUG::2014-04-10 18:44:36,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5240::DEBUG::2014-04-10 18:44:36,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5240::DEBUG::2014-04-10 18:44:36,420::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5240::DEBUG::2014-04-10 18:44:36,420::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5240::DEBUG::2014-04-10 18:44:36,421::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5240::DEBUG::2014-04-10 18:44:36,421::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5240::DEBUG::2014-04-10 18:44:36,421::task::974::TaskManager.Task::(_decref) Task=`3fa77f3d-08d1-4dd5-82b7-afe3a5e18b29`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:36,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:44:36,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000378524 s, 972 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:44:36,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:36,869::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278233 s, 2.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:37,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:37,092::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303465 s, 2.2 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:37,111::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:37,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398902 s, 1.7 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,546::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,546::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,546::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,546::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,548::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,548::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,549::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:37,549::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5241::DEBUG::2014-04-10 18:44:38,234::task::579::TaskManager.Task::(_updateState) Task=`9f8f918a-b7e0-4976-9860-77a4ecd40606`::moving from state init -> state preparing
>Thread-5241::INFO::2014-04-10 18:44:38,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5241::INFO::2014-04-10 18:44:38,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398902', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278233', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303465', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378524', 'lastCheck': '1.6', 'valid': True}}
>Thread-5241::DEBUG::2014-04-10 18:44:38,235::task::1168::TaskManager.Task::(prepare) Task=`9f8f918a-b7e0-4976-9860-77a4ecd40606`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398902', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278233', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303465', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378524', 'lastCheck': '1.6', 'valid': True}}
>Thread-5241::DEBUG::2014-04-10 18:44:38,236::task::579::TaskManager.Task::(_updateState) Task=`9f8f918a-b7e0-4976-9860-77a4ecd40606`::moving from state preparing -> state finished
>Thread-5241::DEBUG::2014-04-10 18:44:38,236::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5241::DEBUG::2014-04-10 18:44:38,236::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5241::DEBUG::2014-04-10 18:44:38,236::task::974::TaskManager.Task::(_decref) Task=`9f8f918a-b7e0-4976-9860-77a4ecd40606`::ref 0 aborting False
>Thread-5242::DEBUG::2014-04-10 18:44:38,264::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5242::DEBUG::2014-04-10 18:44:38,264::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5242::DEBUG::2014-04-10 18:44:38,264::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5242::DEBUG::2014-04-10 18:44:38,265::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5244::DEBUG::2014-04-10 18:44:41,396::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5244::DEBUG::2014-04-10 18:44:41,396::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5244::DEBUG::2014-04-10 18:44:41,397::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5244::DEBUG::2014-04-10 18:44:41,397::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5244::DEBUG::2014-04-10 18:44:41,397::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5244::DEBUG::2014-04-10 18:44:41,398::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.1', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '36.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.24', 'elapsedTime': '20', 'vmType': 'kvm', 'cpuSys': '38.49', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,556::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,556::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,556::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,556::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,558::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,558::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,559::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:42,559::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5246::DEBUG::2014-04-10 18:44:44,476::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5246::DEBUG::2014-04-10 18:44:44,476::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5246::DEBUG::2014-04-10 18:44:44,477::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5246::DEBUG::2014-04-10 18:44:44,477::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5246::DEBUG::2014-04-10 18:44:44,477::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5246::DEBUG::2014-04-10 18:44:44,478::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.1', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '36.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.31', 'elapsedTime': '23', 'vmType': 'kvm', 'cpuSys': '38.49', 'appsList': [], 'guestIPs': ''}]}
>Thread-5247::DEBUG::2014-04-10 18:44:46,535::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5247::DEBUG::2014-04-10 18:44:46,535::task::579::TaskManager.Task::(_updateState) Task=`63443d62-3a35-4749-a932-b5a61f62b6ec`::moving from state init -> state preparing
>Thread-5247::INFO::2014-04-10 18:44:46,535::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5247::INFO::2014-04-10 18:44:46,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5247::DEBUG::2014-04-10 18:44:46,536::task::1168::TaskManager.Task::(prepare) Task=`63443d62-3a35-4749-a932-b5a61f62b6ec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5247::DEBUG::2014-04-10 18:44:46,536::task::579::TaskManager.Task::(_updateState) Task=`63443d62-3a35-4749-a932-b5a61f62b6ec`::moving from state preparing -> state finished
>Thread-5247::DEBUG::2014-04-10 18:44:46,536::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5247::DEBUG::2014-04-10 18:44:46,536::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5247::DEBUG::2014-04-10 18:44:46,536::task::974::TaskManager.Task::(_decref) Task=`63443d62-3a35-4749-a932-b5a61f62b6ec`::ref 0 aborting False
>Thread-5248::DEBUG::2014-04-10 18:44:46,547::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5248::DEBUG::2014-04-10 18:44:46,547::task::579::TaskManager.Task::(_updateState) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::moving from state init -> state preparing
>Thread-5248::INFO::2014-04-10 18:44:46,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5248::DEBUG::2014-04-10 18:44:46,548::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aab45e0d-f2e5-45e2-85d0-83a0d6edee3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5248::DEBUG::2014-04-10 18:44:46,548::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5248::DEBUG::2014-04-10 18:44:46,548::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5248::DEBUG::2014-04-10 18:44:46,549::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aab45e0d-f2e5-45e2-85d0-83a0d6edee3f`::Granted request
>Thread-5248::DEBUG::2014-04-10 18:44:46,549::task::811::TaskManager.Task::(resourceAcquired) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5248::DEBUG::2014-04-10 18:44:46,549::task::974::TaskManager.Task::(_decref) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::ref 1 aborting False
>Thread-5248::INFO::2014-04-10 18:44:46,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5248::DEBUG::2014-04-10 18:44:46,551::task::1168::TaskManager.Task::(prepare) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::task::579::TaskManager.Task::(_updateState) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::moving from state preparing -> state finished
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5248::DEBUG::2014-04-10 18:44:46,552::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5248::DEBUG::2014-04-10 18:44:46,553::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5248::DEBUG::2014-04-10 18:44:46,553::task::974::TaskManager.Task::(_decref) Task=`81a637eb-264e-43e1-9474-0c7754a0f2ae`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:46,655::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:44:46,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000311458 s, 1.2 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:44:46,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:46,883::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324686 s, 2.1 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:47,113::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:47,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00030895 s, 2.2 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:47,142::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:47,148::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000378991 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5250::DEBUG::2014-04-10 18:44:47,537::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5250::DEBUG::2014-04-10 18:44:47,538::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5250::DEBUG::2014-04-10 18:44:47,538::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5250::DEBUG::2014-04-10 18:44:47,538::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5250::DEBUG::2014-04-10 18:44:47,538::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5250::DEBUG::2014-04-10 18:44:47,540::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '36.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.37', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '38.49', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,566::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,566::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,566::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,566::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,568::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,568::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,568::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:47,568::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5252::DEBUG::2014-04-10 18:44:50,581::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5252::DEBUG::2014-04-10 18:44:50,582::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5252::DEBUG::2014-04-10 18:44:50,582::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5252::DEBUG::2014-04-10 18:44:50,582::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5252::DEBUG::2014-04-10 18:44:50,582::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5252::DEBUG::2014-04-10 18:44:50,583::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '36.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '38.49', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,575::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,575::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,575::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,576::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,577::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,577::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,577::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:52,578::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:44:52,691::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5253::DEBUG::2014-04-10 18:44:53,618::task::579::TaskManager.Task::(_updateState) Task=`34b0a30a-3b10-4d9a-952c-c4611c4b1bb9`::moving from state init -> state preparing
>Thread-5253::INFO::2014-04-10 18:44:53,619::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5253::INFO::2014-04-10 18:44:53,619::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378991', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324686', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030895', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311458', 'lastCheck': '7.0', 'valid': True}}
>Thread-5253::DEBUG::2014-04-10 18:44:53,619::task::1168::TaskManager.Task::(prepare) Task=`34b0a30a-3b10-4d9a-952c-c4611c4b1bb9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378991', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324686', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030895', 'lastCheck': '6.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311458', 'lastCheck': '7.0', 'valid': True}}
>Thread-5253::DEBUG::2014-04-10 18:44:53,619::task::579::TaskManager.Task::(_updateState) Task=`34b0a30a-3b10-4d9a-952c-c4611c4b1bb9`::moving from state preparing -> state finished
>Thread-5253::DEBUG::2014-04-10 18:44:53,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5253::DEBUG::2014-04-10 18:44:53,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5253::DEBUG::2014-04-10 18:44:53,620::task::974::TaskManager.Task::(_decref) Task=`34b0a30a-3b10-4d9a-952c-c4611c4b1bb9`::ref 0 aborting False
>Thread-5254::DEBUG::2014-04-10 18:44:53,649::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5254::DEBUG::2014-04-10 18:44:53,650::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5254::DEBUG::2014-04-10 18:44:53,650::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5254::DEBUG::2014-04-10 18:44:53,650::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5255::DEBUG::2014-04-10 18:44:56,651::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5255::DEBUG::2014-04-10 18:44:56,651::task::579::TaskManager.Task::(_updateState) Task=`76bbf8e3-2c58-4c22-be1f-13b3d6b1e007`::moving from state init -> state preparing
>Thread-5255::INFO::2014-04-10 18:44:56,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5255::INFO::2014-04-10 18:44:56,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5255::DEBUG::2014-04-10 18:44:56,652::task::1168::TaskManager.Task::(prepare) Task=`76bbf8e3-2c58-4c22-be1f-13b3d6b1e007`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5255::DEBUG::2014-04-10 18:44:56,652::task::579::TaskManager.Task::(_updateState) Task=`76bbf8e3-2c58-4c22-be1f-13b3d6b1e007`::moving from state preparing -> state finished
>Thread-5255::DEBUG::2014-04-10 18:44:56,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5255::DEBUG::2014-04-10 18:44:56,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5255::DEBUG::2014-04-10 18:44:56,652::task::974::TaskManager.Task::(_decref) Task=`76bbf8e3-2c58-4c22-be1f-13b3d6b1e007`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:44:56,669::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-5256::DEBUG::2014-04-10 18:44:56,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5256::DEBUG::2014-04-10 18:44:56,683::task::579::TaskManager.Task::(_updateState) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::moving from state init -> state preparing
>Thread-5256::INFO::2014-04-10 18:44:56,686::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5256::DEBUG::2014-04-10 18:44:56,690::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`14d2ce27-0c89-4832-b326-1c8954bc8e45`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-469::DEBUG::2014-04-10 18:44:56,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000339085 s, 1.1 MB/s\n'; <rc> = 0
>Thread-5256::DEBUG::2014-04-10 18:44:56,692::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5256::DEBUG::2014-04-10 18:44:56,695::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5256::DEBUG::2014-04-10 18:44:56,695::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`14d2ce27-0c89-4832-b326-1c8954bc8e45`::Granted request
>Thread-5256::DEBUG::2014-04-10 18:44:56,698::task::811::TaskManager.Task::(resourceAcquired) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5256::DEBUG::2014-04-10 18:44:56,699::task::974::TaskManager.Task::(_decref) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::ref 1 aborting False
>Thread-5256::INFO::2014-04-10 18:44:56,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5256::DEBUG::2014-04-10 18:44:56,702::task::1168::TaskManager.Task::(prepare) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5256::DEBUG::2014-04-10 18:44:56,702::task::579::TaskManager.Task::(_updateState) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::moving from state preparing -> state finished
>Thread-5256::DEBUG::2014-04-10 18:44:56,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5256::DEBUG::2014-04-10 18:44:56,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5256::DEBUG::2014-04-10 18:44:56,703::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5256::DEBUG::2014-04-10 18:44:56,703::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5256::DEBUG::2014-04-10 18:44:56,703::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5256::DEBUG::2014-04-10 18:44:56,703::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5256::DEBUG::2014-04-10 18:44:56,703::task::974::TaskManager.Task::(_decref) Task=`990d68c2-9697-4025-8bc8-fb4b9c08dd69`::ref 0 aborting False
>Thread-5258::DEBUG::2014-04-10 18:44:56,774::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5258::DEBUG::2014-04-10 18:44:56,774::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5258::DEBUG::2014-04-10 18:44:56,775::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5258::DEBUG::2014-04-10 18:44:56,775::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5258::DEBUG::2014-04-10 18:44:56,775::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5258::DEBUG::2014-04-10 18:44:56,776::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '78.01', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '22.61', 'appsList': [], 'guestIPs': ''}]}
>Thread-466::DEBUG::2014-04-10 18:44:56,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:44:56,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289054 s, 2.3 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:44:57,145::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:44:57,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261681 s, 2.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:44:57,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:44:57,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000333803 s, 2.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,584::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,584::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,585::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,585::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,586::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,586::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,587::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:44:57,587::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5260::DEBUG::2014-04-10 18:44:59,825::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5260::DEBUG::2014-04-10 18:44:59,825::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5260::DEBUG::2014-04-10 18:44:59,825::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5260::DEBUG::2014-04-10 18:44:59,825::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5260::DEBUG::2014-04-10 18:44:59,826::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5260::DEBUG::2014-04-10 18:44:59,827::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '78.01', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '22.61', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,593::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,594::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,594::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,594::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,595::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,596::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,596::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:02,596::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5262::DEBUG::2014-04-10 18:45:02,869::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5262::DEBUG::2014-04-10 18:45:02,870::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5262::DEBUG::2014-04-10 18:45:02,870::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5262::DEBUG::2014-04-10 18:45:02,870::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5262::DEBUG::2014-04-10 18:45:02,870::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5262::DEBUG::2014-04-10 18:45:02,872::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '78.01', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.68', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '22.61', 'appsList': [], 'guestIPs': ''}]}
>Thread-5264::DEBUG::2014-04-10 18:45:05,910::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5264::DEBUG::2014-04-10 18:45:05,910::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5264::DEBUG::2014-04-10 18:45:05,910::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5264::DEBUG::2014-04-10 18:45:05,911::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5264::DEBUG::2014-04-10 18:45:05,911::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5264::DEBUG::2014-04-10 18:45:05,912::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '78.01', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.71', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '22.61', 'appsList': [], 'guestIPs': ''}]}
>Thread-469::DEBUG::2014-04-10 18:45:06,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:06,712::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000340264 s, 1.1 MB/s\n'; <rc> = 0
>Thread-5265::DEBUG::2014-04-10 18:45:06,807::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5265::DEBUG::2014-04-10 18:45:06,808::task::579::TaskManager.Task::(_updateState) Task=`86bfa690-ad42-4c8f-bee3-7cfd64f17cec`::moving from state init -> state preparing
>Thread-5265::INFO::2014-04-10 18:45:06,808::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5265::INFO::2014-04-10 18:45:06,808::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5265::DEBUG::2014-04-10 18:45:06,809::task::1168::TaskManager.Task::(prepare) Task=`86bfa690-ad42-4c8f-bee3-7cfd64f17cec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5265::DEBUG::2014-04-10 18:45:06,809::task::579::TaskManager.Task::(_updateState) Task=`86bfa690-ad42-4c8f-bee3-7cfd64f17cec`::moving from state preparing -> state finished
>Thread-5265::DEBUG::2014-04-10 18:45:06,809::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5265::DEBUG::2014-04-10 18:45:06,809::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5265::DEBUG::2014-04-10 18:45:06,809::task::974::TaskManager.Task::(_decref) Task=`86bfa690-ad42-4c8f-bee3-7cfd64f17cec`::ref 0 aborting False
>Thread-5266::DEBUG::2014-04-10 18:45:06,820::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5266::DEBUG::2014-04-10 18:45:06,821::task::579::TaskManager.Task::(_updateState) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::moving from state init -> state preparing
>Thread-5266::INFO::2014-04-10 18:45:06,821::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5266::DEBUG::2014-04-10 18:45:06,821::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad6182c0-d259-4e10-af1d-d150d077d326`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5266::DEBUG::2014-04-10 18:45:06,822::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5266::DEBUG::2014-04-10 18:45:06,822::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5266::DEBUG::2014-04-10 18:45:06,822::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ad6182c0-d259-4e10-af1d-d150d077d326`::Granted request
>Thread-5266::DEBUG::2014-04-10 18:45:06,822::task::811::TaskManager.Task::(resourceAcquired) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5266::DEBUG::2014-04-10 18:45:06,823::task::974::TaskManager.Task::(_decref) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::ref 1 aborting False
>Thread-5266::INFO::2014-04-10 18:45:06,825::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5266::DEBUG::2014-04-10 18:45:06,825::task::1168::TaskManager.Task::(prepare) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5266::DEBUG::2014-04-10 18:45:06,825::task::579::TaskManager.Task::(_updateState) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::moving from state preparing -> state finished
>Thread-5266::DEBUG::2014-04-10 18:45:06,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5266::DEBUG::2014-04-10 18:45:06,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5266::DEBUG::2014-04-10 18:45:06,826::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5266::DEBUG::2014-04-10 18:45:06,826::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5266::DEBUG::2014-04-10 18:45:06,826::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5266::DEBUG::2014-04-10 18:45:06,826::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5266::DEBUG::2014-04-10 18:45:06,827::task::974::TaskManager.Task::(_decref) Task=`1583e48a-ec0f-4d82-8e4f-017fd1639ce7`::ref 0 aborting False
>Thread-466::DEBUG::2014-04-10 18:45:06,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:45:06,912::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000272752 s, 2.5 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:45:07,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:07,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032955 s, 2.0 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:45:07,185::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:07,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000368847 s, 1.8 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,603::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,603::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,603::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,603::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,605::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,605::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,605::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:07,605::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5267::DEBUG::2014-04-10 18:45:08,942::task::579::TaskManager.Task::(_updateState) Task=`4f6cc3f6-ce3f-41ae-97f2-796a58783b14`::moving from state init -> state preparing
>Thread-5267::INFO::2014-04-10 18:45:08,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5267::INFO::2014-04-10 18:45:08,942::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368847', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272752', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032955', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340264', 'lastCheck': '2.2', 'valid': True}}
>Thread-5267::DEBUG::2014-04-10 18:45:08,942::task::1168::TaskManager.Task::(prepare) Task=`4f6cc3f6-ce3f-41ae-97f2-796a58783b14`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368847', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000272752', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032955', 'lastCheck': '1.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340264', 'lastCheck': '2.2', 'valid': True}}
>Thread-5267::DEBUG::2014-04-10 18:45:08,943::task::579::TaskManager.Task::(_updateState) Task=`4f6cc3f6-ce3f-41ae-97f2-796a58783b14`::moving from state preparing -> state finished
>Thread-5267::DEBUG::2014-04-10 18:45:08,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5267::DEBUG::2014-04-10 18:45:08,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5267::DEBUG::2014-04-10 18:45:08,943::task::974::TaskManager.Task::(_decref) Task=`4f6cc3f6-ce3f-41ae-97f2-796a58783b14`::ref 0 aborting False
>Thread-5268::DEBUG::2014-04-10 18:45:08,974::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5268::DEBUG::2014-04-10 18:45:08,974::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5268::DEBUG::2014-04-10 18:45:08,974::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5268::DEBUG::2014-04-10 18:45:08,974::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5270::DEBUG::2014-04-10 18:45:12,150::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5270::DEBUG::2014-04-10 18:45:12,150::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5270::DEBUG::2014-04-10 18:45:12,150::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5270::DEBUG::2014-04-10 18:45:12,150::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5270::DEBUG::2014-04-10 18:45:12,151::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5270::DEBUG::2014-04-10 18:45:12,152::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '46.64', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.94', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '15.98', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,612::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,612::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,613::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,613::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,614::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,614::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,615::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:12,615::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5272::DEBUG::2014-04-10 18:45:15,198::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5272::DEBUG::2014-04-10 18:45:15,199::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5272::DEBUG::2014-04-10 18:45:15,199::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5272::DEBUG::2014-04-10 18:45:15,199::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5272::DEBUG::2014-04-10 18:45:15,199::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5272::DEBUG::2014-04-10 18:45:15,201::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '46.64', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.97', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '15.98', 'appsList': [], 'guestIPs': ''}]}
>Thread-469::DEBUG::2014-04-10 18:45:16,719::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:16,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000411113 s, 895 kB/s\n'; <rc> = 0
>Thread-5273::DEBUG::2014-04-10 18:45:16,912::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5273::DEBUG::2014-04-10 18:45:16,912::task::579::TaskManager.Task::(_updateState) Task=`b9a1c467-4c00-4dcd-9913-f6f705f719f0`::moving from state init -> state preparing
>Thread-5273::INFO::2014-04-10 18:45:16,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5273::INFO::2014-04-10 18:45:16,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5273::DEBUG::2014-04-10 18:45:16,913::task::1168::TaskManager.Task::(prepare) Task=`b9a1c467-4c00-4dcd-9913-f6f705f719f0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5273::DEBUG::2014-04-10 18:45:16,913::task::579::TaskManager.Task::(_updateState) Task=`b9a1c467-4c00-4dcd-9913-f6f705f719f0`::moving from state preparing -> state finished
>Thread-5273::DEBUG::2014-04-10 18:45:16,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5273::DEBUG::2014-04-10 18:45:16,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5273::DEBUG::2014-04-10 18:45:16,914::task::974::TaskManager.Task::(_decref) Task=`b9a1c467-4c00-4dcd-9913-f6f705f719f0`::ref 0 aborting False
>Thread-5274::DEBUG::2014-04-10 18:45:16,925::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5274::DEBUG::2014-04-10 18:45:16,929::task::579::TaskManager.Task::(_updateState) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::moving from state init -> state preparing
>Thread-5274::INFO::2014-04-10 18:45:16,931::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5274::DEBUG::2014-04-10 18:45:16,936::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33e6e9f3-c0df-46c6-8d8c-306ee4fd8a83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5274::DEBUG::2014-04-10 18:45:16,938::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5274::DEBUG::2014-04-10 18:45:16,941::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5274::DEBUG::2014-04-10 18:45:16,943::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33e6e9f3-c0df-46c6-8d8c-306ee4fd8a83`::Granted request
>Thread-466::DEBUG::2014-04-10 18:45:16,944::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-5274::DEBUG::2014-04-10 18:45:16,952::task::811::TaskManager.Task::(resourceAcquired) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5274::DEBUG::2014-04-10 18:45:16,955::task::974::TaskManager.Task::(_decref) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::ref 1 aborting False
>Thread-466::DEBUG::2014-04-10 18:45:16,969::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000283294 s, 2.4 MB/s\n'; <rc> = 0
>Thread-5274::INFO::2014-04-10 18:45:16,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5274::DEBUG::2014-04-10 18:45:16,978::task::1168::TaskManager.Task::(prepare) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5274::DEBUG::2014-04-10 18:45:16,980::task::579::TaskManager.Task::(_updateState) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::moving from state preparing -> state finished
>Thread-5274::DEBUG::2014-04-10 18:45:16,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5274::DEBUG::2014-04-10 18:45:16,982::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5274::DEBUG::2014-04-10 18:45:16,984::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5274::DEBUG::2014-04-10 18:45:16,986::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5274::DEBUG::2014-04-10 18:45:16,987::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5274::DEBUG::2014-04-10 18:45:16,987::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5274::DEBUG::2014-04-10 18:45:16,987::task::974::TaskManager.Task::(_decref) Task=`ca7aeb97-ec3a-4e0f-9b6d-33e419dff7f4`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:45:17,186::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:17,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420744 s, 1.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:45:17,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:17,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000440295 s, 1.5 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,621::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,622::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,622::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,622::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,624::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,624::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,624::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:45:17,624::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5276::DEBUG::2014-04-10 18:45:18,261::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5276::DEBUG::2014-04-10 18:45:18,261::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5276::DEBUG::2014-04-10 18:45:18,261::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5276::DEBUG::2014-04-10 18:45:18,261::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5276::DEBUG::2014-04-10 18:45:18,262::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5276::DEBUG::2014-04-10 18:45:18,263::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '46.64', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.03', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '15.98', 'appsList': [], 'guestIPs': ''}]}
>Thread-5278::DEBUG::2014-04-10 18:45:21,304::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-5278::DEBUG::2014-04-10 18:45:21,304::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-5278::DEBUG::2014-04-10 18:45:21,304::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-5278::DEBUG::2014-04-10 18:45:21,304::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-5278::DEBUG::2014-04-10 18:45:21,304::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-5278::DEBUG::2014-04-10 18:45:21,305::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '46.64', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.07', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '15.98', 'appsList': [], 'guestIPs': ''}]}
>Thread-5225::DEBUG::2014-04-10 18:45:22,232::task::579::TaskManager.Task::(_updateState) Task=`c7c706a2-43f6-4e04-a40d-f29911f618e9`::moving from state init -> state preparing
>Thread-5225::INFO::2014-04-10 18:45:22,232::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-5225::INFO::2014-04-10 18:45:22,243::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:45:22,243::task::1168::TaskManager.Task::(prepare) Task=`c7c706a2-43f6-4e04-a40d-f29911f618e9`::finished: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:45:22,243::task::579::TaskManager.Task::(_updateState) Task=`c7c706a2-43f6-4e04-a40d-f29911f618e9`::moving from state preparing -> state finished
>Thread-5225::DEBUG::2014-04-10 18:45:22,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5225::DEBUG::2014-04-10 18:45:22,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5225::DEBUG::2014-04-10 18:45:22,244::task::974::TaskManager.Task::(_decref) Task=`c7c706a2-43f6-4e04-a40d-f29911f618e9`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:45:22,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5279::DEBUG::2014-04-10 18:45:24,385::task::579::TaskManager.Task::(_updateState) Task=`0d3147f7-db0f-458b-987d-3af8c07ee135`::moving from state init -> state preparing
>Thread-5279::INFO::2014-04-10 18:45:24,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5279::INFO::2014-04-10 18:45:24,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440295', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283294', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420744', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411113', 'lastCheck': '7.7', 'valid': True}}
>Thread-5279::DEBUG::2014-04-10 18:45:24,386::task::1168::TaskManager.Task::(prepare) Task=`0d3147f7-db0f-458b-987d-3af8c07ee135`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440295', 'lastCheck': '7.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000283294', 'lastCheck': '7.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420744', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411113', 'lastCheck': '7.7', 'valid': True}}
>Thread-5279::DEBUG::2014-04-10 18:45:24,386::task::579::TaskManager.Task::(_updateState) Task=`0d3147f7-db0f-458b-987d-3af8c07ee135`::moving from state preparing -> state finished
>Thread-5279::DEBUG::2014-04-10 18:45:24,387::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5279::DEBUG::2014-04-10 18:45:24,387::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5279::DEBUG::2014-04-10 18:45:24,387::task::974::TaskManager.Task::(_decref) Task=`0d3147f7-db0f-458b-987d-3af8c07ee135`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:45:26,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:26,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000354293 s, 1.0 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:45:26,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:45:26,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364845 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5281::DEBUG::2014-04-10 18:45:27,078::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5281::DEBUG::2014-04-10 18:45:27,079::task::579::TaskManager.Task::(_updateState) Task=`c51814cf-34c3-4fe9-bcf5-83c3c3541c38`::moving from state init -> state preparing
>Thread-5281::INFO::2014-04-10 18:45:27,079::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5281::INFO::2014-04-10 18:45:27,080::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5281::DEBUG::2014-04-10 18:45:27,080::task::1168::TaskManager.Task::(prepare) Task=`c51814cf-34c3-4fe9-bcf5-83c3c3541c38`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5281::DEBUG::2014-04-10 18:45:27,080::task::579::TaskManager.Task::(_updateState) Task=`c51814cf-34c3-4fe9-bcf5-83c3c3541c38`::moving from state preparing -> state finished
>Thread-5281::DEBUG::2014-04-10 18:45:27,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5281::DEBUG::2014-04-10 18:45:27,080::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5281::DEBUG::2014-04-10 18:45:27,080::task::974::TaskManager.Task::(_decref) Task=`c51814cf-34c3-4fe9-bcf5-83c3c3541c38`::ref 0 aborting False
>Thread-5282::DEBUG::2014-04-10 18:45:27,092::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5282::DEBUG::2014-04-10 18:45:27,092::task::579::TaskManager.Task::(_updateState) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::moving from state init -> state preparing
>Thread-5282::INFO::2014-04-10 18:45:27,093::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5282::DEBUG::2014-04-10 18:45:27,093::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc77bc36-d4b8-49ab-93b8-97c288bd629a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5282::DEBUG::2014-04-10 18:45:27,093::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5282::DEBUG::2014-04-10 18:45:27,094::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5282::DEBUG::2014-04-10 18:45:27,094::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc77bc36-d4b8-49ab-93b8-97c288bd629a`::Granted request
>Thread-5282::DEBUG::2014-04-10 18:45:27,094::task::811::TaskManager.Task::(resourceAcquired) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5282::DEBUG::2014-04-10 18:45:27,094::task::974::TaskManager.Task::(_decref) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::ref 1 aborting False
>Thread-5282::INFO::2014-04-10 18:45:27,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5282::DEBUG::2014-04-10 18:45:27,097::task::1168::TaskManager.Task::(prepare) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5282::DEBUG::2014-04-10 18:45:27,097::task::579::TaskManager.Task::(_updateState) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::moving from state preparing -> state finished
>Thread-5282::DEBUG::2014-04-10 18:45:27,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5282::DEBUG::2014-04-10 18:45:27,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5282::DEBUG::2014-04-10 18:45:27,098::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5282::DEBUG::2014-04-10 18:45:27,098::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5282::DEBUG::2014-04-10 18:45:27,098::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5282::DEBUG::2014-04-10 18:45:27,098::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5282::DEBUG::2014-04-10 18:45:27,098::task::974::TaskManager.Task::(_decref) Task=`9027303a-e534-4fc8-834a-9baa2c57e7b4`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:45:27,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:27,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000325194 s, 2.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:45:27,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:27,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00050574 s, 1.3 MB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:45:36,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:36,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000422943 s, 870 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:45:37,007::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:45:37,012::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028085 s, 2.4 MB/s\n'; <rc> = 0
>Thread-5287::DEBUG::2014-04-10 18:45:37,184::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5287::DEBUG::2014-04-10 18:45:37,185::task::579::TaskManager.Task::(_updateState) Task=`faecf4f8-22c2-4a0c-a457-3268779e7d6d`::moving from state init -> state preparing
>Thread-5287::INFO::2014-04-10 18:45:37,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5287::INFO::2014-04-10 18:45:37,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5287::DEBUG::2014-04-10 18:45:37,186::task::1168::TaskManager.Task::(prepare) Task=`faecf4f8-22c2-4a0c-a457-3268779e7d6d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5287::DEBUG::2014-04-10 18:45:37,186::task::579::TaskManager.Task::(_updateState) Task=`faecf4f8-22c2-4a0c-a457-3268779e7d6d`::moving from state preparing -> state finished
>Thread-5287::DEBUG::2014-04-10 18:45:37,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5287::DEBUG::2014-04-10 18:45:37,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5287::DEBUG::2014-04-10 18:45:37,187::task::974::TaskManager.Task::(_decref) Task=`faecf4f8-22c2-4a0c-a457-3268779e7d6d`::ref 0 aborting False
>Thread-5288::DEBUG::2014-04-10 18:45:37,198::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5288::DEBUG::2014-04-10 18:45:37,198::task::579::TaskManager.Task::(_updateState) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::moving from state init -> state preparing
>Thread-5288::INFO::2014-04-10 18:45:37,198::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5288::DEBUG::2014-04-10 18:45:37,199::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e40c22e6-48b8-4e96-945d-1df8a8070534`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5288::DEBUG::2014-04-10 18:45:37,199::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5288::DEBUG::2014-04-10 18:45:37,199::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5288::DEBUG::2014-04-10 18:45:37,199::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e40c22e6-48b8-4e96-945d-1df8a8070534`::Granted request
>Thread-5288::DEBUG::2014-04-10 18:45:37,200::task::811::TaskManager.Task::(resourceAcquired) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5288::DEBUG::2014-04-10 18:45:37,200::task::974::TaskManager.Task::(_decref) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::ref 1 aborting False
>Thread-5288::INFO::2014-04-10 18:45:37,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5288::DEBUG::2014-04-10 18:45:37,202::task::1168::TaskManager.Task::(prepare) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::task::579::TaskManager.Task::(_updateState) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::moving from state preparing -> state finished
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5288::DEBUG::2014-04-10 18:45:37,203::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5288::DEBUG::2014-04-10 18:45:37,204::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5288::DEBUG::2014-04-10 18:45:37,204::task::974::TaskManager.Task::(_decref) Task=`e26936ae-21ee-4eaa-abbc-085d8f5d86d2`::ref 0 aborting False
>Thread-468::DEBUG::2014-04-10 18:45:37,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:37,219::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379966 s, 1.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:45:37,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:37,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000402537 s, 1.6 MB/s\n'; <rc> = 0
>Thread-5289::DEBUG::2014-04-10 18:45:39,739::task::579::TaskManager.Task::(_updateState) Task=`532a29f5-97e0-4de9-a4ef-9593077c7005`::moving from state init -> state preparing
>Thread-5289::INFO::2014-04-10 18:45:39,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5289::INFO::2014-04-10 18:45:39,740::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402537', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028085', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379966', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422943', 'lastCheck': '3.0', 'valid': True}}
>Thread-5289::DEBUG::2014-04-10 18:45:39,740::task::1168::TaskManager.Task::(prepare) Task=`532a29f5-97e0-4de9-a4ef-9593077c7005`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402537', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028085', 'lastCheck': '2.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379966', 'lastCheck': '2.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422943', 'lastCheck': '3.0', 'valid': True}}
>Thread-5289::DEBUG::2014-04-10 18:45:39,740::task::579::TaskManager.Task::(_updateState) Task=`532a29f5-97e0-4de9-a4ef-9593077c7005`::moving from state preparing -> state finished
>Thread-5289::DEBUG::2014-04-10 18:45:39,740::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5289::DEBUG::2014-04-10 18:45:39,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5289::DEBUG::2014-04-10 18:45:39,740::task::974::TaskManager.Task::(_decref) Task=`532a29f5-97e0-4de9-a4ef-9593077c7005`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:45:46,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:46,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000353188 s, 1.0 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:45:47,015::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:45:47,029::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-466::DEBUG::2014-04-10 18:45:47,030::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-466::DEBUG::2014-04-10 18:45:47,035::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-466::DEBUG::2014-04-10 18:45:47,036::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-466::INFO::2014-04-10 18:45:47,036::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-466::INFO::2014-04-10 18:45:47,037::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-466::DEBUG::2014-04-10 18:45:47,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:45:47,048::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248435 s, 2.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:45:47,222::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:45:47,236::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-468::DEBUG::2014-04-10 18:45:47,238::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-468::DEBUG::2014-04-10 18:45:47,243::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-468::DEBUG::2014-04-10 18:45:47,249::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-468::INFO::2014-04-10 18:45:47,250::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-468::INFO::2014-04-10 18:45:47,251::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-467::DEBUG::2014-04-10 18:45:47,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:47,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000341845 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:45:47,291::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:47,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003332 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5301::DEBUG::2014-04-10 18:45:47,306::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5301::DEBUG::2014-04-10 18:45:47,307::task::579::TaskManager.Task::(_updateState) Task=`d97626f6-c402-441a-a238-471a3a5d7c7d`::moving from state init -> state preparing
>Thread-5301::INFO::2014-04-10 18:45:47,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5301::INFO::2014-04-10 18:45:47,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5301::DEBUG::2014-04-10 18:45:47,308::task::1168::TaskManager.Task::(prepare) Task=`d97626f6-c402-441a-a238-471a3a5d7c7d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5301::DEBUG::2014-04-10 18:45:47,308::task::579::TaskManager.Task::(_updateState) Task=`d97626f6-c402-441a-a238-471a3a5d7c7d`::moving from state preparing -> state finished
>Thread-5301::DEBUG::2014-04-10 18:45:47,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5301::DEBUG::2014-04-10 18:45:47,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5301::DEBUG::2014-04-10 18:45:47,309::task::974::TaskManager.Task::(_decref) Task=`d97626f6-c402-441a-a238-471a3a5d7c7d`::ref 0 aborting False
>Thread-5302::DEBUG::2014-04-10 18:45:47,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5302::DEBUG::2014-04-10 18:45:47,335::task::579::TaskManager.Task::(_updateState) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::moving from state init -> state preparing
>Thread-5302::INFO::2014-04-10 18:45:47,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5302::DEBUG::2014-04-10 18:45:47,336::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08dec6c3-42f7-470f-a229-43665a86538a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5302::DEBUG::2014-04-10 18:45:47,336::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5302::DEBUG::2014-04-10 18:45:47,336::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5302::DEBUG::2014-04-10 18:45:47,337::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`08dec6c3-42f7-470f-a229-43665a86538a`::Granted request
>Thread-5302::DEBUG::2014-04-10 18:45:47,337::task::811::TaskManager.Task::(resourceAcquired) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5302::DEBUG::2014-04-10 18:45:47,337::task::974::TaskManager.Task::(_decref) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::ref 1 aborting False
>Thread-5302::INFO::2014-04-10 18:45:47,339::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5302::DEBUG::2014-04-10 18:45:47,339::task::1168::TaskManager.Task::(prepare) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5302::DEBUG::2014-04-10 18:45:47,340::task::579::TaskManager.Task::(_updateState) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::moving from state preparing -> state finished
>Thread-5302::DEBUG::2014-04-10 18:45:47,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5302::DEBUG::2014-04-10 18:45:47,340::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5302::DEBUG::2014-04-10 18:45:47,340::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5302::DEBUG::2014-04-10 18:45:47,341::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5302::DEBUG::2014-04-10 18:45:47,341::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5302::DEBUG::2014-04-10 18:45:47,341::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5302::DEBUG::2014-04-10 18:45:47,341::task::974::TaskManager.Task::(_decref) Task=`1be5f9bc-e7a6-4651-953b-0065b75d44c2`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:45:52,772::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5305::DEBUG::2014-04-10 18:45:55,000::task::579::TaskManager.Task::(_updateState) Task=`c8549f8f-2013-4d44-bb75-568b7f9c7767`::moving from state init -> state preparing
>Thread-5305::INFO::2014-04-10 18:45:55,001::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5305::INFO::2014-04-10 18:45:55,001::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341845', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248435', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003332', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353188', 'lastCheck': '8.2', 'valid': True}}
>Thread-5305::DEBUG::2014-04-10 18:45:55,001::task::1168::TaskManager.Task::(prepare) Task=`c8549f8f-2013-4d44-bb75-568b7f9c7767`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341845', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000248435', 'lastCheck': '7.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003332', 'lastCheck': '7.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353188', 'lastCheck': '8.2', 'valid': True}}
>Thread-5305::DEBUG::2014-04-10 18:45:55,001::task::579::TaskManager.Task::(_updateState) Task=`c8549f8f-2013-4d44-bb75-568b7f9c7767`::moving from state preparing -> state finished
>Thread-5305::DEBUG::2014-04-10 18:45:55,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5305::DEBUG::2014-04-10 18:45:55,002::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5305::DEBUG::2014-04-10 18:45:55,002::task::974::TaskManager.Task::(_decref) Task=`c8549f8f-2013-4d44-bb75-568b7f9c7767`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:45:56,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:45:56,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000402898 s, 913 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:45:57,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:45:57,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000390951 s, 1.7 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:45:57,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:45:57,352::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000382433 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:45:57,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:45:57,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320763 s, 2.1 MB/s\n'; <rc> = 0
>Thread-5307::DEBUG::2014-04-10 18:45:57,447::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5307::DEBUG::2014-04-10 18:45:57,447::task::579::TaskManager.Task::(_updateState) Task=`a66ca3c8-addf-48cc-9692-a852615e10a7`::moving from state init -> state preparing
>Thread-5307::INFO::2014-04-10 18:45:57,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5307::INFO::2014-04-10 18:45:57,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5307::DEBUG::2014-04-10 18:45:57,448::task::1168::TaskManager.Task::(prepare) Task=`a66ca3c8-addf-48cc-9692-a852615e10a7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5307::DEBUG::2014-04-10 18:45:57,448::task::579::TaskManager.Task::(_updateState) Task=`a66ca3c8-addf-48cc-9692-a852615e10a7`::moving from state preparing -> state finished
>Thread-5307::DEBUG::2014-04-10 18:45:57,448::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5307::DEBUG::2014-04-10 18:45:57,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5307::DEBUG::2014-04-10 18:45:57,449::task::974::TaskManager.Task::(_decref) Task=`a66ca3c8-addf-48cc-9692-a852615e10a7`::ref 0 aborting False
>Thread-5308::DEBUG::2014-04-10 18:45:57,457::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5308::DEBUG::2014-04-10 18:45:57,457::task::579::TaskManager.Task::(_updateState) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::moving from state init -> state preparing
>Thread-5308::INFO::2014-04-10 18:45:57,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5308::DEBUG::2014-04-10 18:45:57,458::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ab1a4c72-f3f1-481e-9904-039dc7abd29f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5308::DEBUG::2014-04-10 18:45:57,458::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5308::DEBUG::2014-04-10 18:45:57,458::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5308::DEBUG::2014-04-10 18:45:57,459::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ab1a4c72-f3f1-481e-9904-039dc7abd29f`::Granted request
>Thread-5308::DEBUG::2014-04-10 18:45:57,459::task::811::TaskManager.Task::(resourceAcquired) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5308::DEBUG::2014-04-10 18:45:57,459::task::974::TaskManager.Task::(_decref) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::ref 1 aborting False
>Thread-5308::INFO::2014-04-10 18:45:57,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5308::DEBUG::2014-04-10 18:45:57,461::task::1168::TaskManager.Task::(prepare) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5308::DEBUG::2014-04-10 18:45:57,462::task::579::TaskManager.Task::(_updateState) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::moving from state preparing -> state finished
>Thread-5308::DEBUG::2014-04-10 18:45:57,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5308::DEBUG::2014-04-10 18:45:57,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5308::DEBUG::2014-04-10 18:45:57,462::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5308::DEBUG::2014-04-10 18:45:57,462::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5308::DEBUG::2014-04-10 18:45:57,463::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5308::DEBUG::2014-04-10 18:45:57,463::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5308::DEBUG::2014-04-10 18:45:57,463::task::974::TaskManager.Task::(_decref) Task=`262484bf-a5b3-4dea-b5c0-b084ca330c22`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:06,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:06,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000421529 s, 873 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:46:07,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:46:07,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345707 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:07,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:07,430::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000398643 s, 1.7 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:46:07,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:46:07,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242291 s, 2.8 MB/s\n'; <rc> = 0
>Thread-5313::DEBUG::2014-04-10 18:46:07,546::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5313::DEBUG::2014-04-10 18:46:07,547::task::579::TaskManager.Task::(_updateState) Task=`6e9195d1-66e8-4ded-b124-0efd2fc6a2ee`::moving from state init -> state preparing
>Thread-5313::INFO::2014-04-10 18:46:07,547::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5313::INFO::2014-04-10 18:46:07,548::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5313::DEBUG::2014-04-10 18:46:07,548::task::1168::TaskManager.Task::(prepare) Task=`6e9195d1-66e8-4ded-b124-0efd2fc6a2ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5313::DEBUG::2014-04-10 18:46:07,548::task::579::TaskManager.Task::(_updateState) Task=`6e9195d1-66e8-4ded-b124-0efd2fc6a2ee`::moving from state preparing -> state finished
>Thread-5313::DEBUG::2014-04-10 18:46:07,548::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5313::DEBUG::2014-04-10 18:46:07,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5313::DEBUG::2014-04-10 18:46:07,549::task::974::TaskManager.Task::(_decref) Task=`6e9195d1-66e8-4ded-b124-0efd2fc6a2ee`::ref 0 aborting False
>Thread-5314::DEBUG::2014-04-10 18:46:07,559::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5314::DEBUG::2014-04-10 18:46:07,559::task::579::TaskManager.Task::(_updateState) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::moving from state init -> state preparing
>Thread-5314::INFO::2014-04-10 18:46:07,560::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5314::DEBUG::2014-04-10 18:46:07,560::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`604aa9f2-9d40-46cc-af7c-617d6b579003`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5314::DEBUG::2014-04-10 18:46:07,560::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5314::DEBUG::2014-04-10 18:46:07,561::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5314::DEBUG::2014-04-10 18:46:07,561::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`604aa9f2-9d40-46cc-af7c-617d6b579003`::Granted request
>Thread-5314::DEBUG::2014-04-10 18:46:07,561::task::811::TaskManager.Task::(resourceAcquired) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5314::DEBUG::2014-04-10 18:46:07,561::task::974::TaskManager.Task::(_decref) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::ref 1 aborting False
>Thread-5314::INFO::2014-04-10 18:46:07,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5314::DEBUG::2014-04-10 18:46:07,564::task::1168::TaskManager.Task::(prepare) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5314::DEBUG::2014-04-10 18:46:07,564::task::579::TaskManager.Task::(_updateState) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::moving from state preparing -> state finished
>Thread-5314::DEBUG::2014-04-10 18:46:07,564::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5314::DEBUG::2014-04-10 18:46:07,564::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5314::DEBUG::2014-04-10 18:46:07,565::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5314::DEBUG::2014-04-10 18:46:07,565::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5314::DEBUG::2014-04-10 18:46:07,565::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5314::DEBUG::2014-04-10 18:46:07,565::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5314::DEBUG::2014-04-10 18:46:07,565::task::974::TaskManager.Task::(_decref) Task=`087f683e-6601-4652-be2c-6db2521a7f92`::ref 0 aborting False
>Thread-5315::DEBUG::2014-04-10 18:46:10,255::task::579::TaskManager.Task::(_updateState) Task=`02e08882-d122-4761-816a-d6f4586e01c6`::moving from state init -> state preparing
>Thread-5315::INFO::2014-04-10 18:46:10,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5315::INFO::2014-04-10 18:46:10,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398643', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345707', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242291', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421529', 'lastCheck': '3.5', 'valid': True}}
>Thread-5315::DEBUG::2014-04-10 18:46:10,256::task::1168::TaskManager.Task::(prepare) Task=`02e08882-d122-4761-816a-d6f4586e01c6`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000398643', 'lastCheck': '2.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345707', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242291', 'lastCheck': '2.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000421529', 'lastCheck': '3.5', 'valid': True}}
>Thread-5315::DEBUG::2014-04-10 18:46:10,256::task::579::TaskManager.Task::(_updateState) Task=`02e08882-d122-4761-816a-d6f4586e01c6`::moving from state preparing -> state finished
>Thread-5315::DEBUG::2014-04-10 18:46:10,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5315::DEBUG::2014-04-10 18:46:10,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5315::DEBUG::2014-04-10 18:46:10,256::task::974::TaskManager.Task::(_decref) Task=`02e08882-d122-4761-816a-d6f4586e01c6`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:16,813::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:16,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000390762 s, 942 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:46:17,089::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:46:17,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000430411 s, 1.6 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:17,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:46:17,490::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:17,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000355383 s, 1.9 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:46:17,506::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379458 s, 1.8 MB/s\n'; <rc> = 0
>Thread-5319::DEBUG::2014-04-10 18:46:17,661::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5319::DEBUG::2014-04-10 18:46:17,662::task::579::TaskManager.Task::(_updateState) Task=`0b22a06a-d693-49a3-b041-0a89f07bfe3c`::moving from state init -> state preparing
>Thread-5319::INFO::2014-04-10 18:46:17,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5319::INFO::2014-04-10 18:46:17,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5319::DEBUG::2014-04-10 18:46:17,662::task::1168::TaskManager.Task::(prepare) Task=`0b22a06a-d693-49a3-b041-0a89f07bfe3c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5319::DEBUG::2014-04-10 18:46:17,663::task::579::TaskManager.Task::(_updateState) Task=`0b22a06a-d693-49a3-b041-0a89f07bfe3c`::moving from state preparing -> state finished
>Thread-5319::DEBUG::2014-04-10 18:46:17,663::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5319::DEBUG::2014-04-10 18:46:17,663::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5319::DEBUG::2014-04-10 18:46:17,663::task::974::TaskManager.Task::(_decref) Task=`0b22a06a-d693-49a3-b041-0a89f07bfe3c`::ref 0 aborting False
>Thread-5320::DEBUG::2014-04-10 18:46:17,674::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5320::DEBUG::2014-04-10 18:46:17,675::task::579::TaskManager.Task::(_updateState) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::moving from state init -> state preparing
>Thread-5320::INFO::2014-04-10 18:46:17,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5320::DEBUG::2014-04-10 18:46:17,675::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`548e99d4-76e4-4e42-a2cb-e92f521c25a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5320::DEBUG::2014-04-10 18:46:17,675::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5320::DEBUG::2014-04-10 18:46:17,676::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5320::DEBUG::2014-04-10 18:46:17,676::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`548e99d4-76e4-4e42-a2cb-e92f521c25a6`::Granted request
>Thread-5320::DEBUG::2014-04-10 18:46:17,676::task::811::TaskManager.Task::(resourceAcquired) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5320::DEBUG::2014-04-10 18:46:17,676::task::974::TaskManager.Task::(_decref) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::ref 1 aborting False
>Thread-5320::INFO::2014-04-10 18:46:17,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5320::DEBUG::2014-04-10 18:46:17,678::task::1168::TaskManager.Task::(prepare) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5320::DEBUG::2014-04-10 18:46:17,678::task::579::TaskManager.Task::(_updateState) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::moving from state preparing -> state finished
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5320::DEBUG::2014-04-10 18:46:17,679::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5320::DEBUG::2014-04-10 18:46:17,680::task::974::TaskManager.Task::(_decref) Task=`0bfac4c3-c284-41f0-9f16-2543495fa1d4`::ref 0 aborting False
>Thread-5225::DEBUG::2014-04-10 18:46:22,432::task::579::TaskManager.Task::(_updateState) Task=`1dcaa6d3-c10e-4b7d-97ea-377a8b408f1a`::moving from state init -> state preparing
>Thread-5225::INFO::2014-04-10 18:46:22,432::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-5225::INFO::2014-04-10 18:46:22,455::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:46:22,455::task::1168::TaskManager.Task::(prepare) Task=`1dcaa6d3-c10e-4b7d-97ea-377a8b408f1a`::finished: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-5225::DEBUG::2014-04-10 18:46:22,455::task::579::TaskManager.Task::(_updateState) Task=`1dcaa6d3-c10e-4b7d-97ea-377a8b408f1a`::moving from state preparing -> state finished
>Thread-5225::DEBUG::2014-04-10 18:46:22,455::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5225::DEBUG::2014-04-10 18:46:22,455::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5225::DEBUG::2014-04-10 18:46:22,455::task::974::TaskManager.Task::(_decref) Task=`1dcaa6d3-c10e-4b7d-97ea-377a8b408f1a`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:46:22,805::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5323::DEBUG::2014-04-10 18:46:25,554::task::579::TaskManager.Task::(_updateState) Task=`f376a49d-6599-46ff-9270-d6885ade2d16`::moving from state init -> state preparing
>Thread-5323::INFO::2014-04-10 18:46:25,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5323::INFO::2014-04-10 18:46:25,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355383', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430411', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379458', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390762', 'lastCheck': '8.7', 'valid': True}}
>Thread-5323::DEBUG::2014-04-10 18:46:25,560::task::1168::TaskManager.Task::(prepare) Task=`f376a49d-6599-46ff-9270-d6885ade2d16`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355383', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430411', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379458', 'lastCheck': '8.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390762', 'lastCheck': '8.7', 'valid': True}}
>Thread-5323::DEBUG::2014-04-10 18:46:25,560::task::579::TaskManager.Task::(_updateState) Task=`f376a49d-6599-46ff-9270-d6885ade2d16`::moving from state preparing -> state finished
>Thread-5323::DEBUG::2014-04-10 18:46:25,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5323::DEBUG::2014-04-10 18:46:25,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5323::DEBUG::2014-04-10 18:46:25,561::task::974::TaskManager.Task::(_decref) Task=`f376a49d-6599-46ff-9270-d6885ade2d16`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:26,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:26,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000384022 s, 958 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:46:27,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:46:27,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347823 s, 1.9 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:27,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:46:27,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:27,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000369198 s, 1.8 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:46:27,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000340497 s, 2.0 MB/s\n'; <rc> = 0
>Thread-5325::DEBUG::2014-04-10 18:46:27,810::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5325::DEBUG::2014-04-10 18:46:27,811::task::579::TaskManager.Task::(_updateState) Task=`269c5ba3-d656-415d-bead-6bfee990ee14`::moving from state init -> state preparing
>Thread-5325::INFO::2014-04-10 18:46:27,811::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5325::INFO::2014-04-10 18:46:27,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5325::DEBUG::2014-04-10 18:46:27,812::task::1168::TaskManager.Task::(prepare) Task=`269c5ba3-d656-415d-bead-6bfee990ee14`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5325::DEBUG::2014-04-10 18:46:27,812::task::579::TaskManager.Task::(_updateState) Task=`269c5ba3-d656-415d-bead-6bfee990ee14`::moving from state preparing -> state finished
>Thread-5325::DEBUG::2014-04-10 18:46:27,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5325::DEBUG::2014-04-10 18:46:27,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5325::DEBUG::2014-04-10 18:46:27,813::task::974::TaskManager.Task::(_decref) Task=`269c5ba3-d656-415d-bead-6bfee990ee14`::ref 0 aborting False
>Thread-5326::DEBUG::2014-04-10 18:46:27,823::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5326::DEBUG::2014-04-10 18:46:27,824::task::579::TaskManager.Task::(_updateState) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::moving from state init -> state preparing
>Thread-5326::INFO::2014-04-10 18:46:27,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5326::DEBUG::2014-04-10 18:46:27,824::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`52ed7da4-e542-49d2-98e7-a23878fd569d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5326::DEBUG::2014-04-10 18:46:27,825::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5326::DEBUG::2014-04-10 18:46:27,825::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5326::DEBUG::2014-04-10 18:46:27,825::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`52ed7da4-e542-49d2-98e7-a23878fd569d`::Granted request
>Thread-5326::DEBUG::2014-04-10 18:46:27,825::task::811::TaskManager.Task::(resourceAcquired) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5326::DEBUG::2014-04-10 18:46:27,826::task::974::TaskManager.Task::(_decref) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::ref 1 aborting False
>Thread-5326::INFO::2014-04-10 18:46:27,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5326::DEBUG::2014-04-10 18:46:27,828::task::1168::TaskManager.Task::(prepare) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5326::DEBUG::2014-04-10 18:46:27,828::task::579::TaskManager.Task::(_updateState) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::moving from state preparing -> state finished
>Thread-5326::DEBUG::2014-04-10 18:46:27,829::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5326::DEBUG::2014-04-10 18:46:27,829::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5326::DEBUG::2014-04-10 18:46:27,829::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5326::DEBUG::2014-04-10 18:46:27,829::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5326::DEBUG::2014-04-10 18:46:27,829::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5326::DEBUG::2014-04-10 18:46:27,830::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5326::DEBUG::2014-04-10 18:46:27,830::task::974::TaskManager.Task::(_decref) Task=`50ea07bc-04c7-44e8-81b9-e27a6fc08fc2`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:36,844::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:36,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00042279 s, 870 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:46:37,117::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:46:37,123::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003198 s, 2.1 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:37,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:46:37,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:37,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00041045 s, 1.6 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:46:37,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242944 s, 2.8 MB/s\n'; <rc> = 0
>Thread-5331::DEBUG::2014-04-10 18:46:37,957::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5331::DEBUG::2014-04-10 18:46:37,958::task::579::TaskManager.Task::(_updateState) Task=`4172d7a0-44bc-465c-a98d-6adfd67a4816`::moving from state init -> state preparing
>Thread-5331::INFO::2014-04-10 18:46:37,958::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5331::INFO::2014-04-10 18:46:37,958::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5331::DEBUG::2014-04-10 18:46:37,959::task::1168::TaskManager.Task::(prepare) Task=`4172d7a0-44bc-465c-a98d-6adfd67a4816`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5331::DEBUG::2014-04-10 18:46:37,959::task::579::TaskManager.Task::(_updateState) Task=`4172d7a0-44bc-465c-a98d-6adfd67a4816`::moving from state preparing -> state finished
>Thread-5331::DEBUG::2014-04-10 18:46:37,959::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5331::DEBUG::2014-04-10 18:46:37,959::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5331::DEBUG::2014-04-10 18:46:37,959::task::974::TaskManager.Task::(_decref) Task=`4172d7a0-44bc-465c-a98d-6adfd67a4816`::ref 0 aborting False
>Thread-5332::DEBUG::2014-04-10 18:46:37,983::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5332::DEBUG::2014-04-10 18:46:37,983::task::579::TaskManager.Task::(_updateState) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::moving from state init -> state preparing
>Thread-5332::INFO::2014-04-10 18:46:37,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5332::DEBUG::2014-04-10 18:46:37,984::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d2883f85-38a5-4b84-b40d-2f36cd54b622`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5332::DEBUG::2014-04-10 18:46:37,984::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5332::DEBUG::2014-04-10 18:46:37,984::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5332::DEBUG::2014-04-10 18:46:37,984::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d2883f85-38a5-4b84-b40d-2f36cd54b622`::Granted request
>Thread-5332::DEBUG::2014-04-10 18:46:37,985::task::811::TaskManager.Task::(resourceAcquired) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5332::DEBUG::2014-04-10 18:46:37,985::task::974::TaskManager.Task::(_decref) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::ref 1 aborting False
>Thread-5332::INFO::2014-04-10 18:46:37,987::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5332::DEBUG::2014-04-10 18:46:37,987::task::1168::TaskManager.Task::(prepare) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5332::DEBUG::2014-04-10 18:46:37,987::task::579::TaskManager.Task::(_updateState) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::moving from state preparing -> state finished
>Thread-5332::DEBUG::2014-04-10 18:46:37,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5332::DEBUG::2014-04-10 18:46:37,988::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5332::DEBUG::2014-04-10 18:46:37,988::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5332::DEBUG::2014-04-10 18:46:37,988::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5332::DEBUG::2014-04-10 18:46:37,988::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5332::DEBUG::2014-04-10 18:46:37,989::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5332::DEBUG::2014-04-10 18:46:37,989::task::974::TaskManager.Task::(_decref) Task=`f85f9ccf-d084-4980-b084-76d7b97fff2e`::ref 0 aborting False
>Thread-5333::DEBUG::2014-04-10 18:46:40,827::task::579::TaskManager.Task::(_updateState) Task=`8e42962c-5f42-4e89-9930-9150d52bcfad`::moving from state init -> state preparing
>Thread-5333::INFO::2014-04-10 18:46:40,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5333::INFO::2014-04-10 18:46:40,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041045', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003198', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242944', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042279', 'lastCheck': '4.0', 'valid': True}}
>Thread-5333::DEBUG::2014-04-10 18:46:40,827::task::1168::TaskManager.Task::(prepare) Task=`8e42962c-5f42-4e89-9930-9150d52bcfad`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041045', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003198', 'lastCheck': '3.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000242944', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042279', 'lastCheck': '4.0', 'valid': True}}
>Thread-5333::DEBUG::2014-04-10 18:46:40,828::task::579::TaskManager.Task::(_updateState) Task=`8e42962c-5f42-4e89-9930-9150d52bcfad`::moving from state preparing -> state finished
>Thread-5333::DEBUG::2014-04-10 18:46:40,828::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5333::DEBUG::2014-04-10 18:46:40,828::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5333::DEBUG::2014-04-10 18:46:40,828::task::974::TaskManager.Task::(_decref) Task=`8e42962c-5f42-4e89-9930-9150d52bcfad`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:46,860::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:46,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000392507 s, 938 kB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 18:46:47,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-466::DEBUG::2014-04-10 18:46:47,142::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0018926 s, 355 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:47,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-468::DEBUG::2014-04-10 18:46:47,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:47,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000330902 s, 2.0 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 18:46:47,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000228826 s, 2.9 MB/s\n'; <rc> = 0
>Thread-5337::DEBUG::2014-04-10 18:46:48,074::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5337::DEBUG::2014-04-10 18:46:48,075::task::579::TaskManager.Task::(_updateState) Task=`7df8f01e-6003-4430-bdef-5882de7fa050`::moving from state init -> state preparing
>Thread-5337::INFO::2014-04-10 18:46:48,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5337::INFO::2014-04-10 18:46:48,075::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5337::DEBUG::2014-04-10 18:46:48,076::task::1168::TaskManager.Task::(prepare) Task=`7df8f01e-6003-4430-bdef-5882de7fa050`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5337::DEBUG::2014-04-10 18:46:48,076::task::579::TaskManager.Task::(_updateState) Task=`7df8f01e-6003-4430-bdef-5882de7fa050`::moving from state preparing -> state finished
>Thread-5337::DEBUG::2014-04-10 18:46:48,076::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5337::DEBUG::2014-04-10 18:46:48,076::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5337::DEBUG::2014-04-10 18:46:48,076::task::974::TaskManager.Task::(_decref) Task=`7df8f01e-6003-4430-bdef-5882de7fa050`::ref 0 aborting False
>Thread-5338::DEBUG::2014-04-10 18:46:48,091::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5338::DEBUG::2014-04-10 18:46:48,092::task::579::TaskManager.Task::(_updateState) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::moving from state init -> state preparing
>Thread-5338::INFO::2014-04-10 18:46:48,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5338::DEBUG::2014-04-10 18:46:48,092::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d574c0-db10-44d7-b448-6cbe24e23af7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5338::DEBUG::2014-04-10 18:46:48,093::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5338::DEBUG::2014-04-10 18:46:48,093::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5338::DEBUG::2014-04-10 18:46:48,093::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`93d574c0-db10-44d7-b448-6cbe24e23af7`::Granted request
>Thread-5338::DEBUG::2014-04-10 18:46:48,094::task::811::TaskManager.Task::(resourceAcquired) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5338::DEBUG::2014-04-10 18:46:48,094::task::974::TaskManager.Task::(_decref) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::ref 1 aborting False
>Thread-5338::INFO::2014-04-10 18:46:48,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5338::DEBUG::2014-04-10 18:46:48,096::task::1168::TaskManager.Task::(prepare) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5338::DEBUG::2014-04-10 18:46:48,096::task::579::TaskManager.Task::(_updateState) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::moving from state preparing -> state finished
>Thread-5338::DEBUG::2014-04-10 18:46:48,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5338::DEBUG::2014-04-10 18:46:48,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5338::DEBUG::2014-04-10 18:46:48,097::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5338::DEBUG::2014-04-10 18:46:48,097::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5338::DEBUG::2014-04-10 18:46:48,097::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5338::DEBUG::2014-04-10 18:46:48,097::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5338::DEBUG::2014-04-10 18:46:48,098::task::974::TaskManager.Task::(_decref) Task=`793751ea-be35-4e7c-a815-eb4a73b85918`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:46:52,839::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5341::DEBUG::2014-04-10 18:46:56,109::task::579::TaskManager.Task::(_updateState) Task=`b733dd22-e378-4412-b4a6-7d63b0c233c9`::moving from state init -> state preparing
>Thread-5341::INFO::2014-04-10 18:46:56,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5341::INFO::2014-04-10 18:46:56,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330902', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392507', 'lastCheck': '9.2', 'valid': True}}
>Thread-5341::DEBUG::2014-04-10 18:46:56,109::task::1168::TaskManager.Task::(prepare) Task=`b733dd22-e378-4412-b4a6-7d63b0c233c9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330902', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '9.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392507', 'lastCheck': '9.2', 'valid': True}}
>Thread-5341::DEBUG::2014-04-10 18:46:56,110::task::579::TaskManager.Task::(_updateState) Task=`b733dd22-e378-4412-b4a6-7d63b0c233c9`::moving from state preparing -> state finished
>Thread-5341::DEBUG::2014-04-10 18:46:56,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5341::DEBUG::2014-04-10 18:46:56,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5341::DEBUG::2014-04-10 18:46:56,110::task::974::TaskManager.Task::(_decref) Task=`b733dd22-e378-4412-b4a6-7d63b0c233c9`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:46:56,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:46:56,881::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489854 s, 751 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:46:57,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:46:57,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000522493 s, 1.3 MB/s\n'; <rc> = 0
>Thread-5343::DEBUG::2014-04-10 18:46:58,189::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5343::DEBUG::2014-04-10 18:46:58,190::task::579::TaskManager.Task::(_updateState) Task=`7782e61c-eca5-4137-ac79-1827a2d2c58f`::moving from state init -> state preparing
>Thread-5343::INFO::2014-04-10 18:46:58,190::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5343::INFO::2014-04-10 18:46:58,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5343::DEBUG::2014-04-10 18:46:58,190::task::1168::TaskManager.Task::(prepare) Task=`7782e61c-eca5-4137-ac79-1827a2d2c58f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5343::DEBUG::2014-04-10 18:46:58,191::task::579::TaskManager.Task::(_updateState) Task=`7782e61c-eca5-4137-ac79-1827a2d2c58f`::moving from state preparing -> state finished
>Thread-5343::DEBUG::2014-04-10 18:46:58,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5343::DEBUG::2014-04-10 18:46:58,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5343::DEBUG::2014-04-10 18:46:58,191::task::974::TaskManager.Task::(_decref) Task=`7782e61c-eca5-4137-ac79-1827a2d2c58f`::ref 0 aborting False
>Thread-5344::DEBUG::2014-04-10 18:46:58,201::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5344::DEBUG::2014-04-10 18:46:58,202::task::579::TaskManager.Task::(_updateState) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::moving from state init -> state preparing
>Thread-5344::INFO::2014-04-10 18:46:58,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5344::DEBUG::2014-04-10 18:46:58,202::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f2eb0c5f-fe6c-4a4e-857d-8192f3060ed2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5344::DEBUG::2014-04-10 18:46:58,203::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5344::DEBUG::2014-04-10 18:46:58,203::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5344::DEBUG::2014-04-10 18:46:58,203::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f2eb0c5f-fe6c-4a4e-857d-8192f3060ed2`::Granted request
>Thread-5344::DEBUG::2014-04-10 18:46:58,203::task::811::TaskManager.Task::(resourceAcquired) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5344::DEBUG::2014-04-10 18:46:58,204::task::974::TaskManager.Task::(_decref) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::ref 1 aborting False
>Thread-5344::INFO::2014-04-10 18:46:58,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5344::DEBUG::2014-04-10 18:46:58,206::task::1168::TaskManager.Task::(prepare) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5344::DEBUG::2014-04-10 18:46:58,206::task::579::TaskManager.Task::(_updateState) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::moving from state preparing -> state finished
>Thread-5344::DEBUG::2014-04-10 18:46:58,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5344::DEBUG::2014-04-10 18:46:58,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5344::DEBUG::2014-04-10 18:46:58,207::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5344::DEBUG::2014-04-10 18:46:58,207::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5344::DEBUG::2014-04-10 18:46:58,207::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5344::DEBUG::2014-04-10 18:46:58,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5344::DEBUG::2014-04-10 18:46:58,208::task::974::TaskManager.Task::(_decref) Task=`8f4e7dea-341d-447d-8602-e79ad17cb450`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:47:06,883::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:47:06,889::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-469::DEBUG::2014-04-10 18:47:06,890::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-469::DEBUG::2014-04-10 18:47:06,895::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-469::DEBUG::2014-04-10 18:47:06,897::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-469::INFO::2014-04-10 18:47:06,897::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-469::INFO::2014-04-10 18:47:06,897::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-469::DEBUG::2014-04-10 18:47:06,902::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:06,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000468528 s, 785 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:47:07,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:07,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000448242 s, 1.5 MB/s\n'; <rc> = 0
>Thread-5352::DEBUG::2014-04-10 18:47:08,307::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5352::DEBUG::2014-04-10 18:47:08,308::task::579::TaskManager.Task::(_updateState) Task=`5db8d6e0-24d5-41b5-a040-a70e77099df6`::moving from state init -> state preparing
>Thread-5352::INFO::2014-04-10 18:47:08,308::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5352::INFO::2014-04-10 18:47:08,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5352::DEBUG::2014-04-10 18:47:08,308::task::1168::TaskManager.Task::(prepare) Task=`5db8d6e0-24d5-41b5-a040-a70e77099df6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5352::DEBUG::2014-04-10 18:47:08,309::task::579::TaskManager.Task::(_updateState) Task=`5db8d6e0-24d5-41b5-a040-a70e77099df6`::moving from state preparing -> state finished
>Thread-5352::DEBUG::2014-04-10 18:47:08,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5352::DEBUG::2014-04-10 18:47:08,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5352::DEBUG::2014-04-10 18:47:08,309::task::974::TaskManager.Task::(_decref) Task=`5db8d6e0-24d5-41b5-a040-a70e77099df6`::ref 0 aborting False
>Thread-5353::DEBUG::2014-04-10 18:47:08,320::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5353::DEBUG::2014-04-10 18:47:08,320::task::579::TaskManager.Task::(_updateState) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::moving from state init -> state preparing
>Thread-5353::INFO::2014-04-10 18:47:08,320::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5353::DEBUG::2014-04-10 18:47:08,321::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dfe3bd96-d917-4d62-bc42-b412a5b9d13b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5353::DEBUG::2014-04-10 18:47:08,321::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5353::DEBUG::2014-04-10 18:47:08,321::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5353::DEBUG::2014-04-10 18:47:08,321::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`dfe3bd96-d917-4d62-bc42-b412a5b9d13b`::Granted request
>Thread-5353::DEBUG::2014-04-10 18:47:08,322::task::811::TaskManager.Task::(resourceAcquired) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5353::DEBUG::2014-04-10 18:47:08,322::task::974::TaskManager.Task::(_decref) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::ref 1 aborting False
>Thread-5353::INFO::2014-04-10 18:47:08,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5353::DEBUG::2014-04-10 18:47:08,324::task::1168::TaskManager.Task::(prepare) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5353::DEBUG::2014-04-10 18:47:08,324::task::579::TaskManager.Task::(_updateState) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::moving from state preparing -> state finished
>Thread-5353::DEBUG::2014-04-10 18:47:08,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5353::DEBUG::2014-04-10 18:47:08,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5353::DEBUG::2014-04-10 18:47:08,325::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5353::DEBUG::2014-04-10 18:47:08,325::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5353::DEBUG::2014-04-10 18:47:08,325::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5353::DEBUG::2014-04-10 18:47:08,326::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5353::DEBUG::2014-04-10 18:47:08,326::task::974::TaskManager.Task::(_decref) Task=`f45baeb9-5bc9-401a-9f01-623c6f0b4b40`::ref 0 aborting False
>Thread-5355::DEBUG::2014-04-10 18:47:11,376::task::579::TaskManager.Task::(_updateState) Task=`c883fdb5-2766-4077-9d0a-12777e5ccc90`::moving from state init -> state preparing
>Thread-5355::INFO::2014-04-10 18:47:11,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5355::INFO::2014-04-10 18:47:11,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448242', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '24.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '23.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468528', 'lastCheck': '4.5', 'valid': True}}
>Thread-5355::DEBUG::2014-04-10 18:47:11,377::task::1168::TaskManager.Task::(prepare) Task=`c883fdb5-2766-4077-9d0a-12777e5ccc90`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448242', 'lastCheck': '3.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '24.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '23.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468528', 'lastCheck': '4.5', 'valid': True}}
>Thread-5355::DEBUG::2014-04-10 18:47:11,377::task::579::TaskManager.Task::(_updateState) Task=`c883fdb5-2766-4077-9d0a-12777e5ccc90`::moving from state preparing -> state finished
>Thread-5355::DEBUG::2014-04-10 18:47:11,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5355::DEBUG::2014-04-10 18:47:11,377::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5355::DEBUG::2014-04-10 18:47:11,378::task::974::TaskManager.Task::(_decref) Task=`c883fdb5-2766-4077-9d0a-12777e5ccc90`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:47:16,916::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:16,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000461775 s, 797 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:47:17,778::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:17,784::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000483123 s, 1.4 MB/s\n'; <rc> = 0
>Thread-5359::DEBUG::2014-04-10 18:47:18,567::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5359::DEBUG::2014-04-10 18:47:18,568::task::579::TaskManager.Task::(_updateState) Task=`dcc877e8-1c48-46fd-82fc-6f06b2b7abe1`::moving from state init -> state preparing
>Thread-5359::INFO::2014-04-10 18:47:18,568::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5359::INFO::2014-04-10 18:47:18,568::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5359::DEBUG::2014-04-10 18:47:18,569::task::1168::TaskManager.Task::(prepare) Task=`dcc877e8-1c48-46fd-82fc-6f06b2b7abe1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5359::DEBUG::2014-04-10 18:47:18,569::task::579::TaskManager.Task::(_updateState) Task=`dcc877e8-1c48-46fd-82fc-6f06b2b7abe1`::moving from state preparing -> state finished
>Thread-5359::DEBUG::2014-04-10 18:47:18,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5359::DEBUG::2014-04-10 18:47:18,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5359::DEBUG::2014-04-10 18:47:18,569::task::974::TaskManager.Task::(_decref) Task=`dcc877e8-1c48-46fd-82fc-6f06b2b7abe1`::ref 0 aborting False
>Thread-5360::DEBUG::2014-04-10 18:47:18,585::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5360::DEBUG::2014-04-10 18:47:18,585::task::579::TaskManager.Task::(_updateState) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::moving from state init -> state preparing
>Thread-5360::INFO::2014-04-10 18:47:18,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5360::DEBUG::2014-04-10 18:47:18,586::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9270df1-3784-4835-a88b-d034b8a9f194`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5360::DEBUG::2014-04-10 18:47:18,586::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5360::DEBUG::2014-04-10 18:47:18,587::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5360::DEBUG::2014-04-10 18:47:18,587::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a9270df1-3784-4835-a88b-d034b8a9f194`::Granted request
>Thread-5360::DEBUG::2014-04-10 18:47:18,587::task::811::TaskManager.Task::(resourceAcquired) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5360::DEBUG::2014-04-10 18:47:18,587::task::974::TaskManager.Task::(_decref) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::ref 1 aborting False
>Thread-5360::INFO::2014-04-10 18:47:18,590::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5360::DEBUG::2014-04-10 18:47:18,590::task::1168::TaskManager.Task::(prepare) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5360::DEBUG::2014-04-10 18:47:18,590::task::579::TaskManager.Task::(_updateState) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::moving from state preparing -> state finished
>Thread-5360::DEBUG::2014-04-10 18:47:18,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5360::DEBUG::2014-04-10 18:47:18,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5360::DEBUG::2014-04-10 18:47:18,591::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5360::DEBUG::2014-04-10 18:47:18,591::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5360::DEBUG::2014-04-10 18:47:18,591::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5360::DEBUG::2014-04-10 18:47:18,591::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5360::DEBUG::2014-04-10 18:47:18,591::task::974::TaskManager.Task::(_decref) Task=`527c6526-41b5-4293-8724-34c3b9345b7c`::ref 0 aborting False
>Thread-5225::DEBUG::2014-04-10 18:47:22,672::task::579::TaskManager.Task::(_updateState) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::moving from state init -> state preparing
>Thread-5225::INFO::2014-04-10 18:47:22,672::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>VM Channels Listener::DEBUG::2014-04-10 18:47:22,873::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-5363::DEBUG::2014-04-10 18:47:26,653::task::579::TaskManager.Task::(_updateState) Task=`298ac03d-ffba-4b5d-8738-25e8081fde16`::moving from state init -> state preparing
>Thread-5363::INFO::2014-04-10 18:47:26,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5363::INFO::2014-04-10 18:47:26,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483123', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '39.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '38.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461775', 'lastCheck': '9.7', 'valid': True}}
>Thread-5363::DEBUG::2014-04-10 18:47:26,654::task::1168::TaskManager.Task::(prepare) Task=`298ac03d-ffba-4b5d-8738-25e8081fde16`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483123', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '39.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '38.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461775', 'lastCheck': '9.7', 'valid': True}}
>Thread-5363::DEBUG::2014-04-10 18:47:26,654::task::579::TaskManager.Task::(_updateState) Task=`298ac03d-ffba-4b5d-8738-25e8081fde16`::moving from state preparing -> state finished
>Thread-5363::DEBUG::2014-04-10 18:47:26,654::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5363::DEBUG::2014-04-10 18:47:26,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5363::DEBUG::2014-04-10 18:47:26,655::task::974::TaskManager.Task::(_decref) Task=`298ac03d-ffba-4b5d-8738-25e8081fde16`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:47:26,929::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:26,937::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000391767 s, 939 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:47:27,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:27,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000397585 s, 1.7 MB/s\n'; <rc> = 0
>Thread-5365::DEBUG::2014-04-10 18:47:28,673::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5365::DEBUG::2014-04-10 18:47:28,673::task::579::TaskManager.Task::(_updateState) Task=`ab04366b-e4c1-4883-8043-a82160629e9d`::moving from state init -> state preparing
>Thread-5365::INFO::2014-04-10 18:47:28,674::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5365::INFO::2014-04-10 18:47:28,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5365::DEBUG::2014-04-10 18:47:28,674::task::1168::TaskManager.Task::(prepare) Task=`ab04366b-e4c1-4883-8043-a82160629e9d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5365::DEBUG::2014-04-10 18:47:28,674::task::579::TaskManager.Task::(_updateState) Task=`ab04366b-e4c1-4883-8043-a82160629e9d`::moving from state preparing -> state finished
>Thread-5365::DEBUG::2014-04-10 18:47:28,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5365::DEBUG::2014-04-10 18:47:28,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5365::DEBUG::2014-04-10 18:47:28,675::task::974::TaskManager.Task::(_decref) Task=`ab04366b-e4c1-4883-8043-a82160629e9d`::ref 0 aborting False
>Thread-5366::DEBUG::2014-04-10 18:47:28,686::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5366::DEBUG::2014-04-10 18:47:28,686::task::579::TaskManager.Task::(_updateState) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::moving from state init -> state preparing
>Thread-5366::INFO::2014-04-10 18:47:28,686::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5366::DEBUG::2014-04-10 18:47:28,687::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a84ad16-c73e-4d94-9aa1-e7157457c882`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5366::DEBUG::2014-04-10 18:47:28,687::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5366::DEBUG::2014-04-10 18:47:28,687::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5366::DEBUG::2014-04-10 18:47:28,688::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a84ad16-c73e-4d94-9aa1-e7157457c882`::Granted request
>Thread-5366::DEBUG::2014-04-10 18:47:28,688::task::811::TaskManager.Task::(resourceAcquired) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5366::DEBUG::2014-04-10 18:47:28,688::task::974::TaskManager.Task::(_decref) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::ref 1 aborting False
>Thread-5366::INFO::2014-04-10 18:47:28,691::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5366::DEBUG::2014-04-10 18:47:28,691::task::1168::TaskManager.Task::(prepare) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5366::DEBUG::2014-04-10 18:47:28,691::task::579::TaskManager.Task::(_updateState) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::moving from state preparing -> state finished
>Thread-5366::DEBUG::2014-04-10 18:47:28,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5366::DEBUG::2014-04-10 18:47:28,691::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5366::DEBUG::2014-04-10 18:47:28,692::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5366::DEBUG::2014-04-10 18:47:28,692::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5366::DEBUG::2014-04-10 18:47:28,692::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5366::DEBUG::2014-04-10 18:47:28,692::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5366::DEBUG::2014-04-10 18:47:28,693::task::974::TaskManager.Task::(_decref) Task=`28ab028d-e449-4181-86e6-a5d7bedd4633`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:47:36,944::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:36,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000614199 s, 599 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:47:37,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:37,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.00052745 s, 1.2 MB/s\n'; <rc> = 0
>Thread-5370::DEBUG::2014-04-10 18:47:38,772::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5370::DEBUG::2014-04-10 18:47:38,773::task::579::TaskManager.Task::(_updateState) Task=`2ec660e9-682d-40be-8294-b7a93c693367`::moving from state init -> state preparing
>Thread-5370::INFO::2014-04-10 18:47:38,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5370::INFO::2014-04-10 18:47:38,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5370::DEBUG::2014-04-10 18:47:38,774::task::1168::TaskManager.Task::(prepare) Task=`2ec660e9-682d-40be-8294-b7a93c693367`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5370::DEBUG::2014-04-10 18:47:38,774::task::579::TaskManager.Task::(_updateState) Task=`2ec660e9-682d-40be-8294-b7a93c693367`::moving from state preparing -> state finished
>Thread-5370::DEBUG::2014-04-10 18:47:38,774::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5370::DEBUG::2014-04-10 18:47:38,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5370::DEBUG::2014-04-10 18:47:38,775::task::974::TaskManager.Task::(_decref) Task=`2ec660e9-682d-40be-8294-b7a93c693367`::ref 0 aborting False
>Thread-5371::DEBUG::2014-04-10 18:47:38,785::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5371::DEBUG::2014-04-10 18:47:38,785::task::579::TaskManager.Task::(_updateState) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::moving from state init -> state preparing
>Thread-5371::INFO::2014-04-10 18:47:38,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5371::DEBUG::2014-04-10 18:47:38,786::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8b0c274a-8c3b-4e1f-8c14-f0c0a0d0d6f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5371::DEBUG::2014-04-10 18:47:38,786::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5371::DEBUG::2014-04-10 18:47:38,786::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5371::DEBUG::2014-04-10 18:47:38,786::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8b0c274a-8c3b-4e1f-8c14-f0c0a0d0d6f3`::Granted request
>Thread-5371::DEBUG::2014-04-10 18:47:38,787::task::811::TaskManager.Task::(resourceAcquired) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5371::DEBUG::2014-04-10 18:47:38,787::task::974::TaskManager.Task::(_decref) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::ref 1 aborting False
>Thread-5371::INFO::2014-04-10 18:47:38,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5371::DEBUG::2014-04-10 18:47:38,789::task::1168::TaskManager.Task::(prepare) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5371::DEBUG::2014-04-10 18:47:38,789::task::579::TaskManager.Task::(_updateState) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::moving from state preparing -> state finished
>Thread-5371::DEBUG::2014-04-10 18:47:38,789::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5371::DEBUG::2014-04-10 18:47:38,790::task::974::TaskManager.Task::(_decref) Task=`65870aff-afa5-46b9-b12c-8b912e4a6323`::ref 0 aborting False
>Thread-5373::DEBUG::2014-04-10 18:47:41,933::task::579::TaskManager.Task::(_updateState) Task=`f491a029-c238-46de-96ee-6879e68a0e7f`::moving from state init -> state preparing
>Thread-5373::INFO::2014-04-10 18:47:41,933::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5373::INFO::2014-04-10 18:47:41,933::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052745', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '54.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '54.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614199', 'lastCheck': '5.0', 'valid': True}}
>Thread-5373::DEBUG::2014-04-10 18:47:41,933::task::1168::TaskManager.Task::(prepare) Task=`f491a029-c238-46de-96ee-6879e68a0e7f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052745', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0018926', 'lastCheck': '54.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '54.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614199', 'lastCheck': '5.0', 'valid': True}}
>Thread-5373::DEBUG::2014-04-10 18:47:41,934::task::579::TaskManager.Task::(_updateState) Task=`f491a029-c238-46de-96ee-6879e68a0e7f`::moving from state preparing -> state finished
>Thread-5373::DEBUG::2014-04-10 18:47:41,934::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5373::DEBUG::2014-04-10 18:47:41,934::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5373::DEBUG::2014-04-10 18:47:41,934::task::974::TaskManager.Task::(_decref) Task=`f491a029-c238-46de-96ee-6879e68a0e7f`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 18:47:46,960::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:46,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485275 s, 758 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:47:47,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:47,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000525759 s, 1.3 MB/s\n'; <rc> = 0
>Thread-5377::DEBUG::2014-04-10 18:47:48,871::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5377::DEBUG::2014-04-10 18:47:48,871::task::579::TaskManager.Task::(_updateState) Task=`bf68d8b0-d015-47c0-af16-9259c8a9d64d`::moving from state init -> state preparing
>Thread-5377::INFO::2014-04-10 18:47:48,872::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5377::INFO::2014-04-10 18:47:48,873::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5377::DEBUG::2014-04-10 18:47:48,873::task::1168::TaskManager.Task::(prepare) Task=`bf68d8b0-d015-47c0-af16-9259c8a9d64d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5377::DEBUG::2014-04-10 18:47:48,873::task::579::TaskManager.Task::(_updateState) Task=`bf68d8b0-d015-47c0-af16-9259c8a9d64d`::moving from state preparing -> state finished
>Thread-5377::DEBUG::2014-04-10 18:47:48,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5377::DEBUG::2014-04-10 18:47:48,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5377::DEBUG::2014-04-10 18:47:48,873::task::974::TaskManager.Task::(_decref) Task=`bf68d8b0-d015-47c0-af16-9259c8a9d64d`::ref 0 aborting False
>Thread-5378::DEBUG::2014-04-10 18:47:48,884::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5378::DEBUG::2014-04-10 18:47:48,884::task::579::TaskManager.Task::(_updateState) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::moving from state init -> state preparing
>Thread-5378::INFO::2014-04-10 18:47:48,884::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5378::DEBUG::2014-04-10 18:47:48,885::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15b8b0f0-54e3-4093-90d4-fe3e2e87cfcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5378::DEBUG::2014-04-10 18:47:48,885::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5378::DEBUG::2014-04-10 18:47:48,886::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5378::DEBUG::2014-04-10 18:47:48,886::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15b8b0f0-54e3-4093-90d4-fe3e2e87cfcb`::Granted request
>Thread-5378::DEBUG::2014-04-10 18:47:48,886::task::811::TaskManager.Task::(resourceAcquired) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5378::DEBUG::2014-04-10 18:47:48,887::task::974::TaskManager.Task::(_decref) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::ref 1 aborting False
>Thread-5378::INFO::2014-04-10 18:47:48,889::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5378::DEBUG::2014-04-10 18:47:48,890::task::1168::TaskManager.Task::(prepare) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5378::DEBUG::2014-04-10 18:47:48,890::task::579::TaskManager.Task::(_updateState) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::moving from state preparing -> state finished
>Thread-5378::DEBUG::2014-04-10 18:47:48,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5378::DEBUG::2014-04-10 18:47:48,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5378::DEBUG::2014-04-10 18:47:48,891::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5378::DEBUG::2014-04-10 18:47:48,891::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5378::DEBUG::2014-04-10 18:47:48,891::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5378::DEBUG::2014-04-10 18:47:48,891::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5378::DEBUG::2014-04-10 18:47:48,891::task::974::TaskManager.Task::(_decref) Task=`7f839105-1761-4a36-af3f-6bedead3e2a1`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:47:52,906::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 64.
>Thread-469::DEBUG::2014-04-10 18:47:56,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:47:57,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000576758 s, 638 kB/s\n'; <rc> = 0
>Thread-466::ERROR::2014-04-10 18:47:57,149::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-466::DEBUG::2014-04-10 18:47:57,152::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f changed its status to Invalid
>Thread-5381::DEBUG::2014-04-10 18:47:57,154::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-466::DEBUG::2014-04-10 18:47:57,155::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-5381::DEBUG::2014-04-10 18:47:57,157::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-5381::DEBUG::2014-04-10 18:47:57,161::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-5383::DEBUG::2014-04-10 18:47:57,600::task::579::TaskManager.Task::(_updateState) Task=`0141a13f-ba00-42c1-ac50-bacb8aedd879`::moving from state init -> state preparing
>Thread-5383::INFO::2014-04-10 18:47:57,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-5383::INFO::2014-04-10 18:47:57,604::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525759', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '69.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576758', 'lastCheck': '0.6', 'valid': True}}
>Thread-5383::DEBUG::2014-04-10 18:47:57,606::task::1168::TaskManager.Task::(prepare) Task=`0141a13f-ba00-42c1-ac50-bacb8aedd879`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525759', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 200, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228826', 'lastCheck': '69.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576758', 'lastCheck': '0.6', 'valid': True}}
>Thread-5383::DEBUG::2014-04-10 18:47:57,607::task::579::TaskManager.Task::(_updateState) Task=`0141a13f-ba00-42c1-ac50-bacb8aedd879`::moving from state preparing -> state finished
>Thread-5383::DEBUG::2014-04-10 18:47:57,609::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5383::DEBUG::2014-04-10 18:47:57,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5383::DEBUG::2014-04-10 18:47:57,612::task::974::TaskManager.Task::(_decref) Task=`0141a13f-ba00-42c1-ac50-bacb8aedd879`::ref 0 aborting False
>Thread-468::ERROR::2014-04-10 18:47:57,745::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in _monitorDomain
>    self.domain.selftest()
>  File "/usr/share/vdsm/storage/nfsSD.py", line 113, in selftest
>    fileSD.FileStorageDomain.selftest(self)
>  File "/usr/share/vdsm/storage/fileSD.py", line 535, in selftest
>    self.oop.os.statvfs(self.domaindir)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-468::DEBUG::2014-04-10 18:47:57,746::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878 changed its status to Invalid
>Thread-5385::DEBUG::2014-04-10 18:47:57,747::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-468::DEBUG::2014-04-10 18:47:57,747::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-5385::DEBUG::2014-04-10 18:47:57,748::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-5385::DEBUG::2014-04-10 18:47:57,750::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-467::DEBUG::2014-04-10 18:47:57,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:47:57,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000465326 s, 1.4 MB/s\n'; <rc> = 0
>Thread-5387::DEBUG::2014-04-10 18:47:58,969::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5387::DEBUG::2014-04-10 18:47:58,970::task::579::TaskManager.Task::(_updateState) Task=`f11971a0-6801-4a40-b1c6-20855d7bac00`::moving from state init -> state preparing
>Thread-5387::INFO::2014-04-10 18:47:58,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5387::INFO::2014-04-10 18:47:58,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5387::DEBUG::2014-04-10 18:47:58,971::task::1168::TaskManager.Task::(prepare) Task=`f11971a0-6801-4a40-b1c6-20855d7bac00`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5387::DEBUG::2014-04-10 18:47:58,971::task::579::TaskManager.Task::(_updateState) Task=`f11971a0-6801-4a40-b1c6-20855d7bac00`::moving from state preparing -> state finished
>Thread-5387::DEBUG::2014-04-10 18:47:58,972::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5387::DEBUG::2014-04-10 18:47:58,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5387::DEBUG::2014-04-10 18:47:58,972::task::974::TaskManager.Task::(_decref) Task=`f11971a0-6801-4a40-b1c6-20855d7bac00`::ref 0 aborting False
>Thread-5388::DEBUG::2014-04-10 18:47:58,982::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5388::DEBUG::2014-04-10 18:47:58,983::task::579::TaskManager.Task::(_updateState) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::moving from state init -> state preparing
>Thread-5388::INFO::2014-04-10 18:47:58,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5388::DEBUG::2014-04-10 18:47:58,984::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eca0f11e-d2fa-4880-9fb0-60f059f0af6d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5388::DEBUG::2014-04-10 18:47:58,984::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5388::DEBUG::2014-04-10 18:47:58,984::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5388::DEBUG::2014-04-10 18:47:58,984::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eca0f11e-d2fa-4880-9fb0-60f059f0af6d`::Granted request
>Thread-5388::DEBUG::2014-04-10 18:47:58,985::task::811::TaskManager.Task::(resourceAcquired) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5388::DEBUG::2014-04-10 18:47:58,985::task::974::TaskManager.Task::(_decref) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::ref 1 aborting False
>Thread-5388::INFO::2014-04-10 18:47:58,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5388::DEBUG::2014-04-10 18:47:58,988::task::1168::TaskManager.Task::(prepare) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5388::DEBUG::2014-04-10 18:47:58,988::task::579::TaskManager.Task::(_updateState) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::moving from state preparing -> state finished
>Thread-5388::DEBUG::2014-04-10 18:47:58,988::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5388::DEBUG::2014-04-10 18:47:58,989::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5388::DEBUG::2014-04-10 18:47:58,989::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5388::DEBUG::2014-04-10 18:47:58,989::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5388::DEBUG::2014-04-10 18:47:58,989::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5388::DEBUG::2014-04-10 18:47:58,989::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5388::DEBUG::2014-04-10 18:47:58,990::task::974::TaskManager.Task::(_decref) Task=`77779b2b-6ede-4905-aa73-1b97bf5588bc`::ref 0 aborting False
>Thread-5349::WARNING::2014-04-10 18:48:06,887::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-5351::WARNING::2014-04-10 18:48:06,888::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-469::DEBUG::2014-04-10 18:48:07,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:48:07,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000553367 s, 665 kB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-04-10 18:48:07,863::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-467::DEBUG::2014-04-10 18:48:07,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n659 bytes (659 B) copied, 0.000535025 s, 1.2 MB/s\n'; <rc> = 0
>Thread-5392::DEBUG::2014-04-10 18:48:09,068::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5392::DEBUG::2014-04-10 18:48:09,069::task::579::TaskManager.Task::(_updateState) Task=`aed0e9c4-1e87-4d5c-b9dc-c5d4fd8b805b`::moving from state init -> state preparing
>Thread-5392::INFO::2014-04-10 18:48:09,069::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5392::INFO::2014-04-10 18:48:09,070::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5392::DEBUG::2014-04-10 18:48:09,070::task::1168::TaskManager.Task::(prepare) Task=`aed0e9c4-1e87-4d5c-b9dc-c5d4fd8b805b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-5392::DEBUG::2014-04-10 18:48:09,070::task::579::TaskManager.Task::(_updateState) Task=`aed0e9c4-1e87-4d5c-b9dc-c5d4fd8b805b`::moving from state preparing -> state finished
>Thread-5392::DEBUG::2014-04-10 18:48:09,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5392::DEBUG::2014-04-10 18:48:09,070::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5392::DEBUG::2014-04-10 18:48:09,070::task::974::TaskManager.Task::(_decref) Task=`aed0e9c4-1e87-4d5c-b9dc-c5d4fd8b805b`::ref 0 aborting False
>Thread-5393::DEBUG::2014-04-10 18:48:09,080::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-5393::DEBUG::2014-04-10 18:48:09,081::task::579::TaskManager.Task::(_updateState) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::moving from state init -> state preparing
>Thread-5393::INFO::2014-04-10 18:48:09,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-5393::DEBUG::2014-04-10 18:48:09,081::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9fa0cc61-3bf0-4499-8a37-3ef055e58fc5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-5393::DEBUG::2014-04-10 18:48:09,082::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-5393::DEBUG::2014-04-10 18:48:09,082::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-5393::DEBUG::2014-04-10 18:48:09,082::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9fa0cc61-3bf0-4499-8a37-3ef055e58fc5`::Granted request
>Thread-5393::DEBUG::2014-04-10 18:48:09,082::task::811::TaskManager.Task::(resourceAcquired) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-5393::DEBUG::2014-04-10 18:48:09,083::task::974::TaskManager.Task::(_decref) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::ref 1 aborting False
>Thread-5393::INFO::2014-04-10 18:48:09,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5393::DEBUG::2014-04-10 18:48:09,085::task::1168::TaskManager.Task::(prepare) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::finished: {'info': {'spm_id': 2, 'master_uuid': '55cb7668-7c5e-4553-b263-c6f3f86b358f', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 6, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-5393::DEBUG::2014-04-10 18:48:09,085::task::579::TaskManager.Task::(_updateState) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::moving from state preparing -> state finished
>Thread-5393::DEBUG::2014-04-10 18:48:09,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-5393::DEBUG::2014-04-10 18:48:09,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5393::DEBUG::2014-04-10 18:48:09,086::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-5393::DEBUG::2014-04-10 18:48:09,086::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-5393::DEBUG::2014-04-10 18:48:09,086::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-5393::DEBUG::2014-04-10 18:48:09,087::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-5393::DEBUG::2014-04-10 18:48:09,087::task::974::TaskManager.Task::(_decref) Task=`ddeaa9b0-cf64-47cc-a3a5-29c2d3e6012a`::ref 0 aborting False
>MainThread::DEBUG::2014-04-10 18:48:11,606::vdsm::45::vds::(sigtermHandler) Received signal 15
>MainThread::INFO::2014-04-10 18:48:11,913::vmChannels::183::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-04-10 18:48:11,913::momIF::84::MOM::(stop) Shutting down MOM
>MainThread::DEBUG::2014-04-10 18:48:11,914::task::579::TaskManager.Task::(_updateState) Task=`16865ea5-2324-4707-ae6c-04410a3eca5f`::moving from state init -> state preparing
>MainThread::INFO::2014-04-10 18:48:11,914::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>Thread-12::DEBUG::2014-04-10 18:48:11,915::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped
>VM Channels Listener::INFO::2014-04-10 18:48:11,929::vmChannels::178::vds::(run) VM channels listener thread has ended.
>MainThread::DEBUG::2014-04-10 18:48:12,607::vdsm::45::vds::(sigtermHandler) Received signal 15
>MainThread::DEBUG::2014-04-10 18:48:12,608::clientIF::228::vds::(prepareForShutdown) cannot run prepareForShutdown concurrently
>MainThread::INFO::2014-04-10 18:48:12,980::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::INFO::2014-04-10 18:48:12,980::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::DEBUG::2014-04-10 18:48:12,980::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-467::INFO::2014-04-10 18:48:12,981::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>Thread-467::DEBUG::2014-04-10 18:48:13,981::clusterlock::207::SANLock::(releaseHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 released successfully (id: 2)
>MainThread::INFO::2014-04-10 18:48:13,982::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-469::DEBUG::2014-04-10 18:48:17,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:48:17,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479848 s, 767 kB/s\n'; <rc> = 0
>Thread-5225::ERROR::2014-04-10 18:48:22,693::task::850::TaskManager.Task::(_setError) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3070, in getVolumeSize
>    apparentsize = str(volClass.getVSize(dom, imgUUID, volUUID, bs=1))
>  File "/usr/share/vdsm/storage/fileVolume.py", line 418, in getVSize
>    return int(sdobj.oop.os.stat(volPath).st_size / bs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-5225::DEBUG::2014-04-10 18:48:22,700::task::869::TaskManager.Task::(_run) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::Task._run: 54d2a054-c45b-4983-a6ee-fd19fae8f8bf ('dbec8cee-b5e4-4011-9dd5-7c122389a878', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'ca8224e3-4aff-4e35-87f6-c12059aeb202', '24018d18-27a2-462e-94df-c84585e4a0df') {} failed - stopping task
>Thread-5225::DEBUG::2014-04-10 18:48:22,700::task::1194::TaskManager.Task::(stop) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::stopping in state preparing (force False)
>Thread-5225::DEBUG::2014-04-10 18:48:22,700::task::974::TaskManager.Task::(_decref) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::ref 1 aborting True
>Thread-5225::DEBUG::2014-04-10 18:48:22,701::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-5225::INFO::2014-04-10 18:48:22,701::task::1151::TaskManager.Task::(prepare) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::aborting: Task is aborted: u'' - code 100
>Thread-5225::DEBUG::2014-04-10 18:48:22,701::task::1156::TaskManager.Task::(prepare) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::Prepare: aborted: 
>Thread-5225::DEBUG::2014-04-10 18:48:22,701::task::974::TaskManager.Task::(_decref) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::ref 0 aborting True
>Thread-5225::DEBUG::2014-04-10 18:48:22,701::task::909::TaskManager.Task::(_doAbort) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::Task._doAbort: force False
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::task::579::TaskManager.Task::(_updateState) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::moving from state preparing -> state aborting
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::task::534::TaskManager.Task::(__state_aborting) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::_aborting: recover policy none
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::task::579::TaskManager.Task::(_updateState) Task=`54d2a054-c45b-4983-a6ee-fd19fae8f8bf`::moving from state aborting -> state failed
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-5225::DEBUG::2014-04-10 18:48:22,702::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-5225::ERROR::2014-04-10 18:48:22,703::dispatcher::70::Storage.Dispatcher.Protect::(run) 
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/dispatcher.py", line 62, in run
>    result = ctask.prepare(self.func, *args, **kwargs)
>  File "/usr/share/vdsm/storage/task.py", line 1159, in prepare
>    raise self.error
>Timeout
>Thread-5225::ERROR::2014-04-10 18:48:22,703::vm::3704::vm.Vm::(updateDriveVolume) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unable to update the volume 24018d18-27a2-462e-94df-c84585e4a0df (domain: dbec8cee-b5e4-4011-9dd5-7c122389a878 image: ca8224e3-4aff-4e35-87f6-c12059aeb202) for the drive vda
>Thread-469::DEBUG::2014-04-10 18:48:27,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:48:27,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000542812 s, 678 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:48:37,115::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:48:37,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000573148 s, 642 kB/s\n'; <rc> = 0
>Thread-469::DEBUG::2014-04-10 18:48:47,130::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-469::DEBUG::2014-04-10 18:48:47,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000528099 s, 697 kB/s\n'; <rc> = 0
>MainThread::WARNING::2014-04-10 18:48:51,729::vdsmDebugPlugin::40::DebugInterpreter::(__turnOnDebugPlugin) Starting Debug Interpreter. Tread lightly!
>MainThread::INFO::2014-04-10 18:48:51,731::vdsm::101::vds::(run) (PID: 25027) I am the actual vdsm 4.13.2-0.13.el6ev ibm-x3650m4-06.qe.lab.eng.nay.redhat.com (2.6.32-456.el6.x86_64)
>MainThread::DEBUG::2014-04-10 18:48:51,970::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-04-10 18:48:51,970::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0
>MainThread::WARNING::2014-04-10 18:48:51,974::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-04-10 18:48:53,043::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-04-10 18:48:53,065::multipath::144::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-04-10 18:48:53,066::hsm::427::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
>MainThread::DEBUG::2014-04-10 18:48:53,223::hsm::427::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-04-10 18:48:53,224::hsm::451::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-04-10 18:48:53,227::hsm::483::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-04-10 18:48:53,227::hsm::484::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2', '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2', '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1', '/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1']
>MainThread::DEBUG::2014-04-10 18:48:53,227::hsm::486::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-04-10 18:48:53,229::hsm::529::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-04-10 18:48:53,231::lvm::338::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>MainThread::INFO::2014-04-10 18:48:53,232::dispatcher::98::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>MainThread::DEBUG::2014-04-10 18:48:53,234::task::579::TaskManager.Task::(_updateState) Task=`5a6f86cd-10d4-4fbd-b151-4137266ae697`::moving from state init -> state preparing
>MainThread::INFO::2014-04-10 18:48:53,234::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x7fccc536f290>>)
>MainThread::INFO::2014-04-10 18:48:53,235::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>storageRefresh::DEBUG::2014-04-10 18:48:53,235::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>MainThread::DEBUG::2014-04-10 18:48:53,235::task::1168::TaskManager.Task::(prepare) Task=`5a6f86cd-10d4-4fbd-b151-4137266ae697`::finished: None
>MainThread::DEBUG::2014-04-10 18:48:53,240::task::579::TaskManager.Task::(_updateState) Task=`5a6f86cd-10d4-4fbd-b151-4137266ae697`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-04-10 18:48:53,240::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-04-10 18:48:53,240::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-04-10 18:48:53,241::task::974::TaskManager.Task::(_decref) Task=`5a6f86cd-10d4-4fbd-b151-4137266ae697`::ref 0 aborting False
>MainThread::INFO::2014-04-10 18:48:53,248::momIF::47::MOM::(__init__) Starting up MOM
>MainThread::INFO::2014-04-10 18:48:53,249::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
>clientIFinit::DEBUG::2014-04-10 18:48:53,250::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt
>VM Channels Listener::INFO::2014-04-10 18:48:53,251::vmChannels::170::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-04-10 18:48:53,294::clientIF::529::vds::(_recoverVm) Trying to recover 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>clientIFinit::INFO::2014-04-10 18:48:53,295::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>clientIFinit::DEBUG::2014-04-10 18:48:53,295::libvirtconnection::131::libvirtconnection::(get) trying to connect libvirt
>storageRefresh::DEBUG::2014-04-10 18:48:53,389::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 18:48:53,394::lvm::363::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:53,399::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:53,414::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-14::DEBUG::2014-04-10 18:48:53,466::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Start
>clientIFinit::DEBUG::2014-04-10 18:48:53,466::clientIF::407::vds::(createVm) Total desktops after creation of 350aed0d-0065-47c3-81db-3ae5dc8dbf53 is 1
>Thread-14::DEBUG::2014-04-10 18:48:53,469::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations acquired
>Thread-14::INFO::2014-04-10 18:48:53,470::vm::3011::vm.Vm::(_run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::VM wrapper has started
>Thread-14::WARNING::2014-04-10 18:48:53,471::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found
>Thread-14::WARNING::2014-04-10 18:48:53,473::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found
>Thread-14::WARNING::2014-04-10 18:48:53,475::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}' found
>storageRefresh::DEBUG::2014-04-10 18:48:53,554::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 18:48:53,558::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:53,570::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
>storageRefresh::DEBUG::2014-04-10 18:48:53,703::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 18:48:53,709::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:53,723::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>storageRefresh::DEBUG::2014-04-10 18:48:53,856::lvm::309::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 18:48:53,861::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:53,864::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>storageRefresh::DEBUG::2014-04-10 18:48:53,867::misc::811::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-04-10 18:48:53,870::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-04-10 18:48:53,873::misc::811::SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-04-10 18:48:53,878::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>storageRefresh::DEBUG::2014-04-10 18:48:53,900::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>storageRefresh::DEBUG::2014-04-10 18:48:53,904::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-14::DEBUG::2014-04-10 18:48:54,396::sampling::285::vm.Vm::(start) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Start statistics collection
>Thread-16::DEBUG::2014-04-10 18:48:54,399::sampling::314::vm.Vm::(run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Stats thread started
>Thread-14::DEBUG::2014-04-10 18:48:54,404::vmChannels::194::vds::(register) Add fileno 9 to listener's channels.
>Thread-14::WARNING::2014-04-10 18:48:54,406::vm::3578::vm.Vm::(_readPauseCode) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_readPauseCode unsupported by libvirt vm
>Thread-14::DEBUG::2014-04-10 18:48:54,455::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations released
>Thread-17::DEBUG::2014-04-10 18:48:54,763::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {}
>Thread-17::DEBUG::2014-04-10 18:48:54,766::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>VM Channels Listener::DEBUG::2014-04-10 18:48:55,258::vmChannels::102::vds::(_do_add_channels) fileno 9 was added to unconnected channels.
>VM Channels Listener::DEBUG::2014-04-10 18:48:55,258::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 9.
>VM Channels Listener::DEBUG::2014-04-10 18:48:55,258::guestIF::147::vm.Vm::(_connect) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Attempting connection to /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 18:48:55,259::guestIF::150::vm.Vm::(_connect) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Connected to /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm
>VM Channels Listener::DEBUG::2014-04-10 18:48:55,260::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 9 succeeded.
>clientIFinit::DEBUG::2014-04-10 18:48:55,471::task::579::TaskManager.Task::(_updateState) Task=`9463e66b-cad1-4f24-9a11-a96dcf227330`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:48:55,472::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:48:55,472::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:48:55,472::task::1168::TaskManager.Task::(prepare) Task=`9463e66b-cad1-4f24-9a11-a96dcf227330`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:48:55,472::task::579::TaskManager.Task::(_updateState) Task=`9463e66b-cad1-4f24-9a11-a96dcf227330`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:48:55,472::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:48:55,472::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:48:55,473::task::974::TaskManager.Task::(_decref) Task=`9463e66b-cad1-4f24-9a11-a96dcf227330`::ref 0 aborting False
>storageRefresh::DEBUG::2014-04-10 18:48:56,944::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>storageRefresh::DEBUG::2014-04-10 18:48:57,033::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-04-10 18:48:57,033::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,033::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,034::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,034::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,034::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,034::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-04-10 18:48:57,035::misc::819::SamplingMethod::(__call__) Returning last result
>storageRefresh::WARNING::2014-04-10 18:48:57,035::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
>Thread-18::DEBUG::2014-04-10 18:48:57,842::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getCapabilities with () {}
>Thread-18::DEBUG::2014-04-10 18:48:57,906::utils::505::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-18::DEBUG::2014-04-10 18:48:57,915::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-18::DEBUG::2014-04-10 18:48:57,964::BindingXMLRPC::982::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:libvirt'}], 'FC': []}, 'packages2': {'kernel': {'release': '456.el6.x86_64', 'buildtime': 1396920867.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6', 'buildtime': 1381834773L, 'version': '0.12.4'}, 'vdsm': {'release': '0.13.el6ev', 'buildtime': 1395572343L, 'version': '4.13.2'}, 'qemu-kvm': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'libvirt': {'release': '31.el6', 'buildtime': 1396956996L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.423.el6', 'buildtime': 1395916935L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz', 'hooks': {'before_vm_start': {'50_qemucmdline': {'md5': 'a884929ad6f5eb039887157288867409'}, '50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}, '10_faqemu': {'md5': '5bf2bb20a269b3f87e35adeb173ff5e8'}}, 'after_vm_destroy': {'50_vhostmd': {'md5': '92498ed80c0219749829ecce2813fc7c'}}, 'after_device_migrate_destination': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_device_create': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'after_device_create': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_nic_hotplug': {'50_openstacknet': {'md5': '24da5c2618e63fc811f10715d4e73f8d'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}, 'before_vm_migrate_destination': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'before_vm_dehibernate': {'50_vhostmd': {'md5': 'f3ee6dbf6fbd01333bd3e32afec4fbba'}}, 'after_nic_hotplug': {'50_openstacknet': {'md5': '2fc481b6124f4d4c0b23a536fa7d1b64'}, 'openstacknet_consts.py': {'md5': 'af4c005614282867517ea4cfb03d9089'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'gateway': '10.66.111.254', 'netmask': '255.255.248.0', 'stp': 'off', 'bridged': True, 'qosInbound': '', 'qosOutbound': '', 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.66.106.40', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::6eae:8bff:fe20:8082/64'], 'mtu': '1500', 'netmask': '255.255.248.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.66.111.254', 'ports': ['eth0', 'vnet0']}}, 'uuid': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:85', 'cfg': {'UUID': '12a4e2bf-6097-40a1-b63e-d011f33e6a0a', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:85', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth3', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:84', 'cfg': {'UUID': '5d727cbd-fa15-4e3b-974e-73b003650876', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:84', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:83', 'cfg': {'UUID': '1a5fab89-fb19-451a-8c23-c74c9177ba4b', 'NM_CONTROLLED': 'yes', 'HWADDR': '6C:AE:8B:20:80:83', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '6c:ae:8b:20:80:82', 'cfg': {'BRIDGE': 'rhevm', 'IPV6INIT': 'yes', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': '6C:AE:8B:20:80:82', 'DEVICE': 'eth0'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.13', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:libvirt', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.13', 'memSize': '48117', 'cpuSpeed': '2001.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.66.4.132'}}
>Thread-19::DEBUG::2014-04-10 18:48:57,988::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call getHardwareInfo with () {}
>Thread-19::DEBUG::2014-04-10 18:48:57,990::BindingXMLRPC::982::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'System x3650 M4 -[7915I31]-', 'systemSerialNumber': '06FHNX8', 'systemFamily': 'System X', 'systemVersion': '0A', 'systemUUID': '94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082', 'systemManufacturer': 'IBM'}}
>Thread-21::DEBUG::2014-04-10 18:48:58,173::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [575cc023]
>Thread-21::DEBUG::2014-04-10 18:48:58,174::task::579::TaskManager.Task::(_updateState) Task=`bf6058b0-49e2-4bb0-8a34-9977c7c14ada`::moving from state init -> state preparing
>Thread-21::INFO::2014-04-10 18:48:58,174::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}, {'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-21::DEBUG::2014-04-10 18:48:58,177::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,332::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,333::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,333::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,333::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,333::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,333::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,335::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,336::vm::636::vm.Vm::(_getNetworkStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Network stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,336::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,336::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,336::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:48:58,336::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:00,478::task::579::TaskManager.Task::(_updateState) Task=`624ff0f2-216a-4638-a615-2be001be84db`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:00,479::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:00,479::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:00,479::task::1168::TaskManager.Task::(prepare) Task=`624ff0f2-216a-4638-a615-2be001be84db`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:00,479::task::579::TaskManager.Task::(_updateState) Task=`624ff0f2-216a-4638-a615-2be001be84db`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:00,479::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:00,480::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:00,480::task::974::TaskManager.Task::(_decref) Task=`624ff0f2-216a-4638-a615-2be001be84db`::ref 0 aborting False
>Thread-22::DEBUG::2014-04-10 18:49:01,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-22::DEBUG::2014-04-10 18:49:01,758::task::579::TaskManager.Task::(_updateState) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::moving from state init -> state preparing
>Thread-22::INFO::2014-04-10 18:49:01,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-22::ERROR::2014-04-10 18:49:01,758::task::850::TaskManager.Task::(_setError) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 622, in getSpmStatus
>    pool = self.getPool(spUUID)
>  File "/usr/share/vdsm/storage/hsm.py", line 321, in getPool
>    raise se.StoragePoolUnknown(spUUID)
>StoragePoolUnknown: Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)
>Thread-22::DEBUG::2014-04-10 18:49:01,760::task::869::TaskManager.Task::(_run) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::Task._run: 33733b37-0c57-4596-bb50-b342c77bfd22 ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-22::DEBUG::2014-04-10 18:49:01,760::task::1194::TaskManager.Task::(stop) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::stopping in state preparing (force False)
>Thread-22::DEBUG::2014-04-10 18:49:01,760::task::974::TaskManager.Task::(_decref) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::ref 1 aborting True
>Thread-22::INFO::2014-04-10 18:49:01,761::task::1151::TaskManager.Task::(prepare) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309
>Thread-22::DEBUG::2014-04-10 18:49:01,761::task::1156::TaskManager.Task::(prepare) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::Prepare: aborted: Unknown pool id, pool not connected
>Thread-22::DEBUG::2014-04-10 18:49:01,761::task::974::TaskManager.Task::(_decref) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::ref 0 aborting True
>Thread-22::DEBUG::2014-04-10 18:49:01,761::task::909::TaskManager.Task::(_doAbort) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::Task._doAbort: force False
>Thread-22::DEBUG::2014-04-10 18:49:01,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-22::DEBUG::2014-04-10 18:49:01,761::task::579::TaskManager.Task::(_updateState) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::moving from state preparing -> state aborting
>Thread-22::DEBUG::2014-04-10 18:49:01,761::task::534::TaskManager.Task::(__state_aborting) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::_aborting: recover policy none
>Thread-22::DEBUG::2014-04-10 18:49:01,762::task::579::TaskManager.Task::(_updateState) Task=`33733b37-0c57-4596-bb50-b342c77bfd22`::moving from state aborting -> state failed
>Thread-22::DEBUG::2014-04-10 18:49:01,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-22::DEBUG::2014-04-10 18:49:01,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-22::ERROR::2014-04-10 18:49:01,762::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)", 'code': 309}}
>Thread-23::DEBUG::2014-04-10 18:49:01,772::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-23::DEBUG::2014-04-10 18:49:01,773::task::579::TaskManager.Task::(_updateState) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::moving from state init -> state preparing
>Thread-23::INFO::2014-04-10 18:49:01,773::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-23::ERROR::2014-04-10 18:49:01,773::task::850::TaskManager.Task::(_setError) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 2119, in getAllTasksStatuses
>    raise se.SpmStatusError()
>SpmStatusError: Not SPM: ()
>Thread-23::DEBUG::2014-04-10 18:49:01,773::task::869::TaskManager.Task::(_run) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::Task._run: 7598f18c-ec64-4b69-8f9d-2c03adf397f0 () {} failed - stopping task
>Thread-23::DEBUG::2014-04-10 18:49:01,773::task::1194::TaskManager.Task::(stop) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::stopping in state preparing (force False)
>Thread-23::DEBUG::2014-04-10 18:49:01,774::task::974::TaskManager.Task::(_decref) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::ref 1 aborting True
>Thread-23::INFO::2014-04-10 18:49:01,774::task::1151::TaskManager.Task::(prepare) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::aborting: Task is aborted: 'Not SPM' - code 654
>Thread-23::DEBUG::2014-04-10 18:49:01,774::task::1156::TaskManager.Task::(prepare) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::Prepare: aborted: Not SPM
>Thread-23::DEBUG::2014-04-10 18:49:01,774::task::974::TaskManager.Task::(_decref) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::ref 0 aborting True
>Thread-23::DEBUG::2014-04-10 18:49:01,774::task::909::TaskManager.Task::(_doAbort) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::Task._doAbort: force False
>Thread-23::DEBUG::2014-04-10 18:49:01,774::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-23::DEBUG::2014-04-10 18:49:01,775::task::579::TaskManager.Task::(_updateState) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::moving from state preparing -> state aborting
>Thread-23::DEBUG::2014-04-10 18:49:01,775::task::534::TaskManager.Task::(__state_aborting) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::_aborting: recover policy none
>Thread-23::DEBUG::2014-04-10 18:49:01,775::task::579::TaskManager.Task::(_updateState) Task=`7598f18c-ec64-4b69-8f9d-2c03adf397f0`::moving from state aborting -> state failed
>Thread-23::DEBUG::2014-04-10 18:49:01,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-23::DEBUG::2014-04-10 18:49:01,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-23::ERROR::2014-04-10 18:49:01,775::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Not SPM: ()', 'code': 654}}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,338::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,338::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,339::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,339::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,339::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,340::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,340::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,341::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,341::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:03,341::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:05,485::task::579::TaskManager.Task::(_updateState) Task=`95a2e123-c03c-4d5b-b433-a0d0015341ba`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:05,486::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:05,499::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:05,499::task::1168::TaskManager.Task::(prepare) Task=`95a2e123-c03c-4d5b-b433-a0d0015341ba`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:05,499::task::579::TaskManager.Task::(_updateState) Task=`95a2e123-c03c-4d5b-b433-a0d0015341ba`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:05,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:05,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:05,499::task::974::TaskManager.Task::(_decref) Task=`95a2e123-c03c-4d5b-b433-a0d0015341ba`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,347::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,348::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,348::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,348::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,348::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,349::vm::600::vm.Vm::(_getCpuStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::CPU stats not available: 'NoneType' object is unsubscriptable
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,350::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,350::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,350::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:08,350::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:10,505::task::579::TaskManager.Task::(_updateState) Task=`a0bab6af-fed3-4b4c-a338-f8c888a00be4`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:10,506::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:10,531::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:10,531::task::1168::TaskManager.Task::(prepare) Task=`a0bab6af-fed3-4b4c-a338-f8c888a00be4`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:10,531::task::579::TaskManager.Task::(_updateState) Task=`a0bab6af-fed3-4b4c-a338-f8c888a00be4`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:10,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:10,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:10,532::task::974::TaskManager.Task::(_decref) Task=`a0bab6af-fed3-4b4c-a338-f8c888a00be4`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,356::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,356::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,356::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,356::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,358::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,358::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,358::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:13,358::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:15,538::task::579::TaskManager.Task::(_updateState) Task=`aaa738b3-07d0-4006-bfd5-75aceb551719`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:15,538::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:15,553::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:15,553::task::1168::TaskManager.Task::(prepare) Task=`aaa738b3-07d0-4006-bfd5-75aceb551719`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:15,553::task::579::TaskManager.Task::(_updateState) Task=`aaa738b3-07d0-4006-bfd5-75aceb551719`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:15,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:15,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:15,554::task::974::TaskManager.Task::(_decref) Task=`aaa738b3-07d0-4006-bfd5-75aceb551719`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,364::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,365::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,365::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,365::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,366::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,366::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,367::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:18,367::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:20,559::task::579::TaskManager.Task::(_updateState) Task=`a876e889-b4fb-4003-b403-eb2dcc11250b`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:20,560::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:20,574::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:20,574::task::1168::TaskManager.Task::(prepare) Task=`a876e889-b4fb-4003-b403-eb2dcc11250b`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:20,574::task::579::TaskManager.Task::(_updateState) Task=`a876e889-b4fb-4003-b403-eb2dcc11250b`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:20,575::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:20,575::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:20,575::task::974::TaskManager.Task::(_decref) Task=`a876e889-b4fb-4003-b403-eb2dcc11250b`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,373::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,373::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,373::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,373::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,374::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,375::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,375::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:23,375::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:49:25,295::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:49:25,581::task::579::TaskManager.Task::(_updateState) Task=`72241a1c-de7e-45da-8a10-b6a8dc33322a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:25,581::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:25,590::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:25,590::task::1168::TaskManager.Task::(prepare) Task=`72241a1c-de7e-45da-8a10-b6a8dc33322a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:25,590::task::579::TaskManager.Task::(_updateState) Task=`72241a1c-de7e-45da-8a10-b6a8dc33322a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:25,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:25,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:25,591::task::974::TaskManager.Task::(_decref) Task=`72241a1c-de7e-45da-8a10-b6a8dc33322a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,381::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,381::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,382::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,382::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,383::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,383::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,383::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:28,383::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:30,596::task::579::TaskManager.Task::(_updateState) Task=`925f8f5b-bacd-43c2-a379-8d18d6b05a90`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:30,597::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:30,617::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:30,618::task::1168::TaskManager.Task::(prepare) Task=`925f8f5b-bacd-43c2-a379-8d18d6b05a90`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:30,618::task::579::TaskManager.Task::(_updateState) Task=`925f8f5b-bacd-43c2-a379-8d18d6b05a90`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:30,618::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:30,618::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:30,618::task::974::TaskManager.Task::(_decref) Task=`925f8f5b-bacd-43c2-a379-8d18d6b05a90`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,390::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,390::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,390::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,390::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,391::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,392::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,392::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:33,392::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:35,624::task::579::TaskManager.Task::(_updateState) Task=`568583d2-dd1e-4a34-861c-7c49075bed39`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:35,624::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:35,637::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:35,637::task::1168::TaskManager.Task::(prepare) Task=`568583d2-dd1e-4a34-861c-7c49075bed39`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:35,638::task::579::TaskManager.Task::(_updateState) Task=`568583d2-dd1e-4a34-861c-7c49075bed39`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:35,638::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:35,638::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:35,638::task::974::TaskManager.Task::(_decref) Task=`568583d2-dd1e-4a34-861c-7c49075bed39`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,398::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,398::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,399::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,399::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,400::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,400::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,400::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:38,400::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:40,644::task::579::TaskManager.Task::(_updateState) Task=`da5f2f10-5fc7-41ce-85f5-6e1fe86c8f06`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:40,644::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:40,675::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:40,676::task::1168::TaskManager.Task::(prepare) Task=`da5f2f10-5fc7-41ce-85f5-6e1fe86c8f06`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:40,676::task::579::TaskManager.Task::(_updateState) Task=`da5f2f10-5fc7-41ce-85f5-6e1fe86c8f06`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:40,676::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:40,676::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:40,676::task::974::TaskManager.Task::(_decref) Task=`da5f2f10-5fc7-41ce-85f5-6e1fe86c8f06`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,407::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,407::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,407::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,407::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,409::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,409::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,409::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:43,409::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:45,682::task::579::TaskManager.Task::(_updateState) Task=`474cc4f3-f8a1-4513-b33e-073b9a9bef3a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:45,682::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:45,696::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:45,696::task::1168::TaskManager.Task::(prepare) Task=`474cc4f3-f8a1-4513-b33e-073b9a9bef3a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:45,697::task::579::TaskManager.Task::(_updateState) Task=`474cc4f3-f8a1-4513-b33e-073b9a9bef3a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:45,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:45,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:45,697::task::974::TaskManager.Task::(_decref) Task=`474cc4f3-f8a1-4513-b33e-073b9a9bef3a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,415::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,415::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,416::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,416::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,417::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,417::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,417::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:48,417::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:49:50,703::task::579::TaskManager.Task::(_updateState) Task=`25cf6598-07db-4898-ba99-a914099770ac`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:50,703::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:50,710::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:50,710::task::1168::TaskManager.Task::(prepare) Task=`25cf6598-07db-4898-ba99-a914099770ac`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:50,710::task::579::TaskManager.Task::(_updateState) Task=`25cf6598-07db-4898-ba99-a914099770ac`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:50,710::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:50,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:50,711::task::974::TaskManager.Task::(_decref) Task=`25cf6598-07db-4898-ba99-a914099770ac`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,424::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,424::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,424::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,424::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,425::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,426::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,426::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:53,426::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:49:55,331::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:49:55,716::task::579::TaskManager.Task::(_updateState) Task=`b057002c-5c39-41b0-a3de-9b28d150dd10`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:49:55,717::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:49:55,726::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:55,726::task::1168::TaskManager.Task::(prepare) Task=`b057002c-5c39-41b0-a3de-9b28d150dd10`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:49:55,726::task::579::TaskManager.Task::(_updateState) Task=`b057002c-5c39-41b0-a3de-9b28d150dd10`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:49:55,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:49:55,726::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:49:55,726::task::974::TaskManager.Task::(_decref) Task=`b057002c-5c39-41b0-a3de-9b28d150dd10`::ref 0 aborting False
>Thread-21::DEBUG::2014-04-10 18:49:58,182::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-21::DEBUG::2014-04-10 18:49:58,182::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-21::DEBUG::2014-04-10 18:49:58,184::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2
>Thread-21::DEBUG::2014-04-10 18:49:58,261::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('65eafe2b-4fa9-4ea1-a869-7deb5afd4654',)
>Thread-21::DEBUG::2014-04-10 18:49:58,261::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 18:49:58,263::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,432::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,433::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,433::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,433::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,434::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,435::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,435::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:49:58,435::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:00,732::task::579::TaskManager.Task::(_updateState) Task=`30fc19a4-2713-4e3d-9608-5d727cdc656d`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:00,733::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:00,747::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:00,747::task::1168::TaskManager.Task::(prepare) Task=`30fc19a4-2713-4e3d-9608-5d727cdc656d`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:00,747::task::579::TaskManager.Task::(_updateState) Task=`30fc19a4-2713-4e3d-9608-5d727cdc656d`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:00,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:00,748::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:00,748::task::974::TaskManager.Task::(_decref) Task=`30fc19a4-2713-4e3d-9608-5d727cdc656d`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,441::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,442::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,442::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,442::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,443::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,444::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,444::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:03,444::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:05,754::task::579::TaskManager.Task::(_updateState) Task=`180d7cb3-5027-4ba2-aab4-7cc2f2ac365d`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:05,754::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:05,754::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:05,754::task::1168::TaskManager.Task::(prepare) Task=`180d7cb3-5027-4ba2-aab4-7cc2f2ac365d`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:05,755::task::579::TaskManager.Task::(_updateState) Task=`180d7cb3-5027-4ba2-aab4-7cc2f2ac365d`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:05,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:05,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:05,755::task::974::TaskManager.Task::(_decref) Task=`180d7cb3-5027-4ba2-aab4-7cc2f2ac365d`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,448::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,449::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,474::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,474::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,476::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,476::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,476::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:08,476::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:10,761::task::579::TaskManager.Task::(_updateState) Task=`05be5e2f-93aa-4783-80a0-b686a86ea096`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:10,761::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:10,761::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:10,762::task::1168::TaskManager.Task::(prepare) Task=`05be5e2f-93aa-4783-80a0-b686a86ea096`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:10,762::task::579::TaskManager.Task::(_updateState) Task=`05be5e2f-93aa-4783-80a0-b686a86ea096`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:10,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:10,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:10,762::task::974::TaskManager.Task::(_decref) Task=`05be5e2f-93aa-4783-80a0-b686a86ea096`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,483::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,483::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,506::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,506::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,507::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,507::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,508::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:13,508::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:15,768::task::579::TaskManager.Task::(_updateState) Task=`af794d10-d8a2-466d-a56c-36a5aa458f7c`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:15,768::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:15,769::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:15,769::task::1168::TaskManager.Task::(prepare) Task=`af794d10-d8a2-466d-a56c-36a5aa458f7c`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:15,769::task::579::TaskManager.Task::(_updateState) Task=`af794d10-d8a2-466d-a56c-36a5aa458f7c`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:15,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:15,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:15,769::task::974::TaskManager.Task::(_decref) Task=`af794d10-d8a2-466d-a56c-36a5aa458f7c`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,514::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,514::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,526::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,526::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,528::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,528::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,528::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:18,528::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:20,775::task::579::TaskManager.Task::(_updateState) Task=`aa7580de-1e24-4c96-81b0-08c756fdee85`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:20,775::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:20,776::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:20,776::task::1168::TaskManager.Task::(prepare) Task=`aa7580de-1e24-4c96-81b0-08c756fdee85`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:20,776::task::579::TaskManager.Task::(_updateState) Task=`aa7580de-1e24-4c96-81b0-08c756fdee85`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:20,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:20,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:20,776::task::974::TaskManager.Task::(_decref) Task=`aa7580de-1e24-4c96-81b0-08c756fdee85`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,545::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,546::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,547::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,547::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,547::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:23,547::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:50:25,368::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:50:25,782::task::579::TaskManager.Task::(_updateState) Task=`4db72b2b-5049-4053-9191-9b7a3ae1ac70`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:25,782::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:25,783::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:25,783::task::1168::TaskManager.Task::(prepare) Task=`4db72b2b-5049-4053-9191-9b7a3ae1ac70`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:25,783::task::579::TaskManager.Task::(_updateState) Task=`4db72b2b-5049-4053-9191-9b7a3ae1ac70`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:25,783::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:25,783::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:25,784::task::974::TaskManager.Task::(_decref) Task=`4db72b2b-5049-4053-9191-9b7a3ae1ac70`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,554::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,554::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,574::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,574::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,575::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,576::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,576::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:28,576::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:30,789::task::579::TaskManager.Task::(_updateState) Task=`66a581f2-ad1f-4dcf-b7cc-9166a4e48939`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:30,790::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:30,790::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:30,790::task::1168::TaskManager.Task::(prepare) Task=`66a581f2-ad1f-4dcf-b7cc-9166a4e48939`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:30,790::task::579::TaskManager.Task::(_updateState) Task=`66a581f2-ad1f-4dcf-b7cc-9166a4e48939`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:30,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:30,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:30,790::task::974::TaskManager.Task::(_decref) Task=`66a581f2-ad1f-4dcf-b7cc-9166a4e48939`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,582::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,583::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,606::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,608::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,608::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,608::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:33,608::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:35,796::task::579::TaskManager.Task::(_updateState) Task=`404010d3-1fba-4b3c-a849-24b3c93b581c`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:35,797::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:35,797::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:35,797::task::1168::TaskManager.Task::(prepare) Task=`404010d3-1fba-4b3c-a849-24b3c93b581c`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:35,797::task::579::TaskManager.Task::(_updateState) Task=`404010d3-1fba-4b3c-a849-24b3c93b581c`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:35,797::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:35,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:35,798::task::974::TaskManager.Task::(_decref) Task=`404010d3-1fba-4b3c-a849-24b3c93b581c`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,615::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,615::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,638::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,638::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,639::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,639::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,639::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:38,639::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:40,803::task::579::TaskManager.Task::(_updateState) Task=`48d578a0-2023-473c-8545-a4ff3f030940`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:40,804::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:40,804::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:40,804::task::1168::TaskManager.Task::(prepare) Task=`48d578a0-2023-473c-8545-a4ff3f030940`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:40,804::task::579::TaskManager.Task::(_updateState) Task=`48d578a0-2023-473c-8545-a4ff3f030940`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:40,805::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:40,805::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:40,805::task::974::TaskManager.Task::(_decref) Task=`48d578a0-2023-473c-8545-a4ff3f030940`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,646::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,646::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,668::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,668::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,669::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,670::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,670::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:43,670::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:45,811::task::579::TaskManager.Task::(_updateState) Task=`763036fd-fb81-4fd2-94ee-e6b7e84c97ad`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:45,811::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:45,811::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:45,811::task::1168::TaskManager.Task::(prepare) Task=`763036fd-fb81-4fd2-94ee-e6b7e84c97ad`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:45,812::task::579::TaskManager.Task::(_updateState) Task=`763036fd-fb81-4fd2-94ee-e6b7e84c97ad`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:45,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:45,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:45,812::task::974::TaskManager.Task::(_decref) Task=`763036fd-fb81-4fd2-94ee-e6b7e84c97ad`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,676::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,676::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,688::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,689::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,690::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,690::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,690::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:48,690::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:50:50,818::task::579::TaskManager.Task::(_updateState) Task=`92305e77-838a-41f5-81aa-2f5bc3e2bc54`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:50,818::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:50,818::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:50,818::task::1168::TaskManager.Task::(prepare) Task=`92305e77-838a-41f5-81aa-2f5bc3e2bc54`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:50,819::task::579::TaskManager.Task::(_updateState) Task=`92305e77-838a-41f5-81aa-2f5bc3e2bc54`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:50,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:50,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:50,819::task::974::TaskManager.Task::(_decref) Task=`92305e77-838a-41f5-81aa-2f5bc3e2bc54`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,697::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,697::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,708::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,708::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,709::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,709::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,710::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:53,710::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:50:55,404::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:50:55,825::task::579::TaskManager.Task::(_updateState) Task=`e143e106-a21a-4a5a-accc-f6e789209114`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:50:55,825::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:50:55,826::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:55,826::task::1168::TaskManager.Task::(prepare) Task=`e143e106-a21a-4a5a-accc-f6e789209114`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:50:55,826::task::579::TaskManager.Task::(_updateState) Task=`e143e106-a21a-4a5a-accc-f6e789209114`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:50:55,826::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:50:55,826::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:50:55,827::task::974::TaskManager.Task::(_decref) Task=`e143e106-a21a-4a5a-accc-f6e789209114`::ref 0 aborting False
>Thread-21::DEBUG::2014-04-10 18:50:58,263::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-21::DEBUG::2014-04-10 18:50:58,264::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 18:50:58,266::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1
>Thread-21::DEBUG::2014-04-10 18:50:58,342::hsm::2342::Storage.HSM::(__prefetchDomains) Found SD uuids: ('f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76',)
>Thread-21::DEBUG::2014-04-10 18:50:58,343::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-21::DEBUG::2014-04-10 18:50:58,343::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-21::INFO::2014-04-10 18:50:58,343::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-21::DEBUG::2014-04-10 18:50:58,343::task::1168::TaskManager.Task::(prepare) Task=`bf6058b0-49e2-4bb0-8a34-9977c7c14ada`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-21::DEBUG::2014-04-10 18:50:58,344::task::579::TaskManager.Task::(_updateState) Task=`bf6058b0-49e2-4bb0-8a34-9977c7c14ada`::moving from state preparing -> state finished
>Thread-21::DEBUG::2014-04-10 18:50:58,344::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-21::DEBUG::2014-04-10 18:50:58,344::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-21::DEBUG::2014-04-10 18:50:58,344::task::974::TaskManager.Task::(_decref) Task=`bf6058b0-49e2-4bb0-8a34-9977c7c14ada`::ref 0 aborting False
>Thread-24::DEBUG::2014-04-10 18:50:58,388::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-24::DEBUG::2014-04-10 18:50:58,388::task::579::TaskManager.Task::(_updateState) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::moving from state init -> state preparing
>Thread-24::INFO::2014-04-10 18:50:58,388::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='55cb7668-7c5e-4553-b263-c6f3f86b358f', masterVersion=6, options=None)
>Thread-24::DEBUG::2014-04-10 18:50:58,389::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5247ef80-e1c5-4629-9883-09e054eaf1ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1013' at 'connectStoragePool'
>Thread-24::DEBUG::2014-04-10 18:50:58,389::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-24::DEBUG::2014-04-10 18:50:58,389::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-24::DEBUG::2014-04-10 18:50:58,390::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5247ef80-e1c5-4629-9883-09e054eaf1ab`::Granted request
>Thread-24::DEBUG::2014-04-10 18:50:58,390::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e16113d1-03de-4077-a252-376d09b1cdc0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1044' at '_connectStoragePool'
>Thread-24::DEBUG::2014-04-10 18:50:58,390::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-24::DEBUG::2014-04-10 18:50:58,390::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-24::DEBUG::2014-04-10 18:50:58,391::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e16113d1-03de-4077-a252-376d09b1cdc0`::Granted request
>Thread-24::INFO::2014-04-10 18:50:58,391::sp::674::Storage.StoragePool::(connect) Connect host #2 to the storage pool f721168f-5edd-4f5f-8976-591eb93f960e with master domain: 55cb7668-7c5e-4553-b263-c6f3f86b358f (ver = 6)
>Thread-24::DEBUG::2014-04-10 18:50:58,392::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,392::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,392::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,393::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,393::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,393::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:50:58,393::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-24::DEBUG::2014-04-10 18:50:58,393::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-24::DEBUG::2014-04-10 18:50:58,394::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-24::DEBUG::2014-04-10 18:50:58,394::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-24::DEBUG::2014-04-10 18:50:58,394::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-24::DEBUG::2014-04-10 18:50:58,413::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-24::DEBUG::2014-04-10 18:50:58,414::misc::819::SamplingMethod::(__call__) Returning last result
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,717::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,717::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,746::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,746::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,753::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,753::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,753::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:50:58,753::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:00,832::task::579::TaskManager.Task::(_updateState) Task=`3964b0f8-69f7-49b9-86c3-1b26dd974233`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:00,833::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:00,833::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:00,833::task::1168::TaskManager.Task::(prepare) Task=`3964b0f8-69f7-49b9-86c3-1b26dd974233`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:00,833::task::579::TaskManager.Task::(_updateState) Task=`3964b0f8-69f7-49b9-86c3-1b26dd974233`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:00,833::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:00,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:00,834::task::974::TaskManager.Task::(_decref) Task=`3964b0f8-69f7-49b9-86c3-1b26dd974233`::ref 0 aborting False
>Thread-24::DEBUG::2014-04-10 18:51:01,446::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-24::DEBUG::2014-04-10 18:51:01,528::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-24::DEBUG::2014-04-10 18:51:01,529::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,530::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,530::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,530::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,530::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,531::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,531::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-24::ERROR::2014-04-10 18:51:01,531::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-24::ERROR::2014-04-10 18:51:01,531::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-24::DEBUG::2014-04-10 18:51:01,531::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-24::DEBUG::2014-04-10 18:51:01,532::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-24::DEBUG::2014-04-10 18:51:01,694::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-24::WARNING::2014-04-10 18:51:01,695::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-24::DEBUG::2014-04-10 18:51:01,695::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,760::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,760::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,785::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,786::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,787::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,787::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,787::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:03,787::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:05,840::task::579::TaskManager.Task::(_updateState) Task=`8c86357f-d19c-416b-9cc4-d3b8df30a8c7`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:05,840::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:05,840::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:05,840::task::1168::TaskManager.Task::(prepare) Task=`8c86357f-d19c-416b-9cc4-d3b8df30a8c7`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:05,840::task::579::TaskManager.Task::(_updateState) Task=`8c86357f-d19c-416b-9cc4-d3b8df30a8c7`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:05,841::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:05,841::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:05,841::task::974::TaskManager.Task::(_decref) Task=`8c86357f-d19c-416b-9cc4-d3b8df30a8c7`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,794::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,794::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,804::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,805::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,806::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,806::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,806::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:08,806::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:10,847::task::579::TaskManager.Task::(_updateState) Task=`9b1fac66-e985-4a18-8052-96950ba429a8`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:10,847::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:10,847::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:10,847::task::1168::TaskManager.Task::(prepare) Task=`9b1fac66-e985-4a18-8052-96950ba429a8`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:10,848::task::579::TaskManager.Task::(_updateState) Task=`9b1fac66-e985-4a18-8052-96950ba429a8`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:10,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:10,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:10,848::task::974::TaskManager.Task::(_decref) Task=`9b1fac66-e985-4a18-8052-96950ba429a8`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,813::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,813::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,837::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,837::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,839::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,839::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,839::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:13,839::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:15,854::task::579::TaskManager.Task::(_updateState) Task=`7c0f8dab-ae2d-4cbb-b08d-f79f0f85985f`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:15,854::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:15,854::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:15,855::task::1168::TaskManager.Task::(prepare) Task=`7c0f8dab-ae2d-4cbb-b08d-f79f0f85985f`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:15,855::task::579::TaskManager.Task::(_updateState) Task=`7c0f8dab-ae2d-4cbb-b08d-f79f0f85985f`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:15,855::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:15,855::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:15,855::task::974::TaskManager.Task::(_decref) Task=`7c0f8dab-ae2d-4cbb-b08d-f79f0f85985f`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,846::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,846::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,871::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,872::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,873::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,873::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,873::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:18,873::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:20,861::task::579::TaskManager.Task::(_updateState) Task=`41e976e6-6685-44c0-af51-7d135cafded0`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:20,861::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:20,861::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:20,862::task::1168::TaskManager.Task::(prepare) Task=`41e976e6-6685-44c0-af51-7d135cafded0`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:20,862::task::579::TaskManager.Task::(_updateState) Task=`41e976e6-6685-44c0-af51-7d135cafded0`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:20,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:20,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:20,862::task::974::TaskManager.Task::(_decref) Task=`41e976e6-6685-44c0-af51-7d135cafded0`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,880::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,880::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,889::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,889::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,890::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,891::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,891::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:23,891::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:51:25,439::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:51:25,868::task::579::TaskManager.Task::(_updateState) Task=`4a888e56-bdec-450f-b05d-3e9bb0d5303a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:25,868::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:25,868::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:25,869::task::1168::TaskManager.Task::(prepare) Task=`4a888e56-bdec-450f-b05d-3e9bb0d5303a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:25,869::task::579::TaskManager.Task::(_updateState) Task=`4a888e56-bdec-450f-b05d-3e9bb0d5303a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:25,869::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:25,869::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:25,869::task::974::TaskManager.Task::(_decref) Task=`4a888e56-bdec-450f-b05d-3e9bb0d5303a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,897::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,898::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,915::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,915::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,916::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,917::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,917::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:28,917::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:30,875::task::579::TaskManager.Task::(_updateState) Task=`bc28444b-ff76-466e-9808-891ec50ea324`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:30,875::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:30,876::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:30,876::task::1168::TaskManager.Task::(prepare) Task=`bc28444b-ff76-466e-9808-891ec50ea324`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:30,876::task::579::TaskManager.Task::(_updateState) Task=`bc28444b-ff76-466e-9808-891ec50ea324`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:30,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:30,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:30,876::task::974::TaskManager.Task::(_decref) Task=`bc28444b-ff76-466e-9808-891ec50ea324`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,923::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,923::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,941::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,941::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,942::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,943::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,943::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:33,943::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:35,882::task::579::TaskManager.Task::(_updateState) Task=`1e6fc428-8530-42aa-8466-2efd2d544f2a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:35,883::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:35,883::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:35,883::task::1168::TaskManager.Task::(prepare) Task=`1e6fc428-8530-42aa-8466-2efd2d544f2a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:35,883::task::579::TaskManager.Task::(_updateState) Task=`1e6fc428-8530-42aa-8466-2efd2d544f2a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:35,883::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:35,883::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:35,883::task::974::TaskManager.Task::(_decref) Task=`1e6fc428-8530-42aa-8466-2efd2d544f2a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,949::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,950::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,969::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,969::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,970::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,970::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,970::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:38,971::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:40,889::task::579::TaskManager.Task::(_updateState) Task=`0e6d7f53-17ab-4650-a76d-c3c921ab7544`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:40,889::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:40,890::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:40,890::task::1168::TaskManager.Task::(prepare) Task=`0e6d7f53-17ab-4650-a76d-c3c921ab7544`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:40,890::task::579::TaskManager.Task::(_updateState) Task=`0e6d7f53-17ab-4650-a76d-c3c921ab7544`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:40,890::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:40,891::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:40,891::task::974::TaskManager.Task::(_decref) Task=`0e6d7f53-17ab-4650-a76d-c3c921ab7544`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,977::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,977::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,993::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,993::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,994::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,995::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,995::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:43,995::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:45,894::task::579::TaskManager.Task::(_updateState) Task=`1ef21867-1a5c-4ad5-9b4d-bc7d87a8b02a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:45,895::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:45,895::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:45,895::task::1168::TaskManager.Task::(prepare) Task=`1ef21867-1a5c-4ad5-9b4d-bc7d87a8b02a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:45,895::task::579::TaskManager.Task::(_updateState) Task=`1ef21867-1a5c-4ad5-9b4d-bc7d87a8b02a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:45,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:45,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:45,896::task::974::TaskManager.Task::(_decref) Task=`1ef21867-1a5c-4ad5-9b4d-bc7d87a8b02a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,001::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,001::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,026::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,027::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,028::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,028::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,028::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:49,028::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:51:50,902::task::579::TaskManager.Task::(_updateState) Task=`16fc2cc8-1894-4ff4-8d15-07de4568e919`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:50,902::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:50,902::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:50,902::task::1168::TaskManager.Task::(prepare) Task=`16fc2cc8-1894-4ff4-8d15-07de4568e919`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:50,902::task::579::TaskManager.Task::(_updateState) Task=`16fc2cc8-1894-4ff4-8d15-07de4568e919`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:50,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:50,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:50,903::task::974::TaskManager.Task::(_decref) Task=`16fc2cc8-1894-4ff4-8d15-07de4568e919`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,035::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,035::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,045::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,045::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,047::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,047::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,047::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:54,047::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:51:55,475::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:51:55,909::task::579::TaskManager.Task::(_updateState) Task=`b6225a20-be4a-4854-9bae-e916d6e3852e`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:51:55,909::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:51:55,909::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:55,909::task::1168::TaskManager.Task::(prepare) Task=`b6225a20-be4a-4854-9bae-e916d6e3852e`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:51:55,910::task::579::TaskManager.Task::(_updateState) Task=`b6225a20-be4a-4854-9bae-e916d6e3852e`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:51:55,910::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:51:55,910::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:51:55,910::task::974::TaskManager.Task::(_decref) Task=`b6225a20-be4a-4854-9bae-e916d6e3852e`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,053::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,054::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,071::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,071::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,073::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,073::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,073::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:51:59,073::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:00,914::task::579::TaskManager.Task::(_updateState) Task=`1b645ac7-669d-4d57-aa5e-e20d0be0b6df`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:00,919::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:00,922::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:00,925::task::1168::TaskManager.Task::(prepare) Task=`1b645ac7-669d-4d57-aa5e-e20d0be0b6df`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:00,929::task::579::TaskManager.Task::(_updateState) Task=`1b645ac7-669d-4d57-aa5e-e20d0be0b6df`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:00,932::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:00,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:00,940::task::974::TaskManager.Task::(_decref) Task=`1b645ac7-669d-4d57-aa5e-e20d0be0b6df`::ref 0 aborting False
>Thread-26::WARNING::2014-04-10 18:52:01,723::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-28::WARNING::2014-04-10 18:52:01,728::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-26::DEBUG::2014-04-10 18:52:01,733::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-28::DEBUG::2014-04-10 18:52:01,734::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-24::ERROR::2014-04-10 18:52:01,736::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-24::DEBUG::2014-04-10 18:52:01,736::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-24::DEBUG::2014-04-10 18:52:01,736::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-24::DEBUG::2014-04-10 18:52:01,737::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-24::DEBUG::2014-04-10 18:52:01,737::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-24::DEBUG::2014-04-10 18:52:01,737::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-24::DEBUG::2014-04-10 18:52:01,737::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-24::DEBUG::2014-04-10 18:52:01,738::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-24::DEBUG::2014-04-10 18:52:01,738::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-24::ERROR::2014-04-10 18:52:01,738::task::850::TaskManager.Task::(_setError) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 1015, in connectStoragePool
>    masterVersion, options)
>  File "/usr/share/vdsm/storage/hsm.py", line 1069, in _connectStoragePool
>    res = pool.connect(hostID, scsiKey, msdUUID, masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 692, in connect
>    self.__rebuild(msdUUID=msdUUID, masterVersion=masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 1238, in __rebuild
>    masterVersion=masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 1508, in getMasterDomain
>    raise se.StoragePoolMasterNotFound(self.spUUID, msdUUID)
>StoragePoolMasterNotFound: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-24::DEBUG::2014-04-10 18:52:01,739::task::869::TaskManager.Task::(_run) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::Task._run: c257fd28-8b62-4675-8d34-09929d4020d1 ('f721168f-5edd-4f5f-8976-591eb93f960e', 2, 'f721168f-5edd-4f5f-8976-591eb93f960e', '55cb7668-7c5e-4553-b263-c6f3f86b358f', 6) {} failed - stopping task
>Thread-24::DEBUG::2014-04-10 18:52:01,739::task::1194::TaskManager.Task::(stop) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::stopping in state preparing (force False)
>Thread-24::DEBUG::2014-04-10 18:52:01,739::task::974::TaskManager.Task::(_decref) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::ref 1 aborting True
>Thread-24::INFO::2014-04-10 18:52:01,740::task::1151::TaskManager.Task::(prepare) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::aborting: Task is aborted: 'Cannot find master domain' - code 304
>Thread-24::DEBUG::2014-04-10 18:52:01,740::task::1156::TaskManager.Task::(prepare) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::Prepare: aborted: Cannot find master domain
>Thread-24::DEBUG::2014-04-10 18:52:01,740::task::974::TaskManager.Task::(_decref) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::ref 0 aborting True
>Thread-24::DEBUG::2014-04-10 18:52:01,740::task::909::TaskManager.Task::(_doAbort) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::Task._doAbort: force False
>Thread-24::DEBUG::2014-04-10 18:52:01,740::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-24::DEBUG::2014-04-10 18:52:01,740::task::579::TaskManager.Task::(_updateState) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::moving from state preparing -> state aborting
>Thread-24::DEBUG::2014-04-10 18:52:01,741::task::534::TaskManager.Task::(__state_aborting) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::_aborting: recover policy none
>Thread-24::DEBUG::2014-04-10 18:52:01,741::task::579::TaskManager.Task::(_updateState) Task=`c257fd28-8b62-4675-8d34-09929d4020d1`::moving from state aborting -> state failed
>Thread-24::DEBUG::2014-04-10 18:52:01,741::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-24::DEBUG::2014-04-10 18:52:01,741::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-24::ERROR::2014-04-10 18:52:01,741::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f'", 'code': 304}}
>Thread-29::DEBUG::2014-04-10 18:52:01,756::task::579::TaskManager.Task::(_updateState) Task=`26cc791a-b96b-44be-99bc-a80d987ef7d9`::moving from state init -> state preparing
>Thread-29::INFO::2014-04-10 18:52:01,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-29::INFO::2014-04-10 18:52:01,757::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-29::DEBUG::2014-04-10 18:52:01,757::task::1168::TaskManager.Task::(prepare) Task=`26cc791a-b96b-44be-99bc-a80d987ef7d9`::finished: {}
>Thread-29::DEBUG::2014-04-10 18:52:01,757::task::579::TaskManager.Task::(_updateState) Task=`26cc791a-b96b-44be-99bc-a80d987ef7d9`::moving from state preparing -> state finished
>Thread-29::DEBUG::2014-04-10 18:52:01,757::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-29::DEBUG::2014-04-10 18:52:01,757::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-29::DEBUG::2014-04-10 18:52:01,758::task::974::TaskManager.Task::(_decref) Task=`26cc791a-b96b-44be-99bc-a80d987ef7d9`::ref 0 aborting False
>Thread-30::DEBUG::2014-04-10 18:52:01,787::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call setMOMPolicyParameters with ({'balloonEnabled': False},) {} flowID [575cc023]
>Thread-30::DEBUG::2014-04-10 18:52:01,893::BindingXMLRPC::982::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-31::DEBUG::2014-04-10 18:52:02,180::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-31::DEBUG::2014-04-10 18:52:02,180::task::579::TaskManager.Task::(_updateState) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::moving from state init -> state preparing
>Thread-31::INFO::2014-04-10 18:52:02,181::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-31::ERROR::2014-04-10 18:52:02,181::task::850::TaskManager.Task::(_setError) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 622, in getSpmStatus
>    pool = self.getPool(spUUID)
>  File "/usr/share/vdsm/storage/hsm.py", line 321, in getPool
>    raise se.StoragePoolUnknown(spUUID)
>StoragePoolUnknown: Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)
>Thread-31::DEBUG::2014-04-10 18:52:02,181::task::869::TaskManager.Task::(_run) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::Task._run: c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-31::DEBUG::2014-04-10 18:52:02,181::task::1194::TaskManager.Task::(stop) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::stopping in state preparing (force False)
>Thread-31::DEBUG::2014-04-10 18:52:02,181::task::974::TaskManager.Task::(_decref) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::ref 1 aborting True
>Thread-31::INFO::2014-04-10 18:52:02,182::task::1151::TaskManager.Task::(prepare) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309
>Thread-31::DEBUG::2014-04-10 18:52:02,182::task::1156::TaskManager.Task::(prepare) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::Prepare: aborted: Unknown pool id, pool not connected
>Thread-31::DEBUG::2014-04-10 18:52:02,182::task::974::TaskManager.Task::(_decref) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::ref 0 aborting True
>Thread-31::DEBUG::2014-04-10 18:52:02,182::task::909::TaskManager.Task::(_doAbort) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::Task._doAbort: force False
>Thread-31::DEBUG::2014-04-10 18:52:02,182::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-31::DEBUG::2014-04-10 18:52:02,182::task::579::TaskManager.Task::(_updateState) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::moving from state preparing -> state aborting
>Thread-31::DEBUG::2014-04-10 18:52:02,183::task::534::TaskManager.Task::(__state_aborting) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::_aborting: recover policy none
>Thread-31::DEBUG::2014-04-10 18:52:02,183::task::579::TaskManager.Task::(_updateState) Task=`c19d0eb9-d66b-4d0f-901c-ec69c4aab6fe`::moving from state aborting -> state failed
>Thread-31::DEBUG::2014-04-10 18:52:02,183::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-31::DEBUG::2014-04-10 18:52:02,183::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-31::ERROR::2014-04-10 18:52:02,183::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)", 'code': 309}}
>Thread-32::DEBUG::2014-04-10 18:52:02,199::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-32::DEBUG::2014-04-10 18:52:02,200::task::579::TaskManager.Task::(_updateState) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::moving from state init -> state preparing
>Thread-32::INFO::2014-04-10 18:52:02,200::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='55cb7668-7c5e-4553-b263-c6f3f86b358f', masterVersion=6, options=None)
>Thread-32::DEBUG::2014-04-10 18:52:02,201::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`18f1efe3-c2c2-4918-8adb-4e3f81333d8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1013' at 'connectStoragePool'
>Thread-32::DEBUG::2014-04-10 18:52:02,201::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-32::DEBUG::2014-04-10 18:52:02,201::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-32::DEBUG::2014-04-10 18:52:02,201::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`18f1efe3-c2c2-4918-8adb-4e3f81333d8c`::Granted request
>Thread-32::DEBUG::2014-04-10 18:52:02,202::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`71316ccc-6c3a-42a0-a2af-9a77781c7280`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1044' at '_connectStoragePool'
>Thread-32::DEBUG::2014-04-10 18:52:02,202::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-32::DEBUG::2014-04-10 18:52:02,202::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-32::DEBUG::2014-04-10 18:52:02,202::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`71316ccc-6c3a-42a0-a2af-9a77781c7280`::Granted request
>Thread-32::INFO::2014-04-10 18:52:02,203::sp::674::Storage.StoragePool::(connect) Connect host #2 to the storage pool f721168f-5edd-4f5f-8976-591eb93f960e with master domain: 55cb7668-7c5e-4553-b263-c6f3f86b358f (ver = 6)
>Thread-32::DEBUG::2014-04-10 18:52:02,203::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,203::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,204::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,204::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,204::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,204::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:02,204::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-32::DEBUG::2014-04-10 18:52:02,205::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-32::DEBUG::2014-04-10 18:52:02,205::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-32::DEBUG::2014-04-10 18:52:02,205::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-32::DEBUG::2014-04-10 18:52:02,205::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-32::DEBUG::2014-04-10 18:52:02,225::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-32::DEBUG::2014-04-10 18:52:02,225::misc::819::SamplingMethod::(__call__) Returning last result
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,080::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,080::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,080::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,080::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,082::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,082::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,082::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:04,082::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-32::DEBUG::2014-04-10 18:52:04,272::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-32::DEBUG::2014-04-10 18:52:04,339::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-32::DEBUG::2014-04-10 18:52:04,340::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,340::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,340::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,340::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,341::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,341::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,341::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-32::ERROR::2014-04-10 18:52:04,341::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-32::ERROR::2014-04-10 18:52:04,341::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-32::DEBUG::2014-04-10 18:52:04,342::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-32::DEBUG::2014-04-10 18:52:04,343::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-32::DEBUG::2014-04-10 18:52:04,494::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-32::WARNING::2014-04-10 18:52:04,495::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-32::DEBUG::2014-04-10 18:52:04,495::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>clientIFinit::DEBUG::2014-04-10 18:52:05,949::task::579::TaskManager.Task::(_updateState) Task=`247576ab-957d-4ad5-b5d9-2cc72ef6fb40`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:05,949::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:05,949::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:05,949::task::1168::TaskManager.Task::(prepare) Task=`247576ab-957d-4ad5-b5d9-2cc72ef6fb40`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:05,949::task::579::TaskManager.Task::(_updateState) Task=`247576ab-957d-4ad5-b5d9-2cc72ef6fb40`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:05,950::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:05,950::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:05,950::task::974::TaskManager.Task::(_decref) Task=`247576ab-957d-4ad5-b5d9-2cc72ef6fb40`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,088::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,089::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,089::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,089::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,090::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,091::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,091::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:09,091::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:10,956::task::579::TaskManager.Task::(_updateState) Task=`3ee7ae8d-d8ca-470a-8d1e-d1777741a7a4`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:10,956::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:10,956::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:10,956::task::1168::TaskManager.Task::(prepare) Task=`3ee7ae8d-d8ca-470a-8d1e-d1777741a7a4`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:10,957::task::579::TaskManager.Task::(_updateState) Task=`3ee7ae8d-d8ca-470a-8d1e-d1777741a7a4`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:10,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:10,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:10,957::task::974::TaskManager.Task::(_decref) Task=`3ee7ae8d-d8ca-470a-8d1e-d1777741a7a4`::ref 0 aborting False
>Thread-39::DEBUG::2014-04-10 18:52:11,078::task::579::TaskManager.Task::(_updateState) Task=`acc75dd6-2bf7-4968-ba55-aa97a4ad2f2c`::moving from state init -> state preparing
>Thread-39::INFO::2014-04-10 18:52:11,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-39::INFO::2014-04-10 18:52:11,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-39::DEBUG::2014-04-10 18:52:11,079::task::1168::TaskManager.Task::(prepare) Task=`acc75dd6-2bf7-4968-ba55-aa97a4ad2f2c`::finished: {}
>Thread-39::DEBUG::2014-04-10 18:52:11,079::task::579::TaskManager.Task::(_updateState) Task=`acc75dd6-2bf7-4968-ba55-aa97a4ad2f2c`::moving from state preparing -> state finished
>Thread-39::DEBUG::2014-04-10 18:52:11,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-39::DEBUG::2014-04-10 18:52:11,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-39::DEBUG::2014-04-10 18:52:11,080::task::974::TaskManager.Task::(_decref) Task=`acc75dd6-2bf7-4968-ba55-aa97a4ad2f2c`::ref 0 aborting False
>Thread-40::DEBUG::2014-04-10 18:52:11,105::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-40::DEBUG::2014-04-10 18:52:11,105::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-40::DEBUG::2014-04-10 18:52:11,105::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-40::DEBUG::2014-04-10 18:52:11,106::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,097::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,098::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,098::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,098::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,099::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,099::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,099::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:14,100::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:15,963::task::579::TaskManager.Task::(_updateState) Task=`1873a58a-58d9-405e-b4e8-b39db89c5ca7`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:15,964::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:15,964::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:15,964::task::1168::TaskManager.Task::(prepare) Task=`1873a58a-58d9-405e-b4e8-b39db89c5ca7`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:15,964::task::579::TaskManager.Task::(_updateState) Task=`1873a58a-58d9-405e-b4e8-b39db89c5ca7`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:15,964::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:15,964::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:15,965::task::974::TaskManager.Task::(_decref) Task=`1873a58a-58d9-405e-b4e8-b39db89c5ca7`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,106::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,106::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,128::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,129::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,130::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,130::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,130::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:19,131::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:20,970::task::579::TaskManager.Task::(_updateState) Task=`27b7ecd9-2770-4dc5-b687-da4612f4a9b6`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:20,971::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:20,971::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:20,971::task::1168::TaskManager.Task::(prepare) Task=`27b7ecd9-2770-4dc5-b687-da4612f4a9b6`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:20,971::task::579::TaskManager.Task::(_updateState) Task=`27b7ecd9-2770-4dc5-b687-da4612f4a9b6`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:20,971::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:20,972::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:20,972::task::974::TaskManager.Task::(_decref) Task=`27b7ecd9-2770-4dc5-b687-da4612f4a9b6`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,137::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,137::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,143::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,143::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,144::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,145::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,145::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:24,145::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:52:25,512::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:52:25,977::task::579::TaskManager.Task::(_updateState) Task=`bf090baa-615b-44d6-883e-66a52dcea96e`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:25,978::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:25,978::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:25,978::task::1168::TaskManager.Task::(prepare) Task=`bf090baa-615b-44d6-883e-66a52dcea96e`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:25,978::task::579::TaskManager.Task::(_updateState) Task=`bf090baa-615b-44d6-883e-66a52dcea96e`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:25,978::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:25,979::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:25,979::task::974::TaskManager.Task::(_decref) Task=`bf090baa-615b-44d6-883e-66a52dcea96e`::ref 0 aborting False
>Thread-45::DEBUG::2014-04-10 18:52:26,379::task::579::TaskManager.Task::(_updateState) Task=`4a9769d1-279b-443c-8694-9fec71b110cd`::moving from state init -> state preparing
>Thread-45::INFO::2014-04-10 18:52:26,379::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-45::INFO::2014-04-10 18:52:26,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-45::DEBUG::2014-04-10 18:52:26,379::task::1168::TaskManager.Task::(prepare) Task=`4a9769d1-279b-443c-8694-9fec71b110cd`::finished: {}
>Thread-45::DEBUG::2014-04-10 18:52:26,380::task::579::TaskManager.Task::(_updateState) Task=`4a9769d1-279b-443c-8694-9fec71b110cd`::moving from state preparing -> state finished
>Thread-45::DEBUG::2014-04-10 18:52:26,380::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-45::DEBUG::2014-04-10 18:52:26,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-45::DEBUG::2014-04-10 18:52:26,380::task::974::TaskManager.Task::(_decref) Task=`4a9769d1-279b-443c-8694-9fec71b110cd`::ref 0 aborting False
>Thread-46::DEBUG::2014-04-10 18:52:26,405::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-46::DEBUG::2014-04-10 18:52:26,405::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-46::DEBUG::2014-04-10 18:52:26,405::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-46::DEBUG::2014-04-10 18:52:26,405::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-47::DEBUG::2014-04-10 18:52:27,411::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [318f801]
>Thread-47::DEBUG::2014-04-10 18:52:27,412::task::579::TaskManager.Task::(_updateState) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::moving from state init -> state preparing
>Thread-47::INFO::2014-04-10 18:52:27,412::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-47::ERROR::2014-04-10 18:52:27,412::task::850::TaskManager.Task::(_setError) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 2119, in getAllTasksStatuses
>    raise se.SpmStatusError()
>SpmStatusError: Not SPM: ()
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::869::TaskManager.Task::(_run) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::Task._run: 756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2 () {} failed - stopping task
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::1194::TaskManager.Task::(stop) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::stopping in state preparing (force False)
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::974::TaskManager.Task::(_decref) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::ref 1 aborting True
>Thread-47::INFO::2014-04-10 18:52:27,413::task::1151::TaskManager.Task::(prepare) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::aborting: Task is aborted: 'Not SPM' - code 654
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::1156::TaskManager.Task::(prepare) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::Prepare: aborted: Not SPM
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::974::TaskManager.Task::(_decref) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::ref 0 aborting True
>Thread-47::DEBUG::2014-04-10 18:52:27,413::task::909::TaskManager.Task::(_doAbort) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::Task._doAbort: force False
>Thread-47::DEBUG::2014-04-10 18:52:27,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-47::DEBUG::2014-04-10 18:52:27,414::task::579::TaskManager.Task::(_updateState) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::moving from state preparing -> state aborting
>Thread-47::DEBUG::2014-04-10 18:52:27,414::task::534::TaskManager.Task::(__state_aborting) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::_aborting: recover policy none
>Thread-47::DEBUG::2014-04-10 18:52:27,414::task::579::TaskManager.Task::(_updateState) Task=`756f71ba-cdd6-4d4f-ac37-e4b8f9db4ef2`::moving from state aborting -> state failed
>Thread-47::DEBUG::2014-04-10 18:52:27,414::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-47::DEBUG::2014-04-10 18:52:27,414::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-47::ERROR::2014-04-10 18:52:27,414::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Not SPM: ()', 'code': 654}}
>Thread-48::DEBUG::2014-04-10 18:52:27,449::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [318f801]
>Thread-48::DEBUG::2014-04-10 18:52:27,450::task::579::TaskManager.Task::(_updateState) Task=`a5f25613-090a-4cfa-b550-2d33b6e8e291`::moving from state init -> state preparing
>Thread-48::INFO::2014-04-10 18:52:27,450::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-48::WARNING::2014-04-10 18:52:27,450::hsm::1106::Storage.HSM::(disconnectStoragePool) disconnect sp: f721168f-5edd-4f5f-8976-591eb93f960e failed. Known pools {}
>Thread-48::INFO::2014-04-10 18:52:27,450::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None
>Thread-48::DEBUG::2014-04-10 18:52:27,450::task::1168::TaskManager.Task::(prepare) Task=`a5f25613-090a-4cfa-b550-2d33b6e8e291`::finished: None
>Thread-48::DEBUG::2014-04-10 18:52:27,450::task::579::TaskManager.Task::(_updateState) Task=`a5f25613-090a-4cfa-b550-2d33b6e8e291`::moving from state preparing -> state finished
>Thread-48::DEBUG::2014-04-10 18:52:27,451::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-48::DEBUG::2014-04-10 18:52:27,451::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-48::DEBUG::2014-04-10 18:52:27,451::task::974::TaskManager.Task::(_decref) Task=`a5f25613-090a-4cfa-b550-2d33b6e8e291`::ref 0 aborting False
>Thread-49::DEBUG::2014-04-10 18:52:27,470::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [318f801]
>Thread-49::DEBUG::2014-04-10 18:52:27,471::task::579::TaskManager.Task::(_updateState) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::moving from state init -> state preparing
>Thread-49::INFO::2014-04-10 18:52:27,471::logUtils::44::dispatcher::(wrapper) Run and protect: reconstructMaster(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', poolName='NFS_shyu', masterDom='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', domDict={'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'active'}, masterVersion=7, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, hostId=2, options=None)
>Thread-49::INFO::2014-04-10 18:52:27,471::hsm::1866::Storage.HSM::(reconstructMaster) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e master=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::DEBUG::2014-04-10 18:52:27,489::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::DEBUG::2014-04-10 18:52:27,565::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-49::DEBUG::2014-04-10 18:52:27,572::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-49::DEBUG::2014-04-10 18:52:27,574::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-49::DEBUG::2014-04-10 18:52:27,574::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS'
>Thread-49::DEBUG::2014-04-10 18:52:27,574::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS'
>Thread-49::INFO::2014-04-10 18:52:27,575::fileSD::299::Storage.StorageDomain::(validate) sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::DEBUG::2014-04-10 18:52:27,579::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-49::DEBUG::2014-04-10 18:52:27,580::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0f09529d-691a-490c-84a0-5e653cb8bab2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1880' at 'reconstructMaster'
>Thread-49::DEBUG::2014-04-10 18:52:27,580::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-49::DEBUG::2014-04-10 18:52:27,580::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,151::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,152::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,176::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,176::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,177::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,178::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,178::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:29,178::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:30,985::task::579::TaskManager.Task::(_updateState) Task=`e1b43b6c-c7d2-4c64-9218-95d2cccd9e8d`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:30,985::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:30,985::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:30,985::task::1168::TaskManager.Task::(prepare) Task=`e1b43b6c-c7d2-4c64-9218-95d2cccd9e8d`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:30,986::task::579::TaskManager.Task::(_updateState) Task=`e1b43b6c-c7d2-4c64-9218-95d2cccd9e8d`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:30,986::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:30,986::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:30,986::task::974::TaskManager.Task::(_decref) Task=`e1b43b6c-c7d2-4c64-9218-95d2cccd9e8d`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,184::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,185::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,194::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,194::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,196::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,196::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,196::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:34,196::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:35,992::task::579::TaskManager.Task::(_updateState) Task=`c600753a-2615-449a-ab35-18b8b13746fc`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:35,992::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:35,993::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:35,993::task::1168::TaskManager.Task::(prepare) Task=`c600753a-2615-449a-ab35-18b8b13746fc`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:35,993::task::579::TaskManager.Task::(_updateState) Task=`c600753a-2615-449a-ab35-18b8b13746fc`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:35,993::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:35,994::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:35,994::task::974::TaskManager.Task::(_decref) Task=`c600753a-2615-449a-ab35-18b8b13746fc`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,203::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,203::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,214::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,214::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,215::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,215::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,215::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:39,215::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:40,999::task::579::TaskManager.Task::(_updateState) Task=`c66f4f6a-5de1-4cf1-a4b7-2d173039b867`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:41,000::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:41,000::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:41,000::task::1168::TaskManager.Task::(prepare) Task=`c66f4f6a-5de1-4cf1-a4b7-2d173039b867`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:41,000::task::579::TaskManager.Task::(_updateState) Task=`c66f4f6a-5de1-4cf1-a4b7-2d173039b867`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:41,001::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:41,001::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:41,001::task::974::TaskManager.Task::(_decref) Task=`c66f4f6a-5de1-4cf1-a4b7-2d173039b867`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,218::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,218::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,229::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,229::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,231::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,231::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,231::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:44,231::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:46,007::task::579::TaskManager.Task::(_updateState) Task=`4fc69a12-7516-4557-b5f5-153c41cf9921`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:46,007::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:46,008::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:46,008::task::1168::TaskManager.Task::(prepare) Task=`4fc69a12-7516-4557-b5f5-153c41cf9921`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:46,008::task::579::TaskManager.Task::(_updateState) Task=`4fc69a12-7516-4557-b5f5-153c41cf9921`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:46,008::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:46,008::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:46,008::task::974::TaskManager.Task::(_decref) Task=`4fc69a12-7516-4557-b5f5-153c41cf9921`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,238::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,238::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,254::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,255::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,256::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,256::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,256::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:49,256::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:52:51,014::task::579::TaskManager.Task::(_updateState) Task=`33dca280-7d67-4375-b9f0-faa65ba0cddc`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:51,015::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:51,015::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:51,015::task::1168::TaskManager.Task::(prepare) Task=`33dca280-7d67-4375-b9f0-faa65ba0cddc`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:51,015::task::579::TaskManager.Task::(_updateState) Task=`33dca280-7d67-4375-b9f0-faa65ba0cddc`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:51,016::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:51,016::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:51,016::task::974::TaskManager.Task::(_decref) Task=`33dca280-7d67-4375-b9f0-faa65ba0cddc`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,263::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,263::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,275::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,275::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,276::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,276::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,276::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:54,277::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:52:55,548::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:52:56,022::task::579::TaskManager.Task::(_updateState) Task=`3b3c0773-eb81-41c5-9d38-2fa406226c61`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:52:56,022::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:52:56,023::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:56,023::task::1168::TaskManager.Task::(prepare) Task=`3b3c0773-eb81-41c5-9d38-2fa406226c61`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:52:56,023::task::579::TaskManager.Task::(_updateState) Task=`3b3c0773-eb81-41c5-9d38-2fa406226c61`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:52:56,023::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:52:56,023::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:52:56,023::task::974::TaskManager.Task::(_decref) Task=`3b3c0773-eb81-41c5-9d38-2fa406226c61`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,283::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,283::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,301::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,301::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,302::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,302::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,303::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:52:59,303::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:53:01,029::task::579::TaskManager.Task::(_updateState) Task=`7d8e69d3-96af-4634-9732-0df644ca0b68`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:01,030::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:01,030::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:01,030::task::1168::TaskManager.Task::(prepare) Task=`7d8e69d3-96af-4634-9732-0df644ca0b68`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:01,030::task::579::TaskManager.Task::(_updateState) Task=`7d8e69d3-96af-4634-9732-0df644ca0b68`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:01,031::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:01,031::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:01,031::task::974::TaskManager.Task::(_decref) Task=`7d8e69d3-96af-4634-9732-0df644ca0b68`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,310::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,311::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,327::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,328::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,330::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,332::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,333::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:04,333::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-34::WARNING::2014-04-10 18:53:04,521::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-34::DEBUG::2014-04-10 18:53:04,522::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-36::WARNING::2014-04-10 18:53:04,523::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-36::DEBUG::2014-04-10 18:53:04,525::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-32::ERROR::2014-04-10 18:53:04,526::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-32::DEBUG::2014-04-10 18:53:04,527::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-32::DEBUG::2014-04-10 18:53:04,527::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-32::DEBUG::2014-04-10 18:53:04,527::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-32::DEBUG::2014-04-10 18:53:04,527::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-32::DEBUG::2014-04-10 18:53:04,527::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0f09529d-691a-490c-84a0-5e653cb8bab2`::Granted request
>Thread-32::DEBUG::2014-04-10 18:53:04,528::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - exclusive: granted' was granted
>Thread-49::DEBUG::2014-04-10 18:53:04,529::task::811::TaskManager.Task::(resourceAcquired) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-32::DEBUG::2014-04-10 18:53:04,530::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-49::DEBUG::2014-04-10 18:53:04,530::task::974::TaskManager.Task::(_decref) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::ref 1 aborting False
>Thread-32::DEBUG::2014-04-10 18:53:04,532::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-49::INFO::2014-04-10 18:53:04,532::sp::780::Storage.StoragePool::(reconstructMaster) spUUID=f721168f-5edd-4f5f-8976-591eb93f960e hostId=2 poolName=NFS_shyu msdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 domDict={'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'active'} masterVersion=7 leaseparams=({'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5})
>Thread-32::DEBUG::2014-04-10 18:53:04,533::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-49::INFO::2014-04-10 18:53:04,533::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>Thread-32::DEBUG::2014-04-10 18:53:04,534::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-32::ERROR::2014-04-10 18:53:04,535::task::850::TaskManager.Task::(_setError) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 1015, in connectStoragePool
>    masterVersion, options)
>  File "/usr/share/vdsm/storage/hsm.py", line 1069, in _connectStoragePool
>    res = pool.connect(hostID, scsiKey, msdUUID, masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 692, in connect
>    self.__rebuild(msdUUID=msdUUID, masterVersion=masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 1238, in __rebuild
>    masterVersion=masterVersion)
>  File "/usr/share/vdsm/storage/sp.py", line 1508, in getMasterDomain
>    raise se.StoragePoolMasterNotFound(self.spUUID, msdUUID)
>StoragePoolMasterNotFound: Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-32::DEBUG::2014-04-10 18:53:04,535::task::869::TaskManager.Task::(_run) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::Task._run: a3351fd6-064f-4ebf-ad94-de910449f9cb ('f721168f-5edd-4f5f-8976-591eb93f960e', 2, 'f721168f-5edd-4f5f-8976-591eb93f960e', '55cb7668-7c5e-4553-b263-c6f3f86b358f', 6) {} failed - stopping task
>Thread-32::DEBUG::2014-04-10 18:53:04,536::task::1194::TaskManager.Task::(stop) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::stopping in state preparing (force False)
>Thread-32::DEBUG::2014-04-10 18:53:04,536::task::974::TaskManager.Task::(_decref) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::ref 1 aborting True
>Thread-32::INFO::2014-04-10 18:53:04,536::task::1151::TaskManager.Task::(prepare) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::aborting: Task is aborted: 'Cannot find master domain' - code 304
>Thread-32::DEBUG::2014-04-10 18:53:04,537::task::1156::TaskManager.Task::(prepare) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::Prepare: aborted: Cannot find master domain
>Thread-32::DEBUG::2014-04-10 18:53:04,537::task::974::TaskManager.Task::(_decref) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::ref 0 aborting True
>Thread-32::DEBUG::2014-04-10 18:53:04,537::task::909::TaskManager.Task::(_doAbort) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::Task._doAbort: force False
>Thread-32::DEBUG::2014-04-10 18:53:04,537::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-32::DEBUG::2014-04-10 18:53:04,537::task::579::TaskManager.Task::(_updateState) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::moving from state preparing -> state aborting
>Thread-32::DEBUG::2014-04-10 18:53:04,538::task::534::TaskManager.Task::(__state_aborting) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::_aborting: recover policy none
>Thread-32::DEBUG::2014-04-10 18:53:04,538::task::579::TaskManager.Task::(_updateState) Task=`a3351fd6-064f-4ebf-ad94-de910449f9cb`::moving from state aborting -> state failed
>Thread-32::DEBUG::2014-04-10 18:53:04,538::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-32::DEBUG::2014-04-10 18:53:04,538::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-32::ERROR::2014-04-10 18:53:04,538::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Cannot find master domain: 'spUUID=f721168f-5edd-4f5f-8976-591eb93f960e, msdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f'", 'code': 304}}
>clientIFinit::DEBUG::2014-04-10 18:53:06,037::task::579::TaskManager.Task::(_updateState) Task=`103e6549-9646-47d9-8dc5-3bdbe523e103`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:06,037::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:06,037::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:06,038::task::1168::TaskManager.Task::(prepare) Task=`103e6549-9646-47d9-8dc5-3bdbe523e103`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:06,038::task::579::TaskManager.Task::(_updateState) Task=`103e6549-9646-47d9-8dc5-3bdbe523e103`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:06,038::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:06,038::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:06,038::task::974::TaskManager.Task::(_decref) Task=`103e6549-9646-47d9-8dc5-3bdbe523e103`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,341::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,341::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,355::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,355::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,357::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,357::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,357::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:09,357::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:53:11,044::task::579::TaskManager.Task::(_updateState) Task=`c58b2ca5-89cb-4dd5-9b85-df4161ee7b5f`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:11,044::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:11,045::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:11,045::task::1168::TaskManager.Task::(prepare) Task=`c58b2ca5-89cb-4dd5-9b85-df4161ee7b5f`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:11,045::task::579::TaskManager.Task::(_updateState) Task=`c58b2ca5-89cb-4dd5-9b85-df4161ee7b5f`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:11,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:11,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:11,045::task::974::TaskManager.Task::(_decref) Task=`c58b2ca5-89cb-4dd5-9b85-df4161ee7b5f`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,364::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,364::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,387::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,387::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,388::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,388::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,388::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:14,388::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-58::DEBUG::2014-04-10 18:53:14,579::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-58::DEBUG::2014-04-10 18:53:14,579::task::579::TaskManager.Task::(_updateState) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::moving from state init -> state preparing
>Thread-58::INFO::2014-04-10 18:53:14,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-58::ERROR::2014-04-10 18:53:14,580::task::850::TaskManager.Task::(_setError) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 622, in getSpmStatus
>    pool = self.getPool(spUUID)
>  File "/usr/share/vdsm/storage/hsm.py", line 321, in getPool
>    raise se.StoragePoolUnknown(spUUID)
>StoragePoolUnknown: Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)
>Thread-58::DEBUG::2014-04-10 18:53:14,580::task::869::TaskManager.Task::(_run) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::Task._run: a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1 ('f721168f-5edd-4f5f-8976-591eb93f960e',) {} failed - stopping task
>Thread-58::DEBUG::2014-04-10 18:53:14,580::task::1194::TaskManager.Task::(stop) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::stopping in state preparing (force False)
>Thread-58::DEBUG::2014-04-10 18:53:14,580::task::974::TaskManager.Task::(_decref) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::ref 1 aborting True
>Thread-58::INFO::2014-04-10 18:53:14,581::task::1151::TaskManager.Task::(prepare) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::1156::TaskManager.Task::(prepare) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::Prepare: aborted: Unknown pool id, pool not connected
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::974::TaskManager.Task::(_decref) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::ref 0 aborting True
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::909::TaskManager.Task::(_doAbort) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::Task._doAbort: force False
>Thread-58::DEBUG::2014-04-10 18:53:14,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::579::TaskManager.Task::(_updateState) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::moving from state preparing -> state aborting
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::534::TaskManager.Task::(__state_aborting) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::_aborting: recover policy none
>Thread-58::DEBUG::2014-04-10 18:53:14,581::task::579::TaskManager.Task::(_updateState) Task=`a97f4100-bd9d-43d2-9b3e-c45b3a57a1c1`::moving from state aborting -> state failed
>Thread-58::DEBUG::2014-04-10 18:53:14,582::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-58::DEBUG::2014-04-10 18:53:14,582::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-58::ERROR::2014-04-10 18:53:14,582::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('f721168f-5edd-4f5f-8976-591eb93f960e',)", 'code': 309}}
>Thread-59::DEBUG::2014-04-10 18:53:14,600::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-59::DEBUG::2014-04-10 18:53:14,600::task::579::TaskManager.Task::(_updateState) Task=`85b66f10-e8c4-49cd-b2af-36c6e8e5daea`::moving from state init -> state preparing
>Thread-59::INFO::2014-04-10 18:53:14,601::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', masterVersion=7, options=None)
>Thread-59::DEBUG::2014-04-10 18:53:14,601::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8dfa3a89-3d0b-46f8-84b1-bf92b2df309e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1013' at 'connectStoragePool'
>Thread-59::DEBUG::2014-04-10 18:53:14,601::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-59::DEBUG::2014-04-10 18:53:14,601::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-59::DEBUG::2014-04-10 18:53:14,602::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8dfa3a89-3d0b-46f8-84b1-bf92b2df309e`::Granted request
>Thread-59::DEBUG::2014-04-10 18:53:14,602::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0551044-40a5-4c2d-8155-1b2dee59e930`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1044' at '_connectStoragePool'
>Thread-59::DEBUG::2014-04-10 18:53:14,602::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-59::DEBUG::2014-04-10 18:53:14,602::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>clientIFinit::DEBUG::2014-04-10 18:53:16,051::task::579::TaskManager.Task::(_updateState) Task=`c108d216-f749-40a8-ba42-7e468bdfdd20`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:16,052::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:16,052::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:16,052::task::1168::TaskManager.Task::(prepare) Task=`c108d216-f749-40a8-ba42-7e468bdfdd20`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:16,052::task::579::TaskManager.Task::(_updateState) Task=`c108d216-f749-40a8-ba42-7e468bdfdd20`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:16,052::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:16,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:16,053::task::974::TaskManager.Task::(_decref) Task=`c108d216-f749-40a8-ba42-7e468bdfdd20`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,395::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,395::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,413::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,413::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,414::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,414::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,415::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:19,415::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:53:21,058::task::579::TaskManager.Task::(_updateState) Task=`9d4a410f-5745-479b-a206-45f860be76b9`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:21,059::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:21,059::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:21,059::task::1168::TaskManager.Task::(prepare) Task=`9d4a410f-5745-479b-a206-45f860be76b9`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:21,059::task::579::TaskManager.Task::(_updateState) Task=`9d4a410f-5745-479b-a206-45f860be76b9`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:21,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:21,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:21,060::task::974::TaskManager.Task::(_decref) Task=`9d4a410f-5745-479b-a206-45f860be76b9`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,421::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,421::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,431::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,431::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,432::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,432::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,432::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:24,433::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-49::DEBUG::2014-04-10 18:53:25,538::clusterlock::192::SANLock::(acquireHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>Thread-49::INFO::2014-04-10 18:53:25,539::clusterlock::225::SANLock::(acquire) Acquiring cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>VM Channels Listener::DEBUG::2014-04-10 18:53:25,584::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-49::DEBUG::2014-04-10 18:53:25,593::clusterlock::251::SANLock::(acquire) Cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>Thread-49::INFO::2014-04-10 18:53:25,593::sp::754::Storage.StoragePool::(createMaster) setting master domain for spUUID f721168f-5edd-4f5f-8976-591eb93f960e on sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::DEBUG::2014-04-10 18:53:25,594::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,594::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,600::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=3', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=a4fca68c36842f81adbc84df4ce1a3ae73d93d6c']
>Thread-49::WARNING::2014-04-10 18:53:25,600::sd::498::Storage.StorageDomain::(attach) domain `f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76` is already attached to pool `f721168f-5edd-4f5f-8976-591eb93f960e`
>Thread-49::DEBUG::2014-04-10 18:53:25,601::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,601::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,601::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-49::DEBUG::2014-04-10 18:53:25,601::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=de51790a799253cc95019f396104197391f2e3a1']
>Thread-49::DEBUG::2014-04-10 18:53:25,640::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-49::INFO::2014-04-10 18:53:25,640::sp::810::Storage.StoragePool::(reconstructMaster) Set storage pool domains: {'22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': 'Attached', 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': 'Active', '55cb7668-7c5e-4553-b263-c6f3f86b358f': 'Active', 'dbec8cee-b5e4-4011-9dd5-7c122389a878': 'Active', '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': 'Active'}
>Thread-49::DEBUG::2014-04-10 18:53:25,640::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,641::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-49::DEBUG::2014-04-10 18:53:25,641::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-49::DEBUG::2014-04-10 18:53:25,674::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-49::DEBUG::2014-04-10 18:53:25,674::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,674::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,675::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,675::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,675::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,675::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:25,675::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-49::DEBUG::2014-04-10 18:53:25,676::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-49::DEBUG::2014-04-10 18:53:25,676::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-49::DEBUG::2014-04-10 18:53:25,676::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-49::DEBUG::2014-04-10 18:53:25,676::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-49::DEBUG::2014-04-10 18:53:25,690::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-49::DEBUG::2014-04-10 18:53:25,690::misc::819::SamplingMethod::(__call__) Returning last result
>clientIFinit::DEBUG::2014-04-10 18:53:26,066::task::579::TaskManager.Task::(_updateState) Task=`85479d2b-e0fe-44de-81f3-c8f9147f41a4`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:26,066::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:26,067::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:26,067::task::1168::TaskManager.Task::(prepare) Task=`85479d2b-e0fe-44de-81f3-c8f9147f41a4`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:26,067::task::579::TaskManager.Task::(_updateState) Task=`85479d2b-e0fe-44de-81f3-c8f9147f41a4`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:26,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:26,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:26,068::task::974::TaskManager.Task::(_decref) Task=`85479d2b-e0fe-44de-81f3-c8f9147f41a4`::ref 0 aborting False
>Thread-51::WARNING::2014-04-10 18:53:27,486::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-53::WARNING::2014-04-10 18:53:27,488::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-51::DEBUG::2014-04-10 18:53:27,489::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-53::DEBUG::2014-04-10 18:53:27,490::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,439::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,439::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,459::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,460::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,461::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,461::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,461::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:29,462::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-49::DEBUG::2014-04-10 18:53:29,717::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-49::DEBUG::2014-04-10 18:53:29,760::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-49::DEBUG::2014-04-10 18:53:29,761::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,761::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,761::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,762::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,762::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,762::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,762::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-49::DEBUG::2014-04-10 18:53:29,789::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::DEBUG::2014-04-10 18:53:29,790::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-49::DEBUG::2014-04-10 18:53:29,796::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-49::DEBUG::2014-04-10 18:53:29,798::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-49::INFO::2014-04-10 18:53:29,798::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-49::INFO::2014-04-10 18:53:29,798::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-49::DEBUG::2014-04-10 18:53:29,799::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 verified, version 7
>Thread-49::DEBUG::2014-04-10 18:53:29,799::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-49::DEBUG::2014-04-10 18:53:29,799::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-49::DEBUG::2014-04-10 18:53:29,804::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-49::INFO::2014-04-10 18:53:29,804::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-49::DEBUG::2014-04-10 18:53:29,805::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `55cb7668-7c5e-4553-b263-c6f3f86b358f`
>Thread-64::DEBUG::2014-04-10 18:53:29,805::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-49::INFO::2014-04-10 18:53:29,806::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-64::ERROR::2014-04-10 18:53:29,807::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 18:53:29,808::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-49::DEBUG::2014-04-10 18:53:29,809::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`
>Thread-65::DEBUG::2014-04-10 18:53:29,809::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::INFO::2014-04-10 18:53:29,812::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-64::DEBUG::2014-04-10 18:53:29,813::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 18:53:29,817::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-49::DEBUG::2014-04-10 18:53:29,817::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `dbec8cee-b5e4-4011-9dd5-7c122389a878`
>Thread-66::ERROR::2014-04-10 18:53:29,821::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-49::INFO::2014-04-10 18:53:29,821::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-66::ERROR::2014-04-10 18:53:29,824::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-49::DEBUG::2014-04-10 18:53:29,828::sp::1562::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `f721168f-5edd-4f5f-8976-591eb93f960e` started monitoring domain `65eafe2b-4fa9-4ea1-a869-7deb5afd4654`
>Thread-67::DEBUG::2014-04-10 18:53:29,828::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-66::DEBUG::2014-04-10 18:53:29,831::lvm::386::OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-49::DEBUG::2014-04-10 18:53:29,832::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-64::DEBUG::2014-04-10 18:53:29,853::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-66::DEBUG::2014-04-10 18:53:29,895::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-49::DEBUG::2014-04-10 18:53:29,899::lvm::386::OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-67::DEBUG::2014-04-10 18:53:29,937::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-49::DEBUG::2014-04-10 18:53:29,939::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:53:29,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:53:29,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000373472 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 18:53:29,976::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 changed its status to Valid
>Thread-72::DEBUG::2014-04-10 18:53:29,977::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-72::DEBUG::2014-04-10 18:53:29,977::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-72::DEBUG::2014-04-10 18:53:29,978::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-73::INFO::2014-04-10 18:53:29,979::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-64::DEBUG::2014-04-10 18:53:30,021::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 18:53:30,022::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-67::DEBUG::2014-04-10 18:53:30,040::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-66::DEBUG::2014-04-10 18:53:30,055::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 18:53:30,056::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-67::DEBUG::2014-04-10 18:53:30,084::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 18:53:30,088::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::DEBUG::2014-04-10 18:53:30,089::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS'
>Thread-67::DEBUG::2014-04-10 18:53:30,090::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS'
>Thread-67::DEBUG::2014-04-10 18:53:30,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-49::DEBUG::2014-04-10 18:53:30,113::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-49::WARNING::2014-04-10 18:53:30,116::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-49::DEBUG::2014-04-10 18:53:30,118::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 18:53:30,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000341241 s, 1.1 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:53:30,149::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 changed its status to Valid
>Thread-86::DEBUG::2014-04-10 18:53:30,156::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-86::DEBUG::2014-04-10 18:53:30,156::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-86::DEBUG::2014-04-10 18:53:30,157::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-87::INFO::2014-04-10 18:53:30,158::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>clientIFinit::DEBUG::2014-04-10 18:53:31,073::task::579::TaskManager.Task::(_updateState) Task=`2f6f1aaf-4a6d-4aac-96bb-7a8b989d901f`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:31,074::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:31,074::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:31,074::task::1168::TaskManager.Task::(prepare) Task=`2f6f1aaf-4a6d-4aac-96bb-7a8b989d901f`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:31,074::task::579::TaskManager.Task::(_updateState) Task=`2f6f1aaf-4a6d-4aac-96bb-7a8b989d901f`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:31,074::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:31,075::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:31,075::task::974::TaskManager.Task::(_decref) Task=`2f6f1aaf-4a6d-4aac-96bb-7a8b989d901f`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,468::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,469::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,469::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,469::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,471::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,471::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,471::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:34,471::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:53:36,080::task::579::TaskManager.Task::(_updateState) Task=`458d1140-21f6-4243-ade6-eccef9fc8ebc`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:36,081::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:36,081::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:36,081::task::1168::TaskManager.Task::(prepare) Task=`458d1140-21f6-4243-ade6-eccef9fc8ebc`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:36,081::task::579::TaskManager.Task::(_updateState) Task=`458d1140-21f6-4243-ade6-eccef9fc8ebc`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:36,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:36,082::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:36,082::task::974::TaskManager.Task::(_decref) Task=`458d1140-21f6-4243-ade6-eccef9fc8ebc`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,478::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,478::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,478::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,478::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,480::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,480::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,480::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:39,480::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:53:39,984::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:53:39,992::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000387642 s, 1.7 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:53:40,162::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:53:40,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000356605 s, 1.0 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:53:41,087::task::579::TaskManager.Task::(_updateState) Task=`65645f03-54e7-47ba-84f9-0542270469a9`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:41,088::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:41,113::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:41,113::task::1168::TaskManager.Task::(prepare) Task=`65645f03-54e7-47ba-84f9-0542270469a9`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:41,114::task::579::TaskManager.Task::(_updateState) Task=`65645f03-54e7-47ba-84f9-0542270469a9`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:41,114::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:41,114::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:41,114::task::974::TaskManager.Task::(_decref) Task=`65645f03-54e7-47ba-84f9-0542270469a9`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,487::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,487::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,487::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,487::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,489::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,489::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,489::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:44,489::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:53:46,120::task::579::TaskManager.Task::(_updateState) Task=`feb103bc-6d97-4ad7-9f2b-9e622a2561cc`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:46,120::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:46,133::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:46,134::task::1168::TaskManager.Task::(prepare) Task=`feb103bc-6d97-4ad7-9f2b-9e622a2561cc`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:46,134::task::579::TaskManager.Task::(_updateState) Task=`feb103bc-6d97-4ad7-9f2b-9e622a2561cc`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:46,134::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:46,134::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:46,134::task::974::TaskManager.Task::(_decref) Task=`feb103bc-6d97-4ad7-9f2b-9e622a2561cc`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,496::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,496::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,497::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,497::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,498::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,498::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,498::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:49,499::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:53:50,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:53:50,010::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000379692 s, 1.7 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:53:50,177::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:53:50,184::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366783 s, 1.0 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:53:51,140::task::579::TaskManager.Task::(_updateState) Task=`6673a8bc-7c80-4df8-bd30-e1dbe5876ab4`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:51,140::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:51,147::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:51,148::task::1168::TaskManager.Task::(prepare) Task=`6673a8bc-7c80-4df8-bd30-e1dbe5876ab4`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:51,148::task::579::TaskManager.Task::(_updateState) Task=`6673a8bc-7c80-4df8-bd30-e1dbe5876ab4`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:51,148::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:51,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:51,148::task::974::TaskManager.Task::(_decref) Task=`6673a8bc-7c80-4df8-bd30-e1dbe5876ab4`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,505::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,506::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,506::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,506::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,507::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,507::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,508::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:54,508::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:53:55,617::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:53:56,153::task::579::TaskManager.Task::(_updateState) Task=`0466d9d2-0a2b-4a28-b985-e595e31e548b`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:53:56,153::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:53:56,170::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:56,170::task::1168::TaskManager.Task::(prepare) Task=`0466d9d2-0a2b-4a28-b985-e595e31e548b`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:53:56,170::task::579::TaskManager.Task::(_updateState) Task=`0466d9d2-0a2b-4a28-b985-e595e31e548b`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:53:56,170::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:53:56,170::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:53:56,171::task::974::TaskManager.Task::(_decref) Task=`0466d9d2-0a2b-4a28-b985-e595e31e548b`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,514::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,515::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,515::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,515::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,516::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,517::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,517::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:53:59,517::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:54:00,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:00,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000374226 s, 1.8 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:54:00,192::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:00,198::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000337135 s, 1.1 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:54:01,176::task::579::TaskManager.Task::(_updateState) Task=`85a609e4-e5e3-4fe0-94f8-71e9fff62da1`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:01,177::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:01,190::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:01,190::task::1168::TaskManager.Task::(prepare) Task=`85a609e4-e5e3-4fe0-94f8-71e9fff62da1`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:01,190::task::579::TaskManager.Task::(_updateState) Task=`85a609e4-e5e3-4fe0-94f8-71e9fff62da1`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:01,190::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:01,190::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:01,191::task::974::TaskManager.Task::(_decref) Task=`85a609e4-e5e3-4fe0-94f8-71e9fff62da1`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,524::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,524::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,524::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,524::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,526::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,526::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,526::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:04,526::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:54:06,196::task::579::TaskManager.Task::(_updateState) Task=`b6eaf55c-0371-46af-8b53-fc2a4351c904`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:06,197::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:06,214::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:06,214::task::1168::TaskManager.Task::(prepare) Task=`b6eaf55c-0371-46af-8b53-fc2a4351c904`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:06,214::task::579::TaskManager.Task::(_updateState) Task=`b6eaf55c-0371-46af-8b53-fc2a4351c904`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:06,214::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:06,214::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:06,214::task::974::TaskManager.Task::(_decref) Task=`b6eaf55c-0371-46af-8b53-fc2a4351c904`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,533::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,533::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,533::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,534::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,535::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,536::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:09,536::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:54:10,035::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:10,043::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.00035418 s, 1.9 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:54:10,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:10,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000362874 s, 1.0 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:54:11,221::task::579::TaskManager.Task::(_updateState) Task=`4f2ba896-fb62-49b7-9819-d672537c69ec`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:11,221::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:11,240::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:11,240::task::1168::TaskManager.Task::(prepare) Task=`4f2ba896-fb62-49b7-9819-d672537c69ec`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:11,240::task::579::TaskManager.Task::(_updateState) Task=`4f2ba896-fb62-49b7-9819-d672537c69ec`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:11,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:11,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:11,241::task::974::TaskManager.Task::(_decref) Task=`4f2ba896-fb62-49b7-9819-d672537c69ec`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,543::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,543::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,543::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,543::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,545::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,545::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,545::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:14,545::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:54:16,247::task::579::TaskManager.Task::(_updateState) Task=`c2bdbbbb-ebfc-43c0-8b6e-f103d3462161`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:16,254::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:16,254::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:16,254::task::1168::TaskManager.Task::(prepare) Task=`c2bdbbbb-ebfc-43c0-8b6e-f103d3462161`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:16,254::task::579::TaskManager.Task::(_updateState) Task=`c2bdbbbb-ebfc-43c0-8b6e-f103d3462161`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:16,254::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:16,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:16,255::task::974::TaskManager.Task::(_decref) Task=`c2bdbbbb-ebfc-43c0-8b6e-f103d3462161`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,552::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,553::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,553::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,553::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,555::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,555::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,555::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:19,555::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:54:20,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:20,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000569575 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:54:20,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:20,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000362467 s, 1.0 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:54:21,261::task::579::TaskManager.Task::(_updateState) Task=`bc8818f6-e04a-457e-9818-1b0723c6abc7`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:21,261::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:21,275::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:21,275::task::1168::TaskManager.Task::(prepare) Task=`bc8818f6-e04a-457e-9818-1b0723c6abc7`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:21,275::task::579::TaskManager.Task::(_updateState) Task=`bc8818f6-e04a-457e-9818-1b0723c6abc7`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:21,276::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:21,276::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:21,276::task::974::TaskManager.Task::(_decref) Task=`bc8818f6-e04a-457e-9818-1b0723c6abc7`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,562::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,562::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,562::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,563::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,564::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,564::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,564::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:24,565::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:54:25,650::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:54:26,282::task::579::TaskManager.Task::(_updateState) Task=`85688745-e9b6-4875-9c42-ccb2e73061b3`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:26,282::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:26,300::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:26,300::task::1168::TaskManager.Task::(prepare) Task=`85688745-e9b6-4875-9c42-ccb2e73061b3`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:26,300::task::579::TaskManager.Task::(_updateState) Task=`85688745-e9b6-4875-9c42-ccb2e73061b3`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:26,300::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:26,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:26,301::task::974::TaskManager.Task::(_decref) Task=`85688745-e9b6-4875-9c42-ccb2e73061b3`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,582::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,597::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,613::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,614::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,619::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,624::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,628::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:29,629::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-61::WARNING::2014-04-10 18:54:29,788::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-63::WARNING::2014-04-10 18:54:29,792::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-61::DEBUG::2014-04-10 18:54:29,810::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-63::DEBUG::2014-04-10 18:54:29,820::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-69::WARNING::2014-04-10 18:54:29,881::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-69::DEBUG::2014-04-10 18:54:29,900::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-71::WARNING::2014-04-10 18:54:29,898::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-71::DEBUG::2014-04-10 18:54:29,915::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-75::WARNING::2014-04-10 18:54:30,051::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-77::WARNING::2014-04-10 18:54:30,056::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-75::DEBUG::2014-04-10 18:54:30,065::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-77::DEBUG::2014-04-10 18:54:30,072::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 18:54:30,082::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-79::WARNING::2014-04-10 18:54:30,083::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-64::ERROR::2014-04-10 18:54:30,091::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-81::WARNING::2014-04-10 18:54:30,088::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-79::DEBUG::2014-04-10 18:54:30,098::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::DEBUG::2014-04-10 18:54:30,102::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f changed its status to Invalid
>Thread-81::DEBUG::2014-04-10 18:54:30,106::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-88::DEBUG::2014-04-10 18:54:30,111::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-66::ERROR::2014-04-10 18:54:30,115::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-88::DEBUG::2014-04-10 18:54:30,117::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-66::ERROR::2014-04-10 18:54:30,122::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-88::DEBUG::2014-04-10 18:54:30,127::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-66::DEBUG::2014-04-10 18:54:30,132::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878 changed its status to Invalid
>Thread-90::DEBUG::2014-04-10 18:54:30,138::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-90::DEBUG::2014-04-10 18:54:30,141::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-90::DEBUG::2014-04-10 18:54:30,146::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-83::WARNING::2014-04-10 18:54:30,151::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-83::DEBUG::2014-04-10 18:54:30,155::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-85::WARNING::2014-04-10 18:54:30,156::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-85::DEBUG::2014-04-10 18:54:30,160::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-49::INFO::2014-04-10 18:54:30,162::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-49::INFO::2014-04-10 18:54:30,164::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-49::INFO::2014-04-10 18:54:30,165::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-49::INFO::2014-04-10 18:54:30,167::clusterlock::255::SANLock::(release) Releasing cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 18:54:30,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:30,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000475903 s, 1.4 MB/s\n'; <rc> = 0
>Thread-49::DEBUG::2014-04-10 18:54:30,191::clusterlock::266::SANLock::(release) Cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully released
>Thread-49::INFO::2014-04-10 18:54:30,192::logUtils::47::dispatcher::(wrapper) Run and protect: reconstructMaster, Return response: None
>Thread-49::DEBUG::2014-04-10 18:54:30,193::task::1168::TaskManager.Task::(prepare) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::finished: None
>Thread-49::DEBUG::2014-04-10 18:54:30,193::task::579::TaskManager.Task::(_updateState) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::moving from state preparing -> state finished
>Thread-49::DEBUG::2014-04-10 18:54:30,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-49::DEBUG::2014-04-10 18:54:30,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-49::DEBUG::2014-04-10 18:54:30,194::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-49::DEBUG::2014-04-10 18:54:30,194::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-49::DEBUG::2014-04-10 18:54:30,194::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-49::DEBUG::2014-04-10 18:54:30,194::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-49::DEBUG::2014-04-10 18:54:30,194::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f0551044-40a5-4c2d-8155-1b2dee59e930`::Granted request
>Thread-49::DEBUG::2014-04-10 18:54:30,195::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - exclusive: granted' was granted
>Thread-49::DEBUG::2014-04-10 18:54:30,196::task::974::TaskManager.Task::(_decref) Task=`9635c361-5c90-4523-b981-f8efc3dc76b1`::ref 0 aborting False
>Thread-59::INFO::2014-04-10 18:54:30,196::sp::674::Storage.StoragePool::(connect) Connect host #2 to the storage pool f721168f-5edd-4f5f-8976-591eb93f960e with master domain: f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (ver = 7)
>Thread-59::DEBUG::2014-04-10 18:54:30,198::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,198::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,198::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,199::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,199::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,199::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:30,199::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-59::DEBUG::2014-04-10 18:54:30,200::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-59::DEBUG::2014-04-10 18:54:30,200::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-59::DEBUG::2014-04-10 18:54:30,200::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-59::DEBUG::2014-04-10 18:54:30,200::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-59::DEBUG::2014-04-10 18:54:30,212::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-59::DEBUG::2014-04-10 18:54:30,212::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-67::DEBUG::2014-04-10 18:54:30,233::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-92::DEBUG::2014-04-10 18:54:30,242::task::579::TaskManager.Task::(_updateState) Task=`9fffb4f0-735c-46f7-8d17-769e6e0be05b`::moving from state init -> state preparing
>Thread-92::INFO::2014-04-10 18:54:30,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-92::INFO::2014-04-10 18:54:30,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475903', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362467', 'lastCheck': '10.0', 'valid': True}}
>Thread-92::DEBUG::2014-04-10 18:54:30,243::task::1168::TaskManager.Task::(prepare) Task=`9fffb4f0-735c-46f7-8d17-769e6e0be05b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475903', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362467', 'lastCheck': '10.0', 'valid': True}}
>Thread-92::DEBUG::2014-04-10 18:54:30,243::task::579::TaskManager.Task::(_updateState) Task=`9fffb4f0-735c-46f7-8d17-769e6e0be05b`::moving from state preparing -> state finished
>Thread-92::DEBUG::2014-04-10 18:54:30,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-92::DEBUG::2014-04-10 18:54:30,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-92::DEBUG::2014-04-10 18:54:30,244::task::974::TaskManager.Task::(_decref) Task=`9fffb4f0-735c-46f7-8d17-769e6e0be05b`::ref 0 aborting False
>Thread-93::DEBUG::2014-04-10 18:54:30,259::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [318f801]
>Thread-93::DEBUG::2014-04-10 18:54:30,260::task::579::TaskManager.Task::(_updateState) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::moving from state init -> state preparing
>Thread-93::INFO::2014-04-10 18:54:30,260::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', masterVersion=7, options=None)
>Thread-93::DEBUG::2014-04-10 18:54:30,260::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15c60641-64aa-4f26-a8ad-a60708d9d1a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '867' at 'refreshStoragePool'
>Thread-93::DEBUG::2014-04-10 18:54:30,260::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-93::DEBUG::2014-04-10 18:54:30,261::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>clientIFinit::DEBUG::2014-04-10 18:54:31,307::task::579::TaskManager.Task::(_updateState) Task=`e7ddde9d-96dc-461a-a9ab-d4cde5d76757`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:31,307::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:31,307::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:31,307::task::1168::TaskManager.Task::(prepare) Task=`e7ddde9d-96dc-461a-a9ab-d4cde5d76757`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:31,307::task::579::TaskManager.Task::(_updateState) Task=`e7ddde9d-96dc-461a-a9ab-d4cde5d76757`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:31,308::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:31,308::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:31,308::task::974::TaskManager.Task::(_decref) Task=`e7ddde9d-96dc-461a-a9ab-d4cde5d76757`::ref 0 aborting False
>Thread-59::DEBUG::2014-04-10 18:54:33,259::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-59::DEBUG::2014-04-10 18:54:33,301::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-59::DEBUG::2014-04-10 18:54:33,301::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,302::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,302::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,302::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,302::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,303::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,303::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-67::DEBUG::2014-04-10 18:54:33,304::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-67::DEBUG::2014-04-10 18:54:33,307::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-67::DEBUG::2014-04-10 18:54:33,311::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-67::DEBUG::2014-04-10 18:54:33,332::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-59::DEBUG::2014-04-10 18:54:33,342::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-59::DEBUG::2014-04-10 18:54:33,344::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 18:54:33,346::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-67::DEBUG::2014-04-10 18:54:33,347::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-59::DEBUG::2014-04-10 18:54:33,350::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-59::DEBUG::2014-04-10 18:54:33,353::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-59::INFO::2014-04-10 18:54:33,353::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-59::INFO::2014-04-10 18:54:33,353::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-59::DEBUG::2014-04-10 18:54:33,354::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 verified, version 7
>Thread-59::DEBUG::2014-04-10 18:54:33,354::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-59::DEBUG::2014-04-10 18:54:33,354::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-59::DEBUG::2014-04-10 18:54:33,360::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-59::DEBUG::2014-04-10 18:54:33,360::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-59::WARNING::2014-04-10 18:54:33,361::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e already exists
>Thread-59::DEBUG::2014-04-10 18:54:33,361::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-59::DEBUG::2014-04-10 18:54:33,362::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-59::DEBUG::2014-04-10 18:54:33,505::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-59::WARNING::2014-04-10 18:54:33,506::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-59::DEBUG::2014-04-10 18:54:33,506::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,639::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,640::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,640::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,640::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,641::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,641::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,642::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:34,642::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:54:36,314::task::579::TaskManager.Task::(_updateState) Task=`ce2d03a9-63dc-4bae-b266-a7fda22138c3`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:36,314::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:36,314::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:36,314::task::1168::TaskManager.Task::(prepare) Task=`ce2d03a9-63dc-4bae-b266-a7fda22138c3`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:36,314::task::579::TaskManager.Task::(_updateState) Task=`ce2d03a9-63dc-4bae-b266-a7fda22138c3`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:36,315::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:36,315::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:36,315::task::974::TaskManager.Task::(_decref) Task=`ce2d03a9-63dc-4bae-b266-a7fda22138c3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:54:37,372::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:37,396::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-04-10 18:54:37,396::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,397::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,397::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,397::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,398::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,398::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 18:54:37,398::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-67::DEBUG::2014-04-10 18:54:37,427::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 18:54:37,429::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 18:54:37,435::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 18:54:37,436::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 18:54:37,437::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 18:54:37,437::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 18:54:37,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:37,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000326242 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,648::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,648::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,649::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,649::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,650::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,650::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,650::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:39,650::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-64::ERROR::2014-04-10 18:54:40,111::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 18:54:40,112::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 18:54:40,112::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 18:54:40,113::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-66::ERROR::2014-04-10 18:54:40,138::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 18:54:40,138::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 18:54:40,139::lvm::386::OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-66::DEBUG::2014-04-10 18:54:40,139::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:40,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:40,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000401789 s, 1.6 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 18:54:40,253::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 18:54:40,254::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-66::DEBUG::2014-04-10 18:54:40,284::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 18:54:40,285::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 18:54:40,286::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>clientIFinit::DEBUG::2014-04-10 18:54:41,321::task::579::TaskManager.Task::(_updateState) Task=`1d3d94c4-c52a-411e-b397-a53bee03ea8a`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:41,321::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:41,321::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:41,322::task::1168::TaskManager.Task::(prepare) Task=`1d3d94c4-c52a-411e-b397-a53bee03ea8a`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:41,322::task::579::TaskManager.Task::(_updateState) Task=`1d3d94c4-c52a-411e-b397-a53bee03ea8a`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:41,322::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:41,322::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:41,322::task::974::TaskManager.Task::(_decref) Task=`1d3d94c4-c52a-411e-b397-a53bee03ea8a`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,657::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,657::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,657::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,657::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,659::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,659::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,659::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:44,659::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:54:46,328::task::579::TaskManager.Task::(_updateState) Task=`37e25996-9fe1-4586-bcc2-6d5f98a6c697`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:46,328::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:46,329::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:46,329::task::1168::TaskManager.Task::(prepare) Task=`37e25996-9fe1-4586-bcc2-6d5f98a6c697`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:46,329::task::579::TaskManager.Task::(_updateState) Task=`37e25996-9fe1-4586-bcc2-6d5f98a6c697`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:46,329::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:46,329::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:46,329::task::974::TaskManager.Task::(_decref) Task=`37e25996-9fe1-4586-bcc2-6d5f98a6c697`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:54:47,459::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:47,467::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000365456 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,666::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,666::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,667::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,667::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,669::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,669::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,669::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:49,669::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:54:50,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:54:50,221::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000480811 s, 1.4 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:54:51,335::task::579::TaskManager.Task::(_updateState) Task=`2405f1fe-f67b-4e09-9c95-7ede940b7574`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:51,335::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:51,336::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:51,336::task::1168::TaskManager.Task::(prepare) Task=`2405f1fe-f67b-4e09-9c95-7ede940b7574`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:51,336::task::579::TaskManager.Task::(_updateState) Task=`2405f1fe-f67b-4e09-9c95-7ede940b7574`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:51,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:51,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:51,336::task::974::TaskManager.Task::(_decref) Task=`2405f1fe-f67b-4e09-9c95-7ede940b7574`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,676::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,676::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,676::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,676::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,678::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,678::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,678::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:54,678::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:54:55,684::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:54:56,342::task::579::TaskManager.Task::(_updateState) Task=`59a8b758-4800-41ec-9d29-8ed56b40ea52`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:54:56,342::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:54:56,342::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:56,343::task::1168::TaskManager.Task::(prepare) Task=`59a8b758-4800-41ec-9d29-8ed56b40ea52`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:54:56,343::task::579::TaskManager.Task::(_updateState) Task=`59a8b758-4800-41ec-9d29-8ed56b40ea52`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:54:56,343::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:54:56,343::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:54:56,343::task::974::TaskManager.Task::(_decref) Task=`59a8b758-4800-41ec-9d29-8ed56b40ea52`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:54:57,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:54:57,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000342718 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,685::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,685::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,685::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,685::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,687::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,687::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,687::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:54:59,687::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:55:00,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:00,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000455891 s, 1.4 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:55:01,349::task::579::TaskManager.Task::(_updateState) Task=`d9f2f7ff-a932-4e74-9194-f28a9447fac6`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:01,350::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:01,350::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:01,350::task::1168::TaskManager.Task::(prepare) Task=`d9f2f7ff-a932-4e74-9194-f28a9447fac6`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:01,350::task::579::TaskManager.Task::(_updateState) Task=`d9f2f7ff-a932-4e74-9194-f28a9447fac6`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:01,350::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:01,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:01,351::task::974::TaskManager.Task::(_decref) Task=`d9f2f7ff-a932-4e74-9194-f28a9447fac6`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,694::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,694::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,694::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,695::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,696::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,696::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,696::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:04,697::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:55:06,355::task::579::TaskManager.Task::(_updateState) Task=`823832cc-f5c6-4995-bad1-a9f05a8702fb`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:06,355::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:06,355::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:06,355::task::1168::TaskManager.Task::(prepare) Task=`823832cc-f5c6-4995-bad1-a9f05a8702fb`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:06,356::task::579::TaskManager.Task::(_updateState) Task=`823832cc-f5c6-4995-bad1-a9f05a8702fb`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:06,356::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:06,356::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:06,356::task::974::TaskManager.Task::(_decref) Task=`823832cc-f5c6-4995-bad1-a9f05a8702fb`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:55:07,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:07,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000360818 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,702::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,702::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,703::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,703::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,704::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,704::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,704::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:09,705::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:55:10,246::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:10,252::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000397003 s, 1.7 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:55:11,362::task::579::TaskManager.Task::(_updateState) Task=`e4b11a73-abe1-4335-a92a-362dc54e723b`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:11,362::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:11,362::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:11,362::task::1168::TaskManager.Task::(prepare) Task=`e4b11a73-abe1-4335-a92a-362dc54e723b`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:11,363::task::579::TaskManager.Task::(_updateState) Task=`e4b11a73-abe1-4335-a92a-362dc54e723b`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:11,363::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:11,363::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:11,363::task::974::TaskManager.Task::(_decref) Task=`e4b11a73-abe1-4335-a92a-362dc54e723b`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,711::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,725::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,726::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,727::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,727::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,727::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:14,727::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>clientIFinit::DEBUG::2014-04-10 18:55:16,369::task::579::TaskManager.Task::(_updateState) Task=`b206a5e6-386b-4dc2-afa4-1281894786be`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:16,370::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:16,370::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:16,370::task::1168::TaskManager.Task::(prepare) Task=`b206a5e6-386b-4dc2-afa4-1281894786be`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:16,370::task::579::TaskManager.Task::(_updateState) Task=`b206a5e6-386b-4dc2-afa4-1281894786be`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:16,370::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:16,371::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:16,371::task::974::TaskManager.Task::(_decref) Task=`b206a5e6-386b-4dc2-afa4-1281894786be`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:55:17,514::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:17,521::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000405826 s, 907 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,733::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,741::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,741::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,741::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,742::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,743::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,743::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:19,743::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:55:20,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:20,268::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000373591 s, 1.8 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:55:21,376::task::579::TaskManager.Task::(_updateState) Task=`099a76c5-a6bc-4ffa-b1d3-9239199e99a9`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:21,377::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:21,377::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:21,377::task::1168::TaskManager.Task::(prepare) Task=`099a76c5-a6bc-4ffa-b1d3-9239199e99a9`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:21,377::task::579::TaskManager.Task::(_updateState) Task=`099a76c5-a6bc-4ffa-b1d3-9239199e99a9`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:21,377::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:21,378::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:21,378::task::974::TaskManager.Task::(_decref) Task=`099a76c5-a6bc-4ffa-b1d3-9239199e99a9`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,748::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,753::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,753::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,753::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,755::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,755::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,756::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:24,756::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:55:25,715::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>clientIFinit::DEBUG::2014-04-10 18:55:26,384::task::579::TaskManager.Task::(_updateState) Task=`2adcb887-95f7-49d3-9bf9-b86f1213b952`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:26,384::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:26,384::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:26,385::task::1168::TaskManager.Task::(prepare) Task=`2adcb887-95f7-49d3-9bf9-b86f1213b952`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:26,385::task::579::TaskManager.Task::(_updateState) Task=`2adcb887-95f7-49d3-9bf9-b86f1213b952`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:26,385::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:26,385::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:26,385::task::974::TaskManager.Task::(_decref) Task=`2adcb887-95f7-49d3-9bf9-b86f1213b952`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:55:27,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:27,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000447698 s, 822 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,761::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,779::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,779::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,780::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,781::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,781::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,781::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:29,781::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:55:30,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:30,286::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000495294 s, 1.3 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:55:31,389::task::579::TaskManager.Task::(_updateState) Task=`b449c5fa-a9d4-47f4-bc17-73d62779511c`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:31,390::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:31,391::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:31,391::task::1168::TaskManager.Task::(prepare) Task=`b449c5fa-a9d4-47f4-bc17-73d62779511c`::finished: {'poollist': []}
>clientIFinit::DEBUG::2014-04-10 18:55:31,391::task::579::TaskManager.Task::(_updateState) Task=`b449c5fa-a9d4-47f4-bc17-73d62779511c`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:31,392::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:31,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:31,392::task::974::TaskManager.Task::(_decref) Task=`b449c5fa-a9d4-47f4-bc17-73d62779511c`::ref 0 aborting False
>Thread-95::WARNING::2014-04-10 18:55:33,332::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-97::WARNING::2014-04-10 18:55:33,340::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-95::DEBUG::2014-04-10 18:55:33,346::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-97::DEBUG::2014-04-10 18:55:33,352::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-99::WARNING::2014-04-10 18:55:33,529::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-99::DEBUG::2014-04-10 18:55:33,534::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-101::WARNING::2014-04-10 18:55:33,534::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-101::DEBUG::2014-04-10 18:55:33,538::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-59::INFO::2014-04-10 18:55:33,539::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-59::INFO::2014-04-10 18:55:33,540::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-59::INFO::2014-04-10 18:55:33,541::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-59::DEBUG::2014-04-10 18:55:33,541::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-59::DEBUG::2014-04-10 18:55:33,541::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-59::DEBUG::2014-04-10 18:55:33,542::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-59::DEBUG::2014-04-10 18:55:33,542::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-59::DEBUG::2014-04-10 18:55:33,542::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`15c60641-64aa-4f26-a8ad-a60708d9d1a1`::Granted request
>Thread-59::DEBUG::2014-04-10 18:55:33,543::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - shared: granted' was granted
>Thread-59::DEBUG::2014-04-10 18:55:33,543::resourceManager::693::ResourceManager::(releaseResource) This is a shared lock. Granting all shared requests
>Thread-93::DEBUG::2014-04-10 18:55:33,545::task::811::TaskManager.Task::(resourceAcquired) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-59::DEBUG::2014-04-10 18:55:33,546::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-93::DEBUG::2014-04-10 18:55:33,548::task::974::TaskManager.Task::(_decref) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::ref 1 aborting False
>Thread-59::DEBUG::2014-04-10 18:55:33,548::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-93::INFO::2014-04-10 18:55:33,549::fileSD::299::Storage.StorageDomain::(validate) sdUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-59::DEBUG::2014-04-10 18:55:33,549::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-59::DEBUG::2014-04-10 18:55:33,552::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-59::INFO::2014-04-10 18:55:33,553::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-59::DEBUG::2014-04-10 18:55:33,553::task::1168::TaskManager.Task::(prepare) Task=`85b66f10-e8c4-49cd-b2af-36c6e8e5daea`::finished: True
>Thread-59::DEBUG::2014-04-10 18:55:33,554::task::579::TaskManager.Task::(_updateState) Task=`85b66f10-e8c4-49cd-b2af-36c6e8e5daea`::moving from state preparing -> state finished
>Thread-59::DEBUG::2014-04-10 18:55:33,554::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-59::DEBUG::2014-04-10 18:55:33,554::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-59::DEBUG::2014-04-10 18:55:33,555::task::974::TaskManager.Task::(_decref) Task=`85b66f10-e8c4-49cd-b2af-36c6e8e5daea`::ref 0 aborting False
>Thread-93::DEBUG::2014-04-10 18:55:33,559::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-93::DEBUG::2014-04-10 18:55:33,560::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,561::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,561::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,561::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,562::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,562::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:33,562::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-93::DEBUG::2014-04-10 18:55:33,562::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-93::DEBUG::2014-04-10 18:55:33,563::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-93::DEBUG::2014-04-10 18:55:33,563::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-93::DEBUG::2014-04-10 18:55:33,563::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-114::DEBUG::2014-04-10 18:55:33,574::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-114::DEBUG::2014-04-10 18:55:33,574::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-114::DEBUG::2014-04-10 18:55:33,574::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-114::DEBUG::2014-04-10 18:55:33,575::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-93::DEBUG::2014-04-10 18:55:33,592::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-93::DEBUG::2014-04-10 18:55:33,595::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-115::DEBUG::2014-04-10 18:55:33,611::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26f5804c]
>Thread-115::DEBUG::2014-04-10 18:55:33,613::task::579::TaskManager.Task::(_updateState) Task=`e1e2bc94-85fe-4c5f-b359-ff29de8b62ec`::moving from state init -> state preparing
>Thread-115::INFO::2014-04-10 18:55:33,613::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}], options=None)
>Thread-115::DEBUG::2014-04-10 18:55:33,617::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,788::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,788::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,788::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,788::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,790::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,790::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,790::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:34,791::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-93::DEBUG::2014-04-10 18:55:35,651::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-93::DEBUG::2014-04-10 18:55:35,730::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-93::DEBUG::2014-04-10 18:55:35,730::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,731::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,731::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,731::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,732::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,733::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,734::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-93::DEBUG::2014-04-10 18:55:35,772::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-93::DEBUG::2014-04-10 18:55:35,774::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-93::DEBUG::2014-04-10 18:55:35,782::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-93::DEBUG::2014-04-10 18:55:35,785::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-93::INFO::2014-04-10 18:55:35,786::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-93::INFO::2014-04-10 18:55:35,786::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-93::DEBUG::2014-04-10 18:55:35,787::sp::1529::Storage.StoragePool::(getMasterDomain) Master domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 verified, version 7
>Thread-93::DEBUG::2014-04-10 18:55:35,787::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-93::DEBUG::2014-04-10 18:55:35,787::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-93::DEBUG::2014-04-10 18:55:35,794::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>Thread-93::DEBUG::2014-04-10 18:55:35,795::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-93::WARNING::2014-04-10 18:55:35,795::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e already exists
>Thread-93::DEBUG::2014-04-10 18:55:35,796::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-93::DEBUG::2014-04-10 18:55:35,799::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f dbec8cee-b5e4-4011-9dd5-7c122389a878 65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (cwd None)
>Thread-93::DEBUG::2014-04-10 18:55:35,980::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found\n  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654\n'; <rc> = 5
>Thread-93::WARNING::2014-04-10 18:55:35,985::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f', '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878', '  Volume group "65eafe2b-4fa9-4ea1-a869-7deb5afd4654" not found', '  Skipping volume group 65eafe2b-4fa9-4ea1-a869-7deb5afd4654']
>Thread-93::DEBUG::2014-04-10 18:55:35,990::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>clientIFinit::DEBUG::2014-04-10 18:55:36,394::task::579::TaskManager.Task::(_updateState) Task=`1e8f1d05-7093-450e-ab33-6729a3f1934e`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:36,395::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None)
>clientIFinit::INFO::2014-04-10 18:55:36,395::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': ['f721168f-5edd-4f5f-8976-591eb93f960e']}
>clientIFinit::DEBUG::2014-04-10 18:55:36,396::task::1168::TaskManager.Task::(prepare) Task=`1e8f1d05-7093-450e-ab33-6729a3f1934e`::finished: {'poollist': ['f721168f-5edd-4f5f-8976-591eb93f960e']}
>clientIFinit::DEBUG::2014-04-10 18:55:36,396::task::579::TaskManager.Task::(_updateState) Task=`1e8f1d05-7093-450e-ab33-6729a3f1934e`::moving from state preparing -> state finished
>clientIFinit::DEBUG::2014-04-10 18:55:36,396::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>clientIFinit::DEBUG::2014-04-10 18:55:36,396::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:55:36,398::task::974::TaskManager.Task::(_decref) Task=`1e8f1d05-7093-450e-ab33-6729a3f1934e`::ref 0 aborting False
>clientIFinit::WARNING::2014-04-10 18:55:36,398::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found
>clientIFinit::WARNING::2014-04-10 18:55:36,398::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found
>clientIFinit::WARNING::2014-04-10 18:55:36,399::vm::1936::vm.Vm::(getConfDevices) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unknown type found, device: '{'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}' found
>clientIFinit::INFO::2014-04-10 18:55:36,399::clientIF::353::vds::(prepareVolumePath) prepared volume path: 
>clientIFinit::DEBUG::2014-04-10 18:55:36,400::task::579::TaskManager.Task::(_updateState) Task=`d53e267e-5cc2-4775-8455-16973476502c`::moving from state init -> state preparing
>clientIFinit::INFO::2014-04-10 18:55:36,400::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', leafUUID='24018d18-27a2-462e-94df-c84585e4a0df')
>clientIFinit::DEBUG::2014-04-10 18:55:36,402::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`2bcfb787-54fd-493a-8760-c04f7cf1c798`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage'
>clientIFinit::DEBUG::2014-04-10 18:55:36,402::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>clientIFinit::DEBUG::2014-04-10 18:55:36,402::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>clientIFinit::DEBUG::2014-04-10 18:55:36,402::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`2bcfb787-54fd-493a-8760-c04f7cf1c798`::Granted request
>clientIFinit::DEBUG::2014-04-10 18:55:36,403::task::811::TaskManager.Task::(resourceAcquired) Task=`d53e267e-5cc2-4775-8455-16973476502c`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>clientIFinit::DEBUG::2014-04-10 18:55:36,403::task::974::TaskManager.Task::(_decref) Task=`d53e267e-5cc2-4775-8455-16973476502c`::ref 1 aborting False
>Thread-103::WARNING::2014-04-10 18:55:37,421::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-103::DEBUG::2014-04-10 18:55:37,426::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-105::WARNING::2014-04-10 18:55:37,426::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-105::DEBUG::2014-04-10 18:55:37,428::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-67::DEBUG::2014-04-10 18:55:37,581::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 18:55:37,584::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 18:55:37,591::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 18:55:37,593::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 18:55:37,593::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 18:55:37,593::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 18:55:37,602::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:37,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000388724 s, 947 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,797::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,800::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,802::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,805::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,808::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,809::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,811::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:39,812::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-107::WARNING::2014-04-10 18:55:40,278::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-107::DEBUG::2014-04-10 18:55:40,285::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-109::WARNING::2014-04-10 18:55:40,285::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-109::DEBUG::2014-04-10 18:55:40,295::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 18:55:40,302::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 18:55:40,309::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-111::WARNING::2014-04-10 18:55:40,312::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-113::WARNING::2014-04-10 18:55:40,314::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-111::DEBUG::2014-04-10 18:55:40,320::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-113::DEBUG::2014-04-10 18:55:40,323::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 18:55:40,328::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 18:55:40,331::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>clientIFinit::ERROR::2014-04-10 18:55:40,331::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>clientIFinit::ERROR::2014-04-10 18:55:40,334::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>clientIFinit::DEBUG::2014-04-10 18:55:40,336::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>clientIFinit::DEBUG::2014-04-10 18:55:40,346::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:40,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:40,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000356591 s, 1.9 MB/s\n'; <rc> = 0
>clientIFinit::DEBUG::2014-04-10 18:55:40,485::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>clientIFinit::WARNING::2014-04-10 18:55:40,486::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>clientIFinit::DEBUG::2014-04-10 18:55:40,486::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,821::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,821::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,821::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,821::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,822::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,823::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,823::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:44,823::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-67::DEBUG::2014-04-10 18:55:47,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:47,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000353261 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,829::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,830::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,830::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,830::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,831::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,831::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,832::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:49,832::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-64::ERROR::2014-04-10 18:55:50,318::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 18:55:50,318::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 18:55:50,318::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 18:55:50,318::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:50,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:55:50,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000358293 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 18:55:50,472::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 18:55:50,473::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 18:55:50,473::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,838::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,839::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,839::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,839::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,840::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,840::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,840::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:54,841::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:55:55,749::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-67::DEBUG::2014-04-10 18:55:57,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:55:57,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00035428 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,847::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,847::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,848::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,848::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,849::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,849::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,849::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:55:59,849::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:56:00,388::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:56:00,395::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000406823 s, 1.6 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,854::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,855::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,855::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,855::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,856::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,856::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,857::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:04,857::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-67::DEBUG::2014-04-10 18:56:07,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:07,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000370492 s, 993 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,860::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,860::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,861::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,861::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,862::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,862::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,862::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:09,862::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:56:10,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:56:10,412::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000359385 s, 1.8 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,869::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,869::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,869::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,870::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,871::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,871::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,871::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:14,871::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-67::DEBUG::2014-04-10 18:56:17,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:17,679::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000332018 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,878::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,891::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,892::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,892::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,894::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,894::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,894::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:19,894::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:56:20,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:56:20,432::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000364543 s, 1.8 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,901::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,911::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,912::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,912::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,914::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,914::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,915::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:24,915::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:56:25,783::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-67::DEBUG::2014-04-10 18:56:27,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:27,695::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000358875 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,918::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,942::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,942::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,943::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,944::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,944::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,944::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:29,944::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:56:30,444::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:56:30,452::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n660 bytes (660 B) copied, 0.000378528 s, 1.7 MB/s\n'; <rc> = 0
>Thread-115::DEBUG::2014-04-10 18:56:33,618::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-115::DEBUG::2014-04-10 18:56:33,622::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,622::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-115::DEBUG::2014-04-10 18:56:33,625::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,625::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-115::INFO::2014-04-10 18:56:33,628::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,629::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-115::DEBUG::2014-04-10 18:56:33,630::task::1168::TaskManager.Task::(prepare) Task=`e1e2bc94-85fe-4c5f-b359-ff29de8b62ec`::finished: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,632::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-115::DEBUG::2014-04-10 18:56:33,632::task::579::TaskManager.Task::(_updateState) Task=`e1e2bc94-85fe-4c5f-b359-ff29de8b62ec`::moving from state preparing -> state finished
>Thread-115::DEBUG::2014-04-10 18:56:33,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-115::DEBUG::2014-04-10 18:56:33,636::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-115::DEBUG::2014-04-10 18:56:33,636::task::974::TaskManager.Task::(_decref) Task=`e1e2bc94-85fe-4c5f-b359-ff29de8b62ec`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,639::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,641::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,642::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:33,643::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-136::DEBUG::2014-04-10 18:56:33,661::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-136::DEBUG::2014-04-10 18:56:33,663::task::579::TaskManager.Task::(_updateState) Task=`7c821c43-2ded-4378-b23c-2cb74c84ebf8`::moving from state init -> state preparing
>Thread-136::INFO::2014-04-10 18:56:33,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-136::INFO::2014-04-10 18:56:33,664::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}}
>Thread-136::DEBUG::2014-04-10 18:56:33,665::task::1168::TaskManager.Task::(prepare) Task=`7c821c43-2ded-4378-b23c-2cb74c84ebf8`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}}
>Thread-136::DEBUG::2014-04-10 18:56:33,665::task::579::TaskManager.Task::(_updateState) Task=`7c821c43-2ded-4378-b23c-2cb74c84ebf8`::moving from state preparing -> state finished
>Thread-136::DEBUG::2014-04-10 18:56:33,665::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-136::DEBUG::2014-04-10 18:56:33,665::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-136::DEBUG::2014-04-10 18:56:33,665::task::974::TaskManager.Task::(_decref) Task=`7c821c43-2ded-4378-b23c-2cb74c84ebf8`::ref 0 aborting False
>Thread-137::DEBUG::2014-04-10 18:56:33,715::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-137::DEBUG::2014-04-10 18:56:33,715::task::579::TaskManager.Task::(_updateState) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::moving from state init -> state preparing
>Thread-137::INFO::2014-04-10 18:56:33,715::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', prevID=-1, prevLVER='-1', recoveryMode=None, scsiFencing='false', maxHostID=250, domVersion='3', options=None)
>Thread-137::DEBUG::2014-04-10 18:56:33,716::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6369ef1a-7dbe-46d1-9620-218f92ff8a4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '587' at 'spmStart'
>Thread-137::DEBUG::2014-04-10 18:56:33,716::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-137::DEBUG::2014-04-10 18:56:33,718::resourceManager::576::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is currently locked, Entering queue (1 in queue)
>Thread-117::WARNING::2014-04-10 18:56:35,764::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-117::DEBUG::2014-04-10 18:56:35,771::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-119::WARNING::2014-04-10 18:56:35,767::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-119::DEBUG::2014-04-10 18:56:35,779::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-121::WARNING::2014-04-10 18:56:36,036::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-121::DEBUG::2014-04-10 18:56:36,040::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-123::WARNING::2014-04-10 18:56:36,042::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-123::DEBUG::2014-04-10 18:56:36,044::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-93::INFO::2014-04-10 18:56:36,045::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-93::INFO::2014-04-10 18:56:36,047::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-93::INFO::2014-04-10 18:56:36,047::sp::1192::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 to /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd
>Thread-93::INFO::2014-04-10 18:56:36,048::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None
>Thread-93::DEBUG::2014-04-10 18:56:36,048::task::1168::TaskManager.Task::(prepare) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::finished: None
>Thread-93::DEBUG::2014-04-10 18:56:36,048::task::579::TaskManager.Task::(_updateState) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::moving from state preparing -> state finished
>Thread-93::DEBUG::2014-04-10 18:56:36,049::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-93::DEBUG::2014-04-10 18:56:36,049::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-93::DEBUG::2014-04-10 18:56:36,049::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-93::DEBUG::2014-04-10 18:56:36,050::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-93::DEBUG::2014-04-10 18:56:36,050::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-93::DEBUG::2014-04-10 18:56:36,051::resourceManager::653::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' has 1 requests in queue. Handling top request.
>Thread-93::DEBUG::2014-04-10 18:56:36,051::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6369ef1a-7dbe-46d1-9620-218f92ff8a4e`::Granted request
>Thread-93::DEBUG::2014-04-10 18:56:36,051::resourceManager::685::ResourceManager::(releaseResource) Request 'Request for Storage.f721168f-5edd-4f5f-8976-591eb93f960e - exclusive: granted' was granted
>Thread-137::DEBUG::2014-04-10 18:56:36,053::task::811::TaskManager.Task::(resourceAcquired) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-93::DEBUG::2014-04-10 18:56:36,053::task::974::TaskManager.Task::(_decref) Task=`d33bee05-8d0b-4734-beae-d8160b76b235`::ref 0 aborting False
>Thread-137::DEBUG::2014-04-10 18:56:36,055::task::974::TaskManager.Task::(_decref) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::ref 1 aborting False
>Thread-137::INFO::2014-04-10 18:56:36,057::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
>Thread-137::DEBUG::2014-04-10 18:56:36,058::task::1163::TaskManager.Task::(prepare) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::Prepare: 1 jobs exist, move to acquiring
>Thread-137::DEBUG::2014-04-10 18:56:36,060::task::579::TaskManager.Task::(_updateState) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::moving from state preparing -> state acquiring
>Thread-137::DEBUG::2014-04-10 18:56:36,060::task::579::TaskManager.Task::(_updateState) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::moving from state acquiring -> state queued
>Thread-137::DEBUG::2014-04-10 18:56:36,060::taskManager::50::TaskManager::(_queueTask) queuing task: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-5::DEBUG::2014-04-10 18:56:36,061::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-137::DEBUG::2014-04-10 18:56:36,061::taskManager::56::TaskManager::(_queueTask) task queued: e7c56099-afb9-407a-991d-cb6b72ddd351
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,063::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: e7c56099-afb9-407a-991d-cb6b72ddd351 running: <bound method Task.commit of <storage.task.Task instance at 0x7fcc7816d5f0>> with: None
>Thread-137::DEBUG::2014-04-10 18:56:36,064::task::1165::TaskManager.Task::(prepare) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::returning
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,065::task::1176::TaskManager.Task::(commit) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::committing task: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-137::DEBUG::2014-04-10 18:56:36,066::task::974::TaskManager.Task::(_decref) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::ref 0 aborting False
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,068::task::579::TaskManager.Task::(_updateState) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::moving from state queued -> state running
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,072::task::889::TaskManager.Task::(_runJobs) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x164a310>> (args: (-1, '-1', 'false', 250, 3) kwargs: {})
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,077::task::315::TaskManager.Task::(run) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x164a310>> (args: (-1, '-1', 'false', 250, 3) kwargs: {}) callback None
>Thread-138::DEBUG::2014-04-10 18:56:36,081::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [553ef988]
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,081::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-138::DEBUG::2014-04-10 18:56:36,083::task::579::TaskManager.Task::(_updateState) Task=`a479af0d-22f8-4ad2-898c-bad68decf7d1`::moving from state init -> state preparing
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,083::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-138::INFO::2014-04-10 18:56:36,086::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}], options=None)
>Thread-138::DEBUG::2014-04-10 18:56:36,091::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,101::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,102::misc::819::SamplingMethod::(__call__) Returning last result
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,108::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>e7c56099-afb9-407a-991d-cb6b72ddd351::INFO::2014-04-10 18:56:36,109::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,110::clusterlock::192::SANLock::(acquireHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>e7c56099-afb9-407a-991d-cb6b72ddd351::INFO::2014-04-10 18:56:36,111::clusterlock::225::SANLock::(acquire) Acquiring cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,256::clusterlock::251::SANLock::(acquire) Cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully acquired (id: 2)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,260::sp::272::Storage.StoragePool::(startSpm) spm lock acquired successfully
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,279::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=1216da1d4ea8f10e41710fc71632249584f011cc']
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,283::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,288::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,292::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,341::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,342::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32ad496f-f597-45e5-b602-1cc7d4dc8fb5`::Request was made in '/usr/share/vdsm/storage/sp.py' line '432' at '_upgradePool'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,342::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,343::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,343::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`32ad496f-f597-45e5-b602-1cc7d4dc8fb5`::Granted request
>e7c56099-afb9-407a-991d-cb6b72ddd351::INFO::2014-04-10 18:56:36,343::sp::438::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,344::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`69f74b23-6a6e-4087-9f12-0feee278544c`::Request was made in '/usr/share/vdsm/storage/sp.py' line '440' at '_upgradePool'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,344::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' for lock type 'exclusive'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,344::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free. Now locking as 'exclusive' (1 active user)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,344::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76`ReqID=`69f74b23-6a6e-4087-9f12-0feee278544c`::Granted request
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,346::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,346::misc::811::SamplingMethod::(__call__) Got in to sampling method
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,346::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,346::misc::811::SamplingMethod::(__call__) Got in to sampling method
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,347::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,360::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:36,361::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-139::DEBUG::2014-04-10 18:56:37,101::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-139::DEBUG::2014-04-10 18:56:37,107::task::579::TaskManager.Task::(_updateState) Task=`7ed8719d-6d44-45a8-a400-df0e44e2169f`::moving from state init -> state preparing
>Thread-139::INFO::2014-04-10 18:56:37,111::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-139::DEBUG::2014-04-10 18:56:37,115::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-139::DEBUG::2014-04-10 18:56:37,117::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-139::INFO::2014-04-10 18:56:37,120::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-139::DEBUG::2014-04-10 18:56:37,123::task::1168::TaskManager.Task::(prepare) Task=`7ed8719d-6d44-45a8-a400-df0e44e2169f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-139::DEBUG::2014-04-10 18:56:37,126::task::579::TaskManager.Task::(_updateState) Task=`7ed8719d-6d44-45a8-a400-df0e44e2169f`::moving from state preparing -> state finished
>Thread-139::DEBUG::2014-04-10 18:56:37,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-139::DEBUG::2014-04-10 18:56:37,131::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-139::DEBUG::2014-04-10 18:56:37,135::task::974::TaskManager.Task::(_decref) Task=`7ed8719d-6d44-45a8-a400-df0e44e2169f`::ref 0 aborting False
>Thread-125::WARNING::2014-04-10 18:56:37,575::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-125::DEBUG::2014-04-10 18:56:37,578::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-127::WARNING::2014-04-10 18:56:37,580::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-127::DEBUG::2014-04-10 18:56:37,581::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-67::DEBUG::2014-04-10 18:56:37,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:37,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000473358 s, 777 kB/s\n'; <rc> = 0
>Thread-140::DEBUG::2014-04-10 18:56:38,158::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-140::DEBUG::2014-04-10 18:56:38,159::task::579::TaskManager.Task::(_updateState) Task=`21800b8e-edf4-4cf3-9a4d-780493529451`::moving from state init -> state preparing
>Thread-140::INFO::2014-04-10 18:56:38,159::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-140::DEBUG::2014-04-10 18:56:38,160::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-140::DEBUG::2014-04-10 18:56:38,160::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-140::INFO::2014-04-10 18:56:38,160::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-140::DEBUG::2014-04-10 18:56:38,161::task::1168::TaskManager.Task::(prepare) Task=`21800b8e-edf4-4cf3-9a4d-780493529451`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-140::DEBUG::2014-04-10 18:56:38,161::task::579::TaskManager.Task::(_updateState) Task=`21800b8e-edf4-4cf3-9a4d-780493529451`::moving from state preparing -> state finished
>Thread-140::DEBUG::2014-04-10 18:56:38,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-140::DEBUG::2014-04-10 18:56:38,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-140::DEBUG::2014-04-10 18:56:38,162::task::974::TaskManager.Task::(_decref) Task=`21800b8e-edf4-4cf3-9a4d-780493529451`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,650::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,650::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,650::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,651::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,653::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,653::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,653::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:38,654::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-141::DEBUG::2014-04-10 18:56:39,172::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-141::DEBUG::2014-04-10 18:56:39,172::task::579::TaskManager.Task::(_updateState) Task=`d6972f38-02de-4afc-8d61-2bc2b7edbcdd`::moving from state init -> state preparing
>Thread-141::INFO::2014-04-10 18:56:39,172::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-141::DEBUG::2014-04-10 18:56:39,173::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-141::DEBUG::2014-04-10 18:56:39,173::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-141::INFO::2014-04-10 18:56:39,173::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-141::DEBUG::2014-04-10 18:56:39,173::task::1168::TaskManager.Task::(prepare) Task=`d6972f38-02de-4afc-8d61-2bc2b7edbcdd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-141::DEBUG::2014-04-10 18:56:39,173::task::579::TaskManager.Task::(_updateState) Task=`d6972f38-02de-4afc-8d61-2bc2b7edbcdd`::moving from state preparing -> state finished
>Thread-141::DEBUG::2014-04-10 18:56:39,174::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-141::DEBUG::2014-04-10 18:56:39,174::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-141::DEBUG::2014-04-10 18:56:39,174::task::974::TaskManager.Task::(_decref) Task=`d6972f38-02de-4afc-8d61-2bc2b7edbcdd`::ref 0 aborting False
>Thread-143::DEBUG::2014-04-10 18:56:40,187::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-143::DEBUG::2014-04-10 18:56:40,189::task::579::TaskManager.Task::(_updateState) Task=`4b4a2509-75e7-4526-9603-c2ab592b2c3a`::moving from state init -> state preparing
>Thread-143::INFO::2014-04-10 18:56:40,190::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-143::DEBUG::2014-04-10 18:56:40,191::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-143::DEBUG::2014-04-10 18:56:40,192::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-143::INFO::2014-04-10 18:56:40,194::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-143::DEBUG::2014-04-10 18:56:40,195::task::1168::TaskManager.Task::(prepare) Task=`4b4a2509-75e7-4526-9603-c2ab592b2c3a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-143::DEBUG::2014-04-10 18:56:40,196::task::579::TaskManager.Task::(_updateState) Task=`4b4a2509-75e7-4526-9603-c2ab592b2c3a`::moving from state preparing -> state finished
>Thread-143::DEBUG::2014-04-10 18:56:40,196::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-143::DEBUG::2014-04-10 18:56:40,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-143::DEBUG::2014-04-10 18:56:40,199::task::974::TaskManager.Task::(_decref) Task=`4b4a2509-75e7-4526-9603-c2ab592b2c3a`::ref 0 aborting False
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,403::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,473::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,477::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,481::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,484::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,488::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,492::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,495::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,498::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-129::WARNING::2014-04-10 18:56:40,511::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-131::WARNING::2014-04-10 18:56:40,521::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-129::DEBUG::2014-04-10 18:56:40,539::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-131::DEBUG::2014-04-10 18:56:40,542::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>clientIFinit::ERROR::2014-04-10 18:56:40,546::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 18:56:40,550::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 18:56:40,553::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>clientIFinit::ERROR::2014-04-10 18:56:40,550::task::850::TaskManager.Task::(_setError) Task=`d53e267e-5cc2-4775-8455-16973476502c`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3259, in prepareImage
>    dom = sdCache.produce(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::DEBUG::2014-04-10 18:56:40,559::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>clientIFinit::DEBUG::2014-04-10 18:56:40,560::task::869::TaskManager.Task::(_run) Task=`d53e267e-5cc2-4775-8455-16973476502c`::Task._run: d53e267e-5cc2-4775-8455-16973476502c ('dbec8cee-b5e4-4011-9dd5-7c122389a878', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'ca8224e3-4aff-4e35-87f6-c12059aeb202', '24018d18-27a2-462e-94df-c84585e4a0df') {} failed - stopping task
>clientIFinit::DEBUG::2014-04-10 18:56:40,565::task::1194::TaskManager.Task::(stop) Task=`d53e267e-5cc2-4775-8455-16973476502c`::stopping in state preparing (force False)
>clientIFinit::DEBUG::2014-04-10 18:56:40,569::task::974::TaskManager.Task::(_decref) Task=`d53e267e-5cc2-4775-8455-16973476502c`::ref 1 aborting True
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,572::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>clientIFinit::INFO::2014-04-10 18:56:40,572::task::1151::TaskManager.Task::(prepare) Task=`d53e267e-5cc2-4775-8455-16973476502c`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>clientIFinit::DEBUG::2014-04-10 18:56:40,576::task::1156::TaskManager.Task::(prepare) Task=`d53e267e-5cc2-4775-8455-16973476502c`::Prepare: aborted: Storage domain does not exist
>clientIFinit::DEBUG::2014-04-10 18:56:40,579::task::974::TaskManager.Task::(_decref) Task=`d53e267e-5cc2-4775-8455-16973476502c`::ref 0 aborting True
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,581::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>clientIFinit::DEBUG::2014-04-10 18:56:40,581::task::909::TaskManager.Task::(_doAbort) Task=`d53e267e-5cc2-4775-8455-16973476502c`::Task._doAbort: force False
>Thread-66::DEBUG::2014-04-10 18:56:40,584::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>clientIFinit::DEBUG::2014-04-10 18:56:40,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:56:40,594::task::579::TaskManager.Task::(_updateState) Task=`d53e267e-5cc2-4775-8455-16973476502c`::moving from state preparing -> state aborting
>clientIFinit::DEBUG::2014-04-10 18:56:40,597::task::534::TaskManager.Task::(__state_aborting) Task=`d53e267e-5cc2-4775-8455-16973476502c`::_aborting: recover policy none
>clientIFinit::DEBUG::2014-04-10 18:56:40,600::task::579::TaskManager.Task::(_updateState) Task=`d53e267e-5cc2-4775-8455-16973476502c`::moving from state aborting -> state failed
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,600::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>clientIFinit::DEBUG::2014-04-10 18:56:40,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>clientIFinit::DEBUG::2014-04-10 18:56:40,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>clientIFinit::DEBUG::2014-04-10 18:56:40,606::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>clientIFinit::DEBUG::2014-04-10 18:56:40,607::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>clientIFinit::DEBUG::2014-04-10 18:56:40,607::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>clientIFinit::DEBUG::2014-04-10 18:56:40,608::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>clientIFinit::ERROR::2014-04-10 18:56:40,608::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)", 'code': 358}}
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,609::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>e7c56099-afb9-407a-991d-cb6b72ddd351::INFO::2014-04-10 18:56:40,610::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>e7c56099-afb9-407a-991d-cb6b72ddd351::INFO::2014-04-10 18:56:40,610::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>clientIFinit::ERROR::2014-04-10 18:56:40,609::clientIF::468::vds::(_recoverExistingVms) Vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53 recovery failed
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 465, in _recoverExistingVms
>    vmObj.getConfDevices()[vm.DISK_DEVICES])
>  File "/usr/share/vdsm/vm.py", line 2225, in preparePaths
>    drive['path'] = self.cif.prepareVolumePath(drive, self.id)
>  File "/usr/share/vdsm/clientIF.py", line 280, in prepareVolumePath
>    raise vm.VolumeError(drive)
>VolumeError: Bad volume specification {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '5368709120', 'alias': u'virtio-disk0', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'readonly': 'False', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'reqsize': '0', 'format': 'raw', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'specParams': {}, 'volumeChain': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'}]}
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,615::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,619::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' (0 active users)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,621::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76' is free, finding out if anyone is waiting for it.
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,623::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', Clearing records.
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,626::sp::443::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,629::sp::450::Storage.StoragePool::(_upgradePool) Registering with state change event
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,630::sp::453::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
>Thread-150::DEBUG::2014-04-10 18:56:40,636::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,637::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,643::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-150::DEBUG::2014-04-10 18:56:40,644::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`582e3538-df52-4183-a8e1-7528b798a5c6`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,646::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-150::DEBUG::2014-04-10 18:56:40,647::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' for lock type 'exclusive'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,650::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-150::DEBUG::2014-04-10 18:56:40,653::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free. Now locking as 'exclusive' (1 active user)
>Thread-150::DEBUG::2014-04-10 18:56:40,656::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`582e3538-df52-4183-a8e1-7528b798a5c6`::Granted request
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,662::sd::621::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/master/vms
>Thread-150::DEBUG::2014-04-10 18:56:40,669::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`7ba5689d-7a76-4402-9fb2-876f5260a723`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:56:40,670::sd::624::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/master/tasks
>Thread-150::DEBUG::2014-04-10 18:56:40,672::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' for lock type 'exclusive'
>Thread-150::DEBUG::2014-04-10 18:56:40,676::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free. Now locking as 'exclusive' (1 active user)
>Thread-150::DEBUG::2014-04-10 18:56:40,680::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654`ReqID=`7ba5689d-7a76-4402-9fb2-876f5260a723`::Granted request
>Thread-65::DEBUG::2014-04-10 18:56:40,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-150::DEBUG::2014-04-10 18:56:40,697::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-150::DEBUG::2014-04-10 18:56:40,700::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654'
>Thread-150::DEBUG::2014-04-10 18:56:40,702::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (0 active users)
>Thread-150::DEBUG::2014-04-10 18:56:40,703::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free, finding out if anyone is waiting for it.
>Thread-150::DEBUG::2014-04-10 18:56:40,705::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.65eafe2b-4fa9-4ea1-a869-7deb5afd4654', Clearing records.
>Thread-65::DEBUG::2014-04-10 18:56:40,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000403118 s, 1.6 MB/s\n'; <rc> = 0
>Thread-150::DEBUG::2014-04-10 18:56:40,707::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654'
>Thread-150::DEBUG::2014-04-10 18:56:40,709::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' (0 active users)
>Thread-150::DEBUG::2014-04-10 18:56:40,709::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654' is free, finding out if anyone is waiting for it.
>Thread-150::DEBUG::2014-04-10 18:56:40,709::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_65eafe2b-4fa9-4ea1-a869-7deb5afd4654', Clearing records.
>Thread-66::DEBUG::2014-04-10 18:56:40,737::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 18:56:40,846::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 18:56:40,846::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-155::DEBUG::2014-04-10 18:56:41,215::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-155::DEBUG::2014-04-10 18:56:41,215::task::579::TaskManager.Task::(_updateState) Task=`f7befc32-ad8e-4198-836a-e5fe3000c4fa`::moving from state init -> state preparing
>Thread-155::INFO::2014-04-10 18:56:41,216::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-155::DEBUG::2014-04-10 18:56:41,216::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-155::DEBUG::2014-04-10 18:56:41,216::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-155::INFO::2014-04-10 18:56:41,216::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-155::DEBUG::2014-04-10 18:56:41,216::task::1168::TaskManager.Task::(prepare) Task=`f7befc32-ad8e-4198-836a-e5fe3000c4fa`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-155::DEBUG::2014-04-10 18:56:41,217::task::579::TaskManager.Task::(_updateState) Task=`f7befc32-ad8e-4198-836a-e5fe3000c4fa`::moving from state preparing -> state finished
>Thread-155::DEBUG::2014-04-10 18:56:41,217::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-155::DEBUG::2014-04-10 18:56:41,217::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-155::DEBUG::2014-04-10 18:56:41,217::task::974::TaskManager.Task::(_decref) Task=`f7befc32-ad8e-4198-836a-e5fe3000c4fa`::ref 0 aborting False
>Thread-156::DEBUG::2014-04-10 18:56:42,228::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-156::DEBUG::2014-04-10 18:56:42,228::task::579::TaskManager.Task::(_updateState) Task=`fe09d99b-c104-48b0-a95b-b0377c73dced`::moving from state init -> state preparing
>Thread-156::INFO::2014-04-10 18:56:42,228::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-156::DEBUG::2014-04-10 18:56:42,229::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-156::DEBUG::2014-04-10 18:56:42,229::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-156::INFO::2014-04-10 18:56:42,229::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-156::DEBUG::2014-04-10 18:56:42,229::task::1168::TaskManager.Task::(prepare) Task=`fe09d99b-c104-48b0-a95b-b0377c73dced`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-156::DEBUG::2014-04-10 18:56:42,229::task::579::TaskManager.Task::(_updateState) Task=`fe09d99b-c104-48b0-a95b-b0377c73dced`::moving from state preparing -> state finished
>Thread-156::DEBUG::2014-04-10 18:56:42,229::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-156::DEBUG::2014-04-10 18:56:42,229::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-156::DEBUG::2014-04-10 18:56:42,230::task::974::TaskManager.Task::(_decref) Task=`fe09d99b-c104-48b0-a95b-b0377c73dced`::ref 0 aborting False
>Thread-158::DEBUG::2014-04-10 18:56:43,241::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-158::DEBUG::2014-04-10 18:56:43,241::task::579::TaskManager.Task::(_updateState) Task=`e28ff98f-4d5e-4e39-9b8b-e1f2c6ffadab`::moving from state init -> state preparing
>Thread-158::INFO::2014-04-10 18:56:43,242::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-158::DEBUG::2014-04-10 18:56:43,242::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-158::DEBUG::2014-04-10 18:56:43,242::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-158::INFO::2014-04-10 18:56:43,243::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-158::DEBUG::2014-04-10 18:56:43,243::task::1168::TaskManager.Task::(prepare) Task=`e28ff98f-4d5e-4e39-9b8b-e1f2c6ffadab`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-158::DEBUG::2014-04-10 18:56:43,243::task::579::TaskManager.Task::(_updateState) Task=`e28ff98f-4d5e-4e39-9b8b-e1f2c6ffadab`::moving from state preparing -> state finished
>Thread-158::DEBUG::2014-04-10 18:56:43,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-158::DEBUG::2014-04-10 18:56:43,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-158::DEBUG::2014-04-10 18:56:43,243::task::974::TaskManager.Task::(_decref) Task=`e28ff98f-4d5e-4e39-9b8b-e1f2c6ffadab`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,660::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,661::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,661::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,661::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,663::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,663::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,663::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:43,663::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-159::DEBUG::2014-04-10 18:56:44,253::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-159::DEBUG::2014-04-10 18:56:44,254::task::579::TaskManager.Task::(_updateState) Task=`fe610b1c-3800-4d30-9423-2851a9aa9ecf`::moving from state init -> state preparing
>Thread-159::INFO::2014-04-10 18:56:44,254::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-159::DEBUG::2014-04-10 18:56:44,254::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-159::DEBUG::2014-04-10 18:56:44,254::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-159::INFO::2014-04-10 18:56:44,255::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-159::DEBUG::2014-04-10 18:56:44,255::task::1168::TaskManager.Task::(prepare) Task=`fe610b1c-3800-4d30-9423-2851a9aa9ecf`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-159::DEBUG::2014-04-10 18:56:44,255::task::579::TaskManager.Task::(_updateState) Task=`fe610b1c-3800-4d30-9423-2851a9aa9ecf`::moving from state preparing -> state finished
>Thread-159::DEBUG::2014-04-10 18:56:44,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-159::DEBUG::2014-04-10 18:56:44,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-159::DEBUG::2014-04-10 18:56:44,256::task::974::TaskManager.Task::(_decref) Task=`fe610b1c-3800-4d30-9423-2851a9aa9ecf`::ref 0 aborting False
>Thread-160::DEBUG::2014-04-10 18:56:45,265::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-160::DEBUG::2014-04-10 18:56:45,266::task::579::TaskManager.Task::(_updateState) Task=`f3f75472-007d-47a1-b62c-4e50a65b7bf4`::moving from state init -> state preparing
>Thread-160::INFO::2014-04-10 18:56:45,266::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-160::DEBUG::2014-04-10 18:56:45,266::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-160::DEBUG::2014-04-10 18:56:45,266::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-160::INFO::2014-04-10 18:56:45,266::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-160::DEBUG::2014-04-10 18:56:45,266::task::1168::TaskManager.Task::(prepare) Task=`f3f75472-007d-47a1-b62c-4e50a65b7bf4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-160::DEBUG::2014-04-10 18:56:45,266::task::579::TaskManager.Task::(_updateState) Task=`f3f75472-007d-47a1-b62c-4e50a65b7bf4`::moving from state preparing -> state finished
>Thread-160::DEBUG::2014-04-10 18:56:45,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-160::DEBUG::2014-04-10 18:56:45,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-160::DEBUG::2014-04-10 18:56:45,267::task::974::TaskManager.Task::(_decref) Task=`f3f75472-007d-47a1-b62c-4e50a65b7bf4`::ref 0 aborting False
>Thread-162::DEBUG::2014-04-10 18:56:46,277::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-162::DEBUG::2014-04-10 18:56:46,278::task::579::TaskManager.Task::(_updateState) Task=`d17d121a-765b-4766-b0eb-ee93891ce8fb`::moving from state init -> state preparing
>Thread-162::INFO::2014-04-10 18:56:46,278::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-162::DEBUG::2014-04-10 18:56:46,278::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-162::DEBUG::2014-04-10 18:56:46,278::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-162::INFO::2014-04-10 18:56:46,279::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-162::DEBUG::2014-04-10 18:56:46,279::task::1168::TaskManager.Task::(prepare) Task=`d17d121a-765b-4766-b0eb-ee93891ce8fb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-162::DEBUG::2014-04-10 18:56:46,279::task::579::TaskManager.Task::(_updateState) Task=`d17d121a-765b-4766-b0eb-ee93891ce8fb`::moving from state preparing -> state finished
>Thread-162::DEBUG::2014-04-10 18:56:46,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-162::DEBUG::2014-04-10 18:56:46,279::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-162::DEBUG::2014-04-10 18:56:46,279::task::974::TaskManager.Task::(_decref) Task=`d17d121a-765b-4766-b0eb-ee93891ce8fb`::ref 0 aborting False
>Thread-163::DEBUG::2014-04-10 18:56:47,293::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-163::DEBUG::2014-04-10 18:56:47,294::task::579::TaskManager.Task::(_updateState) Task=`e444f137-be21-4ced-8a5e-b56b97eb23ef`::moving from state init -> state preparing
>Thread-163::INFO::2014-04-10 18:56:47,294::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-163::DEBUG::2014-04-10 18:56:47,294::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-163::DEBUG::2014-04-10 18:56:47,294::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-163::INFO::2014-04-10 18:56:47,294::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-163::DEBUG::2014-04-10 18:56:47,295::task::1168::TaskManager.Task::(prepare) Task=`e444f137-be21-4ced-8a5e-b56b97eb23ef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-163::DEBUG::2014-04-10 18:56:47,295::task::579::TaskManager.Task::(_updateState) Task=`e444f137-be21-4ced-8a5e-b56b97eb23ef`::moving from state preparing -> state finished
>Thread-163::DEBUG::2014-04-10 18:56:47,295::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-163::DEBUG::2014-04-10 18:56:47,295::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-163::DEBUG::2014-04-10 18:56:47,295::task::974::TaskManager.Task::(_decref) Task=`e444f137-be21-4ced-8a5e-b56b97eb23ef`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:56:47,726::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:47,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444809 s, 827 kB/s\n'; <rc> = 0
>Thread-164::DEBUG::2014-04-10 18:56:48,307::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-164::DEBUG::2014-04-10 18:56:48,308::task::579::TaskManager.Task::(_updateState) Task=`3074372d-ea99-484c-9210-5118d1be304c`::moving from state init -> state preparing
>Thread-164::INFO::2014-04-10 18:56:48,308::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-164::DEBUG::2014-04-10 18:56:48,308::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-164::DEBUG::2014-04-10 18:56:48,309::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-164::INFO::2014-04-10 18:56:48,309::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-164::DEBUG::2014-04-10 18:56:48,309::task::1168::TaskManager.Task::(prepare) Task=`3074372d-ea99-484c-9210-5118d1be304c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-164::DEBUG::2014-04-10 18:56:48,309::task::579::TaskManager.Task::(_updateState) Task=`3074372d-ea99-484c-9210-5118d1be304c`::moving from state preparing -> state finished
>Thread-164::DEBUG::2014-04-10 18:56:48,310::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-164::DEBUG::2014-04-10 18:56:48,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-164::DEBUG::2014-04-10 18:56:48,310::task::974::TaskManager.Task::(_decref) Task=`3074372d-ea99-484c-9210-5118d1be304c`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,668::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,668::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,669::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,669::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,671::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,671::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,671::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:48,672::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-166::DEBUG::2014-04-10 18:56:49,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-166::DEBUG::2014-04-10 18:56:49,323::task::579::TaskManager.Task::(_updateState) Task=`48c7a1cf-7968-44b2-803a-5fb6836489d2`::moving from state init -> state preparing
>Thread-166::INFO::2014-04-10 18:56:49,323::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-166::DEBUG::2014-04-10 18:56:49,324::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-166::DEBUG::2014-04-10 18:56:49,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-166::INFO::2014-04-10 18:56:49,324::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-166::DEBUG::2014-04-10 18:56:49,324::task::1168::TaskManager.Task::(prepare) Task=`48c7a1cf-7968-44b2-803a-5fb6836489d2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-166::DEBUG::2014-04-10 18:56:49,325::task::579::TaskManager.Task::(_updateState) Task=`48c7a1cf-7968-44b2-803a-5fb6836489d2`::moving from state preparing -> state finished
>Thread-166::DEBUG::2014-04-10 18:56:49,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-166::DEBUG::2014-04-10 18:56:49,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-166::DEBUG::2014-04-10 18:56:49,325::task::974::TaskManager.Task::(_decref) Task=`48c7a1cf-7968-44b2-803a-5fb6836489d2`::ref 0 aborting False
>Thread-167::DEBUG::2014-04-10 18:56:50,341::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-167::DEBUG::2014-04-10 18:56:50,346::task::579::TaskManager.Task::(_updateState) Task=`00dab0a7-cc56-4171-b142-d329b21c5483`::moving from state init -> state preparing
>Thread-167::INFO::2014-04-10 18:56:50,349::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-167::DEBUG::2014-04-10 18:56:50,352::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-167::DEBUG::2014-04-10 18:56:50,355::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-167::INFO::2014-04-10 18:56:50,360::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-167::DEBUG::2014-04-10 18:56:50,364::task::1168::TaskManager.Task::(prepare) Task=`00dab0a7-cc56-4171-b142-d329b21c5483`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-167::DEBUG::2014-04-10 18:56:50,368::task::579::TaskManager.Task::(_updateState) Task=`00dab0a7-cc56-4171-b142-d329b21c5483`::moving from state preparing -> state finished
>Thread-167::DEBUG::2014-04-10 18:56:50,371::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-167::DEBUG::2014-04-10 18:56:50,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-167::DEBUG::2014-04-10 18:56:50,377::task::974::TaskManager.Task::(_decref) Task=`00dab0a7-cc56-4171-b142-d329b21c5483`::ref 0 aborting False
>Thread-133::WARNING::2014-04-10 18:56:50,500::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-133::DEBUG::2014-04-10 18:56:50,502::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-135::WARNING::2014-04-10 18:56:50,502::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-135::DEBUG::2014-04-10 18:56:50,504::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 18:56:50,506::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-148::ERROR::2014-04-10 18:56:50,507::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 18:56:50,506::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-148::ERROR::2014-04-10 18:56:50,508::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-148::DEBUG::2014-04-10 18:56:50,510::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-148::DEBUG::2014-04-10 18:56:50,510::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-148::DEBUG::2014-04-10 18:56:50,653::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-148::WARNING::2014-04-10 18:56:50,655::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-148::DEBUG::2014-04-10 18:56:50,655::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-65::DEBUG::2014-04-10 18:56:50,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:56:50,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00039462 s, 1.7 MB/s\n'; <rc> = 0
>Thread-172::DEBUG::2014-04-10 18:56:51,396::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-172::DEBUG::2014-04-10 18:56:51,396::task::579::TaskManager.Task::(_updateState) Task=`bbb5fb1b-aeb6-4238-815b-f1608e5fb3e6`::moving from state init -> state preparing
>Thread-172::INFO::2014-04-10 18:56:51,397::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-172::DEBUG::2014-04-10 18:56:51,397::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-172::DEBUG::2014-04-10 18:56:51,397::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-172::INFO::2014-04-10 18:56:51,397::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-172::DEBUG::2014-04-10 18:56:51,397::task::1168::TaskManager.Task::(prepare) Task=`bbb5fb1b-aeb6-4238-815b-f1608e5fb3e6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-172::DEBUG::2014-04-10 18:56:51,397::task::579::TaskManager.Task::(_updateState) Task=`bbb5fb1b-aeb6-4238-815b-f1608e5fb3e6`::moving from state preparing -> state finished
>Thread-172::DEBUG::2014-04-10 18:56:51,398::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-172::DEBUG::2014-04-10 18:56:51,398::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-172::DEBUG::2014-04-10 18:56:51,398::task::974::TaskManager.Task::(_decref) Task=`bbb5fb1b-aeb6-4238-815b-f1608e5fb3e6`::ref 0 aborting False
>Thread-173::DEBUG::2014-04-10 18:56:51,430::task::579::TaskManager.Task::(_updateState) Task=`3519c897-0eea-419c-9a6a-fd7b401fe972`::moving from state init -> state preparing
>Thread-173::INFO::2014-04-10 18:56:51,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-173::INFO::2014-04-10 18:56:51,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039462', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '71.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444809', 'lastCheck': '3.7', 'valid': True}}
>Thread-173::DEBUG::2014-04-10 18:56:51,431::task::1168::TaskManager.Task::(prepare) Task=`3519c897-0eea-419c-9a6a-fd7b401fe972`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039462', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '71.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444809', 'lastCheck': '3.7', 'valid': True}}
>Thread-173::DEBUG::2014-04-10 18:56:51,431::task::579::TaskManager.Task::(_updateState) Task=`3519c897-0eea-419c-9a6a-fd7b401fe972`::moving from state preparing -> state finished
>Thread-173::DEBUG::2014-04-10 18:56:51,431::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-173::DEBUG::2014-04-10 18:56:51,431::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-173::DEBUG::2014-04-10 18:56:51,432::task::974::TaskManager.Task::(_decref) Task=`3519c897-0eea-419c-9a6a-fd7b401fe972`::ref 0 aborting False
>Thread-174::DEBUG::2014-04-10 18:56:51,491::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-174::DEBUG::2014-04-10 18:56:51,491::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-174::DEBUG::2014-04-10 18:56:51,491::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-174::DEBUG::2014-04-10 18:56:51,491::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-175::DEBUG::2014-04-10 18:56:52,409::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-175::DEBUG::2014-04-10 18:56:52,409::task::579::TaskManager.Task::(_updateState) Task=`fa9f3f90-00b2-4d58-97ee-3d12e14f9740`::moving from state init -> state preparing
>Thread-175::INFO::2014-04-10 18:56:52,410::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-175::DEBUG::2014-04-10 18:56:52,410::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-175::DEBUG::2014-04-10 18:56:52,410::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-175::INFO::2014-04-10 18:56:52,410::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-175::DEBUG::2014-04-10 18:56:52,410::task::1168::TaskManager.Task::(prepare) Task=`fa9f3f90-00b2-4d58-97ee-3d12e14f9740`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-175::DEBUG::2014-04-10 18:56:52,410::task::579::TaskManager.Task::(_updateState) Task=`fa9f3f90-00b2-4d58-97ee-3d12e14f9740`::moving from state preparing -> state finished
>Thread-175::DEBUG::2014-04-10 18:56:52,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-175::DEBUG::2014-04-10 18:56:52,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-175::DEBUG::2014-04-10 18:56:52,411::task::974::TaskManager.Task::(_decref) Task=`fa9f3f90-00b2-4d58-97ee-3d12e14f9740`::ref 0 aborting False
>Thread-176::DEBUG::2014-04-10 18:56:53,422::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-176::DEBUG::2014-04-10 18:56:53,423::task::579::TaskManager.Task::(_updateState) Task=`9847d528-5c37-4e1f-aaff-6dd548993e47`::moving from state init -> state preparing
>Thread-176::INFO::2014-04-10 18:56:53,423::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-176::DEBUG::2014-04-10 18:56:53,423::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-176::DEBUG::2014-04-10 18:56:53,423::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-176::INFO::2014-04-10 18:56:53,423::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-176::DEBUG::2014-04-10 18:56:53,424::task::1168::TaskManager.Task::(prepare) Task=`9847d528-5c37-4e1f-aaff-6dd548993e47`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-176::DEBUG::2014-04-10 18:56:53,424::task::579::TaskManager.Task::(_updateState) Task=`9847d528-5c37-4e1f-aaff-6dd548993e47`::moving from state preparing -> state finished
>Thread-176::DEBUG::2014-04-10 18:56:53,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-176::DEBUG::2014-04-10 18:56:53,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-176::DEBUG::2014-04-10 18:56:53,424::task::974::TaskManager.Task::(_decref) Task=`9847d528-5c37-4e1f-aaff-6dd548993e47`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,678::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,678::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,679::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,679::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,681::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,681::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,681::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:53,681::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-177::DEBUG::2014-04-10 18:56:54,434::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-177::DEBUG::2014-04-10 18:56:54,435::task::579::TaskManager.Task::(_updateState) Task=`4b38a523-e50e-49e4-ad2d-d014453bbd7f`::moving from state init -> state preparing
>Thread-177::INFO::2014-04-10 18:56:54,435::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-177::DEBUG::2014-04-10 18:56:54,435::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-177::DEBUG::2014-04-10 18:56:54,435::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-177::INFO::2014-04-10 18:56:54,435::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-177::DEBUG::2014-04-10 18:56:54,436::task::1168::TaskManager.Task::(prepare) Task=`4b38a523-e50e-49e4-ad2d-d014453bbd7f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-177::DEBUG::2014-04-10 18:56:54,436::task::579::TaskManager.Task::(_updateState) Task=`4b38a523-e50e-49e4-ad2d-d014453bbd7f`::moving from state preparing -> state finished
>Thread-177::DEBUG::2014-04-10 18:56:54,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-177::DEBUG::2014-04-10 18:56:54,436::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-177::DEBUG::2014-04-10 18:56:54,436::task::974::TaskManager.Task::(_decref) Task=`4b38a523-e50e-49e4-ad2d-d014453bbd7f`::ref 0 aborting False
>Thread-179::DEBUG::2014-04-10 18:56:55,462::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-179::DEBUG::2014-04-10 18:56:55,462::task::579::TaskManager.Task::(_updateState) Task=`bffe8432-b370-494c-a5f3-7f352543c75a`::moving from state init -> state preparing
>Thread-179::INFO::2014-04-10 18:56:55,463::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-179::DEBUG::2014-04-10 18:56:55,463::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-179::DEBUG::2014-04-10 18:56:55,463::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-179::INFO::2014-04-10 18:56:55,463::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-179::DEBUG::2014-04-10 18:56:55,463::task::1168::TaskManager.Task::(prepare) Task=`bffe8432-b370-494c-a5f3-7f352543c75a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-179::DEBUG::2014-04-10 18:56:55,463::task::579::TaskManager.Task::(_updateState) Task=`bffe8432-b370-494c-a5f3-7f352543c75a`::moving from state preparing -> state finished
>Thread-179::DEBUG::2014-04-10 18:56:55,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-179::DEBUG::2014-04-10 18:56:55,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-179::DEBUG::2014-04-10 18:56:55,464::task::974::TaskManager.Task::(_decref) Task=`bffe8432-b370-494c-a5f3-7f352543c75a`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:56:55,820::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-180::DEBUG::2014-04-10 18:56:56,474::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-180::DEBUG::2014-04-10 18:56:56,474::task::579::TaskManager.Task::(_updateState) Task=`ea6192af-2638-43cc-9b9f-3ef367f0a0c9`::moving from state init -> state preparing
>Thread-180::INFO::2014-04-10 18:56:56,474::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-180::DEBUG::2014-04-10 18:56:56,475::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-180::DEBUG::2014-04-10 18:56:56,475::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-180::INFO::2014-04-10 18:56:56,475::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-180::DEBUG::2014-04-10 18:56:56,475::task::1168::TaskManager.Task::(prepare) Task=`ea6192af-2638-43cc-9b9f-3ef367f0a0c9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-180::DEBUG::2014-04-10 18:56:56,475::task::579::TaskManager.Task::(_updateState) Task=`ea6192af-2638-43cc-9b9f-3ef367f0a0c9`::moving from state preparing -> state finished
>Thread-180::DEBUG::2014-04-10 18:56:56,475::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-180::DEBUG::2014-04-10 18:56:56,475::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-180::DEBUG::2014-04-10 18:56:56,476::task::974::TaskManager.Task::(_decref) Task=`ea6192af-2638-43cc-9b9f-3ef367f0a0c9`::ref 0 aborting False
>Thread-181::DEBUG::2014-04-10 18:56:57,486::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-181::DEBUG::2014-04-10 18:56:57,486::task::579::TaskManager.Task::(_updateState) Task=`5c9abbf0-4e73-4b01-87a9-84a41c8300ad`::moving from state init -> state preparing
>Thread-181::INFO::2014-04-10 18:56:57,486::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-181::DEBUG::2014-04-10 18:56:57,486::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-181::DEBUG::2014-04-10 18:56:57,486::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-181::INFO::2014-04-10 18:56:57,486::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-181::DEBUG::2014-04-10 18:56:57,487::task::1168::TaskManager.Task::(prepare) Task=`5c9abbf0-4e73-4b01-87a9-84a41c8300ad`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-181::DEBUG::2014-04-10 18:56:57,487::task::579::TaskManager.Task::(_updateState) Task=`5c9abbf0-4e73-4b01-87a9-84a41c8300ad`::moving from state preparing -> state finished
>Thread-181::DEBUG::2014-04-10 18:56:57,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-181::DEBUG::2014-04-10 18:56:57,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-181::DEBUG::2014-04-10 18:56:57,487::task::974::TaskManager.Task::(_decref) Task=`5c9abbf0-4e73-4b01-87a9-84a41c8300ad`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:56:57,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:56:57,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000354631 s, 1.0 MB/s\n'; <rc> = 0
>Thread-183::DEBUG::2014-04-10 18:56:58,498::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-183::DEBUG::2014-04-10 18:56:58,499::task::579::TaskManager.Task::(_updateState) Task=`ddf5dc1c-47e3-4cd5-a495-7b6799260809`::moving from state init -> state preparing
>Thread-183::INFO::2014-04-10 18:56:58,499::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-183::DEBUG::2014-04-10 18:56:58,499::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-183::DEBUG::2014-04-10 18:56:58,500::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-183::INFO::2014-04-10 18:56:58,500::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-183::DEBUG::2014-04-10 18:56:58,500::task::1168::TaskManager.Task::(prepare) Task=`ddf5dc1c-47e3-4cd5-a495-7b6799260809`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-183::DEBUG::2014-04-10 18:56:58,500::task::579::TaskManager.Task::(_updateState) Task=`ddf5dc1c-47e3-4cd5-a495-7b6799260809`::moving from state preparing -> state finished
>Thread-183::DEBUG::2014-04-10 18:56:58,500::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-183::DEBUG::2014-04-10 18:56:58,500::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-183::DEBUG::2014-04-10 18:56:58,501::task::974::TaskManager.Task::(_decref) Task=`ddf5dc1c-47e3-4cd5-a495-7b6799260809`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,688::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,688::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,689::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,689::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,690::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,690::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,691::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:56:58,691::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-184::DEBUG::2014-04-10 18:56:59,511::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-184::DEBUG::2014-04-10 18:56:59,511::task::579::TaskManager.Task::(_updateState) Task=`6e886e07-34ba-48d0-990a-ad9facfdd75e`::moving from state init -> state preparing
>Thread-184::INFO::2014-04-10 18:56:59,512::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-184::DEBUG::2014-04-10 18:56:59,512::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-184::DEBUG::2014-04-10 18:56:59,512::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-184::INFO::2014-04-10 18:56:59,512::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-184::DEBUG::2014-04-10 18:56:59,512::task::1168::TaskManager.Task::(prepare) Task=`6e886e07-34ba-48d0-990a-ad9facfdd75e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-184::DEBUG::2014-04-10 18:56:59,512::task::579::TaskManager.Task::(_updateState) Task=`6e886e07-34ba-48d0-990a-ad9facfdd75e`::moving from state preparing -> state finished
>Thread-184::DEBUG::2014-04-10 18:56:59,513::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-184::DEBUG::2014-04-10 18:56:59,513::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-184::DEBUG::2014-04-10 18:56:59,513::task::974::TaskManager.Task::(_decref) Task=`6e886e07-34ba-48d0-990a-ad9facfdd75e`::ref 0 aborting False
>Thread-185::DEBUG::2014-04-10 18:57:00,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-185::DEBUG::2014-04-10 18:57:00,523::task::579::TaskManager.Task::(_updateState) Task=`d39aacc8-acf4-4b22-9733-1fe67b60b3f9`::moving from state init -> state preparing
>Thread-185::INFO::2014-04-10 18:57:00,524::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-185::DEBUG::2014-04-10 18:57:00,524::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-185::DEBUG::2014-04-10 18:57:00,524::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-185::INFO::2014-04-10 18:57:00,524::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-185::DEBUG::2014-04-10 18:57:00,524::task::1168::TaskManager.Task::(prepare) Task=`d39aacc8-acf4-4b22-9733-1fe67b60b3f9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-185::DEBUG::2014-04-10 18:57:00,524::task::579::TaskManager.Task::(_updateState) Task=`d39aacc8-acf4-4b22-9733-1fe67b60b3f9`::moving from state preparing -> state finished
>Thread-185::DEBUG::2014-04-10 18:57:00,525::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-185::DEBUG::2014-04-10 18:57:00,525::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-185::DEBUG::2014-04-10 18:57:00,525::task::974::TaskManager.Task::(_decref) Task=`d39aacc8-acf4-4b22-9733-1fe67b60b3f9`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:57:00,737::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:00,745::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000401004 s, 1.6 MB/s\n'; <rc> = 0
>Thread-187::DEBUG::2014-04-10 18:57:01,541::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-187::DEBUG::2014-04-10 18:57:01,542::task::579::TaskManager.Task::(_updateState) Task=`cf473773-9968-48fa-9207-3e77456fbc52`::moving from state init -> state preparing
>Thread-187::INFO::2014-04-10 18:57:01,542::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-187::DEBUG::2014-04-10 18:57:01,542::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-187::DEBUG::2014-04-10 18:57:01,542::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-187::INFO::2014-04-10 18:57:01,543::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-187::DEBUG::2014-04-10 18:57:01,543::task::1168::TaskManager.Task::(prepare) Task=`cf473773-9968-48fa-9207-3e77456fbc52`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-187::DEBUG::2014-04-10 18:57:01,543::task::579::TaskManager.Task::(_updateState) Task=`cf473773-9968-48fa-9207-3e77456fbc52`::moving from state preparing -> state finished
>Thread-187::DEBUG::2014-04-10 18:57:01,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-187::DEBUG::2014-04-10 18:57:01,544::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-187::DEBUG::2014-04-10 18:57:01,544::task::974::TaskManager.Task::(_decref) Task=`cf473773-9968-48fa-9207-3e77456fbc52`::ref 0 aborting False
>Thread-188::DEBUG::2014-04-10 18:57:02,554::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-188::DEBUG::2014-04-10 18:57:02,555::task::579::TaskManager.Task::(_updateState) Task=`16abe474-8df9-4f62-b130-b0d7bf4ce1e9`::moving from state init -> state preparing
>Thread-188::INFO::2014-04-10 18:57:02,555::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-188::DEBUG::2014-04-10 18:57:02,555::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-188::DEBUG::2014-04-10 18:57:02,555::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-188::INFO::2014-04-10 18:57:02,555::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-188::DEBUG::2014-04-10 18:57:02,555::task::1168::TaskManager.Task::(prepare) Task=`16abe474-8df9-4f62-b130-b0d7bf4ce1e9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-188::DEBUG::2014-04-10 18:57:02,556::task::579::TaskManager.Task::(_updateState) Task=`16abe474-8df9-4f62-b130-b0d7bf4ce1e9`::moving from state preparing -> state finished
>Thread-188::DEBUG::2014-04-10 18:57:02,556::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-188::DEBUG::2014-04-10 18:57:02,556::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-188::DEBUG::2014-04-10 18:57:02,556::task::974::TaskManager.Task::(_decref) Task=`16abe474-8df9-4f62-b130-b0d7bf4ce1e9`::ref 0 aborting False
>Thread-189::DEBUG::2014-04-10 18:57:03,567::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-189::DEBUG::2014-04-10 18:57:03,567::task::579::TaskManager.Task::(_updateState) Task=`837b3ee7-b28d-4b58-8e7b-7f8894dffea1`::moving from state init -> state preparing
>Thread-189::INFO::2014-04-10 18:57:03,568::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-189::DEBUG::2014-04-10 18:57:03,568::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-189::DEBUG::2014-04-10 18:57:03,568::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-189::INFO::2014-04-10 18:57:03,568::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-189::DEBUG::2014-04-10 18:57:03,568::task::1168::TaskManager.Task::(prepare) Task=`837b3ee7-b28d-4b58-8e7b-7f8894dffea1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-189::DEBUG::2014-04-10 18:57:03,568::task::579::TaskManager.Task::(_updateState) Task=`837b3ee7-b28d-4b58-8e7b-7f8894dffea1`::moving from state preparing -> state finished
>Thread-189::DEBUG::2014-04-10 18:57:03,569::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-189::DEBUG::2014-04-10 18:57:03,569::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-189::DEBUG::2014-04-10 18:57:03,569::task::974::TaskManager.Task::(_decref) Task=`837b3ee7-b28d-4b58-8e7b-7f8894dffea1`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,696::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,696::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,696::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,696::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,698::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,698::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,699::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:03,699::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-191::DEBUG::2014-04-10 18:57:04,579::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-191::DEBUG::2014-04-10 18:57:04,580::task::579::TaskManager.Task::(_updateState) Task=`679be8ea-fc5c-4686-9dd8-7a142633ab1f`::moving from state init -> state preparing
>Thread-191::INFO::2014-04-10 18:57:04,580::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-191::DEBUG::2014-04-10 18:57:04,580::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-191::DEBUG::2014-04-10 18:57:04,580::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-191::INFO::2014-04-10 18:57:04,580::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-191::DEBUG::2014-04-10 18:57:04,580::task::1168::TaskManager.Task::(prepare) Task=`679be8ea-fc5c-4686-9dd8-7a142633ab1f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-191::DEBUG::2014-04-10 18:57:04,581::task::579::TaskManager.Task::(_updateState) Task=`679be8ea-fc5c-4686-9dd8-7a142633ab1f`::moving from state preparing -> state finished
>Thread-191::DEBUG::2014-04-10 18:57:04,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-191::DEBUG::2014-04-10 18:57:04,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-191::DEBUG::2014-04-10 18:57:04,581::task::974::TaskManager.Task::(_decref) Task=`679be8ea-fc5c-4686-9dd8-7a142633ab1f`::ref 0 aborting False
>Thread-192::DEBUG::2014-04-10 18:57:05,683::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-192::DEBUG::2014-04-10 18:57:05,683::task::579::TaskManager.Task::(_updateState) Task=`5cbd45b3-cf2e-4cc1-ab5c-51edf84971f0`::moving from state init -> state preparing
>Thread-192::INFO::2014-04-10 18:57:05,683::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-192::DEBUG::2014-04-10 18:57:05,683::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-192::DEBUG::2014-04-10 18:57:05,684::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-192::INFO::2014-04-10 18:57:05,684::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-192::DEBUG::2014-04-10 18:57:05,684::task::1168::TaskManager.Task::(prepare) Task=`5cbd45b3-cf2e-4cc1-ab5c-51edf84971f0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-192::DEBUG::2014-04-10 18:57:05,684::task::579::TaskManager.Task::(_updateState) Task=`5cbd45b3-cf2e-4cc1-ab5c-51edf84971f0`::moving from state preparing -> state finished
>Thread-192::DEBUG::2014-04-10 18:57:05,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-192::DEBUG::2014-04-10 18:57:05,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-192::DEBUG::2014-04-10 18:57:05,685::task::974::TaskManager.Task::(_decref) Task=`5cbd45b3-cf2e-4cc1-ab5c-51edf84971f0`::ref 0 aborting False
>Thread-193::DEBUG::2014-04-10 18:57:06,694::task::579::TaskManager.Task::(_updateState) Task=`6e0b2ad7-4ab5-4f09-bab7-68f2c71395da`::moving from state init -> state preparing
>Thread-193::INFO::2014-04-10 18:57:06,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-193::INFO::2014-04-10 18:57:06,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401004', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '16.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '86.4', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354631', 'lastCheck': '9.0', 'valid': True}}
>Thread-193::DEBUG::2014-04-10 18:57:06,715::task::1168::TaskManager.Task::(prepare) Task=`6e0b2ad7-4ab5-4f09-bab7-68f2c71395da`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401004', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '16.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '86.4', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354631', 'lastCheck': '9.0', 'valid': True}}
>Thread-193::DEBUG::2014-04-10 18:57:06,715::task::579::TaskManager.Task::(_updateState) Task=`6e0b2ad7-4ab5-4f09-bab7-68f2c71395da`::moving from state preparing -> state finished
>Thread-193::DEBUG::2014-04-10 18:57:06,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-193::DEBUG::2014-04-10 18:57:06,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-193::DEBUG::2014-04-10 18:57:06,716::task::974::TaskManager.Task::(_decref) Task=`6e0b2ad7-4ab5-4f09-bab7-68f2c71395da`::ref 0 aborting False
>Thread-194::DEBUG::2014-04-10 18:57:06,731::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-194::DEBUG::2014-04-10 18:57:06,731::task::579::TaskManager.Task::(_updateState) Task=`bc5dba9e-046b-4cb0-8ce6-eefc1de1346b`::moving from state init -> state preparing
>Thread-194::INFO::2014-04-10 18:57:06,731::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-194::DEBUG::2014-04-10 18:57:06,731::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-194::DEBUG::2014-04-10 18:57:06,731::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-194::INFO::2014-04-10 18:57:06,732::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-194::DEBUG::2014-04-10 18:57:06,732::task::1168::TaskManager.Task::(prepare) Task=`bc5dba9e-046b-4cb0-8ce6-eefc1de1346b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-194::DEBUG::2014-04-10 18:57:06,732::task::579::TaskManager.Task::(_updateState) Task=`bc5dba9e-046b-4cb0-8ce6-eefc1de1346b`::moving from state preparing -> state finished
>Thread-194::DEBUG::2014-04-10 18:57:06,732::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-194::DEBUG::2014-04-10 18:57:06,732::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-194::DEBUG::2014-04-10 18:57:06,732::task::974::TaskManager.Task::(_decref) Task=`bc5dba9e-046b-4cb0-8ce6-eefc1de1346b`::ref 0 aborting False
>Thread-195::DEBUG::2014-04-10 18:57:06,764::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-195::DEBUG::2014-04-10 18:57:06,764::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-195::DEBUG::2014-04-10 18:57:06,764::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-195::DEBUG::2014-04-10 18:57:06,765::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-196::DEBUG::2014-04-10 18:57:07,743::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-196::DEBUG::2014-04-10 18:57:07,743::task::579::TaskManager.Task::(_updateState) Task=`8d0401b7-f2d2-4e01-a2ed-78e155142280`::moving from state init -> state preparing
>Thread-196::INFO::2014-04-10 18:57:07,743::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-196::DEBUG::2014-04-10 18:57:07,743::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-196::DEBUG::2014-04-10 18:57:07,743::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-196::INFO::2014-04-10 18:57:07,744::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-196::DEBUG::2014-04-10 18:57:07,744::task::1168::TaskManager.Task::(prepare) Task=`8d0401b7-f2d2-4e01-a2ed-78e155142280`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-196::DEBUG::2014-04-10 18:57:07,744::task::579::TaskManager.Task::(_updateState) Task=`8d0401b7-f2d2-4e01-a2ed-78e155142280`::moving from state preparing -> state finished
>Thread-196::DEBUG::2014-04-10 18:57:07,744::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-196::DEBUG::2014-04-10 18:57:07,744::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-196::DEBUG::2014-04-10 18:57:07,744::task::974::TaskManager.Task::(_decref) Task=`8d0401b7-f2d2-4e01-a2ed-78e155142280`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:57:07,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:07,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00041078 s, 896 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,706::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,706::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,706::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,706::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,708::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,708::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,708::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:08,708::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-197::DEBUG::2014-04-10 18:57:08,756::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-197::DEBUG::2014-04-10 18:57:08,756::task::579::TaskManager.Task::(_updateState) Task=`0ca5c517-81ec-4882-8011-74cc1c521846`::moving from state init -> state preparing
>Thread-197::INFO::2014-04-10 18:57:08,757::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-197::DEBUG::2014-04-10 18:57:08,757::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-197::DEBUG::2014-04-10 18:57:08,757::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-197::INFO::2014-04-10 18:57:08,757::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-197::DEBUG::2014-04-10 18:57:08,757::task::1168::TaskManager.Task::(prepare) Task=`0ca5c517-81ec-4882-8011-74cc1c521846`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-197::DEBUG::2014-04-10 18:57:08,757::task::579::TaskManager.Task::(_updateState) Task=`0ca5c517-81ec-4882-8011-74cc1c521846`::moving from state preparing -> state finished
>Thread-197::DEBUG::2014-04-10 18:57:08,758::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-197::DEBUG::2014-04-10 18:57:08,758::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-197::DEBUG::2014-04-10 18:57:08,758::task::974::TaskManager.Task::(_decref) Task=`0ca5c517-81ec-4882-8011-74cc1c521846`::ref 0 aborting False
>Thread-198::DEBUG::2014-04-10 18:57:09,768::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-198::DEBUG::2014-04-10 18:57:09,768::task::579::TaskManager.Task::(_updateState) Task=`4dc426b0-2852-47d3-b65f-b681da19d18b`::moving from state init -> state preparing
>Thread-198::INFO::2014-04-10 18:57:09,769::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-198::DEBUG::2014-04-10 18:57:09,769::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-198::DEBUG::2014-04-10 18:57:09,769::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-198::INFO::2014-04-10 18:57:09,769::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-198::DEBUG::2014-04-10 18:57:09,769::task::1168::TaskManager.Task::(prepare) Task=`4dc426b0-2852-47d3-b65f-b681da19d18b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-198::DEBUG::2014-04-10 18:57:09,769::task::579::TaskManager.Task::(_updateState) Task=`4dc426b0-2852-47d3-b65f-b681da19d18b`::moving from state preparing -> state finished
>Thread-198::DEBUG::2014-04-10 18:57:09,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-198::DEBUG::2014-04-10 18:57:09,770::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-198::DEBUG::2014-04-10 18:57:09,770::task::974::TaskManager.Task::(_decref) Task=`4dc426b0-2852-47d3-b65f-b681da19d18b`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:57:10,754::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:10,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000438789 s, 1.5 MB/s\n'; <rc> = 0
>Thread-200::DEBUG::2014-04-10 18:57:10,780::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-200::DEBUG::2014-04-10 18:57:10,780::task::579::TaskManager.Task::(_updateState) Task=`de547807-2d50-49ab-8595-0304c57b42c9`::moving from state init -> state preparing
>Thread-200::INFO::2014-04-10 18:57:10,780::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-200::DEBUG::2014-04-10 18:57:10,781::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-200::DEBUG::2014-04-10 18:57:10,781::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-200::INFO::2014-04-10 18:57:10,781::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-200::DEBUG::2014-04-10 18:57:10,781::task::1168::TaskManager.Task::(prepare) Task=`de547807-2d50-49ab-8595-0304c57b42c9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-200::DEBUG::2014-04-10 18:57:10,781::task::579::TaskManager.Task::(_updateState) Task=`de547807-2d50-49ab-8595-0304c57b42c9`::moving from state preparing -> state finished
>Thread-200::DEBUG::2014-04-10 18:57:10,781::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-200::DEBUG::2014-04-10 18:57:10,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-200::DEBUG::2014-04-10 18:57:10,782::task::974::TaskManager.Task::(_decref) Task=`de547807-2d50-49ab-8595-0304c57b42c9`::ref 0 aborting False
>Thread-201::DEBUG::2014-04-10 18:57:11,792::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-201::DEBUG::2014-04-10 18:57:11,811::task::579::TaskManager.Task::(_updateState) Task=`84fcbfce-ab7c-4448-a8c4-02d484c5911a`::moving from state init -> state preparing
>Thread-201::INFO::2014-04-10 18:57:11,811::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-201::DEBUG::2014-04-10 18:57:11,811::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-201::DEBUG::2014-04-10 18:57:11,812::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-201::INFO::2014-04-10 18:57:11,812::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-201::DEBUG::2014-04-10 18:57:11,812::task::1168::TaskManager.Task::(prepare) Task=`84fcbfce-ab7c-4448-a8c4-02d484c5911a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-201::DEBUG::2014-04-10 18:57:11,812::task::579::TaskManager.Task::(_updateState) Task=`84fcbfce-ab7c-4448-a8c4-02d484c5911a`::moving from state preparing -> state finished
>Thread-201::DEBUG::2014-04-10 18:57:11,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-201::DEBUG::2014-04-10 18:57:11,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-201::DEBUG::2014-04-10 18:57:11,812::task::974::TaskManager.Task::(_decref) Task=`84fcbfce-ab7c-4448-a8c4-02d484c5911a`::ref 0 aborting False
>Thread-202::DEBUG::2014-04-10 18:57:12,822::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-202::DEBUG::2014-04-10 18:57:12,822::task::579::TaskManager.Task::(_updateState) Task=`3ae46636-1382-4869-b9bb-6789158a3afe`::moving from state init -> state preparing
>Thread-202::INFO::2014-04-10 18:57:12,823::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-202::DEBUG::2014-04-10 18:57:12,823::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-202::DEBUG::2014-04-10 18:57:12,823::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-202::INFO::2014-04-10 18:57:12,823::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-202::DEBUG::2014-04-10 18:57:12,823::task::1168::TaskManager.Task::(prepare) Task=`3ae46636-1382-4869-b9bb-6789158a3afe`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-202::DEBUG::2014-04-10 18:57:12,824::task::579::TaskManager.Task::(_updateState) Task=`3ae46636-1382-4869-b9bb-6789158a3afe`::moving from state preparing -> state finished
>Thread-202::DEBUG::2014-04-10 18:57:12,824::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-202::DEBUG::2014-04-10 18:57:12,824::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-202::DEBUG::2014-04-10 18:57:12,824::task::974::TaskManager.Task::(_decref) Task=`3ae46636-1382-4869-b9bb-6789158a3afe`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,716::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,716::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,716::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,716::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,718::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,719::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,719::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:13,719::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-204::DEBUG::2014-04-10 18:57:13,835::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-204::DEBUG::2014-04-10 18:57:13,835::task::579::TaskManager.Task::(_updateState) Task=`6d73ead4-1910-479a-82dc-f369466913b6`::moving from state init -> state preparing
>Thread-204::INFO::2014-04-10 18:57:13,836::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-204::DEBUG::2014-04-10 18:57:13,836::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-204::DEBUG::2014-04-10 18:57:13,836::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-204::INFO::2014-04-10 18:57:13,836::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-204::DEBUG::2014-04-10 18:57:13,836::task::1168::TaskManager.Task::(prepare) Task=`6d73ead4-1910-479a-82dc-f369466913b6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-204::DEBUG::2014-04-10 18:57:13,836::task::579::TaskManager.Task::(_updateState) Task=`6d73ead4-1910-479a-82dc-f369466913b6`::moving from state preparing -> state finished
>Thread-204::DEBUG::2014-04-10 18:57:13,837::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-204::DEBUG::2014-04-10 18:57:13,837::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-204::DEBUG::2014-04-10 18:57:13,837::task::974::TaskManager.Task::(_decref) Task=`6d73ead4-1910-479a-82dc-f369466913b6`::ref 0 aborting False
>Thread-205::DEBUG::2014-04-10 18:57:14,847::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-205::DEBUG::2014-04-10 18:57:14,847::task::579::TaskManager.Task::(_updateState) Task=`71636822-1fed-4003-bdb3-045fd3443893`::moving from state init -> state preparing
>Thread-205::INFO::2014-04-10 18:57:14,847::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-205::DEBUG::2014-04-10 18:57:14,847::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-205::DEBUG::2014-04-10 18:57:14,848::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-205::INFO::2014-04-10 18:57:14,848::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-205::DEBUG::2014-04-10 18:57:14,848::task::1168::TaskManager.Task::(prepare) Task=`71636822-1fed-4003-bdb3-045fd3443893`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-205::DEBUG::2014-04-10 18:57:14,848::task::579::TaskManager.Task::(_updateState) Task=`71636822-1fed-4003-bdb3-045fd3443893`::moving from state preparing -> state finished
>Thread-205::DEBUG::2014-04-10 18:57:14,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-205::DEBUG::2014-04-10 18:57:14,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-205::DEBUG::2014-04-10 18:57:14,849::task::974::TaskManager.Task::(_decref) Task=`71636822-1fed-4003-bdb3-045fd3443893`::ref 0 aborting False
>Thread-206::DEBUG::2014-04-10 18:57:15,858::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-206::DEBUG::2014-04-10 18:57:15,859::task::579::TaskManager.Task::(_updateState) Task=`71339186-74d1-4a59-9b0d-c2fd58eda8b6`::moving from state init -> state preparing
>Thread-206::INFO::2014-04-10 18:57:15,859::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-206::DEBUG::2014-04-10 18:57:15,859::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-206::DEBUG::2014-04-10 18:57:15,859::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-206::INFO::2014-04-10 18:57:15,859::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-206::DEBUG::2014-04-10 18:57:15,859::task::1168::TaskManager.Task::(prepare) Task=`71339186-74d1-4a59-9b0d-c2fd58eda8b6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-206::DEBUG::2014-04-10 18:57:15,859::task::579::TaskManager.Task::(_updateState) Task=`71339186-74d1-4a59-9b0d-c2fd58eda8b6`::moving from state preparing -> state finished
>Thread-206::DEBUG::2014-04-10 18:57:15,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-206::DEBUG::2014-04-10 18:57:15,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-206::DEBUG::2014-04-10 18:57:15,860::task::974::TaskManager.Task::(_decref) Task=`71339186-74d1-4a59-9b0d-c2fd58eda8b6`::ref 0 aborting False
>Thread-208::DEBUG::2014-04-10 18:57:16,869::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-208::DEBUG::2014-04-10 18:57:16,891::task::579::TaskManager.Task::(_updateState) Task=`8d7a7996-6efd-47a1-b6ff-6a22476a51b3`::moving from state init -> state preparing
>Thread-208::INFO::2014-04-10 18:57:16,891::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-208::DEBUG::2014-04-10 18:57:16,892::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-208::DEBUG::2014-04-10 18:57:16,892::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-208::INFO::2014-04-10 18:57:16,892::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-208::DEBUG::2014-04-10 18:57:16,892::task::1168::TaskManager.Task::(prepare) Task=`8d7a7996-6efd-47a1-b6ff-6a22476a51b3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-208::DEBUG::2014-04-10 18:57:16,892::task::579::TaskManager.Task::(_updateState) Task=`8d7a7996-6efd-47a1-b6ff-6a22476a51b3`::moving from state preparing -> state finished
>Thread-208::DEBUG::2014-04-10 18:57:16,892::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-208::DEBUG::2014-04-10 18:57:16,893::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-208::DEBUG::2014-04-10 18:57:16,893::task::974::TaskManager.Task::(_decref) Task=`8d7a7996-6efd-47a1-b6ff-6a22476a51b3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:57:17,773::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:17,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470205 s, 783 kB/s\n'; <rc> = 0
>Thread-209::DEBUG::2014-04-10 18:57:17,903::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-209::DEBUG::2014-04-10 18:57:17,903::task::579::TaskManager.Task::(_updateState) Task=`70684877-2be5-4f98-8a89-95b6fce0ffd6`::moving from state init -> state preparing
>Thread-209::INFO::2014-04-10 18:57:17,904::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-209::DEBUG::2014-04-10 18:57:17,904::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-209::DEBUG::2014-04-10 18:57:17,904::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-209::INFO::2014-04-10 18:57:17,905::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-209::DEBUG::2014-04-10 18:57:17,905::task::1168::TaskManager.Task::(prepare) Task=`70684877-2be5-4f98-8a89-95b6fce0ffd6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-209::DEBUG::2014-04-10 18:57:17,905::task::579::TaskManager.Task::(_updateState) Task=`70684877-2be5-4f98-8a89-95b6fce0ffd6`::moving from state preparing -> state finished
>Thread-209::DEBUG::2014-04-10 18:57:17,905::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-209::DEBUG::2014-04-10 18:57:17,906::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-209::DEBUG::2014-04-10 18:57:17,906::task::974::TaskManager.Task::(_decref) Task=`70684877-2be5-4f98-8a89-95b6fce0ffd6`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,724::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,725::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,725::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,727::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,727::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,727::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:18,727::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-210::DEBUG::2014-04-10 18:57:18,921::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-210::DEBUG::2014-04-10 18:57:18,922::task::579::TaskManager.Task::(_updateState) Task=`9c4b194d-7c4a-4561-96f1-8adbd123a2e7`::moving from state init -> state preparing
>Thread-210::INFO::2014-04-10 18:57:18,922::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-210::DEBUG::2014-04-10 18:57:18,922::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-210::DEBUG::2014-04-10 18:57:18,923::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-210::INFO::2014-04-10 18:57:18,923::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-210::DEBUG::2014-04-10 18:57:18,923::task::1168::TaskManager.Task::(prepare) Task=`9c4b194d-7c4a-4561-96f1-8adbd123a2e7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-210::DEBUG::2014-04-10 18:57:18,923::task::579::TaskManager.Task::(_updateState) Task=`9c4b194d-7c4a-4561-96f1-8adbd123a2e7`::moving from state preparing -> state finished
>Thread-210::DEBUG::2014-04-10 18:57:18,923::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-210::DEBUG::2014-04-10 18:57:18,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-210::DEBUG::2014-04-10 18:57:18,924::task::974::TaskManager.Task::(_decref) Task=`9c4b194d-7c4a-4561-96f1-8adbd123a2e7`::ref 0 aborting False
>Thread-212::DEBUG::2014-04-10 18:57:19,934::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-212::DEBUG::2014-04-10 18:57:19,935::task::579::TaskManager.Task::(_updateState) Task=`a8dd25ae-c2c0-4f13-98be-14d3fb232f03`::moving from state init -> state preparing
>Thread-212::INFO::2014-04-10 18:57:19,935::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-212::DEBUG::2014-04-10 18:57:19,935::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-212::DEBUG::2014-04-10 18:57:19,935::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-212::INFO::2014-04-10 18:57:19,936::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-212::DEBUG::2014-04-10 18:57:19,936::task::1168::TaskManager.Task::(prepare) Task=`a8dd25ae-c2c0-4f13-98be-14d3fb232f03`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-212::DEBUG::2014-04-10 18:57:19,936::task::579::TaskManager.Task::(_updateState) Task=`a8dd25ae-c2c0-4f13-98be-14d3fb232f03`::moving from state preparing -> state finished
>Thread-212::DEBUG::2014-04-10 18:57:19,936::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-212::DEBUG::2014-04-10 18:57:19,936::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-212::DEBUG::2014-04-10 18:57:19,937::task::974::TaskManager.Task::(_decref) Task=`a8dd25ae-c2c0-4f13-98be-14d3fb232f03`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:57:20,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:20,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000367026 s, 1.8 MB/s\n'; <rc> = 0
>Thread-213::DEBUG::2014-04-10 18:57:20,947::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-213::DEBUG::2014-04-10 18:57:20,947::task::579::TaskManager.Task::(_updateState) Task=`ac07ec52-cb4d-4482-8faf-be059ef57c98`::moving from state init -> state preparing
>Thread-213::INFO::2014-04-10 18:57:20,948::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-213::DEBUG::2014-04-10 18:57:20,948::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-213::DEBUG::2014-04-10 18:57:20,948::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-213::INFO::2014-04-10 18:57:20,948::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-213::DEBUG::2014-04-10 18:57:20,948::task::1168::TaskManager.Task::(prepare) Task=`ac07ec52-cb4d-4482-8faf-be059ef57c98`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-213::DEBUG::2014-04-10 18:57:20,949::task::579::TaskManager.Task::(_updateState) Task=`ac07ec52-cb4d-4482-8faf-be059ef57c98`::moving from state preparing -> state finished
>Thread-213::DEBUG::2014-04-10 18:57:20,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-213::DEBUG::2014-04-10 18:57:20,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-213::DEBUG::2014-04-10 18:57:20,949::task::974::TaskManager.Task::(_decref) Task=`ac07ec52-cb4d-4482-8faf-be059ef57c98`::ref 0 aborting False
>Thread-214::DEBUG::2014-04-10 18:57:21,959::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-214::DEBUG::2014-04-10 18:57:21,971::task::579::TaskManager.Task::(_updateState) Task=`da33e467-c532-432b-a9d5-fa07e1a02877`::moving from state init -> state preparing
>Thread-214::INFO::2014-04-10 18:57:21,972::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-214::DEBUG::2014-04-10 18:57:21,972::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-214::DEBUG::2014-04-10 18:57:21,972::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-214::INFO::2014-04-10 18:57:21,972::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-214::DEBUG::2014-04-10 18:57:21,972::task::1168::TaskManager.Task::(prepare) Task=`da33e467-c532-432b-a9d5-fa07e1a02877`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-214::DEBUG::2014-04-10 18:57:21,972::task::579::TaskManager.Task::(_updateState) Task=`da33e467-c532-432b-a9d5-fa07e1a02877`::moving from state preparing -> state finished
>Thread-214::DEBUG::2014-04-10 18:57:21,973::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-214::DEBUG::2014-04-10 18:57:21,973::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-214::DEBUG::2014-04-10 18:57:21,973::task::974::TaskManager.Task::(_decref) Task=`da33e467-c532-432b-a9d5-fa07e1a02877`::ref 0 aborting False
>Thread-215::DEBUG::2014-04-10 18:57:22,032::task::579::TaskManager.Task::(_updateState) Task=`92260890-cdbd-424a-9634-ac76f508cb85`::moving from state init -> state preparing
>Thread-215::INFO::2014-04-10 18:57:22,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-215::INFO::2014-04-10 18:57:22,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367026', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '31.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '101.7', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470205', 'lastCheck': '4.2', 'valid': True}}
>Thread-215::DEBUG::2014-04-10 18:57:22,033::task::1168::TaskManager.Task::(prepare) Task=`92260890-cdbd-424a-9634-ac76f508cb85`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367026', 'lastCheck': '1.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '31.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '101.7', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470205', 'lastCheck': '4.2', 'valid': True}}
>Thread-215::DEBUG::2014-04-10 18:57:22,033::task::579::TaskManager.Task::(_updateState) Task=`92260890-cdbd-424a-9634-ac76f508cb85`::moving from state preparing -> state finished
>Thread-215::DEBUG::2014-04-10 18:57:22,033::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-215::DEBUG::2014-04-10 18:57:22,033::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-215::DEBUG::2014-04-10 18:57:22,033::task::974::TaskManager.Task::(_decref) Task=`92260890-cdbd-424a-9634-ac76f508cb85`::ref 0 aborting False
>Thread-216::DEBUG::2014-04-10 18:57:22,064::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-216::DEBUG::2014-04-10 18:57:22,065::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-216::DEBUG::2014-04-10 18:57:22,065::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-216::DEBUG::2014-04-10 18:57:22,065::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-217::DEBUG::2014-04-10 18:57:22,983::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-217::DEBUG::2014-04-10 18:57:22,983::task::579::TaskManager.Task::(_updateState) Task=`f862f413-2251-45e6-b607-9408a1a28898`::moving from state init -> state preparing
>Thread-217::INFO::2014-04-10 18:57:22,984::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-217::DEBUG::2014-04-10 18:57:22,984::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-217::DEBUG::2014-04-10 18:57:22,984::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-217::INFO::2014-04-10 18:57:22,984::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-217::DEBUG::2014-04-10 18:57:22,984::task::1168::TaskManager.Task::(prepare) Task=`f862f413-2251-45e6-b607-9408a1a28898`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-217::DEBUG::2014-04-10 18:57:22,985::task::579::TaskManager.Task::(_updateState) Task=`f862f413-2251-45e6-b607-9408a1a28898`::moving from state preparing -> state finished
>Thread-217::DEBUG::2014-04-10 18:57:22,985::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-217::DEBUG::2014-04-10 18:57:22,985::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-217::DEBUG::2014-04-10 18:57:22,985::task::974::TaskManager.Task::(_decref) Task=`f862f413-2251-45e6-b607-9408a1a28898`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,735::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,735::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,735::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,735::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,737::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,737::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,738::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:23,738::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-218::DEBUG::2014-04-10 18:57:24,011::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-218::DEBUG::2014-04-10 18:57:24,012::task::579::TaskManager.Task::(_updateState) Task=`54f7bf84-8b7e-4cdf-82f6-d2504e3c5ca7`::moving from state init -> state preparing
>Thread-218::INFO::2014-04-10 18:57:24,012::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-218::DEBUG::2014-04-10 18:57:24,012::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-218::DEBUG::2014-04-10 18:57:24,012::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-218::INFO::2014-04-10 18:57:24,012::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-218::DEBUG::2014-04-10 18:57:24,013::task::1168::TaskManager.Task::(prepare) Task=`54f7bf84-8b7e-4cdf-82f6-d2504e3c5ca7`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-218::DEBUG::2014-04-10 18:57:24,013::task::579::TaskManager.Task::(_updateState) Task=`54f7bf84-8b7e-4cdf-82f6-d2504e3c5ca7`::moving from state preparing -> state finished
>Thread-218::DEBUG::2014-04-10 18:57:24,013::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-218::DEBUG::2014-04-10 18:57:24,013::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-218::DEBUG::2014-04-10 18:57:24,013::task::974::TaskManager.Task::(_decref) Task=`54f7bf84-8b7e-4cdf-82f6-d2504e3c5ca7`::ref 0 aborting False
>Thread-219::DEBUG::2014-04-10 18:57:25,024::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-219::DEBUG::2014-04-10 18:57:25,024::task::579::TaskManager.Task::(_updateState) Task=`1c93d6e1-b8b9-4466-848c-0ca4fa31158a`::moving from state init -> state preparing
>Thread-219::INFO::2014-04-10 18:57:25,024::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-219::DEBUG::2014-04-10 18:57:25,024::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-219::DEBUG::2014-04-10 18:57:25,025::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-219::INFO::2014-04-10 18:57:25,025::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-219::DEBUG::2014-04-10 18:57:25,025::task::1168::TaskManager.Task::(prepare) Task=`1c93d6e1-b8b9-4466-848c-0ca4fa31158a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-219::DEBUG::2014-04-10 18:57:25,025::task::579::TaskManager.Task::(_updateState) Task=`1c93d6e1-b8b9-4466-848c-0ca4fa31158a`::moving from state preparing -> state finished
>Thread-219::DEBUG::2014-04-10 18:57:25,025::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-219::DEBUG::2014-04-10 18:57:25,025::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-219::DEBUG::2014-04-10 18:57:25,026::task::974::TaskManager.Task::(_decref) Task=`1c93d6e1-b8b9-4466-848c-0ca4fa31158a`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:57:25,856::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-221::DEBUG::2014-04-10 18:57:26,036::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-221::DEBUG::2014-04-10 18:57:26,036::task::579::TaskManager.Task::(_updateState) Task=`e998d4be-69b8-476b-8418-a16598d74d98`::moving from state init -> state preparing
>Thread-221::INFO::2014-04-10 18:57:26,036::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-221::DEBUG::2014-04-10 18:57:26,037::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-221::DEBUG::2014-04-10 18:57:26,037::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-221::INFO::2014-04-10 18:57:26,037::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-221::DEBUG::2014-04-10 18:57:26,037::task::1168::TaskManager.Task::(prepare) Task=`e998d4be-69b8-476b-8418-a16598d74d98`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-221::DEBUG::2014-04-10 18:57:26,037::task::579::TaskManager.Task::(_updateState) Task=`e998d4be-69b8-476b-8418-a16598d74d98`::moving from state preparing -> state finished
>Thread-221::DEBUG::2014-04-10 18:57:26,037::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-221::DEBUG::2014-04-10 18:57:26,037::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-221::DEBUG::2014-04-10 18:57:26,038::task::974::TaskManager.Task::(_decref) Task=`e998d4be-69b8-476b-8418-a16598d74d98`::ref 0 aborting False
>Thread-222::DEBUG::2014-04-10 18:57:27,048::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-222::DEBUG::2014-04-10 18:57:27,060::task::579::TaskManager.Task::(_updateState) Task=`854b410f-3209-44a1-801d-978a015b0c09`::moving from state init -> state preparing
>Thread-222::INFO::2014-04-10 18:57:27,060::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-222::DEBUG::2014-04-10 18:57:27,060::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-222::DEBUG::2014-04-10 18:57:27,060::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-222::INFO::2014-04-10 18:57:27,060::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-222::DEBUG::2014-04-10 18:57:27,061::task::1168::TaskManager.Task::(prepare) Task=`854b410f-3209-44a1-801d-978a015b0c09`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-222::DEBUG::2014-04-10 18:57:27,061::task::579::TaskManager.Task::(_updateState) Task=`854b410f-3209-44a1-801d-978a015b0c09`::moving from state preparing -> state finished
>Thread-222::DEBUG::2014-04-10 18:57:27,061::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-222::DEBUG::2014-04-10 18:57:27,061::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-222::DEBUG::2014-04-10 18:57:27,061::task::974::TaskManager.Task::(_decref) Task=`854b410f-3209-44a1-801d-978a015b0c09`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:57:27,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:27,796::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000379139 s, 971 kB/s\n'; <rc> = 0
>Thread-223::DEBUG::2014-04-10 18:57:28,071::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-223::DEBUG::2014-04-10 18:57:28,072::task::579::TaskManager.Task::(_updateState) Task=`1e54ecaf-1424-49d1-8a89-40f76dbefa67`::moving from state init -> state preparing
>Thread-223::INFO::2014-04-10 18:57:28,072::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-223::DEBUG::2014-04-10 18:57:28,072::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-223::DEBUG::2014-04-10 18:57:28,073::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-223::INFO::2014-04-10 18:57:28,073::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-223::DEBUG::2014-04-10 18:57:28,073::task::1168::TaskManager.Task::(prepare) Task=`1e54ecaf-1424-49d1-8a89-40f76dbefa67`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-223::DEBUG::2014-04-10 18:57:28,073::task::579::TaskManager.Task::(_updateState) Task=`1e54ecaf-1424-49d1-8a89-40f76dbefa67`::moving from state preparing -> state finished
>Thread-223::DEBUG::2014-04-10 18:57:28,073::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-223::DEBUG::2014-04-10 18:57:28,074::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-223::DEBUG::2014-04-10 18:57:28,074::task::974::TaskManager.Task::(_decref) Task=`1e54ecaf-1424-49d1-8a89-40f76dbefa67`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,745::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,746::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,746::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,746::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,748::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,748::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,748::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:28,749::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-225::DEBUG::2014-04-10 18:57:29,085::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-225::DEBUG::2014-04-10 18:57:29,086::task::579::TaskManager.Task::(_updateState) Task=`0487b4b3-b975-4149-818a-2601b9ab0670`::moving from state init -> state preparing
>Thread-225::INFO::2014-04-10 18:57:29,086::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-225::DEBUG::2014-04-10 18:57:29,086::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-225::DEBUG::2014-04-10 18:57:29,087::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-225::INFO::2014-04-10 18:57:29,087::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-225::DEBUG::2014-04-10 18:57:29,087::task::1168::TaskManager.Task::(prepare) Task=`0487b4b3-b975-4149-818a-2601b9ab0670`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-225::DEBUG::2014-04-10 18:57:29,087::task::579::TaskManager.Task::(_updateState) Task=`0487b4b3-b975-4149-818a-2601b9ab0670`::moving from state preparing -> state finished
>Thread-225::DEBUG::2014-04-10 18:57:29,087::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-225::DEBUG::2014-04-10 18:57:29,088::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-225::DEBUG::2014-04-10 18:57:29,088::task::974::TaskManager.Task::(_decref) Task=`0487b4b3-b975-4149-818a-2601b9ab0670`::ref 0 aborting False
>Thread-226::DEBUG::2014-04-10 18:57:30,098::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-226::DEBUG::2014-04-10 18:57:30,098::task::579::TaskManager.Task::(_updateState) Task=`007ebea8-8452-45bb-8e71-48f14bdee51b`::moving from state init -> state preparing
>Thread-226::INFO::2014-04-10 18:57:30,099::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-226::DEBUG::2014-04-10 18:57:30,099::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-226::DEBUG::2014-04-10 18:57:30,099::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-226::INFO::2014-04-10 18:57:30,099::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-226::DEBUG::2014-04-10 18:57:30,099::task::1168::TaskManager.Task::(prepare) Task=`007ebea8-8452-45bb-8e71-48f14bdee51b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-226::DEBUG::2014-04-10 18:57:30,099::task::579::TaskManager.Task::(_updateState) Task=`007ebea8-8452-45bb-8e71-48f14bdee51b`::moving from state preparing -> state finished
>Thread-226::DEBUG::2014-04-10 18:57:30,100::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-226::DEBUG::2014-04-10 18:57:30,100::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-226::DEBUG::2014-04-10 18:57:30,100::task::974::TaskManager.Task::(_decref) Task=`007ebea8-8452-45bb-8e71-48f14bdee51b`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:57:30,789::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:30,797::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000405112 s, 1.6 MB/s\n'; <rc> = 0
>Thread-227::DEBUG::2014-04-10 18:57:31,110::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-227::DEBUG::2014-04-10 18:57:31,110::task::579::TaskManager.Task::(_updateState) Task=`430ea3c1-9fc9-4f6e-b81a-837b280bda14`::moving from state init -> state preparing
>Thread-227::INFO::2014-04-10 18:57:31,111::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-227::DEBUG::2014-04-10 18:57:31,111::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-227::DEBUG::2014-04-10 18:57:31,111::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-227::INFO::2014-04-10 18:57:31,111::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-227::DEBUG::2014-04-10 18:57:31,112::task::1168::TaskManager.Task::(prepare) Task=`430ea3c1-9fc9-4f6e-b81a-837b280bda14`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-227::DEBUG::2014-04-10 18:57:31,112::task::579::TaskManager.Task::(_updateState) Task=`430ea3c1-9fc9-4f6e-b81a-837b280bda14`::moving from state preparing -> state finished
>Thread-227::DEBUG::2014-04-10 18:57:31,112::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-227::DEBUG::2014-04-10 18:57:31,112::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-227::DEBUG::2014-04-10 18:57:31,113::task::974::TaskManager.Task::(_decref) Task=`430ea3c1-9fc9-4f6e-b81a-837b280bda14`::ref 0 aborting False
>Thread-229::DEBUG::2014-04-10 18:57:32,122::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-229::DEBUG::2014-04-10 18:57:32,139::task::579::TaskManager.Task::(_updateState) Task=`c76887a5-2301-4177-b71b-1391a8a9cc1b`::moving from state init -> state preparing
>Thread-229::INFO::2014-04-10 18:57:32,140::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-229::DEBUG::2014-04-10 18:57:32,140::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-229::DEBUG::2014-04-10 18:57:32,140::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-229::INFO::2014-04-10 18:57:32,140::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-229::DEBUG::2014-04-10 18:57:32,140::task::1168::TaskManager.Task::(prepare) Task=`c76887a5-2301-4177-b71b-1391a8a9cc1b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-229::DEBUG::2014-04-10 18:57:32,140::task::579::TaskManager.Task::(_updateState) Task=`c76887a5-2301-4177-b71b-1391a8a9cc1b`::moving from state preparing -> state finished
>Thread-229::DEBUG::2014-04-10 18:57:32,141::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-229::DEBUG::2014-04-10 18:57:32,141::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-229::DEBUG::2014-04-10 18:57:32,141::task::974::TaskManager.Task::(_decref) Task=`c76887a5-2301-4177-b71b-1391a8a9cc1b`::ref 0 aborting False
>Thread-230::DEBUG::2014-04-10 18:57:33,151::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-230::DEBUG::2014-04-10 18:57:33,151::task::579::TaskManager.Task::(_updateState) Task=`e46c1a47-99d4-4e96-93b6-c5d390e05113`::moving from state init -> state preparing
>Thread-230::INFO::2014-04-10 18:57:33,151::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-230::DEBUG::2014-04-10 18:57:33,152::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-230::DEBUG::2014-04-10 18:57:33,152::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-230::INFO::2014-04-10 18:57:33,152::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-230::DEBUG::2014-04-10 18:57:33,152::task::1168::TaskManager.Task::(prepare) Task=`e46c1a47-99d4-4e96-93b6-c5d390e05113`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-230::DEBUG::2014-04-10 18:57:33,152::task::579::TaskManager.Task::(_updateState) Task=`e46c1a47-99d4-4e96-93b6-c5d390e05113`::moving from state preparing -> state finished
>Thread-230::DEBUG::2014-04-10 18:57:33,152::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-230::DEBUG::2014-04-10 18:57:33,152::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-230::DEBUG::2014-04-10 18:57:33,153::task::974::TaskManager.Task::(_decref) Task=`e46c1a47-99d4-4e96-93b6-c5d390e05113`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,756::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,757::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,757::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,757::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,759::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,759::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,760::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:33,760::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-231::DEBUG::2014-04-10 18:57:34,164::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-231::DEBUG::2014-04-10 18:57:34,166::task::579::TaskManager.Task::(_updateState) Task=`e8b04993-f99a-4c3a-99e0-b3a8a8c6b52d`::moving from state init -> state preparing
>Thread-231::INFO::2014-04-10 18:57:34,166::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-231::DEBUG::2014-04-10 18:57:34,166::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-231::DEBUG::2014-04-10 18:57:34,167::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-231::INFO::2014-04-10 18:57:34,167::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-231::DEBUG::2014-04-10 18:57:34,167::task::1168::TaskManager.Task::(prepare) Task=`e8b04993-f99a-4c3a-99e0-b3a8a8c6b52d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-231::DEBUG::2014-04-10 18:57:34,167::task::579::TaskManager.Task::(_updateState) Task=`e8b04993-f99a-4c3a-99e0-b3a8a8c6b52d`::moving from state preparing -> state finished
>Thread-231::DEBUG::2014-04-10 18:57:34,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-231::DEBUG::2014-04-10 18:57:34,168::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-231::DEBUG::2014-04-10 18:57:34,168::task::974::TaskManager.Task::(_decref) Task=`e8b04993-f99a-4c3a-99e0-b3a8a8c6b52d`::ref 0 aborting False
>Thread-233::DEBUG::2014-04-10 18:57:35,181::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-233::DEBUG::2014-04-10 18:57:35,183::task::579::TaskManager.Task::(_updateState) Task=`5c31fab0-d9a0-40d0-a1e1-f77053e37f5d`::moving from state init -> state preparing
>Thread-233::INFO::2014-04-10 18:57:35,184::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-233::DEBUG::2014-04-10 18:57:35,185::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-233::DEBUG::2014-04-10 18:57:35,187::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-233::INFO::2014-04-10 18:57:35,188::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-233::DEBUG::2014-04-10 18:57:35,189::task::1168::TaskManager.Task::(prepare) Task=`5c31fab0-d9a0-40d0-a1e1-f77053e37f5d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-233::DEBUG::2014-04-10 18:57:35,191::task::579::TaskManager.Task::(_updateState) Task=`5c31fab0-d9a0-40d0-a1e1-f77053e37f5d`::moving from state preparing -> state finished
>Thread-233::DEBUG::2014-04-10 18:57:35,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-233::DEBUG::2014-04-10 18:57:35,194::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-233::DEBUG::2014-04-10 18:57:35,196::task::974::TaskManager.Task::(_decref) Task=`5c31fab0-d9a0-40d0-a1e1-f77053e37f5d`::ref 0 aborting False
>Thread-138::DEBUG::2014-04-10 18:57:36,101::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-138::DEBUG::2014-04-10 18:57:36,101::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-138::INFO::2014-04-10 18:57:36,102::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-138::DEBUG::2014-04-10 18:57:36,102::task::1168::TaskManager.Task::(prepare) Task=`a479af0d-22f8-4ad2-898c-bad68decf7d1`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-138::DEBUG::2014-04-10 18:57:36,102::task::579::TaskManager.Task::(_updateState) Task=`a479af0d-22f8-4ad2-898c-bad68decf7d1`::moving from state preparing -> state finished
>Thread-138::DEBUG::2014-04-10 18:57:36,102::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-138::DEBUG::2014-04-10 18:57:36,102::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-138::DEBUG::2014-04-10 18:57:36,102::task::974::TaskManager.Task::(_decref) Task=`a479af0d-22f8-4ad2-898c-bad68decf7d1`::ref 0 aborting False
>Thread-234::DEBUG::2014-04-10 18:57:36,210::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-234::DEBUG::2014-04-10 18:57:36,211::task::579::TaskManager.Task::(_updateState) Task=`4ef731f7-d2a6-4088-b9a0-ecd5acdffb78`::moving from state init -> state preparing
>Thread-234::INFO::2014-04-10 18:57:36,211::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-234::DEBUG::2014-04-10 18:57:36,211::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-234::DEBUG::2014-04-10 18:57:36,211::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-234::INFO::2014-04-10 18:57:36,212::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-234::DEBUG::2014-04-10 18:57:36,212::task::1168::TaskManager.Task::(prepare) Task=`4ef731f7-d2a6-4088-b9a0-ecd5acdffb78`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-234::DEBUG::2014-04-10 18:57:36,212::task::579::TaskManager.Task::(_updateState) Task=`4ef731f7-d2a6-4088-b9a0-ecd5acdffb78`::moving from state preparing -> state finished
>Thread-234::DEBUG::2014-04-10 18:57:36,212::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-234::DEBUG::2014-04-10 18:57:36,212::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-234::DEBUG::2014-04-10 18:57:36,213::task::974::TaskManager.Task::(_decref) Task=`4ef731f7-d2a6-4088-b9a0-ecd5acdffb78`::ref 0 aborting False
>Thread-235::DEBUG::2014-04-10 18:57:37,236::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-235::DEBUG::2014-04-10 18:57:37,237::task::579::TaskManager.Task::(_updateState) Task=`11f223d4-9aeb-4fce-835c-ebd54f52b613`::moving from state init -> state preparing
>Thread-235::INFO::2014-04-10 18:57:37,237::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-235::DEBUG::2014-04-10 18:57:37,237::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-235::DEBUG::2014-04-10 18:57:37,237::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-235::INFO::2014-04-10 18:57:37,238::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-235::DEBUG::2014-04-10 18:57:37,238::task::1168::TaskManager.Task::(prepare) Task=`11f223d4-9aeb-4fce-835c-ebd54f52b613`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-235::DEBUG::2014-04-10 18:57:37,238::task::579::TaskManager.Task::(_updateState) Task=`11f223d4-9aeb-4fce-835c-ebd54f52b613`::moving from state preparing -> state finished
>Thread-235::DEBUG::2014-04-10 18:57:37,238::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-235::DEBUG::2014-04-10 18:57:37,238::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-235::DEBUG::2014-04-10 18:57:37,238::task::974::TaskManager.Task::(_decref) Task=`11f223d4-9aeb-4fce-835c-ebd54f52b613`::ref 0 aborting False
>Thread-236::DEBUG::2014-04-10 18:57:37,287::task::579::TaskManager.Task::(_updateState) Task=`9cd98867-d782-4c3a-8e4e-476504a33cf7`::moving from state init -> state preparing
>Thread-236::INFO::2014-04-10 18:57:37,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-236::INFO::2014-04-10 18:57:37,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405112', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '46.8', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '117.0', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379139', 'lastCheck': '9.5', 'valid': True}}
>Thread-236::DEBUG::2014-04-10 18:57:37,288::task::1168::TaskManager.Task::(prepare) Task=`9cd98867-d782-4c3a-8e4e-476504a33cf7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405112', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '46.8', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '117.0', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379139', 'lastCheck': '9.5', 'valid': True}}
>Thread-236::DEBUG::2014-04-10 18:57:37,289::task::579::TaskManager.Task::(_updateState) Task=`9cd98867-d782-4c3a-8e4e-476504a33cf7`::moving from state preparing -> state finished
>Thread-236::DEBUG::2014-04-10 18:57:37,289::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-236::DEBUG::2014-04-10 18:57:37,289::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-236::DEBUG::2014-04-10 18:57:37,289::task::974::TaskManager.Task::(_decref) Task=`9cd98867-d782-4c3a-8e4e-476504a33cf7`::ref 0 aborting False
>Thread-237::DEBUG::2014-04-10 18:57:37,325::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-237::DEBUG::2014-04-10 18:57:37,325::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-237::DEBUG::2014-04-10 18:57:37,326::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-237::DEBUG::2014-04-10 18:57:37,326::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-67::DEBUG::2014-04-10 18:57:37,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:37,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000357644 s, 1.0 MB/s\n'; <rc> = 0
>Thread-238::DEBUG::2014-04-10 18:57:38,250::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-238::DEBUG::2014-04-10 18:57:38,251::task::579::TaskManager.Task::(_updateState) Task=`062b481b-48fe-43d7-9cb2-1950ad9e4c3e`::moving from state init -> state preparing
>Thread-238::INFO::2014-04-10 18:57:38,252::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-238::DEBUG::2014-04-10 18:57:38,252::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-238::DEBUG::2014-04-10 18:57:38,252::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-238::INFO::2014-04-10 18:57:38,252::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-238::DEBUG::2014-04-10 18:57:38,252::task::1168::TaskManager.Task::(prepare) Task=`062b481b-48fe-43d7-9cb2-1950ad9e4c3e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-238::DEBUG::2014-04-10 18:57:38,252::task::579::TaskManager.Task::(_updateState) Task=`062b481b-48fe-43d7-9cb2-1950ad9e4c3e`::moving from state preparing -> state finished
>Thread-238::DEBUG::2014-04-10 18:57:38,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-238::DEBUG::2014-04-10 18:57:38,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-238::DEBUG::2014-04-10 18:57:38,254::task::974::TaskManager.Task::(_decref) Task=`062b481b-48fe-43d7-9cb2-1950ad9e4c3e`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,767::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,768::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,768::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,768::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,769::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,770::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,770::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:38,771::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-239::DEBUG::2014-04-10 18:57:39,276::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-239::DEBUG::2014-04-10 18:57:39,276::task::579::TaskManager.Task::(_updateState) Task=`8657a97c-55df-4c46-9f5e-a0a82b260037`::moving from state init -> state preparing
>Thread-239::INFO::2014-04-10 18:57:39,277::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-239::DEBUG::2014-04-10 18:57:39,277::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-239::DEBUG::2014-04-10 18:57:39,277::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-239::INFO::2014-04-10 18:57:39,277::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-239::DEBUG::2014-04-10 18:57:39,277::task::1168::TaskManager.Task::(prepare) Task=`8657a97c-55df-4c46-9f5e-a0a82b260037`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-239::DEBUG::2014-04-10 18:57:39,278::task::579::TaskManager.Task::(_updateState) Task=`8657a97c-55df-4c46-9f5e-a0a82b260037`::moving from state preparing -> state finished
>Thread-239::DEBUG::2014-04-10 18:57:39,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-239::DEBUG::2014-04-10 18:57:39,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-239::DEBUG::2014-04-10 18:57:39,278::task::974::TaskManager.Task::(_decref) Task=`8657a97c-55df-4c46-9f5e-a0a82b260037`::ref 0 aborting False
>Thread-240::DEBUG::2014-04-10 18:57:40,290::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-240::DEBUG::2014-04-10 18:57:40,292::task::579::TaskManager.Task::(_updateState) Task=`f5392e65-927e-4d79-b53d-2d802b504c9e`::moving from state init -> state preparing
>Thread-240::INFO::2014-04-10 18:57:40,294::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-240::DEBUG::2014-04-10 18:57:40,296::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-240::DEBUG::2014-04-10 18:57:40,298::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-240::INFO::2014-04-10 18:57:40,300::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-240::DEBUG::2014-04-10 18:57:40,301::task::1168::TaskManager.Task::(prepare) Task=`f5392e65-927e-4d79-b53d-2d802b504c9e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-240::DEBUG::2014-04-10 18:57:40,301::task::579::TaskManager.Task::(_updateState) Task=`f5392e65-927e-4d79-b53d-2d802b504c9e`::moving from state preparing -> state finished
>Thread-240::DEBUG::2014-04-10 18:57:40,303::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-240::DEBUG::2014-04-10 18:57:40,304::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-240::DEBUG::2014-04-10 18:57:40,305::task::974::TaskManager.Task::(_decref) Task=`f5392e65-927e-4d79-b53d-2d802b504c9e`::ref 0 aborting False
>Thread-145::WARNING::2014-04-10 18:57:40,538::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-147::WARNING::2014-04-10 18:57:40,543::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-147::DEBUG::2014-04-10 18:57:40,554::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-152::WARNING::2014-04-10 18:57:40,865::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-152::DEBUG::2014-04-10 18:57:40,870::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-154::WARNING::2014-04-10 18:57:40,874::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-154::DEBUG::2014-04-10 18:57:40,878::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 18:57:40,882::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 18:57:40,885::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-149::DEBUG::2014-04-10 18:57:40,885::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-149::DEBUG::2014-04-10 18:57:40,891::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-149::DEBUG::2014-04-10 18:57:40,892::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-149::DEBUG::2014-04-10 18:57:40,894::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-65::DEBUG::2014-04-10 18:57:40,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-149::DEBUG::2014-04-10 18:57:40,903::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:40,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000368942 s, 1.8 MB/s\n'; <rc> = 0
>Thread-149::DEBUG::2014-04-10 18:57:40,919::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-149::DEBUG::2014-04-10 18:57:40,919::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-242::DEBUG::2014-04-10 18:57:41,323::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-242::DEBUG::2014-04-10 18:57:41,324::task::579::TaskManager.Task::(_updateState) Task=`b781f4a5-bcd3-4f2d-8bd1-391c3bb1ab3e`::moving from state init -> state preparing
>Thread-242::INFO::2014-04-10 18:57:41,324::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-242::DEBUG::2014-04-10 18:57:41,324::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-242::DEBUG::2014-04-10 18:57:41,324::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-242::INFO::2014-04-10 18:57:41,325::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-242::DEBUG::2014-04-10 18:57:41,325::task::1168::TaskManager.Task::(prepare) Task=`b781f4a5-bcd3-4f2d-8bd1-391c3bb1ab3e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-242::DEBUG::2014-04-10 18:57:41,325::task::579::TaskManager.Task::(_updateState) Task=`b781f4a5-bcd3-4f2d-8bd1-391c3bb1ab3e`::moving from state preparing -> state finished
>Thread-242::DEBUG::2014-04-10 18:57:41,325::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-242::DEBUG::2014-04-10 18:57:41,325::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-242::DEBUG::2014-04-10 18:57:41,325::task::974::TaskManager.Task::(_decref) Task=`b781f4a5-bcd3-4f2d-8bd1-391c3bb1ab3e`::ref 0 aborting False
>Thread-243::DEBUG::2014-04-10 18:57:42,336::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-243::DEBUG::2014-04-10 18:57:42,368::task::579::TaskManager.Task::(_updateState) Task=`71efd20b-1c88-4880-9c7d-e50fb2343792`::moving from state init -> state preparing
>Thread-243::INFO::2014-04-10 18:57:42,369::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-243::DEBUG::2014-04-10 18:57:42,369::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-243::DEBUG::2014-04-10 18:57:42,369::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-243::INFO::2014-04-10 18:57:42,369::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-243::DEBUG::2014-04-10 18:57:42,369::task::1168::TaskManager.Task::(prepare) Task=`71efd20b-1c88-4880-9c7d-e50fb2343792`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-243::DEBUG::2014-04-10 18:57:42,369::task::579::TaskManager.Task::(_updateState) Task=`71efd20b-1c88-4880-9c7d-e50fb2343792`::moving from state preparing -> state finished
>Thread-243::DEBUG::2014-04-10 18:57:42,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-243::DEBUG::2014-04-10 18:57:42,370::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-243::DEBUG::2014-04-10 18:57:42,370::task::974::TaskManager.Task::(_decref) Task=`71efd20b-1c88-4880-9c7d-e50fb2343792`::ref 0 aborting False
>Thread-149::DEBUG::2014-04-10 18:57:42,942::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-149::DEBUG::2014-04-10 18:57:42,989::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-149::DEBUG::2014-04-10 18:57:42,990::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,990::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,990::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,991::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,991::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,991::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,992::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-149::ERROR::2014-04-10 18:57:42,992::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-149::ERROR::2014-04-10 18:57:42,992::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-149::DEBUG::2014-04-10 18:57:42,992::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-149::DEBUG::2014-04-10 18:57:42,995::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-149::DEBUG::2014-04-10 18:57:43,135::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-149::WARNING::2014-04-10 18:57:43,136::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-149::DEBUG::2014-04-10 18:57:43,136::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-248::DEBUG::2014-04-10 18:57:43,386::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-248::DEBUG::2014-04-10 18:57:43,387::task::579::TaskManager.Task::(_updateState) Task=`dbc3a223-72bd-4065-9b54-ca2925f73a87`::moving from state init -> state preparing
>Thread-248::INFO::2014-04-10 18:57:43,387::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-248::DEBUG::2014-04-10 18:57:43,388::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-248::DEBUG::2014-04-10 18:57:43,388::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-248::INFO::2014-04-10 18:57:43,388::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-248::DEBUG::2014-04-10 18:57:43,388::task::1168::TaskManager.Task::(prepare) Task=`dbc3a223-72bd-4065-9b54-ca2925f73a87`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-248::DEBUG::2014-04-10 18:57:43,388::task::579::TaskManager.Task::(_updateState) Task=`dbc3a223-72bd-4065-9b54-ca2925f73a87`::moving from state preparing -> state finished
>Thread-248::DEBUG::2014-04-10 18:57:43,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-248::DEBUG::2014-04-10 18:57:43,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-248::DEBUG::2014-04-10 18:57:43,389::task::974::TaskManager.Task::(_decref) Task=`dbc3a223-72bd-4065-9b54-ca2925f73a87`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,777::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,778::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,779::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,779::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,781::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,781::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,781::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:43,781::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-250::DEBUG::2014-04-10 18:57:44,403::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-250::DEBUG::2014-04-10 18:57:44,403::task::579::TaskManager.Task::(_updateState) Task=`b8c091d0-5e2e-42cb-98d0-21f171ed4d36`::moving from state init -> state preparing
>Thread-250::INFO::2014-04-10 18:57:44,403::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-250::DEBUG::2014-04-10 18:57:44,404::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-250::DEBUG::2014-04-10 18:57:44,404::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-250::INFO::2014-04-10 18:57:44,404::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-250::DEBUG::2014-04-10 18:57:44,404::task::1168::TaskManager.Task::(prepare) Task=`b8c091d0-5e2e-42cb-98d0-21f171ed4d36`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-250::DEBUG::2014-04-10 18:57:44,404::task::579::TaskManager.Task::(_updateState) Task=`b8c091d0-5e2e-42cb-98d0-21f171ed4d36`::moving from state preparing -> state finished
>Thread-250::DEBUG::2014-04-10 18:57:44,404::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-250::DEBUG::2014-04-10 18:57:44,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-250::DEBUG::2014-04-10 18:57:44,405::task::974::TaskManager.Task::(_decref) Task=`b8c091d0-5e2e-42cb-98d0-21f171ed4d36`::ref 0 aborting False
>Thread-251::DEBUG::2014-04-10 18:57:45,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-251::DEBUG::2014-04-10 18:57:45,415::task::579::TaskManager.Task::(_updateState) Task=`2e3693e9-21f0-47a8-a763-c38954e448da`::moving from state init -> state preparing
>Thread-251::INFO::2014-04-10 18:57:45,415::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-251::DEBUG::2014-04-10 18:57:45,415::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-251::DEBUG::2014-04-10 18:57:45,416::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-251::INFO::2014-04-10 18:57:45,416::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-251::DEBUG::2014-04-10 18:57:45,416::task::1168::TaskManager.Task::(prepare) Task=`2e3693e9-21f0-47a8-a763-c38954e448da`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-251::DEBUG::2014-04-10 18:57:45,416::task::579::TaskManager.Task::(_updateState) Task=`2e3693e9-21f0-47a8-a763-c38954e448da`::moving from state preparing -> state finished
>Thread-251::DEBUG::2014-04-10 18:57:45,416::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-251::DEBUG::2014-04-10 18:57:45,416::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-251::DEBUG::2014-04-10 18:57:45,417::task::974::TaskManager.Task::(_decref) Task=`2e3693e9-21f0-47a8-a763-c38954e448da`::ref 0 aborting False
>Thread-252::DEBUG::2014-04-10 18:57:46,427::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-252::DEBUG::2014-04-10 18:57:46,428::task::579::TaskManager.Task::(_updateState) Task=`249eb8e5-7bb6-4402-b597-f51ce6a277dc`::moving from state init -> state preparing
>Thread-252::INFO::2014-04-10 18:57:46,428::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-252::DEBUG::2014-04-10 18:57:46,428::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-252::DEBUG::2014-04-10 18:57:46,428::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-252::INFO::2014-04-10 18:57:46,429::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-252::DEBUG::2014-04-10 18:57:46,429::task::1168::TaskManager.Task::(prepare) Task=`249eb8e5-7bb6-4402-b597-f51ce6a277dc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-252::DEBUG::2014-04-10 18:57:46,429::task::579::TaskManager.Task::(_updateState) Task=`249eb8e5-7bb6-4402-b597-f51ce6a277dc`::moving from state preparing -> state finished
>Thread-252::DEBUG::2014-04-10 18:57:46,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-252::DEBUG::2014-04-10 18:57:46,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-252::DEBUG::2014-04-10 18:57:46,429::task::974::TaskManager.Task::(_decref) Task=`249eb8e5-7bb6-4402-b597-f51ce6a277dc`::ref 0 aborting False
>Thread-254::DEBUG::2014-04-10 18:57:47,446::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-254::DEBUG::2014-04-10 18:57:47,462::task::579::TaskManager.Task::(_updateState) Task=`6251da0f-a4ee-4217-8954-7c8d784a0940`::moving from state init -> state preparing
>Thread-254::INFO::2014-04-10 18:57:47,462::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-254::DEBUG::2014-04-10 18:57:47,462::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-254::DEBUG::2014-04-10 18:57:47,463::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-254::INFO::2014-04-10 18:57:47,463::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-254::DEBUG::2014-04-10 18:57:47,463::task::1168::TaskManager.Task::(prepare) Task=`6251da0f-a4ee-4217-8954-7c8d784a0940`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-254::DEBUG::2014-04-10 18:57:47,463::task::579::TaskManager.Task::(_updateState) Task=`6251da0f-a4ee-4217-8954-7c8d784a0940`::moving from state preparing -> state finished
>Thread-254::DEBUG::2014-04-10 18:57:47,463::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-254::DEBUG::2014-04-10 18:57:47,463::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-254::DEBUG::2014-04-10 18:57:47,464::task::974::TaskManager.Task::(_decref) Task=`6251da0f-a4ee-4217-8954-7c8d784a0940`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:57:47,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:47,833::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000396561 s, 928 kB/s\n'; <rc> = 0
>Thread-255::DEBUG::2014-04-10 18:57:48,473::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-255::DEBUG::2014-04-10 18:57:48,474::task::579::TaskManager.Task::(_updateState) Task=`4f813e73-6338-4f78-bd25-7a7e1339965f`::moving from state init -> state preparing
>Thread-255::INFO::2014-04-10 18:57:48,474::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-255::DEBUG::2014-04-10 18:57:48,475::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-255::DEBUG::2014-04-10 18:57:48,475::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-255::INFO::2014-04-10 18:57:48,475::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-255::DEBUG::2014-04-10 18:57:48,476::task::1168::TaskManager.Task::(prepare) Task=`4f813e73-6338-4f78-bd25-7a7e1339965f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-255::DEBUG::2014-04-10 18:57:48,476::task::579::TaskManager.Task::(_updateState) Task=`4f813e73-6338-4f78-bd25-7a7e1339965f`::moving from state preparing -> state finished
>Thread-255::DEBUG::2014-04-10 18:57:48,476::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-255::DEBUG::2014-04-10 18:57:48,476::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-255::DEBUG::2014-04-10 18:57:48,476::task::974::TaskManager.Task::(_decref) Task=`4f813e73-6338-4f78-bd25-7a7e1339965f`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,788::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,789::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,789::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,789::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,791::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,791::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,792::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:48,792::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-256::DEBUG::2014-04-10 18:57:49,488::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-256::DEBUG::2014-04-10 18:57:49,489::task::579::TaskManager.Task::(_updateState) Task=`7bb0b246-c45f-43fa-94a7-f687f1b4b5ef`::moving from state init -> state preparing
>Thread-256::INFO::2014-04-10 18:57:49,489::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-256::DEBUG::2014-04-10 18:57:49,490::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-256::DEBUG::2014-04-10 18:57:49,490::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-256::INFO::2014-04-10 18:57:49,490::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-256::DEBUG::2014-04-10 18:57:49,490::task::1168::TaskManager.Task::(prepare) Task=`7bb0b246-c45f-43fa-94a7-f687f1b4b5ef`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-256::DEBUG::2014-04-10 18:57:49,491::task::579::TaskManager.Task::(_updateState) Task=`7bb0b246-c45f-43fa-94a7-f687f1b4b5ef`::moving from state preparing -> state finished
>Thread-256::DEBUG::2014-04-10 18:57:49,491::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-256::DEBUG::2014-04-10 18:57:49,491::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-256::DEBUG::2014-04-10 18:57:49,491::task::974::TaskManager.Task::(_decref) Task=`7bb0b246-c45f-43fa-94a7-f687f1b4b5ef`::ref 0 aborting False
>Thread-258::DEBUG::2014-04-10 18:57:50,511::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-258::DEBUG::2014-04-10 18:57:50,517::task::579::TaskManager.Task::(_updateState) Task=`42732b9f-e746-4db8-baf5-46c62d9bde89`::moving from state init -> state preparing
>Thread-258::INFO::2014-04-10 18:57:50,522::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-258::DEBUG::2014-04-10 18:57:50,525::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-258::DEBUG::2014-04-10 18:57:50,529::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-258::INFO::2014-04-10 18:57:50,533::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-258::DEBUG::2014-04-10 18:57:50,537::task::1168::TaskManager.Task::(prepare) Task=`42732b9f-e746-4db8-baf5-46c62d9bde89`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-258::DEBUG::2014-04-10 18:57:50,541::task::579::TaskManager.Task::(_updateState) Task=`42732b9f-e746-4db8-baf5-46c62d9bde89`::moving from state preparing -> state finished
>Thread-258::DEBUG::2014-04-10 18:57:50,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-258::DEBUG::2014-04-10 18:57:50,548::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-258::DEBUG::2014-04-10 18:57:50,553::task::974::TaskManager.Task::(_decref) Task=`42732b9f-e746-4db8-baf5-46c62d9bde89`::ref 0 aborting False
>Thread-169::WARNING::2014-04-10 18:57:50,679::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-171::WARNING::2014-04-10 18:57:50,680::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-148::ERROR::2014-04-10 18:57:50,681::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>e7c56099-afb9-407a-991d-cb6b72ddd351::ERROR::2014-04-10 18:57:50,683::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>e7c56099-afb9-407a-991d-cb6b72ddd351::ERROR::2014-04-10 18:57:50,684::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:57:50,685::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:57:50,686::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:57:50,817::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>e7c56099-afb9-407a-991d-cb6b72ddd351::WARNING::2014-04-10 18:57:50,818::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:57:50,819::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-65::DEBUG::2014-04-10 18:57:50,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:57:50,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000425168 s, 1.5 MB/s\n'; <rc> = 0
>Thread-263::DEBUG::2014-04-10 18:57:51,579::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-263::DEBUG::2014-04-10 18:57:51,580::task::579::TaskManager.Task::(_updateState) Task=`005bae38-a18d-4edc-94a5-fbf4836f9ef4`::moving from state init -> state preparing
>Thread-263::INFO::2014-04-10 18:57:51,580::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-263::DEBUG::2014-04-10 18:57:51,580::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-263::DEBUG::2014-04-10 18:57:51,580::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-263::INFO::2014-04-10 18:57:51,581::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-263::DEBUG::2014-04-10 18:57:51,581::task::1168::TaskManager.Task::(prepare) Task=`005bae38-a18d-4edc-94a5-fbf4836f9ef4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-263::DEBUG::2014-04-10 18:57:51,581::task::579::TaskManager.Task::(_updateState) Task=`005bae38-a18d-4edc-94a5-fbf4836f9ef4`::moving from state preparing -> state finished
>Thread-263::DEBUG::2014-04-10 18:57:51,581::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-263::DEBUG::2014-04-10 18:57:51,581::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-263::DEBUG::2014-04-10 18:57:51,581::task::974::TaskManager.Task::(_decref) Task=`005bae38-a18d-4edc-94a5-fbf4836f9ef4`::ref 0 aborting False
>Thread-264::DEBUG::2014-04-10 18:57:52,532::task::579::TaskManager.Task::(_updateState) Task=`939ad54e-dd73-41ab-999a-743ece77bf72`::moving from state init -> state preparing
>Thread-264::INFO::2014-04-10 18:57:52,532::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-264::INFO::2014-04-10 18:57:52,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425168', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '62.0', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '11.6', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396561', 'lastCheck': '4.7', 'valid': True}}
>Thread-264::DEBUG::2014-04-10 18:57:52,533::task::1168::TaskManager.Task::(prepare) Task=`939ad54e-dd73-41ab-999a-743ece77bf72`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425168', 'lastCheck': '1.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '62.0', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '11.6', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396561', 'lastCheck': '4.7', 'valid': True}}
>Thread-264::DEBUG::2014-04-10 18:57:52,533::task::579::TaskManager.Task::(_updateState) Task=`939ad54e-dd73-41ab-999a-743ece77bf72`::moving from state preparing -> state finished
>Thread-264::DEBUG::2014-04-10 18:57:52,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-264::DEBUG::2014-04-10 18:57:52,534::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-264::DEBUG::2014-04-10 18:57:52,534::task::974::TaskManager.Task::(_decref) Task=`939ad54e-dd73-41ab-999a-743ece77bf72`::ref 0 aborting False
>Thread-265::DEBUG::2014-04-10 18:57:52,565::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-265::DEBUG::2014-04-10 18:57:52,566::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-265::DEBUG::2014-04-10 18:57:52,566::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-265::DEBUG::2014-04-10 18:57:52,566::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-266::DEBUG::2014-04-10 18:57:52,592::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-266::DEBUG::2014-04-10 18:57:52,593::task::579::TaskManager.Task::(_updateState) Task=`81a5537c-d0e1-4d01-980c-12063f396060`::moving from state init -> state preparing
>Thread-266::INFO::2014-04-10 18:57:52,593::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-266::DEBUG::2014-04-10 18:57:52,593::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-266::DEBUG::2014-04-10 18:57:52,593::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-266::INFO::2014-04-10 18:57:52,594::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-266::DEBUG::2014-04-10 18:57:52,594::task::1168::TaskManager.Task::(prepare) Task=`81a5537c-d0e1-4d01-980c-12063f396060`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-266::DEBUG::2014-04-10 18:57:52,594::task::579::TaskManager.Task::(_updateState) Task=`81a5537c-d0e1-4d01-980c-12063f396060`::moving from state preparing -> state finished
>Thread-266::DEBUG::2014-04-10 18:57:52,594::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-266::DEBUG::2014-04-10 18:57:52,594::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-266::DEBUG::2014-04-10 18:57:52,594::task::974::TaskManager.Task::(_decref) Task=`81a5537c-d0e1-4d01-980c-12063f396060`::ref 0 aborting False
>Thread-267::DEBUG::2014-04-10 18:57:53,604::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-267::DEBUG::2014-04-10 18:57:53,605::task::579::TaskManager.Task::(_updateState) Task=`1d52c84e-21c8-4f0e-85e4-953b5e04c8c6`::moving from state init -> state preparing
>Thread-267::INFO::2014-04-10 18:57:53,605::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-267::DEBUG::2014-04-10 18:57:53,605::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-267::DEBUG::2014-04-10 18:57:53,605::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-267::INFO::2014-04-10 18:57:53,606::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-267::DEBUG::2014-04-10 18:57:53,606::task::1168::TaskManager.Task::(prepare) Task=`1d52c84e-21c8-4f0e-85e4-953b5e04c8c6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-267::DEBUG::2014-04-10 18:57:53,606::task::579::TaskManager.Task::(_updateState) Task=`1d52c84e-21c8-4f0e-85e4-953b5e04c8c6`::moving from state preparing -> state finished
>Thread-267::DEBUG::2014-04-10 18:57:53,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-267::DEBUG::2014-04-10 18:57:53,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-267::DEBUG::2014-04-10 18:57:53,607::task::974::TaskManager.Task::(_decref) Task=`1d52c84e-21c8-4f0e-85e4-953b5e04c8c6`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,799::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,799::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,800::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,800::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,806::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,806::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,807::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:53,807::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-268::DEBUG::2014-04-10 18:57:54,617::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-268::DEBUG::2014-04-10 18:57:54,618::task::579::TaskManager.Task::(_updateState) Task=`d3225df4-7f54-4609-821e-8352c039b76a`::moving from state init -> state preparing
>Thread-268::INFO::2014-04-10 18:57:54,618::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-268::DEBUG::2014-04-10 18:57:54,619::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-268::DEBUG::2014-04-10 18:57:54,619::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-268::INFO::2014-04-10 18:57:54,619::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-268::DEBUG::2014-04-10 18:57:54,619::task::1168::TaskManager.Task::(prepare) Task=`d3225df4-7f54-4609-821e-8352c039b76a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-268::DEBUG::2014-04-10 18:57:54,619::task::579::TaskManager.Task::(_updateState) Task=`d3225df4-7f54-4609-821e-8352c039b76a`::moving from state preparing -> state finished
>Thread-268::DEBUG::2014-04-10 18:57:54,619::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-268::DEBUG::2014-04-10 18:57:54,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-268::DEBUG::2014-04-10 18:57:54,620::task::974::TaskManager.Task::(_decref) Task=`d3225df4-7f54-4609-821e-8352c039b76a`::ref 0 aborting False
>Thread-269::DEBUG::2014-04-10 18:57:55,633::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-269::DEBUG::2014-04-10 18:57:55,634::task::579::TaskManager.Task::(_updateState) Task=`ff4cc62d-35a2-4c51-953b-d3f342ed941d`::moving from state init -> state preparing
>Thread-269::INFO::2014-04-10 18:57:55,634::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-269::DEBUG::2014-04-10 18:57:55,634::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-269::DEBUG::2014-04-10 18:57:55,634::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-269::INFO::2014-04-10 18:57:55,634::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-269::DEBUG::2014-04-10 18:57:55,635::task::1168::TaskManager.Task::(prepare) Task=`ff4cc62d-35a2-4c51-953b-d3f342ed941d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-269::DEBUG::2014-04-10 18:57:55,635::task::579::TaskManager.Task::(_updateState) Task=`ff4cc62d-35a2-4c51-953b-d3f342ed941d`::moving from state preparing -> state finished
>Thread-269::DEBUG::2014-04-10 18:57:55,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-269::DEBUG::2014-04-10 18:57:55,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-269::DEBUG::2014-04-10 18:57:55,635::task::974::TaskManager.Task::(_decref) Task=`ff4cc62d-35a2-4c51-953b-d3f342ed941d`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:57:55,892::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-271::DEBUG::2014-04-10 18:57:56,645::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-271::DEBUG::2014-04-10 18:57:56,646::task::579::TaskManager.Task::(_updateState) Task=`04cefe6b-3bab-4e04-bafe-64f1be9c632b`::moving from state init -> state preparing
>Thread-271::INFO::2014-04-10 18:57:56,646::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-271::DEBUG::2014-04-10 18:57:56,646::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-271::DEBUG::2014-04-10 18:57:56,646::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-271::INFO::2014-04-10 18:57:56,647::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-271::DEBUG::2014-04-10 18:57:56,647::task::1168::TaskManager.Task::(prepare) Task=`04cefe6b-3bab-4e04-bafe-64f1be9c632b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-271::DEBUG::2014-04-10 18:57:56,647::task::579::TaskManager.Task::(_updateState) Task=`04cefe6b-3bab-4e04-bafe-64f1be9c632b`::moving from state preparing -> state finished
>Thread-271::DEBUG::2014-04-10 18:57:56,647::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-271::DEBUG::2014-04-10 18:57:56,647::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-271::DEBUG::2014-04-10 18:57:56,647::task::974::TaskManager.Task::(_decref) Task=`04cefe6b-3bab-4e04-bafe-64f1be9c632b`::ref 0 aborting False
>Thread-272::DEBUG::2014-04-10 18:57:57,657::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-272::DEBUG::2014-04-10 18:57:57,657::task::579::TaskManager.Task::(_updateState) Task=`7633074c-323f-4d4d-b007-5748aae3a46c`::moving from state init -> state preparing
>Thread-272::INFO::2014-04-10 18:57:57,657::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-272::DEBUG::2014-04-10 18:57:57,658::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-272::DEBUG::2014-04-10 18:57:57,658::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-272::INFO::2014-04-10 18:57:57,658::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-272::DEBUG::2014-04-10 18:57:57,658::task::1168::TaskManager.Task::(prepare) Task=`7633074c-323f-4d4d-b007-5748aae3a46c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-272::DEBUG::2014-04-10 18:57:57,658::task::579::TaskManager.Task::(_updateState) Task=`7633074c-323f-4d4d-b007-5748aae3a46c`::moving from state preparing -> state finished
>Thread-272::DEBUG::2014-04-10 18:57:57,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-272::DEBUG::2014-04-10 18:57:57,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-272::DEBUG::2014-04-10 18:57:57,659::task::974::TaskManager.Task::(_decref) Task=`7633074c-323f-4d4d-b007-5748aae3a46c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:57:57,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:57:57,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000534993 s, 688 kB/s\n'; <rc> = 0
>Thread-273::DEBUG::2014-04-10 18:57:58,669::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-273::DEBUG::2014-04-10 18:57:58,669::task::579::TaskManager.Task::(_updateState) Task=`f0b9d5a8-cf88-4787-8552-41b507a3dfab`::moving from state init -> state preparing
>Thread-273::INFO::2014-04-10 18:57:58,669::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-273::DEBUG::2014-04-10 18:57:58,670::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-273::DEBUG::2014-04-10 18:57:58,670::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-273::INFO::2014-04-10 18:57:58,670::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-273::DEBUG::2014-04-10 18:57:58,670::task::1168::TaskManager.Task::(prepare) Task=`f0b9d5a8-cf88-4787-8552-41b507a3dfab`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-273::DEBUG::2014-04-10 18:57:58,670::task::579::TaskManager.Task::(_updateState) Task=`f0b9d5a8-cf88-4787-8552-41b507a3dfab`::moving from state preparing -> state finished
>Thread-273::DEBUG::2014-04-10 18:57:58,671::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-273::DEBUG::2014-04-10 18:57:58,671::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-273::DEBUG::2014-04-10 18:57:58,671::task::974::TaskManager.Task::(_decref) Task=`f0b9d5a8-cf88-4787-8552-41b507a3dfab`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,813::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,814::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,814::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,814::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,815::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,816::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,816::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:57:58,816::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-275::DEBUG::2014-04-10 18:57:59,681::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-275::DEBUG::2014-04-10 18:57:59,682::task::579::TaskManager.Task::(_updateState) Task=`0ba29f6d-d41e-4afd-b9a0-a93ab1cc22e4`::moving from state init -> state preparing
>Thread-275::INFO::2014-04-10 18:57:59,682::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-275::DEBUG::2014-04-10 18:57:59,682::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-275::DEBUG::2014-04-10 18:57:59,682::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-275::INFO::2014-04-10 18:57:59,683::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-275::DEBUG::2014-04-10 18:57:59,683::task::1168::TaskManager.Task::(prepare) Task=`0ba29f6d-d41e-4afd-b9a0-a93ab1cc22e4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-275::DEBUG::2014-04-10 18:57:59,683::task::579::TaskManager.Task::(_updateState) Task=`0ba29f6d-d41e-4afd-b9a0-a93ab1cc22e4`::moving from state preparing -> state finished
>Thread-275::DEBUG::2014-04-10 18:57:59,683::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-275::DEBUG::2014-04-10 18:57:59,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-275::DEBUG::2014-04-10 18:57:59,683::task::974::TaskManager.Task::(_decref) Task=`0ba29f6d-d41e-4afd-b9a0-a93ab1cc22e4`::ref 0 aborting False
>Thread-276::DEBUG::2014-04-10 18:58:00,693::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-276::DEBUG::2014-04-10 18:58:00,693::task::579::TaskManager.Task::(_updateState) Task=`87e247a7-6e6b-4358-9e53-31df77a9e8eb`::moving from state init -> state preparing
>Thread-276::INFO::2014-04-10 18:58:00,693::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-276::DEBUG::2014-04-10 18:58:00,693::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-276::DEBUG::2014-04-10 18:58:00,693::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-276::INFO::2014-04-10 18:58:00,694::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-276::DEBUG::2014-04-10 18:58:00,694::task::1168::TaskManager.Task::(prepare) Task=`87e247a7-6e6b-4358-9e53-31df77a9e8eb`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-276::DEBUG::2014-04-10 18:58:00,694::task::579::TaskManager.Task::(_updateState) Task=`87e247a7-6e6b-4358-9e53-31df77a9e8eb`::moving from state preparing -> state finished
>Thread-276::DEBUG::2014-04-10 18:58:00,694::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-276::DEBUG::2014-04-10 18:58:00,694::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-276::DEBUG::2014-04-10 18:58:00,694::task::974::TaskManager.Task::(_decref) Task=`87e247a7-6e6b-4358-9e53-31df77a9e8eb`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:00,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:00,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000460928 s, 1.4 MB/s\n'; <rc> = 0
>Thread-277::DEBUG::2014-04-10 18:58:01,704::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-277::DEBUG::2014-04-10 18:58:01,705::task::579::TaskManager.Task::(_updateState) Task=`624deba6-0a9b-41a0-8ffc-5f82f40ec5e0`::moving from state init -> state preparing
>Thread-277::INFO::2014-04-10 18:58:01,705::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-277::DEBUG::2014-04-10 18:58:01,705::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-277::DEBUG::2014-04-10 18:58:01,705::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-277::INFO::2014-04-10 18:58:01,706::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-277::DEBUG::2014-04-10 18:58:01,706::task::1168::TaskManager.Task::(prepare) Task=`624deba6-0a9b-41a0-8ffc-5f82f40ec5e0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-277::DEBUG::2014-04-10 18:58:01,706::task::579::TaskManager.Task::(_updateState) Task=`624deba6-0a9b-41a0-8ffc-5f82f40ec5e0`::moving from state preparing -> state finished
>Thread-277::DEBUG::2014-04-10 18:58:01,706::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-277::DEBUG::2014-04-10 18:58:01,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-277::DEBUG::2014-04-10 18:58:01,706::task::974::TaskManager.Task::(_decref) Task=`624deba6-0a9b-41a0-8ffc-5f82f40ec5e0`::ref 0 aborting False
>Thread-279::DEBUG::2014-04-10 18:58:02,721::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-279::DEBUG::2014-04-10 18:58:02,721::task::579::TaskManager.Task::(_updateState) Task=`74ae9831-1ea2-492f-b87f-29e5a1a13c0e`::moving from state init -> state preparing
>Thread-279::INFO::2014-04-10 18:58:02,721::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-279::DEBUG::2014-04-10 18:58:02,721::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-279::DEBUG::2014-04-10 18:58:02,722::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-279::INFO::2014-04-10 18:58:02,722::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-279::DEBUG::2014-04-10 18:58:02,722::task::1168::TaskManager.Task::(prepare) Task=`74ae9831-1ea2-492f-b87f-29e5a1a13c0e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-279::DEBUG::2014-04-10 18:58:02,722::task::579::TaskManager.Task::(_updateState) Task=`74ae9831-1ea2-492f-b87f-29e5a1a13c0e`::moving from state preparing -> state finished
>Thread-279::DEBUG::2014-04-10 18:58:02,723::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-279::DEBUG::2014-04-10 18:58:02,723::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-279::DEBUG::2014-04-10 18:58:02,723::task::974::TaskManager.Task::(_decref) Task=`74ae9831-1ea2-492f-b87f-29e5a1a13c0e`::ref 0 aborting False
>Thread-280::DEBUG::2014-04-10 18:58:03,733::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-280::DEBUG::2014-04-10 18:58:03,734::task::579::TaskManager.Task::(_updateState) Task=`9c8b439e-5788-4899-b624-330d9f313ead`::moving from state init -> state preparing
>Thread-280::INFO::2014-04-10 18:58:03,734::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-280::DEBUG::2014-04-10 18:58:03,734::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-280::DEBUG::2014-04-10 18:58:03,734::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-280::INFO::2014-04-10 18:58:03,734::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-280::DEBUG::2014-04-10 18:58:03,735::task::1168::TaskManager.Task::(prepare) Task=`9c8b439e-5788-4899-b624-330d9f313ead`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-280::DEBUG::2014-04-10 18:58:03,735::task::579::TaskManager.Task::(_updateState) Task=`9c8b439e-5788-4899-b624-330d9f313ead`::moving from state preparing -> state finished
>Thread-280::DEBUG::2014-04-10 18:58:03,735::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-280::DEBUG::2014-04-10 18:58:03,735::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-280::DEBUG::2014-04-10 18:58:03,735::task::974::TaskManager.Task::(_decref) Task=`9c8b439e-5788-4899-b624-330d9f313ead`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,822::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,823::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,823::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,823::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,824::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,825::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,825::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:03,825::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-281::DEBUG::2014-04-10 18:58:05,262::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-281::DEBUG::2014-04-10 18:58:05,263::task::579::TaskManager.Task::(_updateState) Task=`90b8fa1c-eed9-4655-b665-40872d03b1d4`::moving from state init -> state preparing
>Thread-281::INFO::2014-04-10 18:58:05,266::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-281::DEBUG::2014-04-10 18:58:05,268::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-281::DEBUG::2014-04-10 18:58:05,270::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-281::INFO::2014-04-10 18:58:05,272::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-281::DEBUG::2014-04-10 18:58:05,274::task::1168::TaskManager.Task::(prepare) Task=`90b8fa1c-eed9-4655-b665-40872d03b1d4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-281::DEBUG::2014-04-10 18:58:05,274::task::579::TaskManager.Task::(_updateState) Task=`90b8fa1c-eed9-4655-b665-40872d03b1d4`::moving from state preparing -> state finished
>Thread-281::DEBUG::2014-04-10 18:58:05,274::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-281::DEBUG::2014-04-10 18:58:05,274::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-281::DEBUG::2014-04-10 18:58:05,274::task::974::TaskManager.Task::(_decref) Task=`90b8fa1c-eed9-4655-b665-40872d03b1d4`::ref 0 aborting False
>Thread-283::DEBUG::2014-04-10 18:58:06,284::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-283::DEBUG::2014-04-10 18:58:06,285::task::579::TaskManager.Task::(_updateState) Task=`b9aab991-8ff0-4071-8754-371c6dfd09ca`::moving from state init -> state preparing
>Thread-283::INFO::2014-04-10 18:58:06,285::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-283::DEBUG::2014-04-10 18:58:06,285::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-283::DEBUG::2014-04-10 18:58:06,285::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-283::INFO::2014-04-10 18:58:06,285::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-283::DEBUG::2014-04-10 18:58:06,285::task::1168::TaskManager.Task::(prepare) Task=`b9aab991-8ff0-4071-8754-371c6dfd09ca`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-283::DEBUG::2014-04-10 18:58:06,286::task::579::TaskManager.Task::(_updateState) Task=`b9aab991-8ff0-4071-8754-371c6dfd09ca`::moving from state preparing -> state finished
>Thread-283::DEBUG::2014-04-10 18:58:06,286::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-283::DEBUG::2014-04-10 18:58:06,286::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-283::DEBUG::2014-04-10 18:58:06,286::task::974::TaskManager.Task::(_decref) Task=`b9aab991-8ff0-4071-8754-371c6dfd09ca`::ref 0 aborting False
>Thread-284::DEBUG::2014-04-10 18:58:07,295::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-284::DEBUG::2014-04-10 18:58:07,296::task::579::TaskManager.Task::(_updateState) Task=`4bde7a06-8402-4de7-9b1f-ab8ade5fe64c`::moving from state init -> state preparing
>Thread-284::INFO::2014-04-10 18:58:07,296::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-284::DEBUG::2014-04-10 18:58:07,296::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-284::DEBUG::2014-04-10 18:58:07,296::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-284::INFO::2014-04-10 18:58:07,297::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-284::DEBUG::2014-04-10 18:58:07,297::task::1168::TaskManager.Task::(prepare) Task=`4bde7a06-8402-4de7-9b1f-ab8ade5fe64c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-284::DEBUG::2014-04-10 18:58:07,297::task::579::TaskManager.Task::(_updateState) Task=`4bde7a06-8402-4de7-9b1f-ab8ade5fe64c`::moving from state preparing -> state finished
>Thread-284::DEBUG::2014-04-10 18:58:07,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-284::DEBUG::2014-04-10 18:58:07,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-284::DEBUG::2014-04-10 18:58:07,297::task::974::TaskManager.Task::(_decref) Task=`4bde7a06-8402-4de7-9b1f-ab8ade5fe64c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:58:07,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:07,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000383034 s, 961 kB/s\n'; <rc> = 0
>Thread-285::DEBUG::2014-04-10 18:58:08,297::task::579::TaskManager.Task::(_updateState) Task=`03304c68-bb19-4be9-9d42-77e5cccfff93`::moving from state init -> state preparing
>Thread-285::INFO::2014-04-10 18:58:08,298::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-285::INFO::2014-04-10 18:58:08,298::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460928', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '77.8', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '27.4', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383034', 'lastCheck': '0.4', 'valid': True}}
>Thread-285::DEBUG::2014-04-10 18:58:08,298::task::1168::TaskManager.Task::(prepare) Task=`03304c68-bb19-4be9-9d42-77e5cccfff93`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460928', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '77.8', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '27.4', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000383034', 'lastCheck': '0.4', 'valid': True}}
>Thread-285::DEBUG::2014-04-10 18:58:08,299::task::579::TaskManager.Task::(_updateState) Task=`03304c68-bb19-4be9-9d42-77e5cccfff93`::moving from state preparing -> state finished
>Thread-285::DEBUG::2014-04-10 18:58:08,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-285::DEBUG::2014-04-10 18:58:08,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-285::DEBUG::2014-04-10 18:58:08,299::task::974::TaskManager.Task::(_decref) Task=`03304c68-bb19-4be9-9d42-77e5cccfff93`::ref 0 aborting False
>Thread-286::DEBUG::2014-04-10 18:58:08,307::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-286::DEBUG::2014-04-10 18:58:08,308::task::579::TaskManager.Task::(_updateState) Task=`727f76a2-4f12-4321-b35c-93d41bc21d3a`::moving from state init -> state preparing
>Thread-286::INFO::2014-04-10 18:58:08,308::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-286::DEBUG::2014-04-10 18:58:08,308::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-286::DEBUG::2014-04-10 18:58:08,308::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-286::INFO::2014-04-10 18:58:08,309::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-286::DEBUG::2014-04-10 18:58:08,309::task::1168::TaskManager.Task::(prepare) Task=`727f76a2-4f12-4321-b35c-93d41bc21d3a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-286::DEBUG::2014-04-10 18:58:08,309::task::579::TaskManager.Task::(_updateState) Task=`727f76a2-4f12-4321-b35c-93d41bc21d3a`::moving from state preparing -> state finished
>Thread-286::DEBUG::2014-04-10 18:58:08,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-286::DEBUG::2014-04-10 18:58:08,310::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-286::DEBUG::2014-04-10 18:58:08,310::task::974::TaskManager.Task::(_decref) Task=`727f76a2-4f12-4321-b35c-93d41bc21d3a`::ref 0 aborting False
>Thread-287::DEBUG::2014-04-10 18:58:08,338::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-287::DEBUG::2014-04-10 18:58:08,338::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-287::DEBUG::2014-04-10 18:58:08,339::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-287::DEBUG::2014-04-10 18:58:08,339::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,832::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,832::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,832::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,832::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,833::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,834::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,834::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:08,834::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-288::DEBUG::2014-04-10 18:58:09,321::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-288::DEBUG::2014-04-10 18:58:09,321::task::579::TaskManager.Task::(_updateState) Task=`8e156278-4d9b-4447-bcd0-0d0f77250861`::moving from state init -> state preparing
>Thread-288::INFO::2014-04-10 18:58:09,321::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-288::DEBUG::2014-04-10 18:58:09,322::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-288::DEBUG::2014-04-10 18:58:09,322::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-288::INFO::2014-04-10 18:58:09,322::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-288::DEBUG::2014-04-10 18:58:09,322::task::1168::TaskManager.Task::(prepare) Task=`8e156278-4d9b-4447-bcd0-0d0f77250861`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-288::DEBUG::2014-04-10 18:58:09,322::task::579::TaskManager.Task::(_updateState) Task=`8e156278-4d9b-4447-bcd0-0d0f77250861`::moving from state preparing -> state finished
>Thread-288::DEBUG::2014-04-10 18:58:09,323::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-288::DEBUG::2014-04-10 18:58:09,323::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-288::DEBUG::2014-04-10 18:58:09,323::task::974::TaskManager.Task::(_decref) Task=`8e156278-4d9b-4447-bcd0-0d0f77250861`::ref 0 aborting False
>Thread-289::DEBUG::2014-04-10 18:58:10,333::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-289::DEBUG::2014-04-10 18:58:10,333::task::579::TaskManager.Task::(_updateState) Task=`53d2d1aa-de8b-4a18-9471-13e904c29d0f`::moving from state init -> state preparing
>Thread-289::INFO::2014-04-10 18:58:10,334::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-289::DEBUG::2014-04-10 18:58:10,334::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-289::DEBUG::2014-04-10 18:58:10,334::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-289::INFO::2014-04-10 18:58:10,334::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-289::DEBUG::2014-04-10 18:58:10,334::task::1168::TaskManager.Task::(prepare) Task=`53d2d1aa-de8b-4a18-9471-13e904c29d0f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-289::DEBUG::2014-04-10 18:58:10,334::task::579::TaskManager.Task::(_updateState) Task=`53d2d1aa-de8b-4a18-9471-13e904c29d0f`::moving from state preparing -> state finished
>Thread-289::DEBUG::2014-04-10 18:58:10,335::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-289::DEBUG::2014-04-10 18:58:10,335::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-289::DEBUG::2014-04-10 18:58:10,335::task::974::TaskManager.Task::(_decref) Task=`53d2d1aa-de8b-4a18-9471-13e904c29d0f`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:10,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:10,973::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.0004433 s, 1.5 MB/s\n'; <rc> = 0
>Thread-290::DEBUG::2014-04-10 18:58:11,345::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-290::DEBUG::2014-04-10 18:58:11,346::task::579::TaskManager.Task::(_updateState) Task=`ee955f9f-815f-4d86-b4d9-253caa0803c6`::moving from state init -> state preparing
>Thread-290::INFO::2014-04-10 18:58:11,346::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-290::DEBUG::2014-04-10 18:58:11,346::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-290::DEBUG::2014-04-10 18:58:11,346::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-290::INFO::2014-04-10 18:58:11,347::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-290::DEBUG::2014-04-10 18:58:11,347::task::1168::TaskManager.Task::(prepare) Task=`ee955f9f-815f-4d86-b4d9-253caa0803c6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-290::DEBUG::2014-04-10 18:58:11,347::task::579::TaskManager.Task::(_updateState) Task=`ee955f9f-815f-4d86-b4d9-253caa0803c6`::moving from state preparing -> state finished
>Thread-290::DEBUG::2014-04-10 18:58:11,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-290::DEBUG::2014-04-10 18:58:11,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-290::DEBUG::2014-04-10 18:58:11,347::task::974::TaskManager.Task::(_decref) Task=`ee955f9f-815f-4d86-b4d9-253caa0803c6`::ref 0 aborting False
>Thread-292::DEBUG::2014-04-10 18:58:12,361::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-292::DEBUG::2014-04-10 18:58:12,361::task::579::TaskManager.Task::(_updateState) Task=`bb1d62e4-69af-432b-b900-33e7eff1c34f`::moving from state init -> state preparing
>Thread-292::INFO::2014-04-10 18:58:12,361::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-292::DEBUG::2014-04-10 18:58:12,361::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-292::DEBUG::2014-04-10 18:58:12,362::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-292::INFO::2014-04-10 18:58:12,362::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-292::DEBUG::2014-04-10 18:58:12,362::task::1168::TaskManager.Task::(prepare) Task=`bb1d62e4-69af-432b-b900-33e7eff1c34f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-292::DEBUG::2014-04-10 18:58:12,362::task::579::TaskManager.Task::(_updateState) Task=`bb1d62e4-69af-432b-b900-33e7eff1c34f`::moving from state preparing -> state finished
>Thread-292::DEBUG::2014-04-10 18:58:12,362::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-292::DEBUG::2014-04-10 18:58:12,362::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-292::DEBUG::2014-04-10 18:58:12,363::task::974::TaskManager.Task::(_decref) Task=`bb1d62e4-69af-432b-b900-33e7eff1c34f`::ref 0 aborting False
>Thread-293::DEBUG::2014-04-10 18:58:13,372::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-293::DEBUG::2014-04-10 18:58:13,372::task::579::TaskManager.Task::(_updateState) Task=`75ce5688-7560-407a-b4d0-b26f2746d3dc`::moving from state init -> state preparing
>Thread-293::INFO::2014-04-10 18:58:13,373::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-293::DEBUG::2014-04-10 18:58:13,373::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-293::DEBUG::2014-04-10 18:58:13,373::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-293::INFO::2014-04-10 18:58:13,373::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-293::DEBUG::2014-04-10 18:58:13,373::task::1168::TaskManager.Task::(prepare) Task=`75ce5688-7560-407a-b4d0-b26f2746d3dc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-293::DEBUG::2014-04-10 18:58:13,373::task::579::TaskManager.Task::(_updateState) Task=`75ce5688-7560-407a-b4d0-b26f2746d3dc`::moving from state preparing -> state finished
>Thread-293::DEBUG::2014-04-10 18:58:13,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-293::DEBUG::2014-04-10 18:58:13,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-293::DEBUG::2014-04-10 18:58:13,374::task::974::TaskManager.Task::(_decref) Task=`75ce5688-7560-407a-b4d0-b26f2746d3dc`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,840::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,841::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,841::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,841::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,842::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,843::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,843::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:13,843::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-294::DEBUG::2014-04-10 18:58:14,385::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-294::DEBUG::2014-04-10 18:58:14,386::task::579::TaskManager.Task::(_updateState) Task=`fda34789-8713-4ab2-9b82-84c067dd5f04`::moving from state init -> state preparing
>Thread-294::INFO::2014-04-10 18:58:14,387::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-294::DEBUG::2014-04-10 18:58:14,387::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-294::DEBUG::2014-04-10 18:58:14,387::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-294::INFO::2014-04-10 18:58:14,387::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-294::DEBUG::2014-04-10 18:58:14,387::task::1168::TaskManager.Task::(prepare) Task=`fda34789-8713-4ab2-9b82-84c067dd5f04`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-294::DEBUG::2014-04-10 18:58:14,388::task::579::TaskManager.Task::(_updateState) Task=`fda34789-8713-4ab2-9b82-84c067dd5f04`::moving from state preparing -> state finished
>Thread-294::DEBUG::2014-04-10 18:58:14,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-294::DEBUG::2014-04-10 18:58:14,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-294::DEBUG::2014-04-10 18:58:14,388::task::974::TaskManager.Task::(_decref) Task=`fda34789-8713-4ab2-9b82-84c067dd5f04`::ref 0 aborting False
>Thread-296::DEBUG::2014-04-10 18:58:15,398::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-296::DEBUG::2014-04-10 18:58:15,398::task::579::TaskManager.Task::(_updateState) Task=`1921fa1f-bc50-475e-8eb5-2734e555870a`::moving from state init -> state preparing
>Thread-296::INFO::2014-04-10 18:58:15,399::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-296::DEBUG::2014-04-10 18:58:15,399::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-296::DEBUG::2014-04-10 18:58:15,399::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-296::INFO::2014-04-10 18:58:15,399::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-296::DEBUG::2014-04-10 18:58:15,399::task::1168::TaskManager.Task::(prepare) Task=`1921fa1f-bc50-475e-8eb5-2734e555870a`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-296::DEBUG::2014-04-10 18:58:15,399::task::579::TaskManager.Task::(_updateState) Task=`1921fa1f-bc50-475e-8eb5-2734e555870a`::moving from state preparing -> state finished
>Thread-296::DEBUG::2014-04-10 18:58:15,399::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-296::DEBUG::2014-04-10 18:58:15,399::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-296::DEBUG::2014-04-10 18:58:15,400::task::974::TaskManager.Task::(_decref) Task=`1921fa1f-bc50-475e-8eb5-2734e555870a`::ref 0 aborting False
>Thread-297::DEBUG::2014-04-10 18:58:16,409::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-297::DEBUG::2014-04-10 18:58:16,441::task::579::TaskManager.Task::(_updateState) Task=`c0caea80-fec5-4637-a00a-386ac6684817`::moving from state init -> state preparing
>Thread-297::INFO::2014-04-10 18:58:16,441::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-297::DEBUG::2014-04-10 18:58:16,442::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-297::DEBUG::2014-04-10 18:58:16,442::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-297::INFO::2014-04-10 18:58:16,442::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-297::DEBUG::2014-04-10 18:58:16,442::task::1168::TaskManager.Task::(prepare) Task=`c0caea80-fec5-4637-a00a-386ac6684817`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-297::DEBUG::2014-04-10 18:58:16,442::task::579::TaskManager.Task::(_updateState) Task=`c0caea80-fec5-4637-a00a-386ac6684817`::moving from state preparing -> state finished
>Thread-297::DEBUG::2014-04-10 18:58:16,442::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-297::DEBUG::2014-04-10 18:58:16,442::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-297::DEBUG::2014-04-10 18:58:16,443::task::974::TaskManager.Task::(_decref) Task=`c0caea80-fec5-4637-a00a-386ac6684817`::ref 0 aborting False
>Thread-298::DEBUG::2014-04-10 18:58:17,455::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-298::DEBUG::2014-04-10 18:58:17,456::task::579::TaskManager.Task::(_updateState) Task=`8fd23d36-7dfa-4178-925e-9bb3c693aeb3`::moving from state init -> state preparing
>Thread-298::INFO::2014-04-10 18:58:17,456::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-298::DEBUG::2014-04-10 18:58:17,456::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-298::DEBUG::2014-04-10 18:58:17,456::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-298::INFO::2014-04-10 18:58:17,456::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-298::DEBUG::2014-04-10 18:58:17,456::task::1168::TaskManager.Task::(prepare) Task=`8fd23d36-7dfa-4178-925e-9bb3c693aeb3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-298::DEBUG::2014-04-10 18:58:17,456::task::579::TaskManager.Task::(_updateState) Task=`8fd23d36-7dfa-4178-925e-9bb3c693aeb3`::moving from state preparing -> state finished
>Thread-298::DEBUG::2014-04-10 18:58:17,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-298::DEBUG::2014-04-10 18:58:17,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-298::DEBUG::2014-04-10 18:58:17,457::task::974::TaskManager.Task::(_decref) Task=`8fd23d36-7dfa-4178-925e-9bb3c693aeb3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:58:17,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:17,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484586 s, 759 kB/s\n'; <rc> = 0
>Thread-300::DEBUG::2014-04-10 18:58:18,467::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-300::DEBUG::2014-04-10 18:58:18,468::task::579::TaskManager.Task::(_updateState) Task=`28bdfcda-c0a0-4029-b238-b4ada15026d0`::moving from state init -> state preparing
>Thread-300::INFO::2014-04-10 18:58:18,468::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-300::DEBUG::2014-04-10 18:58:18,468::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-300::DEBUG::2014-04-10 18:58:18,468::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-300::INFO::2014-04-10 18:58:18,468::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-300::DEBUG::2014-04-10 18:58:18,469::task::1168::TaskManager.Task::(prepare) Task=`28bdfcda-c0a0-4029-b238-b4ada15026d0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-300::DEBUG::2014-04-10 18:58:18,469::task::579::TaskManager.Task::(_updateState) Task=`28bdfcda-c0a0-4029-b238-b4ada15026d0`::moving from state preparing -> state finished
>Thread-300::DEBUG::2014-04-10 18:58:18,469::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-300::DEBUG::2014-04-10 18:58:18,469::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-300::DEBUG::2014-04-10 18:58:18,469::task::974::TaskManager.Task::(_decref) Task=`28bdfcda-c0a0-4029-b238-b4ada15026d0`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,850::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,850::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,850::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,850::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,852::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,852::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,852::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:18,853::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-301::DEBUG::2014-04-10 18:58:19,480::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-301::DEBUG::2014-04-10 18:58:19,481::task::579::TaskManager.Task::(_updateState) Task=`724b7f61-4bf5-4c96-804e-59e617fa5b8f`::moving from state init -> state preparing
>Thread-301::INFO::2014-04-10 18:58:19,481::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-301::DEBUG::2014-04-10 18:58:19,481::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-301::DEBUG::2014-04-10 18:58:19,481::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-301::INFO::2014-04-10 18:58:19,481::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-301::DEBUG::2014-04-10 18:58:19,482::task::1168::TaskManager.Task::(prepare) Task=`724b7f61-4bf5-4c96-804e-59e617fa5b8f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-301::DEBUG::2014-04-10 18:58:19,482::task::579::TaskManager.Task::(_updateState) Task=`724b7f61-4bf5-4c96-804e-59e617fa5b8f`::moving from state preparing -> state finished
>Thread-301::DEBUG::2014-04-10 18:58:19,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-301::DEBUG::2014-04-10 18:58:19,482::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-301::DEBUG::2014-04-10 18:58:19,482::task::974::TaskManager.Task::(_decref) Task=`724b7f61-4bf5-4c96-804e-59e617fa5b8f`::ref 0 aborting False
>Thread-302::DEBUG::2014-04-10 18:58:20,492::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-302::DEBUG::2014-04-10 18:58:20,492::task::579::TaskManager.Task::(_updateState) Task=`c7797c64-a4c1-4de6-8348-314f7ee99f6c`::moving from state init -> state preparing
>Thread-302::INFO::2014-04-10 18:58:20,492::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-302::DEBUG::2014-04-10 18:58:20,492::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-302::DEBUG::2014-04-10 18:58:20,492::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-302::INFO::2014-04-10 18:58:20,493::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-302::DEBUG::2014-04-10 18:58:20,493::task::1168::TaskManager.Task::(prepare) Task=`c7797c64-a4c1-4de6-8348-314f7ee99f6c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-302::DEBUG::2014-04-10 18:58:20,493::task::579::TaskManager.Task::(_updateState) Task=`c7797c64-a4c1-4de6-8348-314f7ee99f6c`::moving from state preparing -> state finished
>Thread-302::DEBUG::2014-04-10 18:58:20,493::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-302::DEBUG::2014-04-10 18:58:20,493::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-302::DEBUG::2014-04-10 18:58:20,493::task::974::TaskManager.Task::(_decref) Task=`c7797c64-a4c1-4de6-8348-314f7ee99f6c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:20,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:20,990::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000461813 s, 1.4 MB/s\n'; <rc> = 0
>Thread-304::DEBUG::2014-04-10 18:58:21,510::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-304::DEBUG::2014-04-10 18:58:21,529::task::579::TaskManager.Task::(_updateState) Task=`4f260165-7b8a-4a12-878c-09f6c8cc4df0`::moving from state init -> state preparing
>Thread-304::INFO::2014-04-10 18:58:21,529::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-304::DEBUG::2014-04-10 18:58:21,529::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-304::DEBUG::2014-04-10 18:58:21,530::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-304::INFO::2014-04-10 18:58:21,530::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-304::DEBUG::2014-04-10 18:58:21,530::task::1168::TaskManager.Task::(prepare) Task=`4f260165-7b8a-4a12-878c-09f6c8cc4df0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-304::DEBUG::2014-04-10 18:58:21,530::task::579::TaskManager.Task::(_updateState) Task=`4f260165-7b8a-4a12-878c-09f6c8cc4df0`::moving from state preparing -> state finished
>Thread-304::DEBUG::2014-04-10 18:58:21,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-304::DEBUG::2014-04-10 18:58:21,531::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-304::DEBUG::2014-04-10 18:58:21,531::task::974::TaskManager.Task::(_decref) Task=`4f260165-7b8a-4a12-878c-09f6c8cc4df0`::ref 0 aborting False
>Thread-305::DEBUG::2014-04-10 18:58:22,541::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-305::DEBUG::2014-04-10 18:58:22,542::task::579::TaskManager.Task::(_updateState) Task=`2b5a9217-6306-466b-abaf-5cbeac1a70d8`::moving from state init -> state preparing
>Thread-305::INFO::2014-04-10 18:58:22,542::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-305::DEBUG::2014-04-10 18:58:22,542::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-305::DEBUG::2014-04-10 18:58:22,542::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-305::INFO::2014-04-10 18:58:22,543::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-305::DEBUG::2014-04-10 18:58:22,543::task::1168::TaskManager.Task::(prepare) Task=`2b5a9217-6306-466b-abaf-5cbeac1a70d8`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-305::DEBUG::2014-04-10 18:58:22,543::task::579::TaskManager.Task::(_updateState) Task=`2b5a9217-6306-466b-abaf-5cbeac1a70d8`::moving from state preparing -> state finished
>Thread-305::DEBUG::2014-04-10 18:58:22,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-305::DEBUG::2014-04-10 18:58:22,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-305::DEBUG::2014-04-10 18:58:22,543::task::974::TaskManager.Task::(_decref) Task=`2b5a9217-6306-466b-abaf-5cbeac1a70d8`::ref 0 aborting False
>Thread-306::DEBUG::2014-04-10 18:58:23,553::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-306::DEBUG::2014-04-10 18:58:23,554::task::579::TaskManager.Task::(_updateState) Task=`6d830f28-9dff-44f7-b8dc-8687c8fcfb38`::moving from state init -> state preparing
>Thread-306::INFO::2014-04-10 18:58:23,554::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-306::DEBUG::2014-04-10 18:58:23,554::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-306::DEBUG::2014-04-10 18:58:23,554::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-306::INFO::2014-04-10 18:58:23,554::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-306::DEBUG::2014-04-10 18:58:23,555::task::1168::TaskManager.Task::(prepare) Task=`6d830f28-9dff-44f7-b8dc-8687c8fcfb38`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-306::DEBUG::2014-04-10 18:58:23,555::task::579::TaskManager.Task::(_updateState) Task=`6d830f28-9dff-44f7-b8dc-8687c8fcfb38`::moving from state preparing -> state finished
>Thread-306::DEBUG::2014-04-10 18:58:23,555::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-306::DEBUG::2014-04-10 18:58:23,555::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-306::DEBUG::2014-04-10 18:58:23,555::task::974::TaskManager.Task::(_decref) Task=`6d830f28-9dff-44f7-b8dc-8687c8fcfb38`::ref 0 aborting False
>Thread-307::DEBUG::2014-04-10 18:58:23,585::task::579::TaskManager.Task::(_updateState) Task=`85e90077-c9de-4c4d-838e-884b283ecfda`::moving from state init -> state preparing
>Thread-307::INFO::2014-04-10 18:58:23,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-307::INFO::2014-04-10 18:58:23,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461813', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '93.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '42.7', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484586', 'lastCheck': '5.7', 'valid': True}}
>Thread-307::DEBUG::2014-04-10 18:58:23,586::task::1168::TaskManager.Task::(prepare) Task=`85e90077-c9de-4c4d-838e-884b283ecfda`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461813', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '93.1', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '42.7', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484586', 'lastCheck': '5.7', 'valid': True}}
>Thread-307::DEBUG::2014-04-10 18:58:23,586::task::579::TaskManager.Task::(_updateState) Task=`85e90077-c9de-4c4d-838e-884b283ecfda`::moving from state preparing -> state finished
>Thread-307::DEBUG::2014-04-10 18:58:23,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-307::DEBUG::2014-04-10 18:58:23,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-307::DEBUG::2014-04-10 18:58:23,587::task::974::TaskManager.Task::(_decref) Task=`85e90077-c9de-4c4d-838e-884b283ecfda`::ref 0 aborting False
>Thread-308::DEBUG::2014-04-10 18:58:23,609::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-308::DEBUG::2014-04-10 18:58:23,609::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-308::DEBUG::2014-04-10 18:58:23,610::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-308::DEBUG::2014-04-10 18:58:23,610::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,859::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,859::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,860::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,860::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,861::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,861::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,861::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:23,861::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-309::DEBUG::2014-04-10 18:58:24,566::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-309::DEBUG::2014-04-10 18:58:24,567::task::579::TaskManager.Task::(_updateState) Task=`f5dcad37-3e92-4d69-9302-0ba89b5b87c0`::moving from state init -> state preparing
>Thread-309::INFO::2014-04-10 18:58:24,567::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-309::DEBUG::2014-04-10 18:58:24,567::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-309::DEBUG::2014-04-10 18:58:24,567::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-309::INFO::2014-04-10 18:58:24,567::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-309::DEBUG::2014-04-10 18:58:24,568::task::1168::TaskManager.Task::(prepare) Task=`f5dcad37-3e92-4d69-9302-0ba89b5b87c0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-309::DEBUG::2014-04-10 18:58:24,568::task::579::TaskManager.Task::(_updateState) Task=`f5dcad37-3e92-4d69-9302-0ba89b5b87c0`::moving from state preparing -> state finished
>Thread-309::DEBUG::2014-04-10 18:58:24,568::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-309::DEBUG::2014-04-10 18:58:24,568::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-309::DEBUG::2014-04-10 18:58:24,568::task::974::TaskManager.Task::(_decref) Task=`f5dcad37-3e92-4d69-9302-0ba89b5b87c0`::ref 0 aborting False
>Thread-310::DEBUG::2014-04-10 18:58:25,578::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-310::DEBUG::2014-04-10 18:58:25,579::task::579::TaskManager.Task::(_updateState) Task=`e77ecfeb-cf92-4f89-85b0-44aa91d17bde`::moving from state init -> state preparing
>Thread-310::INFO::2014-04-10 18:58:25,579::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-310::DEBUG::2014-04-10 18:58:25,579::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-310::DEBUG::2014-04-10 18:58:25,580::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-310::INFO::2014-04-10 18:58:25,580::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-310::DEBUG::2014-04-10 18:58:25,580::task::1168::TaskManager.Task::(prepare) Task=`e77ecfeb-cf92-4f89-85b0-44aa91d17bde`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-310::DEBUG::2014-04-10 18:58:25,580::task::579::TaskManager.Task::(_updateState) Task=`e77ecfeb-cf92-4f89-85b0-44aa91d17bde`::moving from state preparing -> state finished
>Thread-310::DEBUG::2014-04-10 18:58:25,580::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-310::DEBUG::2014-04-10 18:58:25,580::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-310::DEBUG::2014-04-10 18:58:25,581::task::974::TaskManager.Task::(_decref) Task=`e77ecfeb-cf92-4f89-85b0-44aa91d17bde`::ref 0 aborting False
>VM Channels Listener::DEBUG::2014-04-10 18:58:25,926::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-311::DEBUG::2014-04-10 18:58:26,590::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-311::DEBUG::2014-04-10 18:58:26,605::task::579::TaskManager.Task::(_updateState) Task=`f788784f-c0d3-428b-a427-09c8bef0b1fc`::moving from state init -> state preparing
>Thread-311::INFO::2014-04-10 18:58:26,605::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-311::DEBUG::2014-04-10 18:58:26,605::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-311::DEBUG::2014-04-10 18:58:26,605::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-311::INFO::2014-04-10 18:58:26,605::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-311::DEBUG::2014-04-10 18:58:26,606::task::1168::TaskManager.Task::(prepare) Task=`f788784f-c0d3-428b-a427-09c8bef0b1fc`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-311::DEBUG::2014-04-10 18:58:26,606::task::579::TaskManager.Task::(_updateState) Task=`f788784f-c0d3-428b-a427-09c8bef0b1fc`::moving from state preparing -> state finished
>Thread-311::DEBUG::2014-04-10 18:58:26,606::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-311::DEBUG::2014-04-10 18:58:26,606::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-311::DEBUG::2014-04-10 18:58:26,606::task::974::TaskManager.Task::(_decref) Task=`f788784f-c0d3-428b-a427-09c8bef0b1fc`::ref 0 aborting False
>Thread-313::DEBUG::2014-04-10 18:58:27,615::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-313::DEBUG::2014-04-10 18:58:27,616::task::579::TaskManager.Task::(_updateState) Task=`b5e536b4-6f27-4dfc-bc18-1fc5fc5f4c6b`::moving from state init -> state preparing
>Thread-313::INFO::2014-04-10 18:58:27,616::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-313::DEBUG::2014-04-10 18:58:27,616::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-313::DEBUG::2014-04-10 18:58:27,616::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-313::INFO::2014-04-10 18:58:27,617::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-313::DEBUG::2014-04-10 18:58:27,617::task::1168::TaskManager.Task::(prepare) Task=`b5e536b4-6f27-4dfc-bc18-1fc5fc5f4c6b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-313::DEBUG::2014-04-10 18:58:27,617::task::579::TaskManager.Task::(_updateState) Task=`b5e536b4-6f27-4dfc-bc18-1fc5fc5f4c6b`::moving from state preparing -> state finished
>Thread-313::DEBUG::2014-04-10 18:58:27,617::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-313::DEBUG::2014-04-10 18:58:27,617::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-313::DEBUG::2014-04-10 18:58:27,617::task::974::TaskManager.Task::(_decref) Task=`b5e536b4-6f27-4dfc-bc18-1fc5fc5f4c6b`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:58:27,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:27,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488037 s, 754 kB/s\n'; <rc> = 0
>Thread-314::DEBUG::2014-04-10 18:58:28,627::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-314::DEBUG::2014-04-10 18:58:28,628::task::579::TaskManager.Task::(_updateState) Task=`74891b5b-24b2-4c91-a41a-704a7dfebfec`::moving from state init -> state preparing
>Thread-314::INFO::2014-04-10 18:58:28,628::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-314::DEBUG::2014-04-10 18:58:28,628::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-314::DEBUG::2014-04-10 18:58:28,629::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-314::INFO::2014-04-10 18:58:28,629::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-314::DEBUG::2014-04-10 18:58:28,629::task::1168::TaskManager.Task::(prepare) Task=`74891b5b-24b2-4c91-a41a-704a7dfebfec`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-314::DEBUG::2014-04-10 18:58:28,629::task::579::TaskManager.Task::(_updateState) Task=`74891b5b-24b2-4c91-a41a-704a7dfebfec`::moving from state preparing -> state finished
>Thread-314::DEBUG::2014-04-10 18:58:28,629::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-314::DEBUG::2014-04-10 18:58:28,629::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-314::DEBUG::2014-04-10 18:58:28,630::task::974::TaskManager.Task::(_decref) Task=`74891b5b-24b2-4c91-a41a-704a7dfebfec`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,868::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,868::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,869::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,869::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,870::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,870::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,871::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:28,871::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-315::DEBUG::2014-04-10 18:58:29,640::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-315::DEBUG::2014-04-10 18:58:29,641::task::579::TaskManager.Task::(_updateState) Task=`0436fee2-052b-4713-8e50-3da498d3ae26`::moving from state init -> state preparing
>Thread-315::INFO::2014-04-10 18:58:29,641::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-315::DEBUG::2014-04-10 18:58:29,641::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-315::DEBUG::2014-04-10 18:58:29,641::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-315::INFO::2014-04-10 18:58:29,642::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-315::DEBUG::2014-04-10 18:58:29,642::task::1168::TaskManager.Task::(prepare) Task=`0436fee2-052b-4713-8e50-3da498d3ae26`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-315::DEBUG::2014-04-10 18:58:29,642::task::579::TaskManager.Task::(_updateState) Task=`0436fee2-052b-4713-8e50-3da498d3ae26`::moving from state preparing -> state finished
>Thread-315::DEBUG::2014-04-10 18:58:29,642::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-315::DEBUG::2014-04-10 18:58:29,642::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-315::DEBUG::2014-04-10 18:58:29,643::task::974::TaskManager.Task::(_decref) Task=`0436fee2-052b-4713-8e50-3da498d3ae26`::ref 0 aborting False
>Thread-317::DEBUG::2014-04-10 18:58:30,652::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-317::DEBUG::2014-04-10 18:58:30,652::task::579::TaskManager.Task::(_updateState) Task=`f764a660-810c-455a-b4ee-fb7cd562237f`::moving from state init -> state preparing
>Thread-317::INFO::2014-04-10 18:58:30,653::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-317::DEBUG::2014-04-10 18:58:30,653::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-317::DEBUG::2014-04-10 18:58:30,653::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-317::INFO::2014-04-10 18:58:30,653::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-317::DEBUG::2014-04-10 18:58:30,653::task::1168::TaskManager.Task::(prepare) Task=`f764a660-810c-455a-b4ee-fb7cd562237f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-317::DEBUG::2014-04-10 18:58:30,653::task::579::TaskManager.Task::(_updateState) Task=`f764a660-810c-455a-b4ee-fb7cd562237f`::moving from state preparing -> state finished
>Thread-317::DEBUG::2014-04-10 18:58:30,653::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-317::DEBUG::2014-04-10 18:58:30,654::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-317::DEBUG::2014-04-10 18:58:30,654::task::974::TaskManager.Task::(_decref) Task=`f764a660-810c-455a-b4ee-fb7cd562237f`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:30,993::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 18:58:31,009::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 18:58:31,010::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 18:58:31,019::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 18:58:31,020::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 18:58:31,021::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 18:58:31,021::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 18:58:31,027::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:31,034::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000353409 s, 1.9 MB/s\n'; <rc> = 0
>Thread-322::DEBUG::2014-04-10 18:58:31,664::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-322::DEBUG::2014-04-10 18:58:31,687::task::579::TaskManager.Task::(_updateState) Task=`da980d5f-b85a-4b5c-801a-aee7b3ebb161`::moving from state init -> state preparing
>Thread-322::INFO::2014-04-10 18:58:31,687::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-322::DEBUG::2014-04-10 18:58:31,687::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-322::DEBUG::2014-04-10 18:58:31,688::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-322::INFO::2014-04-10 18:58:31,688::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-322::DEBUG::2014-04-10 18:58:31,688::task::1168::TaskManager.Task::(prepare) Task=`da980d5f-b85a-4b5c-801a-aee7b3ebb161`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-322::DEBUG::2014-04-10 18:58:31,688::task::579::TaskManager.Task::(_updateState) Task=`da980d5f-b85a-4b5c-801a-aee7b3ebb161`::moving from state preparing -> state finished
>Thread-322::DEBUG::2014-04-10 18:58:31,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-322::DEBUG::2014-04-10 18:58:31,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-322::DEBUG::2014-04-10 18:58:31,689::task::974::TaskManager.Task::(_decref) Task=`da980d5f-b85a-4b5c-801a-aee7b3ebb161`::ref 0 aborting False
>Thread-323::DEBUG::2014-04-10 18:58:32,698::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-323::DEBUG::2014-04-10 18:58:32,699::task::579::TaskManager.Task::(_updateState) Task=`c3d33272-b112-4bad-88c4-9cb9c328b31d`::moving from state init -> state preparing
>Thread-323::INFO::2014-04-10 18:58:32,699::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-323::DEBUG::2014-04-10 18:58:32,699::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-323::DEBUG::2014-04-10 18:58:32,699::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-323::INFO::2014-04-10 18:58:32,699::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-323::DEBUG::2014-04-10 18:58:32,699::task::1168::TaskManager.Task::(prepare) Task=`c3d33272-b112-4bad-88c4-9cb9c328b31d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-323::DEBUG::2014-04-10 18:58:32,700::task::579::TaskManager.Task::(_updateState) Task=`c3d33272-b112-4bad-88c4-9cb9c328b31d`::moving from state preparing -> state finished
>Thread-323::DEBUG::2014-04-10 18:58:32,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-323::DEBUG::2014-04-10 18:58:32,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-323::DEBUG::2014-04-10 18:58:32,700::task::974::TaskManager.Task::(_decref) Task=`c3d33272-b112-4bad-88c4-9cb9c328b31d`::ref 0 aborting False
>Thread-325::DEBUG::2014-04-10 18:58:33,709::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-325::DEBUG::2014-04-10 18:58:33,710::task::579::TaskManager.Task::(_updateState) Task=`def7303a-d3cd-4722-bf3e-df56c1b30797`::moving from state init -> state preparing
>Thread-325::INFO::2014-04-10 18:58:33,710::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-325::DEBUG::2014-04-10 18:58:33,710::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-325::DEBUG::2014-04-10 18:58:33,710::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-325::INFO::2014-04-10 18:58:33,710::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-325::DEBUG::2014-04-10 18:58:33,710::task::1168::TaskManager.Task::(prepare) Task=`def7303a-d3cd-4722-bf3e-df56c1b30797`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-325::DEBUG::2014-04-10 18:58:33,711::task::579::TaskManager.Task::(_updateState) Task=`def7303a-d3cd-4722-bf3e-df56c1b30797`::moving from state preparing -> state finished
>Thread-325::DEBUG::2014-04-10 18:58:33,711::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-325::DEBUG::2014-04-10 18:58:33,711::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-325::DEBUG::2014-04-10 18:58:33,711::task::974::TaskManager.Task::(_decref) Task=`def7303a-d3cd-4722-bf3e-df56c1b30797`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,878::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,878::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,878::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,878::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,880::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,880::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,880::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:33,880::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-326::DEBUG::2014-04-10 18:58:34,722::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-326::DEBUG::2014-04-10 18:58:34,723::task::579::TaskManager.Task::(_updateState) Task=`fb43fed6-5393-4ad0-a1da-266b24c249b9`::moving from state init -> state preparing
>Thread-326::INFO::2014-04-10 18:58:34,723::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-326::DEBUG::2014-04-10 18:58:34,723::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-326::DEBUG::2014-04-10 18:58:34,723::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-326::INFO::2014-04-10 18:58:34,724::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-326::DEBUG::2014-04-10 18:58:34,724::task::1168::TaskManager.Task::(prepare) Task=`fb43fed6-5393-4ad0-a1da-266b24c249b9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-326::DEBUG::2014-04-10 18:58:34,724::task::579::TaskManager.Task::(_updateState) Task=`fb43fed6-5393-4ad0-a1da-266b24c249b9`::moving from state preparing -> state finished
>Thread-326::DEBUG::2014-04-10 18:58:34,724::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-326::DEBUG::2014-04-10 18:58:34,724::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-326::DEBUG::2014-04-10 18:58:34,724::task::974::TaskManager.Task::(_decref) Task=`fb43fed6-5393-4ad0-a1da-266b24c249b9`::ref 0 aborting False
>Thread-327::DEBUG::2014-04-10 18:58:35,736::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-327::DEBUG::2014-04-10 18:58:35,737::task::579::TaskManager.Task::(_updateState) Task=`11d69657-433a-4f2f-86c8-9def5aa340ac`::moving from state init -> state preparing
>Thread-327::INFO::2014-04-10 18:58:35,737::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-327::DEBUG::2014-04-10 18:58:35,737::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-327::DEBUG::2014-04-10 18:58:35,737::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-327::INFO::2014-04-10 18:58:35,737::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-327::DEBUG::2014-04-10 18:58:35,737::task::1168::TaskManager.Task::(prepare) Task=`11d69657-433a-4f2f-86c8-9def5aa340ac`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-327::DEBUG::2014-04-10 18:58:35,738::task::579::TaskManager.Task::(_updateState) Task=`11d69657-433a-4f2f-86c8-9def5aa340ac`::moving from state preparing -> state finished
>Thread-327::DEBUG::2014-04-10 18:58:35,738::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-327::DEBUG::2014-04-10 18:58:35,738::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-327::DEBUG::2014-04-10 18:58:35,738::task::974::TaskManager.Task::(_decref) Task=`11d69657-433a-4f2f-86c8-9def5aa340ac`::ref 0 aborting False
>Thread-329::DEBUG::2014-04-10 18:58:36,748::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-329::DEBUG::2014-04-10 18:58:36,773::task::579::TaskManager.Task::(_updateState) Task=`a55a5c81-ac1e-4255-bd4f-4dd5684ab2dd`::moving from state init -> state preparing
>Thread-329::INFO::2014-04-10 18:58:36,774::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-329::DEBUG::2014-04-10 18:58:36,774::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-329::DEBUG::2014-04-10 18:58:36,774::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-329::INFO::2014-04-10 18:58:36,774::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-329::DEBUG::2014-04-10 18:58:36,774::task::1168::TaskManager.Task::(prepare) Task=`a55a5c81-ac1e-4255-bd4f-4dd5684ab2dd`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-329::DEBUG::2014-04-10 18:58:36,774::task::579::TaskManager.Task::(_updateState) Task=`a55a5c81-ac1e-4255-bd4f-4dd5684ab2dd`::moving from state preparing -> state finished
>Thread-329::DEBUG::2014-04-10 18:58:36,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-329::DEBUG::2014-04-10 18:58:36,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-329::DEBUG::2014-04-10 18:58:36,775::task::974::TaskManager.Task::(_decref) Task=`a55a5c81-ac1e-4255-bd4f-4dd5684ab2dd`::ref 0 aborting False
>Thread-330::DEBUG::2014-04-10 18:58:37,784::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-330::DEBUG::2014-04-10 18:58:37,785::task::579::TaskManager.Task::(_updateState) Task=`10b9d169-232b-4bcf-ac40-51adf6b4e43f`::moving from state init -> state preparing
>Thread-330::INFO::2014-04-10 18:58:37,785::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-330::DEBUG::2014-04-10 18:58:37,785::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-330::DEBUG::2014-04-10 18:58:37,785::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-330::INFO::2014-04-10 18:58:37,785::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-330::DEBUG::2014-04-10 18:58:37,786::task::1168::TaskManager.Task::(prepare) Task=`10b9d169-232b-4bcf-ac40-51adf6b4e43f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-330::DEBUG::2014-04-10 18:58:37,786::task::579::TaskManager.Task::(_updateState) Task=`10b9d169-232b-4bcf-ac40-51adf6b4e43f`::moving from state preparing -> state finished
>Thread-330::DEBUG::2014-04-10 18:58:37,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-330::DEBUG::2014-04-10 18:58:37,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-330::DEBUG::2014-04-10 18:58:37,786::task::974::TaskManager.Task::(_decref) Task=`10b9d169-232b-4bcf-ac40-51adf6b4e43f`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:58:37,896::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 18:58:37,913::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 18:58:37,914::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 18:58:37,920::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 18:58:37,922::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 18:58:37,922::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 18:58:37,922::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 18:58:37,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:37,934::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000311888 s, 1.2 MB/s\n'; <rc> = 0
>Thread-335::DEBUG::2014-04-10 18:58:38,796::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-335::DEBUG::2014-04-10 18:58:38,797::task::579::TaskManager.Task::(_updateState) Task=`982d891c-62d2-4239-b8fc-e1d386e29f5d`::moving from state init -> state preparing
>Thread-335::INFO::2014-04-10 18:58:38,797::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-335::DEBUG::2014-04-10 18:58:38,797::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-335::DEBUG::2014-04-10 18:58:38,798::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-335::INFO::2014-04-10 18:58:38,798::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-335::DEBUG::2014-04-10 18:58:38,798::task::1168::TaskManager.Task::(prepare) Task=`982d891c-62d2-4239-b8fc-e1d386e29f5d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-335::DEBUG::2014-04-10 18:58:38,798::task::579::TaskManager.Task::(_updateState) Task=`982d891c-62d2-4239-b8fc-e1d386e29f5d`::moving from state preparing -> state finished
>Thread-335::DEBUG::2014-04-10 18:58:38,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-335::DEBUG::2014-04-10 18:58:38,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-335::DEBUG::2014-04-10 18:58:38,799::task::974::TaskManager.Task::(_decref) Task=`982d891c-62d2-4239-b8fc-e1d386e29f5d`::ref 0 aborting False
>Thread-336::DEBUG::2014-04-10 18:58:38,874::task::579::TaskManager.Task::(_updateState) Task=`2b8bd51a-1996-4db5-9e78-a6f007198d65`::moving from state init -> state preparing
>Thread-336::INFO::2014-04-10 18:58:38,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-336::INFO::2014-04-10 18:58:38,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353409', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '108.4', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '58.0', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311888', 'lastCheck': '0.9', 'valid': True}}
>Thread-336::DEBUG::2014-04-10 18:58:38,875::task::1168::TaskManager.Task::(prepare) Task=`2b8bd51a-1996-4db5-9e78-a6f007198d65`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353409', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '108.4', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '58.0', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311888', 'lastCheck': '0.9', 'valid': True}}
>Thread-336::DEBUG::2014-04-10 18:58:38,875::task::579::TaskManager.Task::(_updateState) Task=`2b8bd51a-1996-4db5-9e78-a6f007198d65`::moving from state preparing -> state finished
>Thread-336::DEBUG::2014-04-10 18:58:38,876::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-336::DEBUG::2014-04-10 18:58:38,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-336::DEBUG::2014-04-10 18:58:38,876::task::974::TaskManager.Task::(_decref) Task=`2b8bd51a-1996-4db5-9e78-a6f007198d65`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,887::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,887::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,887::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,888::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,889::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,890::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,890::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:38,890::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-337::DEBUG::2014-04-10 18:58:38,899::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-337::DEBUG::2014-04-10 18:58:38,899::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-337::DEBUG::2014-04-10 18:58:38,899::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-337::DEBUG::2014-04-10 18:58:38,900::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-338::DEBUG::2014-04-10 18:58:39,810::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-338::DEBUG::2014-04-10 18:58:39,811::task::579::TaskManager.Task::(_updateState) Task=`00fcd246-2bdb-4f67-b63c-b0aeb4b7ff82`::moving from state init -> state preparing
>Thread-338::INFO::2014-04-10 18:58:39,811::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-338::DEBUG::2014-04-10 18:58:39,811::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-338::DEBUG::2014-04-10 18:58:39,811::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-338::INFO::2014-04-10 18:58:39,812::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-338::DEBUG::2014-04-10 18:58:39,812::task::1168::TaskManager.Task::(prepare) Task=`00fcd246-2bdb-4f67-b63c-b0aeb4b7ff82`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-338::DEBUG::2014-04-10 18:58:39,812::task::579::TaskManager.Task::(_updateState) Task=`00fcd246-2bdb-4f67-b63c-b0aeb4b7ff82`::moving from state preparing -> state finished
>Thread-338::DEBUG::2014-04-10 18:58:39,812::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-338::DEBUG::2014-04-10 18:58:39,812::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-338::DEBUG::2014-04-10 18:58:39,813::task::974::TaskManager.Task::(_decref) Task=`00fcd246-2bdb-4f67-b63c-b0aeb4b7ff82`::ref 0 aborting False
>Thread-339::DEBUG::2014-04-10 18:58:40,823::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-339::DEBUG::2014-04-10 18:58:40,823::task::579::TaskManager.Task::(_updateState) Task=`f897a9b2-84bc-4e45-8a5f-a1cd14f54705`::moving from state init -> state preparing
>Thread-339::INFO::2014-04-10 18:58:40,823::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-339::DEBUG::2014-04-10 18:58:40,824::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-339::DEBUG::2014-04-10 18:58:40,824::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-339::INFO::2014-04-10 18:58:40,824::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-339::DEBUG::2014-04-10 18:58:40,824::task::1168::TaskManager.Task::(prepare) Task=`f897a9b2-84bc-4e45-8a5f-a1cd14f54705`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-339::DEBUG::2014-04-10 18:58:40,824::task::579::TaskManager.Task::(_updateState) Task=`f897a9b2-84bc-4e45-8a5f-a1cd14f54705`::moving from state preparing -> state finished
>Thread-339::DEBUG::2014-04-10 18:58:40,825::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-339::DEBUG::2014-04-10 18:58:40,825::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-339::DEBUG::2014-04-10 18:58:40,825::task::974::TaskManager.Task::(_decref) Task=`f897a9b2-84bc-4e45-8a5f-a1cd14f54705`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:41,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:41,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00045831 s, 1.4 MB/s\n'; <rc> = 0
>Thread-340::DEBUG::2014-04-10 18:58:41,836::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-340::DEBUG::2014-04-10 18:58:41,857::task::579::TaskManager.Task::(_updateState) Task=`36339dfe-8ad7-467e-b874-b9ec84aed49e`::moving from state init -> state preparing
>Thread-340::INFO::2014-04-10 18:58:41,857::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-340::DEBUG::2014-04-10 18:58:41,857::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-340::DEBUG::2014-04-10 18:58:41,858::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-340::INFO::2014-04-10 18:58:41,858::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-340::DEBUG::2014-04-10 18:58:41,858::task::1168::TaskManager.Task::(prepare) Task=`36339dfe-8ad7-467e-b874-b9ec84aed49e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-340::DEBUG::2014-04-10 18:58:41,858::task::579::TaskManager.Task::(_updateState) Task=`36339dfe-8ad7-467e-b874-b9ec84aed49e`::moving from state preparing -> state finished
>Thread-340::DEBUG::2014-04-10 18:58:41,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-340::DEBUG::2014-04-10 18:58:41,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-340::DEBUG::2014-04-10 18:58:41,859::task::974::TaskManager.Task::(_decref) Task=`36339dfe-8ad7-467e-b874-b9ec84aed49e`::ref 0 aborting False
>Thread-342::DEBUG::2014-04-10 18:58:42,870::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-342::DEBUG::2014-04-10 18:58:42,873::task::579::TaskManager.Task::(_updateState) Task=`a6b38562-620d-4122-b5f7-471c5081d05d`::moving from state init -> state preparing
>Thread-342::INFO::2014-04-10 18:58:42,873::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-342::DEBUG::2014-04-10 18:58:42,874::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-342::DEBUG::2014-04-10 18:58:42,876::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-342::INFO::2014-04-10 18:58:42,877::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-342::DEBUG::2014-04-10 18:58:42,877::task::1168::TaskManager.Task::(prepare) Task=`a6b38562-620d-4122-b5f7-471c5081d05d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-342::DEBUG::2014-04-10 18:58:42,878::task::579::TaskManager.Task::(_updateState) Task=`a6b38562-620d-4122-b5f7-471c5081d05d`::moving from state preparing -> state finished
>Thread-342::DEBUG::2014-04-10 18:58:42,879::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-342::DEBUG::2014-04-10 18:58:42,879::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-342::DEBUG::2014-04-10 18:58:42,880::task::974::TaskManager.Task::(_decref) Task=`a6b38562-620d-4122-b5f7-471c5081d05d`::ref 0 aborting False
>Thread-245::WARNING::2014-04-10 18:58:43,161::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-245::DEBUG::2014-04-10 18:58:43,164::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-247::WARNING::2014-04-10 18:58:43,164::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-247::DEBUG::2014-04-10 18:58:43,167::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-149::ERROR::2014-04-10 18:58:43,168::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 18:58:43,169::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 18:58:43,171::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 18:58:43,172::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 18:58:43,173::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-66::DEBUG::2014-04-10 18:58:43,313::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 18:58:43,314::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 18:58:43,314::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-347::DEBUG::2014-04-10 18:58:43,894::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-347::DEBUG::2014-04-10 18:58:43,895::task::579::TaskManager.Task::(_updateState) Task=`0b100859-435a-4edd-a67d-fc654e9e795b`::moving from state init -> state preparing
>Thread-347::INFO::2014-04-10 18:58:43,895::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-347::DEBUG::2014-04-10 18:58:43,895::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-347::DEBUG::2014-04-10 18:58:43,895::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-347::INFO::2014-04-10 18:58:43,895::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-347::DEBUG::2014-04-10 18:58:43,896::task::1168::TaskManager.Task::(prepare) Task=`0b100859-435a-4edd-a67d-fc654e9e795b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-347::DEBUG::2014-04-10 18:58:43,896::task::579::TaskManager.Task::(_updateState) Task=`0b100859-435a-4edd-a67d-fc654e9e795b`::moving from state preparing -> state finished
>Thread-347::DEBUG::2014-04-10 18:58:43,896::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-347::DEBUG::2014-04-10 18:58:43,896::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-347::DEBUG::2014-04-10 18:58:43,896::task::974::TaskManager.Task::(_decref) Task=`0b100859-435a-4edd-a67d-fc654e9e795b`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,899::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,901::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,902::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,902::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,903::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,904::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,904::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:43,904::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-348::DEBUG::2014-04-10 18:58:44,910::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-348::DEBUG::2014-04-10 18:58:44,911::task::579::TaskManager.Task::(_updateState) Task=`389c71b4-0e1e-4b62-a9ee-441401cf2ca4`::moving from state init -> state preparing
>Thread-348::INFO::2014-04-10 18:58:44,911::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-348::DEBUG::2014-04-10 18:58:44,912::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-348::DEBUG::2014-04-10 18:58:44,912::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-348::INFO::2014-04-10 18:58:44,912::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-348::DEBUG::2014-04-10 18:58:44,912::task::1168::TaskManager.Task::(prepare) Task=`389c71b4-0e1e-4b62-a9ee-441401cf2ca4`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-348::DEBUG::2014-04-10 18:58:44,912::task::579::TaskManager.Task::(_updateState) Task=`389c71b4-0e1e-4b62-a9ee-441401cf2ca4`::moving from state preparing -> state finished
>Thread-348::DEBUG::2014-04-10 18:58:44,912::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-348::DEBUG::2014-04-10 18:58:44,912::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-348::DEBUG::2014-04-10 18:58:44,913::task::974::TaskManager.Task::(_decref) Task=`389c71b4-0e1e-4b62-a9ee-441401cf2ca4`::ref 0 aborting False
>Thread-350::DEBUG::2014-04-10 18:58:45,922::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-350::DEBUG::2014-04-10 18:58:45,922::task::579::TaskManager.Task::(_updateState) Task=`facaa61b-be44-499d-a80a-64f95e7838ea`::moving from state init -> state preparing
>Thread-350::INFO::2014-04-10 18:58:45,923::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-350::DEBUG::2014-04-10 18:58:45,923::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-350::DEBUG::2014-04-10 18:58:45,923::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-350::INFO::2014-04-10 18:58:45,923::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-350::DEBUG::2014-04-10 18:58:45,923::task::1168::TaskManager.Task::(prepare) Task=`facaa61b-be44-499d-a80a-64f95e7838ea`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-350::DEBUG::2014-04-10 18:58:45,923::task::579::TaskManager.Task::(_updateState) Task=`facaa61b-be44-499d-a80a-64f95e7838ea`::moving from state preparing -> state finished
>Thread-350::DEBUG::2014-04-10 18:58:45,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-350::DEBUG::2014-04-10 18:58:45,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-350::DEBUG::2014-04-10 18:58:45,924::task::974::TaskManager.Task::(_decref) Task=`facaa61b-be44-499d-a80a-64f95e7838ea`::ref 0 aborting False
>Thread-351::DEBUG::2014-04-10 18:58:46,933::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-351::DEBUG::2014-04-10 18:58:46,960::task::579::TaskManager.Task::(_updateState) Task=`2c1f63ab-6a04-4e63-855b-abb7e4542cf3`::moving from state init -> state preparing
>Thread-351::INFO::2014-04-10 18:58:46,961::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-351::DEBUG::2014-04-10 18:58:46,961::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-351::DEBUG::2014-04-10 18:58:46,961::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-351::INFO::2014-04-10 18:58:46,961::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-351::DEBUG::2014-04-10 18:58:46,961::task::1168::TaskManager.Task::(prepare) Task=`2c1f63ab-6a04-4e63-855b-abb7e4542cf3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-351::DEBUG::2014-04-10 18:58:46,961::task::579::TaskManager.Task::(_updateState) Task=`2c1f63ab-6a04-4e63-855b-abb7e4542cf3`::moving from state preparing -> state finished
>Thread-351::DEBUG::2014-04-10 18:58:46,962::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-351::DEBUG::2014-04-10 18:58:46,962::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-351::DEBUG::2014-04-10 18:58:46,962::task::974::TaskManager.Task::(_decref) Task=`2c1f63ab-6a04-4e63-855b-abb7e4542cf3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 18:58:47,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:47,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00039499 s, 932 kB/s\n'; <rc> = 0
>Thread-352::DEBUG::2014-04-10 18:58:47,972::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-352::DEBUG::2014-04-10 18:58:47,973::task::579::TaskManager.Task::(_updateState) Task=`d1296cd5-0ed2-4ff5-bd52-e31a4dbfed49`::moving from state init -> state preparing
>Thread-352::INFO::2014-04-10 18:58:47,973::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-352::DEBUG::2014-04-10 18:58:47,973::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-352::DEBUG::2014-04-10 18:58:47,974::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-352::INFO::2014-04-10 18:58:47,974::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-352::DEBUG::2014-04-10 18:58:47,974::task::1168::TaskManager.Task::(prepare) Task=`d1296cd5-0ed2-4ff5-bd52-e31a4dbfed49`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-352::DEBUG::2014-04-10 18:58:47,974::task::579::TaskManager.Task::(_updateState) Task=`d1296cd5-0ed2-4ff5-bd52-e31a4dbfed49`::moving from state preparing -> state finished
>Thread-352::DEBUG::2014-04-10 18:58:47,974::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-352::DEBUG::2014-04-10 18:58:47,975::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-352::DEBUG::2014-04-10 18:58:47,975::task::974::TaskManager.Task::(_decref) Task=`d1296cd5-0ed2-4ff5-bd52-e31a4dbfed49`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,907::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,907::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,907::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,907::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,909::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,910::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,910::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:48,911::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-354::DEBUG::2014-04-10 18:58:48,985::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-354::DEBUG::2014-04-10 18:58:48,985::task::579::TaskManager.Task::(_updateState) Task=`85d758ea-2264-467b-a03b-6123c6373287`::moving from state init -> state preparing
>Thread-354::INFO::2014-04-10 18:58:48,985::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-354::DEBUG::2014-04-10 18:58:48,986::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-354::DEBUG::2014-04-10 18:58:48,986::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-354::INFO::2014-04-10 18:58:48,986::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-354::DEBUG::2014-04-10 18:58:48,986::task::1168::TaskManager.Task::(prepare) Task=`85d758ea-2264-467b-a03b-6123c6373287`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-354::DEBUG::2014-04-10 18:58:48,987::task::579::TaskManager.Task::(_updateState) Task=`85d758ea-2264-467b-a03b-6123c6373287`::moving from state preparing -> state finished
>Thread-354::DEBUG::2014-04-10 18:58:48,987::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-354::DEBUG::2014-04-10 18:58:48,987::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-354::DEBUG::2014-04-10 18:58:48,987::task::974::TaskManager.Task::(_decref) Task=`85d758ea-2264-467b-a03b-6123c6373287`::ref 0 aborting False
>Thread-355::DEBUG::2014-04-10 18:58:50,003::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-355::DEBUG::2014-04-10 18:58:50,008::task::579::TaskManager.Task::(_updateState) Task=`40492515-543d-463b-972e-4f5b5a8f97e6`::moving from state init -> state preparing
>Thread-355::INFO::2014-04-10 18:58:50,012::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-355::DEBUG::2014-04-10 18:58:50,014::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-355::DEBUG::2014-04-10 18:58:50,016::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-355::INFO::2014-04-10 18:58:50,019::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-355::DEBUG::2014-04-10 18:58:50,021::task::1168::TaskManager.Task::(prepare) Task=`40492515-543d-463b-972e-4f5b5a8f97e6`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-355::DEBUG::2014-04-10 18:58:50,024::task::579::TaskManager.Task::(_updateState) Task=`40492515-543d-463b-972e-4f5b5a8f97e6`::moving from state preparing -> state finished
>Thread-355::DEBUG::2014-04-10 18:58:50,026::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-355::DEBUG::2014-04-10 18:58:50,029::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-355::DEBUG::2014-04-10 18:58:50,032::task::974::TaskManager.Task::(_decref) Task=`40492515-543d-463b-972e-4f5b5a8f97e6`::ref 0 aborting False
>Thread-260::WARNING::2014-04-10 18:58:50,837::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-260::DEBUG::2014-04-10 18:58:50,839::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-262::WARNING::2014-04-10 18:58:50,844::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>e7c56099-afb9-407a-991d-cb6b72ddd351::ERROR::2014-04-10 18:58:50,845::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 18:58:50,845::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>e7c56099-afb9-407a-991d-cb6b72ddd351::ERROR::2014-04-10 18:58:50,845::sp::296::Storage.StoragePool::(startSpm) Backup domain validation failed
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sp.py", line 293, in startSpm
>    self.checkBackupDomain(__securityOverride=True)
>  File "/usr/share/vdsm/storage/securable.py", line 68, in wrapper
>    return f(self, *args, **kwargs)
>  File "/usr/share/vdsm/storage/sp.py", line 1577, in checkBackupDomain
>    dom = sdCache.produce(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 18:58:50,846::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 18:58:50,847::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,848::sp::333::Storage.StoragePool::(startSpm) ended.
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,849::task::579::TaskManager.Task::(_updateState) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::moving from state running -> state finished
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,850::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,852::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-64::DEBUG::2014-04-10 18:58:50,853::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,854::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,860::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,860::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,861::task::897::TaskManager.Task::(_runJobs) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::Task.run: exit - success: result 
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,861::task::974::TaskManager.Task::(_decref) Task=`e7c56099-afb9-407a-991d-cb6b72ddd351`::ref 0 aborting False
>e7c56099-afb9-407a-991d-cb6b72ddd351::DEBUG::2014-04-10 18:58:50,862::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-64::DEBUG::2014-04-10 18:58:50,990::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 18:58:50,990::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 18:58:50,991::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-360::DEBUG::2014-04-10 18:58:51,051::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-360::DEBUG::2014-04-10 18:58:51,052::task::579::TaskManager.Task::(_updateState) Task=`6aec27ef-b94a-45bf-969d-c587c2aa33dd`::moving from state init -> state preparing
>Thread-360::INFO::2014-04-10 18:58:51,052::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-360::DEBUG::2014-04-10 18:58:51,052::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-360::DEBUG::2014-04-10 18:58:51,052::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}
>Thread-360::INFO::2014-04-10 18:58:51,052::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-360::DEBUG::2014-04-10 18:58:51,053::task::1168::TaskManager.Task::(prepare) Task=`6aec27ef-b94a-45bf-969d-c587c2aa33dd`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'e7c56099-afb9-407a-991d-cb6b72ddd351'}}
>Thread-360::DEBUG::2014-04-10 18:58:51,053::task::579::TaskManager.Task::(_updateState) Task=`6aec27ef-b94a-45bf-969d-c587c2aa33dd`::moving from state preparing -> state finished
>Thread-360::DEBUG::2014-04-10 18:58:51,053::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-360::DEBUG::2014-04-10 18:58:51,053::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-360::DEBUG::2014-04-10 18:58:51,053::task::974::TaskManager.Task::(_decref) Task=`6aec27ef-b94a-45bf-969d-c587c2aa33dd`::ref 0 aborting False
>Thread-361::DEBUG::2014-04-10 18:58:51,066::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-361::DEBUG::2014-04-10 18:58:51,070::task::579::TaskManager.Task::(_updateState) Task=`f6d0946a-ae01-4240-830b-a8fc1b5a1408`::moving from state init -> state preparing
>Thread-361::INFO::2014-04-10 18:58:51,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-361::INFO::2014-04-10 18:58:51,077::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-361::DEBUG::2014-04-10 18:58:51,081::task::1168::TaskManager.Task::(prepare) Task=`f6d0946a-ae01-4240-830b-a8fc1b5a1408`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-361::DEBUG::2014-04-10 18:58:51,085::task::579::TaskManager.Task::(_updateState) Task=`f6d0946a-ae01-4240-830b-a8fc1b5a1408`::moving from state preparing -> state finished
>Thread-361::DEBUG::2014-04-10 18:58:51,088::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-361::DEBUG::2014-04-10 18:58:51,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-361::DEBUG::2014-04-10 18:58:51,095::task::974::TaskManager.Task::(_decref) Task=`f6d0946a-ae01-4240-830b-a8fc1b5a1408`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 18:58:51,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:58:51,110::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000525412 s, 1.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-04-10 18:58:51,116::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-363::DEBUG::2014-04-10 18:58:51,119::task::579::TaskManager.Task::(_updateState) Task=`204c92af-89ab-4208-9e66-616d62e280ae`::moving from state init -> state preparing
>Thread-363::INFO::2014-04-10 18:58:51,122::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='e7c56099-afb9-407a-991d-cb6b72ddd351', spUUID=None, options=None)
>Thread-363::DEBUG::2014-04-10 18:58:51,123::taskManager::161::TaskManager::(clearTask) Entry. taskID: e7c56099-afb9-407a-991d-cb6b72ddd351
>Thread-363::DEBUG::2014-04-10 18:58:51,125::taskManager::166::TaskManager::(clearTask) Return.
>Thread-363::INFO::2014-04-10 18:58:51,127::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-363::DEBUG::2014-04-10 18:58:51,128::task::1168::TaskManager.Task::(prepare) Task=`204c92af-89ab-4208-9e66-616d62e280ae`::finished: None
>Thread-363::DEBUG::2014-04-10 18:58:51,129::task::579::TaskManager.Task::(_updateState) Task=`204c92af-89ab-4208-9e66-616d62e280ae`::moving from state preparing -> state finished
>Thread-363::DEBUG::2014-04-10 18:58:51,129::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-363::DEBUG::2014-04-10 18:58:51,129::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-363::DEBUG::2014-04-10 18:58:51,130::task::974::TaskManager.Task::(_decref) Task=`204c92af-89ab-4208-9e66-616d62e280ae`::ref 0 aborting False
>Thread-364::DEBUG::2014-04-10 18:58:51,182::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-364::DEBUG::2014-04-10 18:58:51,182::task::579::TaskManager.Task::(_updateState) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::moving from state init -> state preparing
>Thread-364::INFO::2014-04-10 18:58:51,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-364::DEBUG::2014-04-10 18:58:51,183::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5bc7e175-4f9a-4bcd-96b5-f9d1082e9944`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-364::DEBUG::2014-04-10 18:58:51,183::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-364::DEBUG::2014-04-10 18:58:51,184::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-364::DEBUG::2014-04-10 18:58:51,184::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5bc7e175-4f9a-4bcd-96b5-f9d1082e9944`::Granted request
>Thread-364::DEBUG::2014-04-10 18:58:51,184::task::811::TaskManager.Task::(resourceAcquired) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-364::DEBUG::2014-04-10 18:58:51,184::task::974::TaskManager.Task::(_decref) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::ref 1 aborting False
>Thread-364::INFO::2014-04-10 18:58:51,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-364::DEBUG::2014-04-10 18:58:51,187::task::1168::TaskManager.Task::(prepare) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-364::DEBUG::2014-04-10 18:58:51,187::task::579::TaskManager.Task::(_updateState) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::moving from state preparing -> state finished
>Thread-364::DEBUG::2014-04-10 18:58:51,187::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-364::DEBUG::2014-04-10 18:58:51,188::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-364::DEBUG::2014-04-10 18:58:51,188::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-364::DEBUG::2014-04-10 18:58:51,188::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-364::DEBUG::2014-04-10 18:58:51,188::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-364::DEBUG::2014-04-10 18:58:51,188::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-364::DEBUG::2014-04-10 18:58:51,189::task::974::TaskManager.Task::(_decref) Task=`9ea7d415-b638-4c19-87e2-8fd26d860270`::ref 0 aborting False
>Thread-365::DEBUG::2014-04-10 18:58:51,275::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-365::DEBUG::2014-04-10 18:58:51,275::task::579::TaskManager.Task::(_updateState) Task=`9197253e-fb8a-4af0-a926-c78f1869aa5d`::moving from state init -> state preparing
>Thread-365::INFO::2014-04-10 18:58:51,276::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None)
>Thread-365::DEBUG::2014-04-10 18:58:51,276::taskManager::181::TaskManager::(getAllTasksInfo) Entry.
>Thread-365::DEBUG::2014-04-10 18:58:51,276::taskManager::192::TaskManager::(getAllTasksInfo) Return. Response: {}
>Thread-365::INFO::2014-04-10 18:58:51,276::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}}
>Thread-365::DEBUG::2014-04-10 18:58:51,276::task::1168::TaskManager.Task::(prepare) Task=`9197253e-fb8a-4af0-a926-c78f1869aa5d`::finished: {'allTasksInfo': {}}
>Thread-365::DEBUG::2014-04-10 18:58:51,276::task::579::TaskManager.Task::(_updateState) Task=`9197253e-fb8a-4af0-a926-c78f1869aa5d`::moving from state preparing -> state finished
>Thread-365::DEBUG::2014-04-10 18:58:51,277::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-365::DEBUG::2014-04-10 18:58:51,277::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-365::DEBUG::2014-04-10 18:58:51,277::task::974::TaskManager.Task::(_decref) Task=`9197253e-fb8a-4af0-a926-c78f1869aa5d`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,917::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,918::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,918::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,918::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,920::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,920::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,920::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:53,921::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-366::DEBUG::2014-04-10 18:58:54,118::task::579::TaskManager.Task::(_updateState) Task=`2d8c6713-b294-4e25-8737-c47a0f5dbccd`::moving from state init -> state preparing
>Thread-366::INFO::2014-04-10 18:58:54,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-366::INFO::2014-04-10 18:58:54,119::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525412', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '123.6', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '73.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039499', 'lastCheck': '6.2', 'valid': True}}
>Thread-366::DEBUG::2014-04-10 18:58:54,119::task::1168::TaskManager.Task::(prepare) Task=`2d8c6713-b294-4e25-8737-c47a0f5dbccd`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525412', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '123.6', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '73.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00039499', 'lastCheck': '6.2', 'valid': True}}
>Thread-366::DEBUG::2014-04-10 18:58:54,119::task::579::TaskManager.Task::(_updateState) Task=`2d8c6713-b294-4e25-8737-c47a0f5dbccd`::moving from state preparing -> state finished
>Thread-366::DEBUG::2014-04-10 18:58:54,119::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-366::DEBUG::2014-04-10 18:58:54,119::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-366::DEBUG::2014-04-10 18:58:54,119::task::974::TaskManager.Task::(_decref) Task=`2d8c6713-b294-4e25-8737-c47a0f5dbccd`::ref 0 aborting False
>Thread-367::DEBUG::2014-04-10 18:58:54,149::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-367::DEBUG::2014-04-10 18:58:54,149::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-367::DEBUG::2014-04-10 18:58:54,150::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-367::DEBUG::2014-04-10 18:58:54,150::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:58:55,960::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-67::DEBUG::2014-04-10 18:58:57,960::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:58:57,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000349184 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,927::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,927::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,951::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,951::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,952::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,953::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,953::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:58:58,953::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:59:01,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:01,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000407954 s, 1.6 MB/s\n'; <rc> = 0
>Thread-370::DEBUG::2014-04-10 18:59:01,278::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-370::DEBUG::2014-04-10 18:59:01,278::task::579::TaskManager.Task::(_updateState) Task=`9e0cb431-272e-4bc0-a55f-aeac691edb5f`::moving from state init -> state preparing
>Thread-370::INFO::2014-04-10 18:59:01,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-370::INFO::2014-04-10 18:59:01,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-370::DEBUG::2014-04-10 18:59:01,279::task::1168::TaskManager.Task::(prepare) Task=`9e0cb431-272e-4bc0-a55f-aeac691edb5f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-370::DEBUG::2014-04-10 18:59:01,279::task::579::TaskManager.Task::(_updateState) Task=`9e0cb431-272e-4bc0-a55f-aeac691edb5f`::moving from state preparing -> state finished
>Thread-370::DEBUG::2014-04-10 18:59:01,279::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-370::DEBUG::2014-04-10 18:59:01,280::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-370::DEBUG::2014-04-10 18:59:01,280::task::974::TaskManager.Task::(_decref) Task=`9e0cb431-272e-4bc0-a55f-aeac691edb5f`::ref 0 aborting False
>Thread-371::DEBUG::2014-04-10 18:59:01,294::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-371::DEBUG::2014-04-10 18:59:01,295::task::579::TaskManager.Task::(_updateState) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::moving from state init -> state preparing
>Thread-371::INFO::2014-04-10 18:59:01,295::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-371::DEBUG::2014-04-10 18:59:01,296::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0acc0e3a-7187-48d0-9bb1-8b38144dded9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-371::DEBUG::2014-04-10 18:59:01,296::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-371::DEBUG::2014-04-10 18:59:01,296::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-371::DEBUG::2014-04-10 18:59:01,296::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0acc0e3a-7187-48d0-9bb1-8b38144dded9`::Granted request
>Thread-371::DEBUG::2014-04-10 18:59:01,297::task::811::TaskManager.Task::(resourceAcquired) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-371::DEBUG::2014-04-10 18:59:01,297::task::974::TaskManager.Task::(_decref) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::ref 1 aborting False
>Thread-371::INFO::2014-04-10 18:59:01,299::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-371::DEBUG::2014-04-10 18:59:01,299::task::1168::TaskManager.Task::(prepare) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-371::DEBUG::2014-04-10 18:59:01,300::task::579::TaskManager.Task::(_updateState) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::moving from state preparing -> state finished
>Thread-371::DEBUG::2014-04-10 18:59:01,300::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-371::DEBUG::2014-04-10 18:59:01,300::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-371::DEBUG::2014-04-10 18:59:01,300::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-371::DEBUG::2014-04-10 18:59:01,300::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-371::DEBUG::2014-04-10 18:59:01,300::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-371::DEBUG::2014-04-10 18:59:01,301::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-371::DEBUG::2014-04-10 18:59:01,301::task::974::TaskManager.Task::(_decref) Task=`5d34aa39-2e5d-4e17-97eb-d6f934c58a0f`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,960::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,960::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,972::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,972::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,973::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,973::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,974::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:03,974::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-374::DEBUG::2014-04-10 18:59:07,328::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmShutdown with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53', '30', 'System Administrator has initiated shutdown of this Virtual Machine. Virtual Machine is shutting down.') {} flowID [4c7647d0]
>Thread-374::DEBUG::2014-04-10 18:59:07,336::BindingXMLRPC::982::vds::(wrapper) return vmShutdown with {'status': {'message': 'Machine shut down', 'code': 0}}
>Thread-67::DEBUG::2014-04-10 18:59:07,974::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:07,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000466318 s, 789 kB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,978::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,978::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,997::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,998::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,999::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:08,999::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:09,000::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:09,000::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-375::DEBUG::2014-04-10 18:59:09,409::task::579::TaskManager.Task::(_updateState) Task=`5424c95c-0be8-4eae-9cf9-ea7276b42a53`::moving from state init -> state preparing
>Thread-375::INFO::2014-04-10 18:59:09,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-375::INFO::2014-04-10 18:59:09,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407954', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '138.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '88.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466318', 'lastCheck': '1.4', 'valid': True}}
>Thread-375::DEBUG::2014-04-10 18:59:09,410::task::1168::TaskManager.Task::(prepare) Task=`5424c95c-0be8-4eae-9cf9-ea7276b42a53`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407954', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '138.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '88.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466318', 'lastCheck': '1.4', 'valid': True}}
>Thread-375::DEBUG::2014-04-10 18:59:09,410::task::579::TaskManager.Task::(_updateState) Task=`5424c95c-0be8-4eae-9cf9-ea7276b42a53`::moving from state preparing -> state finished
>Thread-375::DEBUG::2014-04-10 18:59:09,410::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-375::DEBUG::2014-04-10 18:59:09,411::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-375::DEBUG::2014-04-10 18:59:09,411::task::974::TaskManager.Task::(_decref) Task=`5424c95c-0be8-4eae-9cf9-ea7276b42a53`::ref 0 aborting False
>Thread-376::DEBUG::2014-04-10 18:59:09,437::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-376::DEBUG::2014-04-10 18:59:09,437::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-376::DEBUG::2014-04-10 18:59:09,437::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-376::DEBUG::2014-04-10 18:59:09,437::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:59:11,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:11,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000416774 s, 1.6 MB/s\n'; <rc> = 0
>Thread-377::DEBUG::2014-04-10 18:59:11,374::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-377::DEBUG::2014-04-10 18:59:11,375::task::579::TaskManager.Task::(_updateState) Task=`991318db-3c3d-4390-830a-406987895e56`::moving from state init -> state preparing
>Thread-377::INFO::2014-04-10 18:59:11,375::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-377::INFO::2014-04-10 18:59:11,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-377::DEBUG::2014-04-10 18:59:11,376::task::1168::TaskManager.Task::(prepare) Task=`991318db-3c3d-4390-830a-406987895e56`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-377::DEBUG::2014-04-10 18:59:11,376::task::579::TaskManager.Task::(_updateState) Task=`991318db-3c3d-4390-830a-406987895e56`::moving from state preparing -> state finished
>Thread-377::DEBUG::2014-04-10 18:59:11,376::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-377::DEBUG::2014-04-10 18:59:11,376::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-377::DEBUG::2014-04-10 18:59:11,376::task::974::TaskManager.Task::(_decref) Task=`991318db-3c3d-4390-830a-406987895e56`::ref 0 aborting False
>Thread-378::DEBUG::2014-04-10 18:59:11,386::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-378::DEBUG::2014-04-10 18:59:11,386::task::579::TaskManager.Task::(_updateState) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::moving from state init -> state preparing
>Thread-378::INFO::2014-04-10 18:59:11,387::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-378::DEBUG::2014-04-10 18:59:11,387::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d621a9a-7c53-4302-ba24-8cb658a0a3e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-378::DEBUG::2014-04-10 18:59:11,387::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-378::DEBUG::2014-04-10 18:59:11,388::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-378::DEBUG::2014-04-10 18:59:11,388::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2d621a9a-7c53-4302-ba24-8cb658a0a3e8`::Granted request
>Thread-378::DEBUG::2014-04-10 18:59:11,388::task::811::TaskManager.Task::(resourceAcquired) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-378::DEBUG::2014-04-10 18:59:11,388::task::974::TaskManager.Task::(_decref) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::ref 1 aborting False
>Thread-378::INFO::2014-04-10 18:59:11,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-378::DEBUG::2014-04-10 18:59:11,391::task::1168::TaskManager.Task::(prepare) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-378::DEBUG::2014-04-10 18:59:11,391::task::579::TaskManager.Task::(_updateState) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::moving from state preparing -> state finished
>Thread-378::DEBUG::2014-04-10 18:59:11,391::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-378::DEBUG::2014-04-10 18:59:11,392::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-378::DEBUG::2014-04-10 18:59:11,392::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-378::DEBUG::2014-04-10 18:59:11,392::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-378::DEBUG::2014-04-10 18:59:11,392::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-378::DEBUG::2014-04-10 18:59:11,392::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-378::DEBUG::2014-04-10 18:59:11,393::task::974::TaskManager.Task::(_decref) Task=`1b144d60-e1cb-4a8d-82ca-57176636b977`::ref 0 aborting False
>Thread-380::DEBUG::2014-04-10 18:59:12,559::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {} flowID [26dce09e]
>Thread-380::DEBUG::2014-04-10 18:59:12,560::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-380::DEBUG::2014-04-10 18:59:12,560::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-380::DEBUG::2014-04-10 18:59:12,560::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-380::DEBUG::2014-04-10 18:59:12,560::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-380::DEBUG::2014-04-10 18:59:12,561::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.47', 'elapsedTime': '891', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,006::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,007::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,023::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,023::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,025::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,025::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,025::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:14,025::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-382::DEBUG::2014-04-10 18:59:15,595::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-382::DEBUG::2014-04-10 18:59:15,596::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-382::DEBUG::2014-04-10 18:59:15,596::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-382::DEBUG::2014-04-10 18:59:15,596::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-382::DEBUG::2014-04-10 18:59:15,597::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-382::DEBUG::2014-04-10 18:59:15,598::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.50', 'elapsedTime': '894', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]}
>Thread-67::DEBUG::2014-04-10 18:59:17,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:17,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000382428 s, 962 kB/s\n'; <rc> = 0
>Thread-384::DEBUG::2014-04-10 18:59:18,635::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-384::DEBUG::2014-04-10 18:59:18,636::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-384::DEBUG::2014-04-10 18:59:18,636::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-384::DEBUG::2014-04-10 18:59:18,636::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-384::DEBUG::2014-04-10 18:59:18,636::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-384::DEBUG::2014-04-10 18:59:18,637::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.54', 'elapsedTime': '897', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,032::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,032::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,049::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,049::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,051::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,051::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,051::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:19,051::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:59:21,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:21,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000385428 s, 1.7 MB/s\n'; <rc> = 0
>Thread-385::DEBUG::2014-04-10 18:59:21,459::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-385::DEBUG::2014-04-10 18:59:21,460::task::579::TaskManager.Task::(_updateState) Task=`4269251a-16c5-4f35-827f-0c23f0ce4985`::moving from state init -> state preparing
>Thread-385::INFO::2014-04-10 18:59:21,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-385::INFO::2014-04-10 18:59:21,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-385::DEBUG::2014-04-10 18:59:21,460::task::1168::TaskManager.Task::(prepare) Task=`4269251a-16c5-4f35-827f-0c23f0ce4985`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-385::DEBUG::2014-04-10 18:59:21,460::task::579::TaskManager.Task::(_updateState) Task=`4269251a-16c5-4f35-827f-0c23f0ce4985`::moving from state preparing -> state finished
>Thread-385::DEBUG::2014-04-10 18:59:21,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-385::DEBUG::2014-04-10 18:59:21,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-385::DEBUG::2014-04-10 18:59:21,461::task::974::TaskManager.Task::(_decref) Task=`4269251a-16c5-4f35-827f-0c23f0ce4985`::ref 0 aborting False
>Thread-386::DEBUG::2014-04-10 18:59:21,475::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-386::DEBUG::2014-04-10 18:59:21,475::task::579::TaskManager.Task::(_updateState) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::moving from state init -> state preparing
>Thread-386::INFO::2014-04-10 18:59:21,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-386::DEBUG::2014-04-10 18:59:21,476::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9918cbff-fb36-4793-b237-ac0744f6ef89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-386::DEBUG::2014-04-10 18:59:21,477::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-386::DEBUG::2014-04-10 18:59:21,477::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-386::DEBUG::2014-04-10 18:59:21,477::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9918cbff-fb36-4793-b237-ac0744f6ef89`::Granted request
>Thread-386::DEBUG::2014-04-10 18:59:21,478::task::811::TaskManager.Task::(resourceAcquired) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-386::DEBUG::2014-04-10 18:59:21,478::task::974::TaskManager.Task::(_decref) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::ref 1 aborting False
>Thread-386::INFO::2014-04-10 18:59:21,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-386::DEBUG::2014-04-10 18:59:21,481::task::1168::TaskManager.Task::(prepare) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-386::DEBUG::2014-04-10 18:59:21,481::task::579::TaskManager.Task::(_updateState) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::moving from state preparing -> state finished
>Thread-386::DEBUG::2014-04-10 18:59:21,481::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-386::DEBUG::2014-04-10 18:59:21,481::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-386::DEBUG::2014-04-10 18:59:21,482::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-386::DEBUG::2014-04-10 18:59:21,482::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-386::DEBUG::2014-04-10 18:59:21,482::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-386::DEBUG::2014-04-10 18:59:21,482::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-386::DEBUG::2014-04-10 18:59:21,482::task::974::TaskManager.Task::(_decref) Task=`29e0cb70-11ed-4b81-8fd9-f174890f962e`::ref 0 aborting False
>Thread-388::DEBUG::2014-04-10 18:59:21,673::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-388::DEBUG::2014-04-10 18:59:21,674::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-388::DEBUG::2014-04-10 18:59:21,674::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-388::DEBUG::2014-04-10 18:59:21,674::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-388::DEBUG::2014-04-10 18:59:21,674::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-388::DEBUG::2014-04-10 18:59:21,676::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'elapsedTime': '900', 'vmType': 'kvm', 'cpuSys': '1.00', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,058::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,058::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,074::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,075::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,076::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,076::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,077::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:24,077::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-389::DEBUG::2014-04-10 18:59:24,703::task::579::TaskManager.Task::(_updateState) Task=`3045a2d9-4d88-4149-ad0e-e014917e8658`::moving from state init -> state preparing
>Thread-389::INFO::2014-04-10 18:59:24,703::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-389::INFO::2014-04-10 18:59:24,703::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385428', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '154.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '103.8', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382428', 'lastCheck': '6.7', 'valid': True}}
>Thread-389::DEBUG::2014-04-10 18:59:24,703::task::1168::TaskManager.Task::(prepare) Task=`3045a2d9-4d88-4149-ad0e-e014917e8658`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385428', 'lastCheck': '3.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '154.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '103.8', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000382428', 'lastCheck': '6.7', 'valid': True}}
>Thread-389::DEBUG::2014-04-10 18:59:24,704::task::579::TaskManager.Task::(_updateState) Task=`3045a2d9-4d88-4149-ad0e-e014917e8658`::moving from state preparing -> state finished
>Thread-389::DEBUG::2014-04-10 18:59:24,704::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-389::DEBUG::2014-04-10 18:59:24,704::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-389::DEBUG::2014-04-10 18:59:24,704::task::974::TaskManager.Task::(_decref) Task=`3045a2d9-4d88-4149-ad0e-e014917e8658`::ref 0 aborting False
>Thread-390::DEBUG::2014-04-10 18:59:24,734::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-390::DEBUG::2014-04-10 18:59:24,734::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-390::DEBUG::2014-04-10 18:59:24,735::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-390::DEBUG::2014-04-10 18:59:24,735::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:59:26,002::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-392::DEBUG::2014-04-10 18:59:27,857::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-392::DEBUG::2014-04-10 18:59:27,858::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-392::DEBUG::2014-04-10 18:59:27,858::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-392::DEBUG::2014-04-10 18:59:27,858::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-392::DEBUG::2014-04-10 18:59:27,858::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-392::DEBUG::2014-04-10 18:59:27,860::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.06', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.76', 'elapsedTime': '906', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-67::DEBUG::2014-04-10 18:59:28,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:28,010::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000346416 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,082::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,083::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,107::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,107::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,109::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,109::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,110::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:29,110::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-394::DEBUG::2014-04-10 18:59:30,900::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-394::DEBUG::2014-04-10 18:59:30,901::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-394::DEBUG::2014-04-10 18:59:30,904::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-394::DEBUG::2014-04-10 18:59:30,904::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-394::DEBUG::2014-04-10 18:59:30,906::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-394::DEBUG::2014-04-10 18:59:30,909::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.06', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.80', 'elapsedTime': '909', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-319::WARNING::2014-04-10 18:59:31,003::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-319::DEBUG::2014-04-10 18:59:31,005::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-321::WARNING::2014-04-10 18:59:31,009::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-321::DEBUG::2014-04-10 18:59:31,009::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-65::DEBUG::2014-04-10 18:59:31,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:31,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000471804 s, 1.4 MB/s\n'; <rc> = 0
>Thread-395::DEBUG::2014-04-10 18:59:31,588::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-395::DEBUG::2014-04-10 18:59:31,588::task::579::TaskManager.Task::(_updateState) Task=`219592d1-0239-4711-b561-40e84bbd688a`::moving from state init -> state preparing
>Thread-395::INFO::2014-04-10 18:59:31,589::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-395::INFO::2014-04-10 18:59:31,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-395::DEBUG::2014-04-10 18:59:31,589::task::1168::TaskManager.Task::(prepare) Task=`219592d1-0239-4711-b561-40e84bbd688a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-395::DEBUG::2014-04-10 18:59:31,589::task::579::TaskManager.Task::(_updateState) Task=`219592d1-0239-4711-b561-40e84bbd688a`::moving from state preparing -> state finished
>Thread-395::DEBUG::2014-04-10 18:59:31,590::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-395::DEBUG::2014-04-10 18:59:31,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-395::DEBUG::2014-04-10 18:59:31,590::task::974::TaskManager.Task::(_decref) Task=`219592d1-0239-4711-b561-40e84bbd688a`::ref 0 aborting False
>Thread-396::DEBUG::2014-04-10 18:59:31,600::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-396::DEBUG::2014-04-10 18:59:31,601::task::579::TaskManager.Task::(_updateState) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::moving from state init -> state preparing
>Thread-396::INFO::2014-04-10 18:59:31,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-396::DEBUG::2014-04-10 18:59:31,601::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f355e2f4-2328-4a5d-9cda-a745de1d782b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-396::DEBUG::2014-04-10 18:59:31,602::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-396::DEBUG::2014-04-10 18:59:31,603::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-396::DEBUG::2014-04-10 18:59:31,603::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f355e2f4-2328-4a5d-9cda-a745de1d782b`::Granted request
>Thread-396::DEBUG::2014-04-10 18:59:31,603::task::811::TaskManager.Task::(resourceAcquired) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-396::DEBUG::2014-04-10 18:59:31,604::task::974::TaskManager.Task::(_decref) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::ref 1 aborting False
>Thread-396::INFO::2014-04-10 18:59:31,606::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-396::DEBUG::2014-04-10 18:59:31,606::task::1168::TaskManager.Task::(prepare) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-396::DEBUG::2014-04-10 18:59:31,607::task::579::TaskManager.Task::(_updateState) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::moving from state preparing -> state finished
>Thread-396::DEBUG::2014-04-10 18:59:31,607::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-396::DEBUG::2014-04-10 18:59:31,607::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-396::DEBUG::2014-04-10 18:59:31,607::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-396::DEBUG::2014-04-10 18:59:31,608::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-396::DEBUG::2014-04-10 18:59:31,608::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-396::DEBUG::2014-04-10 18:59:31,608::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-396::DEBUG::2014-04-10 18:59:31,608::task::974::TaskManager.Task::(_decref) Task=`0782abeb-dae4-4e7c-b4bc-34a4fe6208fb`::ref 0 aborting False
>Thread-398::DEBUG::2014-04-10 18:59:33,951::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-398::DEBUG::2014-04-10 18:59:33,952::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-398::DEBUG::2014-04-10 18:59:33,952::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-398::DEBUG::2014-04-10 18:59:33,952::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-398::DEBUG::2014-04-10 18:59:33,952::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-398::DEBUG::2014-04-10 18:59:33,953::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.06', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.85', 'elapsedTime': '912', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,112::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,112::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,127::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,127::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,128::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,129::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,129::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:34,129::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-400::DEBUG::2014-04-10 18:59:37,003::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-400::DEBUG::2014-04-10 18:59:37,005::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-400::DEBUG::2014-04-10 18:59:37,006::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-400::DEBUG::2014-04-10 18:59:37,007::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-400::DEBUG::2014-04-10 18:59:37,008::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-400::DEBUG::2014-04-10 18:59:37,010::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.06', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'elapsedTime': '915', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-332::WARNING::2014-04-10 18:59:37,905::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-334::WARNING::2014-04-10 18:59:37,912::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-67::DEBUG::2014-04-10 18:59:38,021::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:38,029::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000349706 s, 1.1 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,135::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,136::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,153::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,154::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,155::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,155::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,155::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:39,155::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-401::DEBUG::2014-04-10 18:59:40,046::task::579::TaskManager.Task::(_updateState) Task=`b859c2ee-a81d-4458-9a98-b376d170fed9`::moving from state init -> state preparing
>Thread-401::INFO::2014-04-10 18:59:40,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-401::INFO::2014-04-10 18:59:40,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471804', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '169.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '119.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349706', 'lastCheck': '2.0', 'valid': True}}
>Thread-401::DEBUG::2014-04-10 18:59:40,047::task::1168::TaskManager.Task::(prepare) Task=`b859c2ee-a81d-4458-9a98-b376d170fed9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471804', 'lastCheck': '8.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '169.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '119.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349706', 'lastCheck': '2.0', 'valid': True}}
>Thread-401::DEBUG::2014-04-10 18:59:40,047::task::579::TaskManager.Task::(_updateState) Task=`b859c2ee-a81d-4458-9a98-b376d170fed9`::moving from state preparing -> state finished
>Thread-401::DEBUG::2014-04-10 18:59:40,047::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-401::DEBUG::2014-04-10 18:59:40,047::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-401::DEBUG::2014-04-10 18:59:40,047::task::974::TaskManager.Task::(_decref) Task=`b859c2ee-a81d-4458-9a98-b376d170fed9`::ref 0 aborting False
>Thread-402::DEBUG::2014-04-10 18:59:40,088::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-402::DEBUG::2014-04-10 18:59:40,088::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-402::DEBUG::2014-04-10 18:59:40,088::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-402::DEBUG::2014-04-10 18:59:40,089::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 18:59:41,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:41,214::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000368862 s, 1.8 MB/s\n'; <rc> = 0
>Thread-403::DEBUG::2014-04-10 18:59:41,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-403::DEBUG::2014-04-10 18:59:41,680::task::579::TaskManager.Task::(_updateState) Task=`beb2778b-f869-4d1e-806b-64703ac28c65`::moving from state init -> state preparing
>Thread-403::INFO::2014-04-10 18:59:41,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-403::INFO::2014-04-10 18:59:41,681::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-403::DEBUG::2014-04-10 18:59:41,681::task::1168::TaskManager.Task::(prepare) Task=`beb2778b-f869-4d1e-806b-64703ac28c65`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-403::DEBUG::2014-04-10 18:59:41,681::task::579::TaskManager.Task::(_updateState) Task=`beb2778b-f869-4d1e-806b-64703ac28c65`::moving from state preparing -> state finished
>Thread-403::DEBUG::2014-04-10 18:59:41,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-403::DEBUG::2014-04-10 18:59:41,682::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-403::DEBUG::2014-04-10 18:59:41,682::task::974::TaskManager.Task::(_decref) Task=`beb2778b-f869-4d1e-806b-64703ac28c65`::ref 0 aborting False
>Thread-404::DEBUG::2014-04-10 18:59:41,692::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-404::DEBUG::2014-04-10 18:59:41,693::task::579::TaskManager.Task::(_updateState) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::moving from state init -> state preparing
>Thread-404::INFO::2014-04-10 18:59:41,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-404::DEBUG::2014-04-10 18:59:41,694::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55800f08-4564-4e24-9a77-d7b1d10c963a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-404::DEBUG::2014-04-10 18:59:41,694::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-404::DEBUG::2014-04-10 18:59:41,695::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-404::DEBUG::2014-04-10 18:59:41,695::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`55800f08-4564-4e24-9a77-d7b1d10c963a`::Granted request
>Thread-404::DEBUG::2014-04-10 18:59:41,695::task::811::TaskManager.Task::(resourceAcquired) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-404::DEBUG::2014-04-10 18:59:41,695::task::974::TaskManager.Task::(_decref) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::ref 1 aborting False
>Thread-404::INFO::2014-04-10 18:59:41,699::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-404::DEBUG::2014-04-10 18:59:41,699::task::1168::TaskManager.Task::(prepare) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-404::DEBUG::2014-04-10 18:59:41,700::task::579::TaskManager.Task::(_updateState) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::moving from state preparing -> state finished
>Thread-404::DEBUG::2014-04-10 18:59:41,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-404::DEBUG::2014-04-10 18:59:41,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-404::DEBUG::2014-04-10 18:59:41,701::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-404::DEBUG::2014-04-10 18:59:41,701::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-404::DEBUG::2014-04-10 18:59:41,702::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-404::DEBUG::2014-04-10 18:59:41,702::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-404::DEBUG::2014-04-10 18:59:41,702::task::974::TaskManager.Task::(_decref) Task=`049460ee-3331-417d-9c15-1f345d12f7e1`::ref 0 aborting False
>Thread-406::DEBUG::2014-04-10 18:59:43,211::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-406::DEBUG::2014-04-10 18:59:43,212::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-406::DEBUG::2014-04-10 18:59:43,214::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-406::DEBUG::2014-04-10 18:59:43,214::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-406::DEBUG::2014-04-10 18:59:43,215::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-406::DEBUG::2014-04-10 18:59:43,218::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.10', 'elapsedTime': '922', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-344::WARNING::2014-04-10 18:59:43,338::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-344::DEBUG::2014-04-10 18:59:43,340::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-346::WARNING::2014-04-10 18:59:43,340::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-346::DEBUG::2014-04-10 18:59:43,343::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 18:59:43,344::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 18:59:43,344::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,162::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,162::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,179::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,179::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,181::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,181::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,181::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:44,181::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-408::DEBUG::2014-04-10 18:59:46,260::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-408::DEBUG::2014-04-10 18:59:46,260::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-408::DEBUG::2014-04-10 18:59:46,261::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-408::DEBUG::2014-04-10 18:59:46,261::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-408::DEBUG::2014-04-10 18:59:46,261::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-408::DEBUG::2014-04-10 18:59:46,262::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.15', 'elapsedTime': '925', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-67::DEBUG::2014-04-10 18:59:48,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:48,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000354726 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,188::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,189::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,207::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,207::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,209::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,209::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,209::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:49,210::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-410::DEBUG::2014-04-10 18:59:49,297::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-410::DEBUG::2014-04-10 18:59:49,297::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-410::DEBUG::2014-04-10 18:59:49,298::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-410::DEBUG::2014-04-10 18:59:49,298::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-410::DEBUG::2014-04-10 18:59:49,298::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-410::DEBUG::2014-04-10 18:59:49,299::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'elapsedTime': '928', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-357::WARNING::2014-04-10 18:59:51,013::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-357::DEBUG::2014-04-10 18:59:51,015::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-359::WARNING::2014-04-10 18:59:51,017::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-359::DEBUG::2014-04-10 18:59:51,018::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 18:59:51,018::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 18:59:51,019::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-65::DEBUG::2014-04-10 18:59:51,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 18:59:51,230::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000360852 s, 1.8 MB/s\n'; <rc> = 0
>Thread-411::DEBUG::2014-04-10 18:59:51,769::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-411::DEBUG::2014-04-10 18:59:51,770::task::579::TaskManager.Task::(_updateState) Task=`54a41861-ee1b-4ab1-ae2e-9fd5d1849ae3`::moving from state init -> state preparing
>Thread-411::INFO::2014-04-10 18:59:51,770::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-411::INFO::2014-04-10 18:59:51,771::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-411::DEBUG::2014-04-10 18:59:51,771::task::1168::TaskManager.Task::(prepare) Task=`54a41861-ee1b-4ab1-ae2e-9fd5d1849ae3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-411::DEBUG::2014-04-10 18:59:51,771::task::579::TaskManager.Task::(_updateState) Task=`54a41861-ee1b-4ab1-ae2e-9fd5d1849ae3`::moving from state preparing -> state finished
>Thread-411::DEBUG::2014-04-10 18:59:51,771::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-411::DEBUG::2014-04-10 18:59:51,771::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-411::DEBUG::2014-04-10 18:59:51,772::task::974::TaskManager.Task::(_decref) Task=`54a41861-ee1b-4ab1-ae2e-9fd5d1849ae3`::ref 0 aborting False
>Thread-412::DEBUG::2014-04-10 18:59:51,782::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-412::DEBUG::2014-04-10 18:59:51,782::task::579::TaskManager.Task::(_updateState) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::moving from state init -> state preparing
>Thread-412::INFO::2014-04-10 18:59:51,782::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-412::DEBUG::2014-04-10 18:59:51,783::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cf28e656-70d9-437f-8151-b1a034f36c35`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-412::DEBUG::2014-04-10 18:59:51,783::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-412::DEBUG::2014-04-10 18:59:51,783::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-412::DEBUG::2014-04-10 18:59:51,783::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cf28e656-70d9-437f-8151-b1a034f36c35`::Granted request
>Thread-412::DEBUG::2014-04-10 18:59:51,784::task::811::TaskManager.Task::(resourceAcquired) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-412::DEBUG::2014-04-10 18:59:51,784::task::974::TaskManager.Task::(_decref) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::ref 1 aborting False
>Thread-412::INFO::2014-04-10 18:59:51,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-412::DEBUG::2014-04-10 18:59:51,786::task::1168::TaskManager.Task::(prepare) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-412::DEBUG::2014-04-10 18:59:51,787::task::579::TaskManager.Task::(_updateState) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::moving from state preparing -> state finished
>Thread-412::DEBUG::2014-04-10 18:59:51,787::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-412::DEBUG::2014-04-10 18:59:51,787::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-412::DEBUG::2014-04-10 18:59:51,787::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-412::DEBUG::2014-04-10 18:59:51,788::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-412::DEBUG::2014-04-10 18:59:51,788::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-412::DEBUG::2014-04-10 18:59:51,788::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-412::DEBUG::2014-04-10 18:59:51,788::task::974::TaskManager.Task::(_decref) Task=`c83b2e1e-02a7-489b-9543-e33665481b52`::ref 0 aborting False
>Thread-414::DEBUG::2014-04-10 18:59:52,520::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-414::DEBUG::2014-04-10 18:59:52,521::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-414::DEBUG::2014-04-10 18:59:52,521::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-414::DEBUG::2014-04-10 18:59:52,521::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-414::DEBUG::2014-04-10 18:59:52,521::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-414::DEBUG::2014-04-10 18:59:52,523::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '-0.11', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.40', 'elapsedTime': '931', 'vmType': 'kvm', 'cpuSys': '0.93', 'appsList': [], 'guestIPs': ''}]}
>Thread-66::DEBUG::2014-04-10 18:59:53,345::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 18:59:53,345::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 18:59:53,345::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 18:59:53,345::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 18:59:53,346::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-66::DEBUG::2014-04-10 18:59:53,490::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 18:59:53,491::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 18:59:53,491::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,216::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,217::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,238::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,238::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,239::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,240::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,240::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:54,240::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-419::DEBUG::2014-04-10 18:59:55,558::task::579::TaskManager.Task::(_updateState) Task=`b494150a-d572-402d-bb08-9d6562311dff`::moving from state init -> state preparing
>Thread-419::INFO::2014-04-10 18:59:55,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-419::INFO::2014-04-10 18:59:55,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360852', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '4.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '12.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354726', 'lastCheck': '7.5', 'valid': True}}
>Thread-419::DEBUG::2014-04-10 18:59:55,559::task::1168::TaskManager.Task::(prepare) Task=`b494150a-d572-402d-bb08-9d6562311dff`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360852', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '4.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '12.2', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354726', 'lastCheck': '7.5', 'valid': True}}
>Thread-419::DEBUG::2014-04-10 18:59:55,560::task::579::TaskManager.Task::(_updateState) Task=`b494150a-d572-402d-bb08-9d6562311dff`::moving from state preparing -> state finished
>Thread-419::DEBUG::2014-04-10 18:59:55,560::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-419::DEBUG::2014-04-10 18:59:55,560::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-419::DEBUG::2014-04-10 18:59:55,560::task::974::TaskManager.Task::(_decref) Task=`b494150a-d572-402d-bb08-9d6562311dff`::ref 0 aborting False
>Thread-420::DEBUG::2014-04-10 18:59:55,592::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-420::DEBUG::2014-04-10 18:59:55,592::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-420::DEBUG::2014-04-10 18:59:55,593::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-420::DEBUG::2014-04-10 18:59:55,593::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>VM Channels Listener::DEBUG::2014-04-10 18:59:56,039::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 9.
>Thread-67::DEBUG::2014-04-10 18:59:58,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 18:59:58,057::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000361515 s, 1.0 MB/s\n'; <rc> = 0
>Thread-422::DEBUG::2014-04-10 18:59:58,721::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-422::DEBUG::2014-04-10 18:59:58,721::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-422::DEBUG::2014-04-10 18:59:58,722::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-422::DEBUG::2014-04-10 18:59:58,722::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-422::DEBUG::2014-04-10 18:59:58,722::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-422::DEBUG::2014-04-10 18:59:58,723::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.60', 'elapsedTime': '937', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,246::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,247::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,264::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,264::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,265::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,265::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,266::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 18:59:59,266::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-64::DEBUG::2014-04-10 19:00:01,020::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:00:01,020::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:00:01,020::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:00:01,021::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:00:01,021::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:00:01,160::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:00:01,161::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:00:01,161::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-65::DEBUG::2014-04-10 19:00:01,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:01,249::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00264498 s, 249 kB/s\n'; <rc> = 0
>Thread-428::DEBUG::2014-04-10 19:00:01,759::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-428::DEBUG::2014-04-10 19:00:01,760::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-428::DEBUG::2014-04-10 19:00:01,760::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-428::DEBUG::2014-04-10 19:00:01,760::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-428::DEBUG::2014-04-10 19:00:01,760::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-428::DEBUG::2014-04-10 19:00:01,767::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.64', 'elapsedTime': '940', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-429::DEBUG::2014-04-10 19:00:01,858::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-429::DEBUG::2014-04-10 19:00:01,858::task::579::TaskManager.Task::(_updateState) Task=`49c789cb-f798-4c7e-b1c5-4898c580fb47`::moving from state init -> state preparing
>Thread-429::INFO::2014-04-10 19:00:01,859::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-429::INFO::2014-04-10 19:00:01,859::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-429::DEBUG::2014-04-10 19:00:01,859::task::1168::TaskManager.Task::(prepare) Task=`49c789cb-f798-4c7e-b1c5-4898c580fb47`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-429::DEBUG::2014-04-10 19:00:01,860::task::579::TaskManager.Task::(_updateState) Task=`49c789cb-f798-4c7e-b1c5-4898c580fb47`::moving from state preparing -> state finished
>Thread-429::DEBUG::2014-04-10 19:00:01,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-429::DEBUG::2014-04-10 19:00:01,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-429::DEBUG::2014-04-10 19:00:01,860::task::974::TaskManager.Task::(_decref) Task=`49c789cb-f798-4c7e-b1c5-4898c580fb47`::ref 0 aborting False
>Thread-430::DEBUG::2014-04-10 19:00:01,870::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-430::DEBUG::2014-04-10 19:00:01,870::task::579::TaskManager.Task::(_updateState) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::moving from state init -> state preparing
>Thread-430::INFO::2014-04-10 19:00:01,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-430::DEBUG::2014-04-10 19:00:01,871::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bcf126a8-5fde-4bc6-aa88-3e56f965a84a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-430::DEBUG::2014-04-10 19:00:01,871::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-430::DEBUG::2014-04-10 19:00:01,871::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-430::DEBUG::2014-04-10 19:00:01,872::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bcf126a8-5fde-4bc6-aa88-3e56f965a84a`::Granted request
>Thread-430::DEBUG::2014-04-10 19:00:01,872::task::811::TaskManager.Task::(resourceAcquired) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-430::DEBUG::2014-04-10 19:00:01,872::task::974::TaskManager.Task::(_decref) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::ref 1 aborting False
>Thread-430::INFO::2014-04-10 19:00:01,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-430::DEBUG::2014-04-10 19:00:01,875::task::1168::TaskManager.Task::(prepare) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-430::DEBUG::2014-04-10 19:00:01,875::task::579::TaskManager.Task::(_updateState) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::moving from state preparing -> state finished
>Thread-430::DEBUG::2014-04-10 19:00:01,875::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-430::DEBUG::2014-04-10 19:00:01,876::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-430::DEBUG::2014-04-10 19:00:01,876::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-430::DEBUG::2014-04-10 19:00:01,876::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-430::DEBUG::2014-04-10 19:00:01,876::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-430::DEBUG::2014-04-10 19:00:01,876::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-430::DEBUG::2014-04-10 19:00:01,877::task::974::TaskManager.Task::(_decref) Task=`ced087a2-eb3b-4f14-9a92-9e1733400a51`::ref 0 aborting False
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,273::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,273::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,273::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,273::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,275::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,275::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,275::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:04,275::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-432::DEBUG::2014-04-10 19:00:04,804::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-432::DEBUG::2014-04-10 19:00:04,805::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-432::DEBUG::2014-04-10 19:00:04,805::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-432::DEBUG::2014-04-10 19:00:04,805::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-432::DEBUG::2014-04-10 19:00:04,805::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-432::DEBUG::2014-04-10 19:00:04,806::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.68', 'elapsedTime': '943', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-434::DEBUG::2014-04-10 19:00:07,841::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-434::DEBUG::2014-04-10 19:00:07,842::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-434::DEBUG::2014-04-10 19:00:07,842::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-434::DEBUG::2014-04-10 19:00:07,842::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-434::DEBUG::2014-04-10 19:00:07,842::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-434::DEBUG::2014-04-10 19:00:07,844::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering down', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '24594', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '8525885258410380720', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:01:a4:a5:a5:07', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayType': 'qxl', 'cpuUser': '0.24', 'disks': {u'vda': {'truesize': '0', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.72', 'elapsedTime': '946', 'vmType': 'kvm', 'cpuSys': '0.60', 'appsList': [], 'guestIPs': ''}]}
>Thread-67::DEBUG::2014-04-10 19:00:08,064::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:08,072::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000355584 s, 1.0 MB/s\n'; <rc> = 0
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,282::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,282::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,282::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,282::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,284::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,284::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,284::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>GuestMonitor-vm1::DEBUG::2014-04-10 19:00:09,284::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-435::DEBUG::2014-04-10 19:00:10,870::task::579::TaskManager.Task::(_updateState) Task=`2898e33a-fe51-4c2c-acfa-635ea31a9ded`::moving from state init -> state preparing
>Thread-435::INFO::2014-04-10 19:00:10,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-435::INFO::2014-04-10 19:00:10,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00264498', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '19.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '27.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355584', 'lastCheck': '2.8', 'valid': True}}
>Thread-435::DEBUG::2014-04-10 19:00:10,871::task::1168::TaskManager.Task::(prepare) Task=`2898e33a-fe51-4c2c-acfa-635ea31a9ded`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00264498', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '19.9', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '27.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355584', 'lastCheck': '2.8', 'valid': True}}
>Thread-435::DEBUG::2014-04-10 19:00:10,871::task::579::TaskManager.Task::(_updateState) Task=`2898e33a-fe51-4c2c-acfa-635ea31a9ded`::moving from state preparing -> state finished
>Thread-435::DEBUG::2014-04-10 19:00:10,871::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-435::DEBUG::2014-04-10 19:00:10,871::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-435::DEBUG::2014-04-10 19:00:10,871::task::974::TaskManager.Task::(_decref) Task=`2898e33a-fe51-4c2c-acfa-635ea31a9ded`::ref 0 aborting False
>Thread-436::DEBUG::2014-04-10 19:00:10,894::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc stats not available
>Thread-436::DEBUG::2014-04-10 19:00:10,894::vm::656::vm.Vm::(_getDiskStats) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda stats not available
>Thread-436::DEBUG::2014-04-10 19:00:10,894::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk hdc latency not available
>Thread-436::DEBUG::2014-04-10 19:00:10,895::vm::695::vm.Vm::(_getDiskLatency) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Disk vda latency not available
>Thread-65::DEBUG::2014-04-10 19:00:11,258::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:11,266::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000363885 s, 1.8 MB/s\n'; <rc> = 0
>Thread-437::DEBUG::2014-04-10 19:00:11,940::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-437::DEBUG::2014-04-10 19:00:11,940::task::579::TaskManager.Task::(_updateState) Task=`36b7c067-9316-4f18-a34f-d46f98ed184a`::moving from state init -> state preparing
>Thread-437::INFO::2014-04-10 19:00:11,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-437::INFO::2014-04-10 19:00:11,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-437::DEBUG::2014-04-10 19:00:11,941::task::1168::TaskManager.Task::(prepare) Task=`36b7c067-9316-4f18-a34f-d46f98ed184a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-437::DEBUG::2014-04-10 19:00:11,941::task::579::TaskManager.Task::(_updateState) Task=`36b7c067-9316-4f18-a34f-d46f98ed184a`::moving from state preparing -> state finished
>Thread-437::DEBUG::2014-04-10 19:00:11,942::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-437::DEBUG::2014-04-10 19:00:11,942::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-437::DEBUG::2014-04-10 19:00:11,942::task::974::TaskManager.Task::(_decref) Task=`36b7c067-9316-4f18-a34f-d46f98ed184a`::ref 0 aborting False
>Thread-438::DEBUG::2014-04-10 19:00:11,951::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-438::DEBUG::2014-04-10 19:00:11,951::task::579::TaskManager.Task::(_updateState) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::moving from state init -> state preparing
>Thread-438::INFO::2014-04-10 19:00:11,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-438::DEBUG::2014-04-10 19:00:11,952::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`843042fa-fdbd-44a3-a568-eb2f08da272a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-438::DEBUG::2014-04-10 19:00:11,952::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-438::DEBUG::2014-04-10 19:00:11,952::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-438::DEBUG::2014-04-10 19:00:11,952::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`843042fa-fdbd-44a3-a568-eb2f08da272a`::Granted request
>Thread-438::DEBUG::2014-04-10 19:00:11,953::task::811::TaskManager.Task::(resourceAcquired) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-438::DEBUG::2014-04-10 19:00:11,953::task::974::TaskManager.Task::(_decref) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::ref 1 aborting False
>Thread-438::INFO::2014-04-10 19:00:11,955::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-438::DEBUG::2014-04-10 19:00:11,955::task::1168::TaskManager.Task::(prepare) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-438::DEBUG::2014-04-10 19:00:11,956::task::579::TaskManager.Task::(_updateState) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::moving from state preparing -> state finished
>Thread-438::DEBUG::2014-04-10 19:00:11,956::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-438::DEBUG::2014-04-10 19:00:11,956::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-438::DEBUG::2014-04-10 19:00:11,956::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-438::DEBUG::2014-04-10 19:00:11,956::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-438::DEBUG::2014-04-10 19:00:11,957::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-438::DEBUG::2014-04-10 19:00:11,957::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-438::DEBUG::2014-04-10 19:00:11,957::task::974::TaskManager.Task::(_decref) Task=`47c2386b-e0e3-4c03-87a6-fd5d09c67c92`::ref 0 aborting False
>Thread-439::DEBUG::2014-04-10 19:00:13,228::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {} flowID [690093bc]
>Thread-439::INFO::2014-04-10 19:00:13,229::API::324::vds::(destroy) vmContainerLock acquired by vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>Thread-439::DEBUG::2014-04-10 19:00:13,229::vm::4533::vm.Vm::(destroy) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::destroy Called
>Thread-439::INFO::2014-04-10 19:00:13,229::vm::4479::vm.Vm::(releaseVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Release VM resources
>Thread-439::DEBUG::2014-04-10 19:00:13,239::sampling::292::vm.Vm::(stop) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Stop statistics collection
>Thread-439::DEBUG::2014-04-10 19:00:13,240::vmChannels::205::vds::(unregister) Delete fileno 9 from listener.
>Thread-16::DEBUG::2014-04-10 19:00:13,240::sampling::323::vm.Vm::(run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Stats thread finished
>VM Channels Listener::DEBUG::2014-04-10 19:00:14,060::vmChannels::112::vds::(_do_del_channels) fileno 9 was removed from listener.
>Thread-440::DEBUG::2014-04-10 19:00:17,520::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [5598b9c6]
>Thread-440::DEBUG::2014-04-10 19:00:17,521::task::579::TaskManager.Task::(_updateState) Task=`496ff5e8-7a7b-458b-834d-00fc7c363615`::moving from state init -> state preparing
>Thread-440::INFO::2014-04-10 19:00:17,521::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}], options=None)
>Thread-440::DEBUG::2014-04-10 19:00:17,523::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1
>Thread-67::DEBUG::2014-04-10 19:00:18,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:18,088::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533406 s, 690 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:00:21,275::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:21,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000492042 s, 1.3 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:00:28,095::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:28,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000502283 s, 733 kB/s\n'; <rc> = 0
>Thread-439::DEBUG::2014-04-10 19:00:28,281::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 9 edom: 10 level: 2 message: operation failed: failed to kill qemu process with SIGTERM
>libvirtEventLoop::DEBUG::2014-04-10 19:00:28,281::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::event Shutdown detail 0 opaque None
>Thread-439::WARNING::2014-04-10 19:00:28,282::vm::4496::vm.Vm::(releaseVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Failed to destroy VM '350aed0d-0065-47c3-81db-3ae5dc8dbf53' gracefully
>Thread-65::DEBUG::2014-04-10 19:00:31,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:31,301::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000420286 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:00:38,112::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:38,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000486322 s, 757 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:00:41,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:41,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000398106 s, 1.7 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:00:48,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:48,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464646 s, 792 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:00:51,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:00:51,340::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000415831 s, 1.6 MB/s\n'; <rc> = 0
>Thread-416::WARNING::2014-04-10 19:00:53,520::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-418::WARNING::2014-04-10 19:00:53,522::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-416::DEBUG::2014-04-10 19:00:53,524::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-418::DEBUG::2014-04-10 19:00:53,525::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 19:00:53,528::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 19:00:53,528::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-67::DEBUG::2014-04-10 19:00:58,144::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:00:58,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430149 s, 856 kB/s\n'; <rc> = 0
>Thread-424::WARNING::2014-04-10 19:01:01,186::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-426::WARNING::2014-04-10 19:01:01,188::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-424::DEBUG::2014-04-10 19:01:01,191::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-426::DEBUG::2014-04-10 19:01:01,192::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 19:01:01,194::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 19:01:01,194::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-65::DEBUG::2014-04-10 19:01:01,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:01,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000594869 s, 1.1 MB/s\n'; <rc> = 0
>Thread-66::ERROR::2014-04-10 19:01:03,529::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:01:03,530::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:01:03,530::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:01:03,530::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:01:03,680::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:01:03,681::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:01:03,681::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 19:01:08,160::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:08,166::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000533648 s, 690 kB/s\n'; <rc> = 0
>libvirtEventLoop::DEBUG::2014-04-10 19:01:08,759::vm::5017::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::event Stopped detail 1 opaque None
>libvirtEventLoop::INFO::2014-04-10 19:01:08,761::vm::2238::vm.Vm::(_onQemuDeath) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::underlying process disconnected
>Thread-439::WARNING::2014-04-10 19:01:08,759::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x164b3d0>> _customize:<bound method Drive._customize of <vm.Drive object at 0x164b3d0>> _deviceXML:None _makeName:<bound method Drive._makeName of <vm.Drive object at 0x164b3d0>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x164b3d0>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x164b3d0>> address:{u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'} alias:ide0-1-0 apparentsize:0 blockDev:False cache:none conf:{'username': 'Unknown', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'pid': '24594', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'displaySecurePort': u'5901', 'timeOffset': '0', 'cpuType': 'Conroe', 'pauseCode': 'NOERR', 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'vmName': 'vm1', 'nice': '0', 'guestFQDN': '', 'custom': {}, 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'displayIp': '0', 'keyboardLayout': 'en-us', 'displayPort': u'5900', 'guestIPs': '', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'nicModel': 'rtl8139,pv', 'smpCoresPerSocket': '1', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'alias': u'scsi0', 'specParams': {}, 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': True, 'network': 'rhevm', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet0'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '5368709120', 'alias': u'virtio-disk0', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'readonly': 'False', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'reqsize': '0', 'format': 'raw', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'specParams': {}, 'volumeChain': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'}]}, {'target': 1048576, 'alias': u'balloon0', 'specParams': {'model': 'virtio'}, 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5', 'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'memballoon', 'type': 'balloon'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}], 'status': 'Powering down', 'clientIp': '', 'display': 'qxl'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x164b3d0>> device:cdrom deviceId:f6e39fc9-32fc-4ad5-9b64-8a672306722c drv:raw extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x164b3d0>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x164b3d0>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x164b3d0>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x164b3d0>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x164b3d0>> log:<logUtils.SimpleLogAdapter instance at 0x16ce128> name:hdc networkDev:False path: readonly:True reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:cdrom volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>Thread-439::DEBUG::2014-04-10 19:01:08,769::task::579::TaskManager.Task::(_updateState) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::moving from state init -> state preparing
>Thread-439::INFO::2014-04-10 19:01:08,769::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID=None)
>Thread-439::DEBUG::2014-04-10 19:01:08,770::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`334d5680-9a5f-4e59-a7fc-a69926ea199c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage'
>Thread-439::DEBUG::2014-04-10 19:01:08,770::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-439::DEBUG::2014-04-10 19:01:08,770::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-439::DEBUG::2014-04-10 19:01:08,770::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`334d5680-9a5f-4e59-a7fc-a69926ea199c`::Granted request
>Thread-439::DEBUG::2014-04-10 19:01:08,771::task::811::TaskManager.Task::(resourceAcquired) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-439::DEBUG::2014-04-10 19:01:08,771::task::974::TaskManager.Task::(_decref) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::ref 1 aborting False
>Thread-64::ERROR::2014-04-10 19:01:11,195::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:01:11,196::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:01:11,196::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:01:11,197::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:01:11,348::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:01:11,350::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:01:11,350::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-65::DEBUG::2014-04-10 19:01:11,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:11,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000476362 s, 1.4 MB/s\n'; <rc> = 0
>Thread-440::DEBUG::2014-04-10 19:01:17,530::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-440::DEBUG::2014-04-10 19:01:17,531::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-440::DEBUG::2014-04-10 19:01:17,531::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-440::INFO::2014-04-10 19:01:17,532::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>Thread-440::DEBUG::2014-04-10 19:01:17,532::task::1168::TaskManager.Task::(prepare) Task=`496ff5e8-7a7b-458b-834d-00fc7c363615`::finished: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>Thread-440::DEBUG::2014-04-10 19:01:17,532::task::579::TaskManager.Task::(_updateState) Task=`496ff5e8-7a7b-458b-834d-00fc7c363615`::moving from state preparing -> state finished
>Thread-440::DEBUG::2014-04-10 19:01:17,532::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-440::DEBUG::2014-04-10 19:01:17,532::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-440::DEBUG::2014-04-10 19:01:17,532::task::974::TaskManager.Task::(_decref) Task=`496ff5e8-7a7b-458b-834d-00fc7c363615`::ref 0 aborting False
>Thread-449::DEBUG::2014-04-10 19:01:17,543::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-449::DEBUG::2014-04-10 19:01:17,544::task::579::TaskManager.Task::(_updateState) Task=`9067ee3d-71b4-4fbd-9630-181ba9d95c19`::moving from state init -> state preparing
>Thread-449::INFO::2014-04-10 19:01:17,544::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-449::INFO::2014-04-10 19:01:17,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-449::DEBUG::2014-04-10 19:01:17,545::task::1168::TaskManager.Task::(prepare) Task=`9067ee3d-71b4-4fbd-9630-181ba9d95c19`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-449::DEBUG::2014-04-10 19:01:17,545::task::579::TaskManager.Task::(_updateState) Task=`9067ee3d-71b4-4fbd-9630-181ba9d95c19`::moving from state preparing -> state finished
>Thread-449::DEBUG::2014-04-10 19:01:17,545::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-449::DEBUG::2014-04-10 19:01:17,545::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-449::DEBUG::2014-04-10 19:01:17,545::task::974::TaskManager.Task::(_decref) Task=`9067ee3d-71b4-4fbd-9630-181ba9d95c19`::ref 0 aborting False
>Thread-450::DEBUG::2014-04-10 19:01:17,556::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-450::DEBUG::2014-04-10 19:01:17,557::task::579::TaskManager.Task::(_updateState) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::moving from state init -> state preparing
>Thread-450::INFO::2014-04-10 19:01:17,557::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-450::DEBUG::2014-04-10 19:01:17,557::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c9d23f6-2671-4824-a24d-d30d0191a83c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-450::DEBUG::2014-04-10 19:01:17,558::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-450::DEBUG::2014-04-10 19:01:17,558::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-450::DEBUG::2014-04-10 19:01:17,558::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0c9d23f6-2671-4824-a24d-d30d0191a83c`::Granted request
>Thread-450::DEBUG::2014-04-10 19:01:17,558::task::811::TaskManager.Task::(resourceAcquired) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-450::DEBUG::2014-04-10 19:01:17,559::task::974::TaskManager.Task::(_decref) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::ref 1 aborting False
>Thread-450::INFO::2014-04-10 19:01:17,561::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-450::DEBUG::2014-04-10 19:01:17,561::task::1168::TaskManager.Task::(prepare) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-450::DEBUG::2014-04-10 19:01:17,562::task::579::TaskManager.Task::(_updateState) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::moving from state preparing -> state finished
>Thread-450::DEBUG::2014-04-10 19:01:17,562::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-450::DEBUG::2014-04-10 19:01:17,562::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-450::DEBUG::2014-04-10 19:01:17,562::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-450::DEBUG::2014-04-10 19:01:17,562::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-450::DEBUG::2014-04-10 19:01:17,563::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-450::DEBUG::2014-04-10 19:01:17,563::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-450::DEBUG::2014-04-10 19:01:17,563::task::974::TaskManager.Task::(_decref) Task=`1acecfd5-430c-4907-bb77-d150ca63aa84`::ref 0 aborting False
>Thread-451::DEBUG::2014-04-10 19:01:17,576::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1047a8b0]
>Thread-451::DEBUG::2014-04-10 19:01:17,576::task::579::TaskManager.Task::(_updateState) Task=`17550ed7-018f-4b6c-8907-9df71dfe1941`::moving from state init -> state preparing
>Thread-451::INFO::2014-04-10 19:01:17,577::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}], options=None)
>Thread-451::DEBUG::2014-04-10 19:01:17,578::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2
>Thread-67::DEBUG::2014-04-10 19:01:18,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:18,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000605855 s, 607 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:01:21,404::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:21,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000556365 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:01:28,191::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:28,197::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000527954 s, 697 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:01:31,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:31,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000563122 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:01:38,208::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:38,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000473425 s, 777 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:01:41,440::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:41,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000423924 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:01:48,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:48,229::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000426 s, 864 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:01:51,457::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:01:51,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000368515 s, 1.8 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:01:58,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:01:58,243::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000387949 s, 949 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:02:01,475::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:01,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000456025 s, 1.4 MB/s\n'; <rc> = 0
>Thread-442::WARNING::2014-04-10 19:02:03,704::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-444::WARNING::2014-04-10 19:02:03,706::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-442::DEBUG::2014-04-10 19:02:03,726::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-444::DEBUG::2014-04-10 19:02:03,726::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 19:02:03,728::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 19:02:03,729::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-439::DEBUG::2014-04-10 19:02:03,729::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-439::DEBUG::2014-04-10 19:02:03,731::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-439::DEBUG::2014-04-10 19:02:03,731::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-439::DEBUG::2014-04-10 19:02:03,731::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-439::DEBUG::2014-04-10 19:02:03,732::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-439::DEBUG::2014-04-10 19:02:03,743::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-439::DEBUG::2014-04-10 19:02:03,743::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-439::DEBUG::2014-04-10 19:02:05,790::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-439::DEBUG::2014-04-10 19:02:05,862::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-439::DEBUG::2014-04-10 19:02:05,863::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,864::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,864::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,864::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,864::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,865::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,865::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-439::ERROR::2014-04-10 19:02:05,865::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-439::ERROR::2014-04-10 19:02:05,865::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-439::DEBUG::2014-04-10 19:02:05,865::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-439::DEBUG::2014-04-10 19:02:05,866::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-439::DEBUG::2014-04-10 19:02:06,010::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-439::WARNING::2014-04-10 19:02:06,011::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-439::DEBUG::2014-04-10 19:02:06,011::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 19:02:08,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:08,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000384911 s, 956 kB/s\n'; <rc> = 0
>Thread-446::WARNING::2014-04-10 19:02:11,376::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-448::WARNING::2014-04-10 19:02:11,378::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-446::DEBUG::2014-04-10 19:02:11,380::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-448::DEBUG::2014-04-10 19:02:11,380::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 19:02:11,382::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 19:02:11,383::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-65::DEBUG::2014-04-10 19:02:11,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:11,501::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000501654 s, 1.3 MB/s\n'; <rc> = 0
>Thread-451::DEBUG::2014-04-10 19:02:17,584::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-451::DEBUG::2014-04-10 19:02:17,584::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-451::INFO::2014-04-10 19:02:17,585::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-451::DEBUG::2014-04-10 19:02:17,585::task::1168::TaskManager.Task::(prepare) Task=`17550ed7-018f-4b6c-8907-9df71dfe1941`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-451::DEBUG::2014-04-10 19:02:17,585::task::579::TaskManager.Task::(_updateState) Task=`17550ed7-018f-4b6c-8907-9df71dfe1941`::moving from state preparing -> state finished
>Thread-451::DEBUG::2014-04-10 19:02:17,585::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-451::DEBUG::2014-04-10 19:02:17,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-451::DEBUG::2014-04-10 19:02:17,586::task::974::TaskManager.Task::(_decref) Task=`17550ed7-018f-4b6c-8907-9df71dfe1941`::ref 0 aborting False
>Thread-456::DEBUG::2014-04-10 19:02:17,612::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-456::DEBUG::2014-04-10 19:02:17,612::task::579::TaskManager.Task::(_updateState) Task=`4e46404c-d305-4965-b949-d20654e64f1f`::moving from state init -> state preparing
>Thread-456::INFO::2014-04-10 19:02:17,613::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-456::INFO::2014-04-10 19:02:17,613::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-456::DEBUG::2014-04-10 19:02:17,613::task::1168::TaskManager.Task::(prepare) Task=`4e46404c-d305-4965-b949-d20654e64f1f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-456::DEBUG::2014-04-10 19:02:17,613::task::579::TaskManager.Task::(_updateState) Task=`4e46404c-d305-4965-b949-d20654e64f1f`::moving from state preparing -> state finished
>Thread-456::DEBUG::2014-04-10 19:02:17,613::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-456::DEBUG::2014-04-10 19:02:17,614::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-456::DEBUG::2014-04-10 19:02:17,614::task::974::TaskManager.Task::(_decref) Task=`4e46404c-d305-4965-b949-d20654e64f1f`::ref 0 aborting False
>Thread-457::DEBUG::2014-04-10 19:02:17,623::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-457::DEBUG::2014-04-10 19:02:17,623::task::579::TaskManager.Task::(_updateState) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::moving from state init -> state preparing
>Thread-457::INFO::2014-04-10 19:02:17,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-457::DEBUG::2014-04-10 19:02:17,624::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2e80142-2af5-4279-8853-d1a2e49f1545`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-457::DEBUG::2014-04-10 19:02:17,624::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-457::DEBUG::2014-04-10 19:02:17,624::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-457::DEBUG::2014-04-10 19:02:17,624::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a2e80142-2af5-4279-8853-d1a2e49f1545`::Granted request
>Thread-457::DEBUG::2014-04-10 19:02:17,625::task::811::TaskManager.Task::(resourceAcquired) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-457::DEBUG::2014-04-10 19:02:17,625::task::974::TaskManager.Task::(_decref) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::ref 1 aborting False
>Thread-457::INFO::2014-04-10 19:02:17,628::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-457::DEBUG::2014-04-10 19:02:17,628::task::1168::TaskManager.Task::(prepare) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-457::DEBUG::2014-04-10 19:02:17,628::task::579::TaskManager.Task::(_updateState) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::moving from state preparing -> state finished
>Thread-457::DEBUG::2014-04-10 19:02:17,628::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-457::DEBUG::2014-04-10 19:02:17,628::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-457::DEBUG::2014-04-10 19:02:17,629::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-457::DEBUG::2014-04-10 19:02:17,629::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-457::DEBUG::2014-04-10 19:02:17,629::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-457::DEBUG::2014-04-10 19:02:17,629::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-457::DEBUG::2014-04-10 19:02:17,629::task::974::TaskManager.Task::(_decref) Task=`3e5ab1f5-a2a4-4f4d-8c76-daf19157b3a8`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:02:18,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:18,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000463711 s, 794 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:02:21,383::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-64::DEBUG::2014-04-10 19:02:21,384::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-64::DEBUG::2014-04-10 19:02:21,384::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-64::DEBUG::2014-04-10 19:02:21,384::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-64::DEBUG::2014-04-10 19:02:21,385::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:02:21,399::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-64::DEBUG::2014-04-10 19:02:21,400::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-65::DEBUG::2014-04-10 19:02:21,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:21,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00050885 s, 1.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:02:23,431::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:02:23,474::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:02:23,474::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,475::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,475::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,475::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,475::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,476::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,476::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-64::ERROR::2014-04-10 19:02:23,476::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:02:23,476::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:02:23,476::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:02:23,477::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:02:23,623::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:02:23,624::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:02:23,624::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-462::DEBUG::2014-04-10 19:02:27,713::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-462::DEBUG::2014-04-10 19:02:27,714::task::579::TaskManager.Task::(_updateState) Task=`719dd04d-124c-468c-8f23-709d186864d4`::moving from state init -> state preparing
>Thread-462::INFO::2014-04-10 19:02:27,714::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-462::INFO::2014-04-10 19:02:27,714::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-462::DEBUG::2014-04-10 19:02:27,715::task::1168::TaskManager.Task::(prepare) Task=`719dd04d-124c-468c-8f23-709d186864d4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-462::DEBUG::2014-04-10 19:02:27,715::task::579::TaskManager.Task::(_updateState) Task=`719dd04d-124c-468c-8f23-709d186864d4`::moving from state preparing -> state finished
>Thread-462::DEBUG::2014-04-10 19:02:27,715::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-462::DEBUG::2014-04-10 19:02:27,715::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-462::DEBUG::2014-04-10 19:02:27,715::task::974::TaskManager.Task::(_decref) Task=`719dd04d-124c-468c-8f23-709d186864d4`::ref 0 aborting False
>Thread-463::DEBUG::2014-04-10 19:02:27,724::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-463::DEBUG::2014-04-10 19:02:27,724::task::579::TaskManager.Task::(_updateState) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::moving from state init -> state preparing
>Thread-463::INFO::2014-04-10 19:02:27,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-463::DEBUG::2014-04-10 19:02:27,725::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc112c57-5b2b-4734-a3b4-cf5ffed37b27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-463::DEBUG::2014-04-10 19:02:27,725::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-463::DEBUG::2014-04-10 19:02:27,725::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-463::DEBUG::2014-04-10 19:02:27,725::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bc112c57-5b2b-4734-a3b4-cf5ffed37b27`::Granted request
>Thread-463::DEBUG::2014-04-10 19:02:27,725::task::811::TaskManager.Task::(resourceAcquired) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-463::DEBUG::2014-04-10 19:02:27,726::task::974::TaskManager.Task::(_decref) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::ref 1 aborting False
>Thread-463::INFO::2014-04-10 19:02:27,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-463::DEBUG::2014-04-10 19:02:27,729::task::1168::TaskManager.Task::(prepare) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-463::DEBUG::2014-04-10 19:02:27,729::task::579::TaskManager.Task::(_updateState) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::moving from state preparing -> state finished
>Thread-463::DEBUG::2014-04-10 19:02:27,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-463::DEBUG::2014-04-10 19:02:27,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-463::DEBUG::2014-04-10 19:02:27,729::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-463::DEBUG::2014-04-10 19:02:27,730::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-463::DEBUG::2014-04-10 19:02:27,730::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-463::DEBUG::2014-04-10 19:02:27,730::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-463::DEBUG::2014-04-10 19:02:27,730::task::974::TaskManager.Task::(_decref) Task=`61fa6709-b6a1-4a96-b877-7fbb72f18e7f`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:02:28,287::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:28,295::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000476818 s, 772 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:02:31,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:31,535::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000540813 s, 1.2 MB/s\n'; <rc> = 0
>Thread-464::DEBUG::2014-04-10 19:02:37,796::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-464::DEBUG::2014-04-10 19:02:37,797::task::579::TaskManager.Task::(_updateState) Task=`d1e598f4-97aa-4205-ba82-fffdb3ed0bcc`::moving from state init -> state preparing
>Thread-464::INFO::2014-04-10 19:02:37,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-464::INFO::2014-04-10 19:02:37,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-464::DEBUG::2014-04-10 19:02:37,798::task::1168::TaskManager.Task::(prepare) Task=`d1e598f4-97aa-4205-ba82-fffdb3ed0bcc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-464::DEBUG::2014-04-10 19:02:37,798::task::579::TaskManager.Task::(_updateState) Task=`d1e598f4-97aa-4205-ba82-fffdb3ed0bcc`::moving from state preparing -> state finished
>Thread-464::DEBUG::2014-04-10 19:02:37,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-464::DEBUG::2014-04-10 19:02:37,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-464::DEBUG::2014-04-10 19:02:37,798::task::974::TaskManager.Task::(_decref) Task=`d1e598f4-97aa-4205-ba82-fffdb3ed0bcc`::ref 0 aborting False
>Thread-465::DEBUG::2014-04-10 19:02:37,807::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-465::DEBUG::2014-04-10 19:02:37,808::task::579::TaskManager.Task::(_updateState) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::moving from state init -> state preparing
>Thread-465::INFO::2014-04-10 19:02:37,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-465::DEBUG::2014-04-10 19:02:37,809::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18b4e7c2-3ee4-4aa6-8fec-d223ebedd89f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-465::DEBUG::2014-04-10 19:02:37,809::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-465::DEBUG::2014-04-10 19:02:37,809::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-465::DEBUG::2014-04-10 19:02:37,809::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`18b4e7c2-3ee4-4aa6-8fec-d223ebedd89f`::Granted request
>Thread-465::DEBUG::2014-04-10 19:02:37,810::task::811::TaskManager.Task::(resourceAcquired) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-465::DEBUG::2014-04-10 19:02:37,810::task::974::TaskManager.Task::(_decref) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::ref 1 aborting False
>Thread-465::INFO::2014-04-10 19:02:37,812::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-465::DEBUG::2014-04-10 19:02:37,812::task::1168::TaskManager.Task::(prepare) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-465::DEBUG::2014-04-10 19:02:37,813::task::579::TaskManager.Task::(_updateState) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::moving from state preparing -> state finished
>Thread-465::DEBUG::2014-04-10 19:02:37,813::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-465::DEBUG::2014-04-10 19:02:37,813::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-465::DEBUG::2014-04-10 19:02:37,813::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-465::DEBUG::2014-04-10 19:02:37,813::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-465::DEBUG::2014-04-10 19:02:37,814::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-465::DEBUG::2014-04-10 19:02:37,814::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-465::DEBUG::2014-04-10 19:02:37,814::task::974::TaskManager.Task::(_decref) Task=`df44d64b-1768-487d-b2ed-d60a9a6f991e`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:02:38,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:38,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00054298 s, 678 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:02:41,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:41,554::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000588616 s, 1.1 MB/s\n'; <rc> = 0
>Thread-466::DEBUG::2014-04-10 19:02:47,903::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-466::DEBUG::2014-04-10 19:02:47,904::task::579::TaskManager.Task::(_updateState) Task=`47c34753-1073-4baf-958f-f3196f22ac2f`::moving from state init -> state preparing
>Thread-466::INFO::2014-04-10 19:02:47,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-466::INFO::2014-04-10 19:02:47,905::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-466::DEBUG::2014-04-10 19:02:47,905::task::1168::TaskManager.Task::(prepare) Task=`47c34753-1073-4baf-958f-f3196f22ac2f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-466::DEBUG::2014-04-10 19:02:47,905::task::579::TaskManager.Task::(_updateState) Task=`47c34753-1073-4baf-958f-f3196f22ac2f`::moving from state preparing -> state finished
>Thread-466::DEBUG::2014-04-10 19:02:47,905::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-466::DEBUG::2014-04-10 19:02:47,905::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-466::DEBUG::2014-04-10 19:02:47,906::task::974::TaskManager.Task::(_decref) Task=`47c34753-1073-4baf-958f-f3196f22ac2f`::ref 0 aborting False
>Thread-467::DEBUG::2014-04-10 19:02:47,914::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-467::DEBUG::2014-04-10 19:02:47,915::task::579::TaskManager.Task::(_updateState) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::moving from state init -> state preparing
>Thread-467::INFO::2014-04-10 19:02:47,915::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-467::DEBUG::2014-04-10 19:02:47,915::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a55a0212-3ced-448e-b42b-97cd0d3a60c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-467::DEBUG::2014-04-10 19:02:47,915::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-467::DEBUG::2014-04-10 19:02:47,916::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-467::DEBUG::2014-04-10 19:02:47,916::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a55a0212-3ced-448e-b42b-97cd0d3a60c5`::Granted request
>Thread-467::DEBUG::2014-04-10 19:02:47,917::task::811::TaskManager.Task::(resourceAcquired) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-467::DEBUG::2014-04-10 19:02:47,917::task::974::TaskManager.Task::(_decref) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::ref 1 aborting False
>Thread-467::INFO::2014-04-10 19:02:47,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-467::DEBUG::2014-04-10 19:02:47,919::task::1168::TaskManager.Task::(prepare) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-467::DEBUG::2014-04-10 19:02:47,920::task::579::TaskManager.Task::(_updateState) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::moving from state preparing -> state finished
>Thread-467::DEBUG::2014-04-10 19:02:47,920::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-467::DEBUG::2014-04-10 19:02:47,920::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-467::DEBUG::2014-04-10 19:02:47,920::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-467::DEBUG::2014-04-10 19:02:47,921::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-467::DEBUG::2014-04-10 19:02:47,921::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-467::DEBUG::2014-04-10 19:02:47,921::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-467::DEBUG::2014-04-10 19:02:47,921::task::974::TaskManager.Task::(_decref) Task=`9a8f7cd1-9a02-4523-9af1-85f9b0a6448f`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:02:48,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:48,327::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000380703 s, 967 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:02:51,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:02:51,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00046613 s, 1.4 MB/s\n'; <rc> = 0
>Thread-468::DEBUG::2014-04-10 19:02:57,993::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-468::DEBUG::2014-04-10 19:02:57,994::task::579::TaskManager.Task::(_updateState) Task=`217e72b1-36f9-45e1-8184-10faa70bda20`::moving from state init -> state preparing
>Thread-468::INFO::2014-04-10 19:02:57,995::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-468::INFO::2014-04-10 19:02:57,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-468::DEBUG::2014-04-10 19:02:57,995::task::1168::TaskManager.Task::(prepare) Task=`217e72b1-36f9-45e1-8184-10faa70bda20`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-468::DEBUG::2014-04-10 19:02:57,995::task::579::TaskManager.Task::(_updateState) Task=`217e72b1-36f9-45e1-8184-10faa70bda20`::moving from state preparing -> state finished
>Thread-468::DEBUG::2014-04-10 19:02:57,996::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-468::DEBUG::2014-04-10 19:02:57,996::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-468::DEBUG::2014-04-10 19:02:57,996::task::974::TaskManager.Task::(_decref) Task=`217e72b1-36f9-45e1-8184-10faa70bda20`::ref 0 aborting False
>Thread-469::DEBUG::2014-04-10 19:02:58,004::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-469::DEBUG::2014-04-10 19:02:58,005::task::579::TaskManager.Task::(_updateState) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::moving from state init -> state preparing
>Thread-469::INFO::2014-04-10 19:02:58,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-469::DEBUG::2014-04-10 19:02:58,005::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3feb453c-a716-4680-b3ff-73bb576db161`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-469::DEBUG::2014-04-10 19:02:58,005::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-469::DEBUG::2014-04-10 19:02:58,006::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-469::DEBUG::2014-04-10 19:02:58,006::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3feb453c-a716-4680-b3ff-73bb576db161`::Granted request
>Thread-469::DEBUG::2014-04-10 19:02:58,006::task::811::TaskManager.Task::(resourceAcquired) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-469::DEBUG::2014-04-10 19:02:58,006::task::974::TaskManager.Task::(_decref) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::ref 1 aborting False
>Thread-469::INFO::2014-04-10 19:02:58,008::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-469::DEBUG::2014-04-10 19:02:58,009::task::1168::TaskManager.Task::(prepare) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-469::DEBUG::2014-04-10 19:02:58,009::task::579::TaskManager.Task::(_updateState) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::moving from state preparing -> state finished
>Thread-469::DEBUG::2014-04-10 19:02:58,009::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-469::DEBUG::2014-04-10 19:02:58,009::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-469::DEBUG::2014-04-10 19:02:58,009::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-469::DEBUG::2014-04-10 19:02:58,009::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-469::DEBUG::2014-04-10 19:02:58,010::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-469::DEBUG::2014-04-10 19:02:58,010::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-469::DEBUG::2014-04-10 19:02:58,010::task::974::TaskManager.Task::(_decref) Task=`90f7de4c-fec8-408c-9811-c862a6743b10`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:02:58,334::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:02:58,341::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000460189 s, 800 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:03:01,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:01,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000396572 s, 1.7 MB/s\n'; <rc> = 0
>Thread-453::WARNING::2014-04-10 19:03:06,036::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-453::DEBUG::2014-04-10 19:03:06,038::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-455::WARNING::2014-04-10 19:03:06,037::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-455::DEBUG::2014-04-10 19:03:06,040::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-439::ERROR::2014-04-10 19:03:06,041::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 19:03:06,042::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:03:06,043::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-439::ERROR::2014-04-10 19:03:06,042::task::850::TaskManager.Task::(_setError) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::Unexpected error
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/task.py", line 857, in _run
>    return fn(*args, **kargs)
>  File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
>    res = f(*args, **kwargs)
>  File "/usr/share/vdsm/storage/hsm.py", line 3306, in teardownImage
>    dom = sdCache.produce(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::DEBUG::2014-04-10 19:03:06,045::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-439::DEBUG::2014-04-10 19:03:06,046::task::869::TaskManager.Task::(_run) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::Task._run: eb9235f8-8b8c-4684-b993-4325515bc147 ('dbec8cee-b5e4-4011-9dd5-7c122389a878', 'f721168f-5edd-4f5f-8976-591eb93f960e', 'ca8224e3-4aff-4e35-87f6-c12059aeb202') {} failed - stopping task
>Thread-439::DEBUG::2014-04-10 19:03:06,047::task::1194::TaskManager.Task::(stop) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::stopping in state preparing (force False)
>Thread-439::DEBUG::2014-04-10 19:03:06,049::task::974::TaskManager.Task::(_decref) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::ref 1 aborting True
>Thread-439::INFO::2014-04-10 19:03:06,051::task::1151::TaskManager.Task::(prepare) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::aborting: Task is aborted: 'Storage domain does not exist' - code 358
>Thread-66::DEBUG::2014-04-10 19:03:06,051::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-439::DEBUG::2014-04-10 19:03:06,052::task::1156::TaskManager.Task::(prepare) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::Prepare: aborted: Storage domain does not exist
>Thread-439::DEBUG::2014-04-10 19:03:06,058::task::974::TaskManager.Task::(_decref) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::ref 0 aborting True
>Thread-439::DEBUG::2014-04-10 19:03:06,059::task::909::TaskManager.Task::(_doAbort) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::Task._doAbort: force False
>Thread-439::DEBUG::2014-04-10 19:03:06,059::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-439::DEBUG::2014-04-10 19:03:06,059::task::579::TaskManager.Task::(_updateState) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::moving from state preparing -> state aborting
>Thread-439::DEBUG::2014-04-10 19:03:06,059::task::534::TaskManager.Task::(__state_aborting) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::_aborting: recover policy none
>Thread-439::DEBUG::2014-04-10 19:03:06,060::task::579::TaskManager.Task::(_updateState) Task=`eb9235f8-8b8c-4684-b993-4325515bc147`::moving from state aborting -> state failed
>Thread-439::DEBUG::2014-04-10 19:03:06,060::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-439::DEBUG::2014-04-10 19:03:06,060::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-439::DEBUG::2014-04-10 19:03:06,061::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-439::DEBUG::2014-04-10 19:03:06,061::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-439::DEBUG::2014-04-10 19:03:06,061::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-439::DEBUG::2014-04-10 19:03:06,062::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-439::ERROR::2014-04-10 19:03:06,062::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)", 'code': 358}}
>Thread-439::DEBUG::2014-04-10 19:03:06,065::task::579::TaskManager.Task::(_updateState) Task=`fcaaaf14-e983-4d9b-b728-f4e822d9e2b7`::moving from state init -> state preparing
>Thread-439::INFO::2014-04-10 19:03:06,066::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='350aed0d-0065-47c3-81db-3ae5dc8dbf53')
>Thread-439::INFO::2014-04-10 19:03:06,067::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None
>Thread-439::DEBUG::2014-04-10 19:03:06,068::task::1168::TaskManager.Task::(prepare) Task=`fcaaaf14-e983-4d9b-b728-f4e822d9e2b7`::finished: None
>Thread-439::DEBUG::2014-04-10 19:03:06,068::task::579::TaskManager.Task::(_updateState) Task=`fcaaaf14-e983-4d9b-b728-f4e822d9e2b7`::moving from state preparing -> state finished
>Thread-439::DEBUG::2014-04-10 19:03:06,068::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-439::DEBUG::2014-04-10 19:03:06,068::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-439::DEBUG::2014-04-10 19:03:06,069::task::974::TaskManager.Task::(_decref) Task=`fcaaaf14-e983-4d9b-b728-f4e822d9e2b7`::ref 0 aborting False
>Thread-439::DEBUG::2014-04-10 19:03:06,070::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:03:06,192::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:03:06,193::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:03:06,193::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-439::DEBUG::2014-04-10 19:03:06,371::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-439::INFO::2014-04-10 19:03:06,371::hooks::100::root::(_runHooksDir) 
>Thread-439::DEBUG::2014-04-10 19:03:06,372::vm::4527::vm.Vm::(deleteVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Total desktops after destroy of 350aed0d-0065-47c3-81db-3ae5dc8dbf53 is 0
>Thread-439::DEBUG::2014-04-10 19:03:06,373::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>libvirtEventLoop::DEBUG::2014-04-10 19:03:06,374::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '350aed0d-0065-47c3-81db-3ae5dc8dbf53'
>libvirtEventLoop::DEBUG::2014-04-10 19:03:06,374::vm::2657::vm.Vm::(setDownStatus) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Changed state to Down: Admin shut down
>libvirtEventLoop::DEBUG::2014-04-10 19:03:06,374::sampling::292::vm.Vm::(stop) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Stop statistics collection
>libvirtEventLoop::DEBUG::2014-04-10 19:03:06,375::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '350aed0d-0065-47c3-81db-3ae5dc8dbf53'
>Thread-476::DEBUG::2014-04-10 19:03:08,082::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4a19fd68]
>Thread-476::DEBUG::2014-04-10 19:03:08,083::task::579::TaskManager.Task::(_updateState) Task=`6879609b-8330-4865-a4a1-4112460079da`::moving from state init -> state preparing
>Thread-476::INFO::2014-04-10 19:03:08,083::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-476::INFO::2014-04-10 19:03:08,084::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-476::DEBUG::2014-04-10 19:03:08,084::task::1168::TaskManager.Task::(prepare) Task=`6879609b-8330-4865-a4a1-4112460079da`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-476::DEBUG::2014-04-10 19:03:08,084::task::579::TaskManager.Task::(_updateState) Task=`6879609b-8330-4865-a4a1-4112460079da`::moving from state preparing -> state finished
>Thread-476::DEBUG::2014-04-10 19:03:08,084::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-476::DEBUG::2014-04-10 19:03:08,085::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-476::DEBUG::2014-04-10 19:03:08,085::task::974::TaskManager.Task::(_decref) Task=`6879609b-8330-4865-a4a1-4112460079da`::ref 0 aborting False
>Thread-477::DEBUG::2014-04-10 19:03:08,102::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [4a19fd68]
>Thread-477::DEBUG::2014-04-10 19:03:08,103::task::579::TaskManager.Task::(_updateState) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::moving from state init -> state preparing
>Thread-477::INFO::2014-04-10 19:03:08,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-477::DEBUG::2014-04-10 19:03:08,104::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63c6a090-d9e0-428b-b4fa-afab4bbac27a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-477::DEBUG::2014-04-10 19:03:08,104::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-477::DEBUG::2014-04-10 19:03:08,104::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-477::DEBUG::2014-04-10 19:03:08,104::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`63c6a090-d9e0-428b-b4fa-afab4bbac27a`::Granted request
>Thread-477::DEBUG::2014-04-10 19:03:08,105::task::811::TaskManager.Task::(resourceAcquired) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-477::DEBUG::2014-04-10 19:03:08,105::task::974::TaskManager.Task::(_decref) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::ref 1 aborting False
>Thread-477::INFO::2014-04-10 19:03:08,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-477::DEBUG::2014-04-10 19:03:08,109::task::1168::TaskManager.Task::(prepare) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-477::DEBUG::2014-04-10 19:03:08,109::task::579::TaskManager.Task::(_updateState) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::moving from state preparing -> state finished
>Thread-477::DEBUG::2014-04-10 19:03:08,109::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-477::DEBUG::2014-04-10 19:03:08,109::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-477::DEBUG::2014-04-10 19:03:08,109::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-477::DEBUG::2014-04-10 19:03:08,110::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-477::DEBUG::2014-04-10 19:03:08,110::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-477::DEBUG::2014-04-10 19:03:08,110::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-477::DEBUG::2014-04-10 19:03:08,110::task::974::TaskManager.Task::(_decref) Task=`03319885-ddc2-4a7c-9135-bd7901dc9541`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:03:08,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:08,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000487309 s, 755 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:03:11,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:11,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000410926 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:03:18,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:18,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000366709 s, 1.0 MB/s\n'; <rc> = 0
>Thread-481::DEBUG::2014-04-10 19:03:18,540::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-481::DEBUG::2014-04-10 19:03:18,541::task::579::TaskManager.Task::(_updateState) Task=`708acf87-8e27-4ae1-96a0-8b53ac8f82d4`::moving from state init -> state preparing
>Thread-481::INFO::2014-04-10 19:03:18,542::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-481::INFO::2014-04-10 19:03:18,542::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-481::DEBUG::2014-04-10 19:03:18,542::task::1168::TaskManager.Task::(prepare) Task=`708acf87-8e27-4ae1-96a0-8b53ac8f82d4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-481::DEBUG::2014-04-10 19:03:18,542::task::579::TaskManager.Task::(_updateState) Task=`708acf87-8e27-4ae1-96a0-8b53ac8f82d4`::moving from state preparing -> state finished
>Thread-481::DEBUG::2014-04-10 19:03:18,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-481::DEBUG::2014-04-10 19:03:18,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-481::DEBUG::2014-04-10 19:03:18,543::task::974::TaskManager.Task::(_decref) Task=`708acf87-8e27-4ae1-96a0-8b53ac8f82d4`::ref 0 aborting False
>Thread-482::DEBUG::2014-04-10 19:03:18,545::task::579::TaskManager.Task::(_updateState) Task=`3f6f2f12-74cd-4912-b8e5-f42412646bad`::moving from state init -> state preparing
>Thread-482::INFO::2014-04-10 19:03:18,545::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-482::INFO::2014-04-10 19:03:18,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410926', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '67.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '74.8', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366709', 'lastCheck': '0.2', 'valid': True}}
>Thread-482::DEBUG::2014-04-10 19:03:18,547::task::1168::TaskManager.Task::(prepare) Task=`3f6f2f12-74cd-4912-b8e5-f42412646bad`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410926', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '67.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '74.8', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366709', 'lastCheck': '0.2', 'valid': True}}
>Thread-482::DEBUG::2014-04-10 19:03:18,547::task::579::TaskManager.Task::(_updateState) Task=`3f6f2f12-74cd-4912-b8e5-f42412646bad`::moving from state preparing -> state finished
>Thread-482::DEBUG::2014-04-10 19:03:18,547::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-482::DEBUG::2014-04-10 19:03:18,547::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-482::DEBUG::2014-04-10 19:03:18,547::task::974::TaskManager.Task::(_decref) Task=`3f6f2f12-74cd-4912-b8e5-f42412646bad`::ref 0 aborting False
>Thread-483::DEBUG::2014-04-10 19:03:18,553::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-483::DEBUG::2014-04-10 19:03:18,554::task::579::TaskManager.Task::(_updateState) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::moving from state init -> state preparing
>Thread-483::INFO::2014-04-10 19:03:18,554::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-483::DEBUG::2014-04-10 19:03:18,554::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e3e286d-7424-47ed-85e2-17a236dc7914`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-483::DEBUG::2014-04-10 19:03:18,555::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-483::DEBUG::2014-04-10 19:03:18,555::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-483::DEBUG::2014-04-10 19:03:18,555::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7e3e286d-7424-47ed-85e2-17a236dc7914`::Granted request
>Thread-483::DEBUG::2014-04-10 19:03:18,555::task::811::TaskManager.Task::(resourceAcquired) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-483::DEBUG::2014-04-10 19:03:18,556::task::974::TaskManager.Task::(_decref) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::ref 1 aborting False
>Thread-483::INFO::2014-04-10 19:03:18,558::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-483::DEBUG::2014-04-10 19:03:18,559::task::1168::TaskManager.Task::(prepare) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-483::DEBUG::2014-04-10 19:03:18,559::task::579::TaskManager.Task::(_updateState) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::moving from state preparing -> state finished
>Thread-483::DEBUG::2014-04-10 19:03:18,559::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-483::DEBUG::2014-04-10 19:03:18,559::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-483::DEBUG::2014-04-10 19:03:18,559::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-483::DEBUG::2014-04-10 19:03:18,560::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-483::DEBUG::2014-04-10 19:03:18,560::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-483::DEBUG::2014-04-10 19:03:18,560::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-483::DEBUG::2014-04-10 19:03:18,560::task::974::TaskManager.Task::(_decref) Task=`dee565b7-eecb-4ee8-a15f-82b6ca035f28`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:03:21,614::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:21,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000409191 s, 1.6 MB/s\n'; <rc> = 0
>Thread-459::WARNING::2014-04-10 19:03:23,642::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-461::WARNING::2014-04-10 19:03:23,650::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-459::DEBUG::2014-04-10 19:03:23,652::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-461::DEBUG::2014-04-10 19:03:23,653::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 19:03:23,655::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 19:03:23,655::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-67::DEBUG::2014-04-10 19:03:28,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:28,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000453404 s, 812 kB/s\n'; <rc> = 0
>Thread-488::DEBUG::2014-04-10 19:03:28,730::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-488::DEBUG::2014-04-10 19:03:28,745::task::579::TaskManager.Task::(_updateState) Task=`a700e310-2d38-44b1-93f4-47e8eaf06381`::moving from state init -> state preparing
>Thread-488::INFO::2014-04-10 19:03:28,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-488::INFO::2014-04-10 19:03:28,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-488::DEBUG::2014-04-10 19:03:28,745::task::1168::TaskManager.Task::(prepare) Task=`a700e310-2d38-44b1-93f4-47e8eaf06381`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-488::DEBUG::2014-04-10 19:03:28,746::task::579::TaskManager.Task::(_updateState) Task=`a700e310-2d38-44b1-93f4-47e8eaf06381`::moving from state preparing -> state finished
>Thread-488::DEBUG::2014-04-10 19:03:28,746::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-488::DEBUG::2014-04-10 19:03:28,746::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-488::DEBUG::2014-04-10 19:03:28,746::task::974::TaskManager.Task::(_decref) Task=`a700e310-2d38-44b1-93f4-47e8eaf06381`::ref 0 aborting False
>Thread-489::DEBUG::2014-04-10 19:03:28,755::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-489::DEBUG::2014-04-10 19:03:28,756::task::579::TaskManager.Task::(_updateState) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::moving from state init -> state preparing
>Thread-489::INFO::2014-04-10 19:03:28,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-489::DEBUG::2014-04-10 19:03:28,756::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a90c2137-4c45-4b50-8457-a1aa63fcf71c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-489::DEBUG::2014-04-10 19:03:28,757::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-489::DEBUG::2014-04-10 19:03:28,757::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-489::DEBUG::2014-04-10 19:03:28,757::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a90c2137-4c45-4b50-8457-a1aa63fcf71c`::Granted request
>Thread-489::DEBUG::2014-04-10 19:03:28,757::task::811::TaskManager.Task::(resourceAcquired) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-489::DEBUG::2014-04-10 19:03:28,758::task::974::TaskManager.Task::(_decref) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::ref 1 aborting False
>Thread-489::INFO::2014-04-10 19:03:28,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-489::DEBUG::2014-04-10 19:03:28,760::task::1168::TaskManager.Task::(prepare) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-489::DEBUG::2014-04-10 19:03:28,760::task::579::TaskManager.Task::(_updateState) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::moving from state preparing -> state finished
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-489::DEBUG::2014-04-10 19:03:28,761::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-489::DEBUG::2014-04-10 19:03:28,762::task::974::TaskManager.Task::(_decref) Task=`ecc5620f-ce81-4e60-9ec6-6512b4cdbcfd`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:03:31,624::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:03:31,639::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:03:31,641::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 19:03:31,649::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 19:03:31,650::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 19:03:31,651::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 19:03:31,651::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 19:03:31,655::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:31,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.0135065 s, 48.7 kB/s\n'; <rc> = 0
>Thread-64::ERROR::2014-04-10 19:03:33,656::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:03:33,656::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:03:33,656::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:03:33,657::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:03:33,800::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:03:33,801::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:03:33,801::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-499::DEBUG::2014-04-10 19:03:33,832::task::579::TaskManager.Task::(_updateState) Task=`c6a73dbe-612e-42a9-a5c0-33575205b91a`::moving from state init -> state preparing
>Thread-499::INFO::2014-04-10 19:03:33,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-499::INFO::2014-04-10 19:03:33,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0135065', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '10.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '90.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453404', 'lastCheck': '5.4', 'valid': True}}
>Thread-499::DEBUG::2014-04-10 19:03:33,833::task::1168::TaskManager.Task::(prepare) Task=`c6a73dbe-612e-42a9-a5c0-33575205b91a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0135065', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '10.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '90.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453404', 'lastCheck': '5.4', 'valid': True}}
>Thread-499::DEBUG::2014-04-10 19:03:33,834::task::579::TaskManager.Task::(_updateState) Task=`c6a73dbe-612e-42a9-a5c0-33575205b91a`::moving from state preparing -> state finished
>Thread-499::DEBUG::2014-04-10 19:03:33,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-499::DEBUG::2014-04-10 19:03:33,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-499::DEBUG::2014-04-10 19:03:33,834::task::974::TaskManager.Task::(_decref) Task=`c6a73dbe-612e-42a9-a5c0-33575205b91a`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:03:38,386::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:03:38,414::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:03:38,415::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 19:03:38,421::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 19:03:38,422::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 19:03:38,422::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 19:03:38,422::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 19:03:38,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:38,435::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000359556 s, 1.0 MB/s\n'; <rc> = 0
>Thread-506::DEBUG::2014-04-10 19:03:38,821::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-506::DEBUG::2014-04-10 19:03:38,833::task::579::TaskManager.Task::(_updateState) Task=`8452464b-97d2-4a31-9eea-6ca1a3ca5ab4`::moving from state init -> state preparing
>Thread-506::INFO::2014-04-10 19:03:38,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-506::INFO::2014-04-10 19:03:38,834::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-506::DEBUG::2014-04-10 19:03:38,834::task::1168::TaskManager.Task::(prepare) Task=`8452464b-97d2-4a31-9eea-6ca1a3ca5ab4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-506::DEBUG::2014-04-10 19:03:38,834::task::579::TaskManager.Task::(_updateState) Task=`8452464b-97d2-4a31-9eea-6ca1a3ca5ab4`::moving from state preparing -> state finished
>Thread-506::DEBUG::2014-04-10 19:03:38,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-506::DEBUG::2014-04-10 19:03:38,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-506::DEBUG::2014-04-10 19:03:38,835::task::974::TaskManager.Task::(_decref) Task=`8452464b-97d2-4a31-9eea-6ca1a3ca5ab4`::ref 0 aborting False
>Thread-507::DEBUG::2014-04-10 19:03:38,844::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-507::DEBUG::2014-04-10 19:03:38,844::task::579::TaskManager.Task::(_updateState) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::moving from state init -> state preparing
>Thread-507::INFO::2014-04-10 19:03:38,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-507::DEBUG::2014-04-10 19:03:38,845::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`02ee5277-6734-43b6-8f85-947d66a8fef4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-507::DEBUG::2014-04-10 19:03:38,845::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-507::DEBUG::2014-04-10 19:03:38,845::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-507::DEBUG::2014-04-10 19:03:38,846::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`02ee5277-6734-43b6-8f85-947d66a8fef4`::Granted request
>Thread-507::DEBUG::2014-04-10 19:03:38,846::task::811::TaskManager.Task::(resourceAcquired) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-507::DEBUG::2014-04-10 19:03:38,846::task::974::TaskManager.Task::(_decref) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::ref 1 aborting False
>Thread-507::INFO::2014-04-10 19:03:38,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-507::DEBUG::2014-04-10 19:03:38,849::task::1168::TaskManager.Task::(prepare) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-507::DEBUG::2014-04-10 19:03:38,849::task::579::TaskManager.Task::(_updateState) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::moving from state preparing -> state finished
>Thread-507::DEBUG::2014-04-10 19:03:38,849::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-507::DEBUG::2014-04-10 19:03:38,849::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-507::DEBUG::2014-04-10 19:03:38,849::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-507::DEBUG::2014-04-10 19:03:38,850::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-507::DEBUG::2014-04-10 19:03:38,850::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-507::DEBUG::2014-04-10 19:03:38,850::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-507::DEBUG::2014-04-10 19:03:38,850::task::974::TaskManager.Task::(_decref) Task=`8c501c16-9a8a-4d7f-8902-556d49b84c5d`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:03:41,685::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:41,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000471212 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:03:48,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:48,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000376594 s, 977 kB/s\n'; <rc> = 0
>Thread-511::DEBUG::2014-04-10 19:03:48,988::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-511::DEBUG::2014-04-10 19:03:48,989::task::579::TaskManager.Task::(_updateState) Task=`43570ed6-7da6-4d52-a9aa-7871289b5ef1`::moving from state init -> state preparing
>Thread-511::INFO::2014-04-10 19:03:48,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-511::INFO::2014-04-10 19:03:48,989::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-511::DEBUG::2014-04-10 19:03:48,990::task::1168::TaskManager.Task::(prepare) Task=`43570ed6-7da6-4d52-a9aa-7871289b5ef1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-511::DEBUG::2014-04-10 19:03:48,990::task::579::TaskManager.Task::(_updateState) Task=`43570ed6-7da6-4d52-a9aa-7871289b5ef1`::moving from state preparing -> state finished
>Thread-511::DEBUG::2014-04-10 19:03:48,990::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-511::DEBUG::2014-04-10 19:03:48,990::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-511::DEBUG::2014-04-10 19:03:48,990::task::974::TaskManager.Task::(_decref) Task=`43570ed6-7da6-4d52-a9aa-7871289b5ef1`::ref 0 aborting False
>Thread-512::DEBUG::2014-04-10 19:03:48,999::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-512::DEBUG::2014-04-10 19:03:49,000::task::579::TaskManager.Task::(_updateState) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::moving from state init -> state preparing
>Thread-512::INFO::2014-04-10 19:03:49,000::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-512::DEBUG::2014-04-10 19:03:49,001::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5481b70b-8db3-4268-a702-66b0ddaaf569`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-512::DEBUG::2014-04-10 19:03:49,001::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-512::DEBUG::2014-04-10 19:03:49,001::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-512::DEBUG::2014-04-10 19:03:49,001::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5481b70b-8db3-4268-a702-66b0ddaaf569`::Granted request
>Thread-512::DEBUG::2014-04-10 19:03:49,002::task::811::TaskManager.Task::(resourceAcquired) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-512::DEBUG::2014-04-10 19:03:49,002::task::974::TaskManager.Task::(_decref) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::ref 1 aborting False
>Thread-512::INFO::2014-04-10 19:03:49,004::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-512::DEBUG::2014-04-10 19:03:49,005::task::1168::TaskManager.Task::(prepare) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-512::DEBUG::2014-04-10 19:03:49,005::task::579::TaskManager.Task::(_updateState) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::moving from state preparing -> state finished
>Thread-512::DEBUG::2014-04-10 19:03:49,005::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-512::DEBUG::2014-04-10 19:03:49,006::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-512::DEBUG::2014-04-10 19:03:49,006::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-512::DEBUG::2014-04-10 19:03:49,006::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-512::DEBUG::2014-04-10 19:03:49,006::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-512::DEBUG::2014-04-10 19:03:49,006::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-512::DEBUG::2014-04-10 19:03:49,007::task::974::TaskManager.Task::(_decref) Task=`b8fab5b4-d779-4ff3-b7bb-65faf77a5caf`::ref 0 aborting False
>Thread-513::DEBUG::2014-04-10 19:03:49,062::task::579::TaskManager.Task::(_updateState) Task=`86e2ce2c-ce77-4a00-82f0-f6e59a474e63`::moving from state init -> state preparing
>Thread-513::INFO::2014-04-10 19:03:49,062::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-513::INFO::2014-04-10 19:03:49,062::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471212', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.4', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '105.3', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376594', 'lastCheck': '0.6', 'valid': True}}
>Thread-513::DEBUG::2014-04-10 19:03:49,062::task::1168::TaskManager.Task::(prepare) Task=`86e2ce2c-ce77-4a00-82f0-f6e59a474e63`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471212', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '25.4', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '105.3', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376594', 'lastCheck': '0.6', 'valid': True}}
>Thread-513::DEBUG::2014-04-10 19:03:49,063::task::579::TaskManager.Task::(_updateState) Task=`86e2ce2c-ce77-4a00-82f0-f6e59a474e63`::moving from state preparing -> state finished
>Thread-513::DEBUG::2014-04-10 19:03:49,063::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-513::DEBUG::2014-04-10 19:03:49,063::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-513::DEBUG::2014-04-10 19:03:49,063::task::974::TaskManager.Task::(_decref) Task=`86e2ce2c-ce77-4a00-82f0-f6e59a474e63`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:03:51,700::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:03:51,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000469088 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:03:58,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:03:58,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000409647 s, 898 kB/s\n'; <rc> = 0
>Thread-518::DEBUG::2014-04-10 19:03:58,931::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [2603568]
>Thread-518::DEBUG::2014-04-10 19:03:58,932::task::579::TaskManager.Task::(_updateState) Task=`de48cfd1-2b29-4f82-8937-71ef604ada24`::moving from state init -> state preparing
>Thread-518::INFO::2014-04-10 19:03:58,932::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}], options=None)
>Thread-518::DEBUG::2014-04-10 19:03:58,934::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2
>Thread-519::DEBUG::2014-04-10 19:03:59,103::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-519::DEBUG::2014-04-10 19:03:59,104::task::579::TaskManager.Task::(_updateState) Task=`d2155a82-5cf4-4fa4-9ae5-a03a29ee3fcf`::moving from state init -> state preparing
>Thread-519::INFO::2014-04-10 19:03:59,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-519::INFO::2014-04-10 19:03:59,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-519::DEBUG::2014-04-10 19:03:59,105::task::1168::TaskManager.Task::(prepare) Task=`d2155a82-5cf4-4fa4-9ae5-a03a29ee3fcf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-519::DEBUG::2014-04-10 19:03:59,105::task::579::TaskManager.Task::(_updateState) Task=`d2155a82-5cf4-4fa4-9ae5-a03a29ee3fcf`::moving from state preparing -> state finished
>Thread-519::DEBUG::2014-04-10 19:03:59,106::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-519::DEBUG::2014-04-10 19:03:59,106::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-519::DEBUG::2014-04-10 19:03:59,106::task::974::TaskManager.Task::(_decref) Task=`d2155a82-5cf4-4fa4-9ae5-a03a29ee3fcf`::ref 0 aborting False
>Thread-520::DEBUG::2014-04-10 19:03:59,115::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-520::DEBUG::2014-04-10 19:03:59,116::task::579::TaskManager.Task::(_updateState) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::moving from state init -> state preparing
>Thread-520::INFO::2014-04-10 19:03:59,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-520::DEBUG::2014-04-10 19:03:59,117::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`35b9670e-8fc0-4d55-97e0-1d8a17d20a3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-520::DEBUG::2014-04-10 19:03:59,117::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-520::DEBUG::2014-04-10 19:03:59,117::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-520::DEBUG::2014-04-10 19:03:59,117::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`35b9670e-8fc0-4d55-97e0-1d8a17d20a3e`::Granted request
>Thread-520::DEBUG::2014-04-10 19:03:59,118::task::811::TaskManager.Task::(resourceAcquired) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-520::DEBUG::2014-04-10 19:03:59,118::task::974::TaskManager.Task::(_decref) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::ref 1 aborting False
>Thread-520::INFO::2014-04-10 19:03:59,121::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-520::DEBUG::2014-04-10 19:03:59,121::task::1168::TaskManager.Task::(prepare) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-520::DEBUG::2014-04-10 19:03:59,121::task::579::TaskManager.Task::(_updateState) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::moving from state preparing -> state finished
>Thread-520::DEBUG::2014-04-10 19:03:59,122::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-520::DEBUG::2014-04-10 19:03:59,122::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-520::DEBUG::2014-04-10 19:03:59,122::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-520::DEBUG::2014-04-10 19:03:59,122::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-520::DEBUG::2014-04-10 19:03:59,122::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-520::DEBUG::2014-04-10 19:03:59,123::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-520::DEBUG::2014-04-10 19:03:59,123::task::974::TaskManager.Task::(_decref) Task=`a6cb0e80-3193-40e2-8c05-7bae53d8299f`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:04:01,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:01,723::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000471741 s, 1.4 MB/s\n'; <rc> = 0
>Thread-522::DEBUG::2014-04-10 19:04:04,246::task::579::TaskManager.Task::(_updateState) Task=`2c89d4a5-59aa-40e6-a40d-add815cf030b`::moving from state init -> state preparing
>Thread-522::INFO::2014-04-10 19:04:04,247::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-522::INFO::2014-04-10 19:04:04,247::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471741', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '40.6', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '120.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409647', 'lastCheck': '5.8', 'valid': True}}
>Thread-522::DEBUG::2014-04-10 19:04:04,247::task::1168::TaskManager.Task::(prepare) Task=`2c89d4a5-59aa-40e6-a40d-add815cf030b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471741', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '40.6', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '120.5', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000409647', 'lastCheck': '5.8', 'valid': True}}
>Thread-522::DEBUG::2014-04-10 19:04:04,248::task::579::TaskManager.Task::(_updateState) Task=`2c89d4a5-59aa-40e6-a40d-add815cf030b`::moving from state preparing -> state finished
>Thread-522::DEBUG::2014-04-10 19:04:04,248::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-522::DEBUG::2014-04-10 19:04:04,248::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-522::DEBUG::2014-04-10 19:04:04,248::task::974::TaskManager.Task::(_decref) Task=`2c89d4a5-59aa-40e6-a40d-add815cf030b`::ref 0 aborting False
>Thread-472::WARNING::2014-04-10 19:04:06,217::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-472::DEBUG::2014-04-10 19:04:06,219::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-474::WARNING::2014-04-10 19:04:06,223::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-66::ERROR::2014-04-10 19:04:06,224::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 19:04:06,225::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-525::DEBUG::2014-04-10 19:04:08,043::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [321d53a7]
>Thread-525::DEBUG::2014-04-10 19:04:08,044::task::579::TaskManager.Task::(_updateState) Task=`6f76f9f9-83bb-43ea-a88f-949a5f51bae1`::moving from state init -> state preparing
>Thread-525::INFO::2014-04-10 19:04:08,044::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}], options=None)
>Thread-525::DEBUG::2014-04-10 19:04:08,046::hsm::2318::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1
>Thread-67::DEBUG::2014-04-10 19:04:08,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:08,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000363191 s, 1.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:04:11,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:11,738::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000462008 s, 1.4 MB/s\n'; <rc> = 0
>Thread-66::ERROR::2014-04-10 19:04:16,226::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:04:16,226::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:04:16,226::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:04:16,227::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:04:16,370::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:04:16,371::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:04:16,371::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 19:04:18,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:18,500::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000357585 s, 1.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:04:21,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:21,753::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000404869 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:04:28,509::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:28,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000375602 s, 980 kB/s\n'; <rc> = 0
>Thread-492::WARNING::2014-04-10 19:04:31,630::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-492::DEBUG::2014-04-10 19:04:31,631::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-494::WARNING::2014-04-10 19:04:31,639::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-65::DEBUG::2014-04-10 19:04:31,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:31,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00042032 s, 1.6 MB/s\n'; <rc> = 0
>Thread-496::WARNING::2014-04-10 19:04:33,827::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-498::WARNING::2014-04-10 19:04:33,831::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-496::DEBUG::2014-04-10 19:04:33,844::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-498::DEBUG::2014-04-10 19:04:33,845::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-64::ERROR::2014-04-10 19:04:33,847::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 55cb7668-7c5e-4553-b263-c6f3f86b358f not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-64::ERROR::2014-04-10 19:04:33,847::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 55cb7668-7c5e-4553-b263-c6f3f86b358f monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('55cb7668-7c5e-4553-b263-c6f3f86b358f',)
>Thread-503::WARNING::2014-04-10 19:04:38,408::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-505::WARNING::2014-04-10 19:04:38,412::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-503::DEBUG::2014-04-10 19:04:38,416::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-505::DEBUG::2014-04-10 19:04:38,419::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-67::DEBUG::2014-04-10 19:04:38,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:38,536::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479568 s, 767 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:04:41,781::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:41,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000460467 s, 1.4 MB/s\n'; <rc> = 0
>Thread-64::ERROR::2014-04-10 19:04:43,848::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:04:43,848::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:04:43,865::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:04:43,865::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:04:43,997::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:04:43,997::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:04:43,998::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-67::DEBUG::2014-04-10 19:04:48,543::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:48,550::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000470085 s, 783 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:04:51,795::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:04:51,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000504875 s, 1.3 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:04:58,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:04:58,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000420491 s, 875 kB/s\n'; <rc> = 0
>Thread-518::DEBUG::2014-04-10 19:04:58,941::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-518::DEBUG::2014-04-10 19:04:58,942::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-518::INFO::2014-04-10 19:04:58,942::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-518::DEBUG::2014-04-10 19:04:58,942::task::1168::TaskManager.Task::(prepare) Task=`de48cfd1-2b29-4f82-8937-71ef604ada24`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}]}
>Thread-518::DEBUG::2014-04-10 19:04:58,943::task::579::TaskManager.Task::(_updateState) Task=`de48cfd1-2b29-4f82-8937-71ef604ada24`::moving from state preparing -> state finished
>Thread-518::DEBUG::2014-04-10 19:04:58,943::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-518::DEBUG::2014-04-10 19:04:58,943::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-518::DEBUG::2014-04-10 19:04:58,943::task::974::TaskManager.Task::(_decref) Task=`de48cfd1-2b29-4f82-8937-71ef604ada24`::ref 0 aborting False
>Thread-534::DEBUG::2014-04-10 19:04:58,997::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-534::DEBUG::2014-04-10 19:04:58,998::task::579::TaskManager.Task::(_updateState) Task=`efe48ca0-1f9e-4f3d-9ee7-ac36ff6e48fe`::moving from state init -> state preparing
>Thread-534::INFO::2014-04-10 19:04:58,998::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-534::INFO::2014-04-10 19:04:58,998::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-534::DEBUG::2014-04-10 19:04:58,998::task::1168::TaskManager.Task::(prepare) Task=`efe48ca0-1f9e-4f3d-9ee7-ac36ff6e48fe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-534::DEBUG::2014-04-10 19:04:58,999::task::579::TaskManager.Task::(_updateState) Task=`efe48ca0-1f9e-4f3d-9ee7-ac36ff6e48fe`::moving from state preparing -> state finished
>Thread-534::DEBUG::2014-04-10 19:04:58,999::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-534::DEBUG::2014-04-10 19:04:58,999::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-534::DEBUG::2014-04-10 19:04:58,999::task::974::TaskManager.Task::(_decref) Task=`efe48ca0-1f9e-4f3d-9ee7-ac36ff6e48fe`::ref 0 aborting False
>Thread-536::DEBUG::2014-04-10 19:04:59,014::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-536::DEBUG::2014-04-10 19:04:59,014::task::579::TaskManager.Task::(_updateState) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::moving from state init -> state preparing
>Thread-536::INFO::2014-04-10 19:04:59,014::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-536::DEBUG::2014-04-10 19:04:59,015::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f881e87-4f8a-4d33-b21e-01adb4470031`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-536::DEBUG::2014-04-10 19:04:59,015::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-536::DEBUG::2014-04-10 19:04:59,015::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-536::DEBUG::2014-04-10 19:04:59,016::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1f881e87-4f8a-4d33-b21e-01adb4470031`::Granted request
>Thread-536::DEBUG::2014-04-10 19:04:59,016::task::811::TaskManager.Task::(resourceAcquired) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-536::DEBUG::2014-04-10 19:04:59,016::task::974::TaskManager.Task::(_decref) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::ref 1 aborting False
>Thread-536::INFO::2014-04-10 19:04:59,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-536::DEBUG::2014-04-10 19:04:59,019::task::1168::TaskManager.Task::(prepare) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'isoprefix': '', 'alerts': [], 'version': -1}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-536::DEBUG::2014-04-10 19:04:59,019::task::579::TaskManager.Task::(_updateState) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::moving from state preparing -> state finished
>Thread-536::DEBUG::2014-04-10 19:04:59,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-536::DEBUG::2014-04-10 19:04:59,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-536::DEBUG::2014-04-10 19:04:59,020::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-536::DEBUG::2014-04-10 19:04:59,020::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-536::DEBUG::2014-04-10 19:04:59,020::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-536::DEBUG::2014-04-10 19:04:59,021::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-536::DEBUG::2014-04-10 19:04:59,021::task::974::TaskManager.Task::(_decref) Task=`ba6fec55-988f-4a56-81ed-9d28b613e610`::ref 0 aborting False
>Thread-537::DEBUG::2014-04-10 19:04:59,105::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [714ba2cd]
>Thread-537::DEBUG::2014-04-10 19:04:59,106::task::579::TaskManager.Task::(_updateState) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::moving from state init -> state preparing
>Thread-537::INFO::2014-04-10 19:04:59,106::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='55cb7668-7c5e-4553-b263-c6f3f86b358f', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-537::DEBUG::2014-04-10 19:04:59,106::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a060692-2fa9-47b1-b584-be4504d7d11e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1239' at 'activateStorageDomain'
>Thread-537::DEBUG::2014-04-10 19:04:59,106::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-537::DEBUG::2014-04-10 19:04:59,107::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-537::DEBUG::2014-04-10 19:04:59,107::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a060692-2fa9-47b1-b584-be4504d7d11e`::Granted request
>Thread-537::DEBUG::2014-04-10 19:04:59,107::task::811::TaskManager.Task::(resourceAcquired) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-537::DEBUG::2014-04-10 19:04:59,107::task::974::TaskManager.Task::(_decref) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::ref 1 aborting False
>Thread-537::DEBUG::2014-04-10 19:04:59,108::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`b15114fb-8f80-48d9-92fa-59c35db32998`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1240' at 'activateStorageDomain'
>Thread-537::DEBUG::2014-04-10 19:04:59,108::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-537::DEBUG::2014-04-10 19:04:59,108::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-537::DEBUG::2014-04-10 19:04:59,109::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`b15114fb-8f80-48d9-92fa-59c35db32998`::Granted request
>Thread-537::DEBUG::2014-04-10 19:04:59,109::task::811::TaskManager.Task::(resourceAcquired) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::_resourcesAcquired: Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f (exclusive)
>Thread-537::DEBUG::2014-04-10 19:04:59,109::task::974::TaskManager.Task::(_decref) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::ref 1 aborting False
>Thread-537::INFO::2014-04-10 19:04:59,109::sp::1106::Storage.StoragePool::(activateSD) sdUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f spUUID=f721168f-5edd-4f5f-8976-591eb93f960e
>Thread-65::DEBUG::2014-04-10 19:05:01,811::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:01,818::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000481718 s, 1.4 MB/s\n'; <rc> = 0
>Thread-525::DEBUG::2014-04-10 19:05:08,052::hsm::2387::Storage.HSM::(connectStorageServer) prefetch failed: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': <function findDomain at 0xf21500>, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': <function findDomain at 0xf21500>}
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/hsm.py", line 2384, in connectStorageServer
>    doms = self.__prefetchDomains(domType, conObj)
>  File "/usr/share/vdsm/storage/hsm.py", line 2321, in __prefetchDomains
>    goop.glob.glob(os.path.join(lPath, uuidPatern)))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-525::DEBUG::2014-04-10 19:05:08,052::hsm::2398::Storage.HSM::(connectStorageServer) knownSDs: {f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76: storage.nfsSD.findDomain, 65eafe2b-4fa9-4ea1-a869-7deb5afd4654: storage.nfsSD.findDomain}
>Thread-525::INFO::2014-04-10 19:05:08,053::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>Thread-525::DEBUG::2014-04-10 19:05:08,053::task::1168::TaskManager.Task::(prepare) Task=`6f76f9f9-83bb-43ea-a88f-949a5f51bae1`::finished: {'statuslist': [{'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}]}
>Thread-525::DEBUG::2014-04-10 19:05:08,053::task::579::TaskManager.Task::(_updateState) Task=`6f76f9f9-83bb-43ea-a88f-949a5f51bae1`::moving from state preparing -> state finished
>Thread-525::DEBUG::2014-04-10 19:05:08,054::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-525::DEBUG::2014-04-10 19:05:08,054::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-525::DEBUG::2014-04-10 19:05:08,054::task::974::TaskManager.Task::(_decref) Task=`6f76f9f9-83bb-43ea-a88f-949a5f51bae1`::ref 0 aborting False
>Thread-540::DEBUG::2014-04-10 19:05:08,078::task::579::TaskManager.Task::(_updateState) Task=`ae3198b4-20e7-4b73-9fa0-6f0f6d3da6b9`::moving from state init -> state preparing
>Thread-540::INFO::2014-04-10 19:05:08,078::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-540::INFO::2014-04-10 19:05:08,078::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481718', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '34.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '61.9', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420491', 'lastCheck': '9.5', 'valid': True}}
>Thread-540::DEBUG::2014-04-10 19:05:08,078::task::1168::TaskManager.Task::(prepare) Task=`ae3198b4-20e7-4b73-9fa0-6f0f6d3da6b9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481718', 'lastCheck': '6.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '34.2', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '61.9', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420491', 'lastCheck': '9.5', 'valid': True}}
>Thread-540::DEBUG::2014-04-10 19:05:08,079::task::579::TaskManager.Task::(_updateState) Task=`ae3198b4-20e7-4b73-9fa0-6f0f6d3da6b9`::moving from state preparing -> state finished
>Thread-540::DEBUG::2014-04-10 19:05:08,079::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-540::DEBUG::2014-04-10 19:05:08,079::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-540::DEBUG::2014-04-10 19:05:08,079::task::974::TaskManager.Task::(_decref) Task=`ae3198b4-20e7-4b73-9fa0-6f0f6d3da6b9`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:05:08,600::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:08,607::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000407823 s, 902 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:05:11,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:11,832::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000478521 s, 1.4 MB/s\n'; <rc> = 0
>Thread-527::WARNING::2014-04-10 19:05:16,399::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-527::DEBUG::2014-04-10 19:05:16,401::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-529::WARNING::2014-04-10 19:05:16,402::fileSD::622::scanDomains::(collectMetaFiles) Metadata collection for domain path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2 timedout
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/fileSD.py", line 611, in collectMetaFiles
>    sd.DOMAIN_META_DATA))
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in callCrabRPCFunction
>    *args, **kwargs)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in callCrabRPCFunction
>    rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>  File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in _recvAll
>    raise Timeout()
>Timeout
>Thread-529::DEBUG::2014-04-10 19:05:16,403::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop) Pool handler existed, OUT: '' ERR: ''
>Thread-66::ERROR::2014-04-10 19:05:16,404::sdc::143::Storage.StorageDomainCache::(_findDomain) domain dbec8cee-b5e4-4011-9dd5-7c122389a878 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-66::ERROR::2014-04-10 19:05:16,405::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain dbec8cee-b5e4-4011-9dd5-7c122389a878 monitoring information
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/domainMonitor.py", line 204, in _monitorDomain
>    self.domain = sdCache.produce(self.sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 98, in produce
>    domain.getRealDomain()
>  File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>    return self._cache._realProduce(self._sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>    domain = self._findDomain(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('dbec8cee-b5e4-4011-9dd5-7c122389a878',)
>Thread-67::DEBUG::2014-04-10 19:05:18,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:18,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000500464 s, 735 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:05:21,841::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:21,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000516383 s, 1.3 MB/s\n'; <rc> = 0
>Thread-546::DEBUG::2014-04-10 19:05:23,312::task::579::TaskManager.Task::(_updateState) Task=`f9eb38cc-bef7-4e49-b5db-93e726f415c5`::moving from state init -> state preparing
>Thread-546::INFO::2014-04-10 19:05:23,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-546::INFO::2014-04-10 19:05:23,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516383', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '49.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.9', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500464', 'lastCheck': '4.7', 'valid': True}}
>Thread-546::DEBUG::2014-04-10 19:05:23,313::task::1168::TaskManager.Task::(prepare) Task=`f9eb38cc-bef7-4e49-b5db-93e726f415c5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516383', 'lastCheck': '1.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '49.5', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '6.9', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500464', 'lastCheck': '4.7', 'valid': True}}
>Thread-546::DEBUG::2014-04-10 19:05:23,313::task::579::TaskManager.Task::(_updateState) Task=`f9eb38cc-bef7-4e49-b5db-93e726f415c5`::moving from state preparing -> state finished
>Thread-546::DEBUG::2014-04-10 19:05:23,313::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-546::DEBUG::2014-04-10 19:05:23,313::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-546::DEBUG::2014-04-10 19:05:23,314::task::974::TaskManager.Task::(_decref) Task=`f9eb38cc-bef7-4e49-b5db-93e726f415c5`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:05:26,405::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:05:26,405::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-66::DEBUG::2014-04-10 19:05:26,406::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-66::DEBUG::2014-04-10 19:05:26,406::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-66::DEBUG::2014-04-10 19:05:26,406::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-66::DEBUG::2014-04-10 19:05:26,406::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:05:26,419::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-66::DEBUG::2014-04-10 19:05:26,420::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-67::DEBUG::2014-04-10 19:05:28,631::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:28,639::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474811 s, 775 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:05:29,451::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:05:29,529::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:05:29,530::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,535::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,535::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,535::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,535::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,536::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,536::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-66::ERROR::2014-04-10 19:05:29,536::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:05:29,536::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:05:29,536::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:05:29,537::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:05:29,677::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:05:29,678::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:05:29,678::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-65::DEBUG::2014-04-10 19:05:31,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:31,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000560935 s, 1.2 MB/s\n'; <rc> = 0
>Thread-556::DEBUG::2014-04-10 19:05:38,550::task::579::TaskManager.Task::(_updateState) Task=`0ff80649-d07d-4b04-b833-bc684d7b1ac3`::moving from state init -> state preparing
>Thread-556::INFO::2014-04-10 19:05:38,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-556::INFO::2014-04-10 19:05:38,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560935', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '64.7', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474811', 'lastCheck': '9.9', 'valid': True}}
>Thread-556::DEBUG::2014-04-10 19:05:38,551::task::1168::TaskManager.Task::(prepare) Task=`0ff80649-d07d-4b04-b833-bc684d7b1ac3`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560935', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '64.7', 'valid': False}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 358, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '22.1', 'valid': False}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474811', 'lastCheck': '9.9', 'valid': True}}
>Thread-556::DEBUG::2014-04-10 19:05:38,551::task::579::TaskManager.Task::(_updateState) Task=`0ff80649-d07d-4b04-b833-bc684d7b1ac3`::moving from state preparing -> state finished
>Thread-556::DEBUG::2014-04-10 19:05:38,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-556::DEBUG::2014-04-10 19:05:38,551::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-556::DEBUG::2014-04-10 19:05:38,551::task::974::TaskManager.Task::(_decref) Task=`0ff80649-d07d-4b04-b833-bc684d7b1ac3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:05:38,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:38,658::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000535603 s, 687 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:05:40,059::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-66::DEBUG::2014-04-10 19:05:40,061::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-64::DEBUG::2014-04-10 19:05:40,145::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-64::DEBUG::2014-04-10 19:05:40,150::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-64::DEBUG::2014-04-10 19:05:40,152::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::DEBUG::2014-04-10 19:05:40,152::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS'
>Thread-64::DEBUG::2014-04-10 19:05:40,152::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace '55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS'
>Thread-66::DEBUG::2014-04-10 19:05:40,153::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-537::INFO::2014-04-10 19:05:40,155::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None
>Thread-537::DEBUG::2014-04-10 19:05:40,155::task::1168::TaskManager.Task::(prepare) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::finished: None
>Thread-537::DEBUG::2014-04-10 19:05:40,157::task::579::TaskManager.Task::(_updateState) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::moving from state preparing -> state finished
>Thread-537::DEBUG::2014-04-10 19:05:40,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f': < ResourceRef 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f', isValid: 'True' obj: 'None'>}
>Thread-537::DEBUG::2014-04-10 19:05:40,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-537::DEBUG::2014-04-10 19:05:40,158::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-66::DEBUG::2014-04-10 19:05:40,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-537::DEBUG::2014-04-10 19:05:40,159::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-537::DEBUG::2014-04-10 19:05:40,161::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-537::DEBUG::2014-04-10 19:05:40,161::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-537::DEBUG::2014-04-10 19:05:40,163::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-66::DEBUG::2014-04-10 19:05:40,165::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::DEBUG::2014-04-10 19:05:40,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-537::DEBUG::2014-04-10 19:05:40,165::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-537::DEBUG::2014-04-10 19:05:40,170::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-537::DEBUG::2014-04-10 19:05:40,172::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-66::DEBUG::2014-04-10 19:05:40,175::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS'
>Thread-537::DEBUG::2014-04-10 19:05:40,177::task::974::TaskManager.Task::(_decref) Task=`18e51889-2661-45ca-aaee-77c6063d03f0`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:05:40,182::resourceManager::420::ResourceManager::(registerNamespace) Registering namespace 'dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS'
>Thread-64::DEBUG::2014-04-10 19:05:40,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233667 s, 2.9 MB/s\n'; <rc> = 0
>Thread-558::DEBUG::2014-04-10 19:05:40,206::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-558::DEBUG::2014-04-10 19:05:40,209::task::579::TaskManager.Task::(_updateState) Task=`5c07b216-6da6-4299-a39c-91b350e06044`::moving from state init -> state preparing
>Thread-558::INFO::2014-04-10 19:05:40,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-558::INFO::2014-04-10 19:05:40,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-558::DEBUG::2014-04-10 19:05:40,218::task::1168::TaskManager.Task::(prepare) Task=`5c07b216-6da6-4299-a39c-91b350e06044`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-558::DEBUG::2014-04-10 19:05:40,221::task::579::TaskManager.Task::(_updateState) Task=`5c07b216-6da6-4299-a39c-91b350e06044`::moving from state preparing -> state finished
>Thread-64::DEBUG::2014-04-10 19:05:40,221::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 55cb7668-7c5e-4553-b263-c6f3f86b358f changed its status to Valid
>Thread-559::DEBUG::2014-04-10 19:05:40,222::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [714ba2cd]
>Thread-558::DEBUG::2014-04-10 19:05:40,223::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-560::DEBUG::2014-04-10 19:05:40,225::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-64::INFO::2014-04-10 19:05:40,226::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>Thread-558::DEBUG::2014-04-10 19:05:40,228::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-559::DEBUG::2014-04-10 19:05:40,229::task::579::TaskManager.Task::(_updateState) Task=`51757505-b368-4180-99c8-53eb70074ba0`::moving from state init -> state preparing
>Thread-560::DEBUG::2014-04-10 19:05:40,230::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-64::DEBUG::2014-04-10 19:05:40,231::clusterlock::192::SANLock::(acquireHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f successfully acquired (id: 2)
>Thread-558::DEBUG::2014-04-10 19:05:40,234::task::974::TaskManager.Task::(_decref) Task=`5c07b216-6da6-4299-a39c-91b350e06044`::ref 0 aborting False
>Thread-559::INFO::2014-04-10 19:05:40,236::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', masterVersion=7, options=None)
>Thread-560::DEBUG::2014-04-10 19:05:40,238::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain`
>Thread-561::INFO::2014-04-10 19:05:40,240::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-560::DEBUG::2014-04-10 19:05:40,248::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-562::DEBUG::2014-04-10 19:05:40,248::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-559::DEBUG::2014-04-10 19:05:40,252::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e3538cba-0910-4442-98dd-89e1d38eade9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '867' at 'refreshStoragePool'
>Thread-559::DEBUG::2014-04-10 19:05:40,256::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-562::DEBUG::2014-04-10 19:05:40,257::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`a124a557-1419-4a67-9d90-cf7a881696a1`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>Thread-562::DEBUG::2014-04-10 19:05:40,259::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-559::DEBUG::2014-04-10 19:05:40,260::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-559::DEBUG::2014-04-10 19:05:40,263::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e3538cba-0910-4442-98dd-89e1d38eade9`::Granted request
>Thread-562::DEBUG::2014-04-10 19:05:40,267::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-563::DEBUG::2014-04-10 19:05:40,269::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-562::DEBUG::2014-04-10 19:05:40,270::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`a124a557-1419-4a67-9d90-cf7a881696a1`::Granted request
>Thread-559::DEBUG::2014-04-10 19:05:40,271::task::811::TaskManager.Task::(resourceAcquired) Task=`51757505-b368-4180-99c8-53eb70074ba0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-563::DEBUG::2014-04-10 19:05:40,274::task::579::TaskManager.Task::(_updateState) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::moving from state init -> state preparing
>Thread-559::DEBUG::2014-04-10 19:05:40,275::task::974::TaskManager.Task::(_decref) Task=`51757505-b368-4180-99c8-53eb70074ba0`::ref 1 aborting False
>Thread-563::INFO::2014-04-10 19:05:40,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-559::INFO::2014-04-10 19:05:40,278::hsm::876::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM)
>Thread-562::DEBUG::2014-04-10 19:05:40,280::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`9543e6ea-4be3-4ec7-b0d4-36dd20baa513`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>Thread-559::INFO::2014-04-10 19:05:40,281::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None
>Thread-562::DEBUG::2014-04-10 19:05:40,283::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' for lock type 'exclusive'
>Thread-66::DEBUG::2014-04-10 19:05:40,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-559::DEBUG::2014-04-10 19:05:40,284::task::1168::TaskManager.Task::(prepare) Task=`51757505-b368-4180-99c8-53eb70074ba0`::finished: None
>Thread-563::DEBUG::2014-04-10 19:05:40,290::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e98b3a0f-b449-4a23-b130-993568b1476e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-559::DEBUG::2014-04-10 19:05:40,293::task::579::TaskManager.Task::(_updateState) Task=`51757505-b368-4180-99c8-53eb70074ba0`::moving from state preparing -> state finished
>Thread-562::DEBUG::2014-04-10 19:05:40,293::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free. Now locking as 'exclusive' (1 active user)
>Thread-563::DEBUG::2014-04-10 19:05:40,294::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-559::DEBUG::2014-04-10 19:05:40,296::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-562::DEBUG::2014-04-10 19:05:40,297::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f`ReqID=`9543e6ea-4be3-4ec7-b0d4-36dd20baa513`::Granted request
>Thread-559::DEBUG::2014-04-10 19:05:40,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-563::DEBUG::2014-04-10 19:05:40,301::resourceManager::565::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' found in shared state and queue is empty, Joining current shared lock (2 active users)
>Thread-559::DEBUG::2014-04-10 19:05:40,304::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-563::DEBUG::2014-04-10 19:05:40,304::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e98b3a0f-b449-4a23-b130-993568b1476e`::Granted request
>Thread-66::DEBUG::2014-04-10 19:05:40,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000233062 s, 2.9 MB/s\n'; <rc> = 0
>Thread-559::DEBUG::2014-04-10 19:05:40,310::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (1 active users)
>Thread-563::DEBUG::2014-04-10 19:05:40,312::task::811::TaskManager.Task::(resourceAcquired) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-559::DEBUG::2014-04-10 19:05:40,315::task::974::TaskManager.Task::(_decref) Task=`51757505-b368-4180-99c8-53eb70074ba0`::ref 0 aborting False
>Thread-563::DEBUG::2014-04-10 19:05:40,316::task::974::TaskManager.Task::(_decref) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::ref 1 aborting False
>Thread-562::DEBUG::2014-04-10 19:05:40,321::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-562::DEBUG::2014-04-10 19:05:40,328::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-562::DEBUG::2014-04-10 19:05:40,331::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-66::DEBUG::2014-04-10 19:05:40,331::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain dbec8cee-b5e4-4011-9dd5-7c122389a878 changed its status to Valid
>Thread-562::DEBUG::2014-04-10 19:05:40,333::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-564::DEBUG::2014-04-10 19:05:40,334::misc::931::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-66::INFO::2014-04-10 19:05:40,335::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 2)
>Thread-562::DEBUG::2014-04-10 19:05:40,337::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-564::DEBUG::2014-04-10 19:05:40,339::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-66::DEBUG::2014-04-10 19:05:40,340::clusterlock::192::SANLock::(acquireHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 successfully acquired (id: 2)
>Thread-564::DEBUG::2014-04-10 19:05:40,345::misc::941::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain`
>Thread-565::INFO::2014-04-10 19:05:40,347::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-562::DEBUG::2014-04-10 19:05:40,347::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f'
>Thread-564::DEBUG::2014-04-10 19:05:40,352::misc::951::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-566::DEBUG::2014-04-10 19:05:40,352::sp::164::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-562::DEBUG::2014-04-10 19:05:40,354::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f' (0 active users)
>Thread-562::DEBUG::2014-04-10 19:05:40,358::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f' is free, finding out if anyone is waiting for it.
>Thread-566::DEBUG::2014-04-10 19:05:40,360::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`f8ff857b-3508-4c2b-aaae-c103871e5c16`::Request was made in '/usr/share/vdsm/storage/sp.py' line '175' at '_upgradePoolDomain'
>Thread-562::DEBUG::2014-04-10 19:05:40,360::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_55cb7668-7c5e-4553-b263-c6f3f86b358f', Clearing records.
>Thread-563::INFO::2014-04-10 19:05:40,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-566::DEBUG::2014-04-10 19:05:40,362::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'exclusive'
>Thread-563::DEBUG::2014-04-10 19:05:40,364::task::1168::TaskManager.Task::(prepare) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-566::DEBUG::2014-04-10 19:05:40,365::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'exclusive' (1 active user)
>Thread-563::DEBUG::2014-04-10 19:05:40,365::task::579::TaskManager.Task::(_updateState) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::moving from state preparing -> state finished
>Thread-566::DEBUG::2014-04-10 19:05:40,366::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`f8ff857b-3508-4c2b-aaae-c103871e5c16`::Granted request
>Thread-563::DEBUG::2014-04-10 19:05:40,366::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-563::DEBUG::2014-04-10 19:05:40,368::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-563::DEBUG::2014-04-10 19:05:40,369::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-566::DEBUG::2014-04-10 19:05:40,370::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`1b7bc1c9-9e92-4819-ad66-0a3c892b73b7`::Request was made in '/usr/share/vdsm/storage/sp.py' line '177' at '_upgradePoolDomain'
>Thread-566::DEBUG::2014-04-10 19:05:40,371::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'exclusive'
>Thread-563::DEBUG::2014-04-10 19:05:40,371::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-563::DEBUG::2014-04-10 19:05:40,372::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-563::DEBUG::2014-04-10 19:05:40,372::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-566::DEBUG::2014-04-10 19:05:40,372::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'exclusive' (1 active user)
>Thread-566::DEBUG::2014-04-10 19:05:40,373::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`1b7bc1c9-9e92-4819-ad66-0a3c892b73b7`::Granted request
>Thread-563::DEBUG::2014-04-10 19:05:40,373::task::974::TaskManager.Task::(_decref) Task=`0f1d8455-ae87-4fa4-91ca-2fabce5f06e5`::ref 0 aborting False
>Thread-566::DEBUG::2014-04-10 19:05:40,381::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-566::DEBUG::2014-04-10 19:05:40,381::sp::204::Storage.StoragePool::(_upgradePoolDomain) All domains are upgraded, unregistering from state change event
>Thread-566::DEBUG::2014-04-10 19:05:40,381::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-566::DEBUG::2014-04-10 19:05:40,381::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-566::DEBUG::2014-04-10 19:05:40,382::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-567::DEBUG::2014-04-10 19:05:40,449::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [a43d49a]
>Thread-567::DEBUG::2014-04-10 19:05:40,450::task::579::TaskManager.Task::(_updateState) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::moving from state init -> state preparing
>Thread-567::INFO::2014-04-10 19:05:40,450::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-567::DEBUG::2014-04-10 19:05:40,450::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31551b12-74c0-4e9c-ac84-20c54812744e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1239' at 'activateStorageDomain'
>Thread-567::DEBUG::2014-04-10 19:05:40,451::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-567::DEBUG::2014-04-10 19:05:40,451::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-567::DEBUG::2014-04-10 19:05:40,451::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`31551b12-74c0-4e9c-ac84-20c54812744e`::Granted request
>Thread-567::DEBUG::2014-04-10 19:05:40,451::task::811::TaskManager.Task::(resourceAcquired) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-567::DEBUG::2014-04-10 19:05:40,451::task::974::TaskManager.Task::(_decref) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::ref 1 aborting False
>Thread-567::DEBUG::2014-04-10 19:05:40,452::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`cc76d489-93c2-4be1-8ffd-e531390da169`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1240' at 'activateStorageDomain'
>Thread-567::DEBUG::2014-04-10 19:05:40,452::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'exclusive'
>Thread-567::DEBUG::2014-04-10 19:05:40,452::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'exclusive' (1 active user)
>Thread-567::DEBUG::2014-04-10 19:05:40,452::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`cc76d489-93c2-4be1-8ffd-e531390da169`::Granted request
>Thread-567::DEBUG::2014-04-10 19:05:40,453::task::811::TaskManager.Task::(resourceAcquired) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (exclusive)
>Thread-567::DEBUG::2014-04-10 19:05:40,453::task::974::TaskManager.Task::(_decref) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::ref 1 aborting False
>Thread-567::INFO::2014-04-10 19:05:40,453::sp::1106::Storage.StoragePool::(activateSD) sdUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878 spUUID=f721168f-5edd-4f5f-8976-591eb93f960e
>Thread-567::INFO::2014-04-10 19:05:40,453::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None
>Thread-567::DEBUG::2014-04-10 19:05:40,453::task::1168::TaskManager.Task::(prepare) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::finished: None
>Thread-567::DEBUG::2014-04-10 19:05:40,454::task::579::TaskManager.Task::(_updateState) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::moving from state preparing -> state finished
>Thread-567::DEBUG::2014-04-10 19:05:40,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>, 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-567::DEBUG::2014-04-10 19:05:40,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-567::DEBUG::2014-04-10 19:05:40,454::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-567::DEBUG::2014-04-10 19:05:40,454::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-567::DEBUG::2014-04-10 19:05:40,455::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-567::DEBUG::2014-04-10 19:05:40,456::task::974::TaskManager.Task::(_decref) Task=`1a973607-e6dd-4ab4-aac6-ffa1ac0e26bb`::ref 0 aborting False
>Thread-568::DEBUG::2014-04-10 19:05:40,479::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [a43d49a]
>Thread-568::DEBUG::2014-04-10 19:05:40,480::task::579::TaskManager.Task::(_updateState) Task=`122643f9-4c8c-4713-a371-f768599943be`::moving from state init -> state preparing
>Thread-568::INFO::2014-04-10 19:05:40,480::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', msdUUID='f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', masterVersion=7, options=None)
>Thread-568::DEBUG::2014-04-10 19:05:40,480::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3f882f2-be98-4b62-b481-d5d3ca85b00a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '867' at 'refreshStoragePool'
>Thread-568::DEBUG::2014-04-10 19:05:40,480::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-568::DEBUG::2014-04-10 19:05:40,481::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-568::DEBUG::2014-04-10 19:05:40,481::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a3f882f2-be98-4b62-b481-d5d3ca85b00a`::Granted request
>Thread-568::DEBUG::2014-04-10 19:05:40,481::task::811::TaskManager.Task::(resourceAcquired) Task=`122643f9-4c8c-4713-a371-f768599943be`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-568::DEBUG::2014-04-10 19:05:40,481::task::974::TaskManager.Task::(_decref) Task=`122643f9-4c8c-4713-a371-f768599943be`::ref 1 aborting False
>Thread-568::INFO::2014-04-10 19:05:40,481::hsm::876::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM)
>Thread-568::INFO::2014-04-10 19:05:40,482::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None
>Thread-568::DEBUG::2014-04-10 19:05:40,482::task::1168::TaskManager.Task::(prepare) Task=`122643f9-4c8c-4713-a371-f768599943be`::finished: None
>Thread-568::DEBUG::2014-04-10 19:05:40,482::task::579::TaskManager.Task::(_updateState) Task=`122643f9-4c8c-4713-a371-f768599943be`::moving from state preparing -> state finished
>Thread-568::DEBUG::2014-04-10 19:05:40,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-568::DEBUG::2014-04-10 19:05:40,482::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-568::DEBUG::2014-04-10 19:05:40,483::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-568::DEBUG::2014-04-10 19:05:40,483::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-568::DEBUG::2014-04-10 19:05:40,483::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-568::DEBUG::2014-04-10 19:05:40,483::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-568::DEBUG::2014-04-10 19:05:40,483::task::974::TaskManager.Task::(_decref) Task=`122643f9-4c8c-4713-a371-f768599943be`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:05:41,877::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:41,884::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000552996 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:05:48,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:48,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000572624 s, 643 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:05:50,238::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:05:50,239::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:05:50,239::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:05:50,239::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:05:50,240::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:05:50,351::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:05:50,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000718259 s, 934 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:05:50,386::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:05:50,387::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:05:50,387::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:05:50,404::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:05:50,405::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-64::DEBUG::2014-04-10 19:05:50,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-64::DEBUG::2014-04-10 19:05:50,410::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::INFO::2014-04-10 19:05:50,410::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-64::INFO::2014-04-10 19:05:50,410::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-64::DEBUG::2014-04-10 19:05:50,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:05:50,421::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000232959 s, 2.9 MB/s\n'; <rc> = 0
>Thread-576::DEBUG::2014-04-10 19:05:50,453::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-576::DEBUG::2014-04-10 19:05:50,453::task::579::TaskManager.Task::(_updateState) Task=`943b2b5e-7315-4932-84fc-887fb6dbc257`::moving from state init -> state preparing
>Thread-576::INFO::2014-04-10 19:05:50,453::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-576::INFO::2014-04-10 19:05:50,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-576::DEBUG::2014-04-10 19:05:50,454::task::1168::TaskManager.Task::(prepare) Task=`943b2b5e-7315-4932-84fc-887fb6dbc257`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-576::DEBUG::2014-04-10 19:05:50,454::task::579::TaskManager.Task::(_updateState) Task=`943b2b5e-7315-4932-84fc-887fb6dbc257`::moving from state preparing -> state finished
>Thread-576::DEBUG::2014-04-10 19:05:50,454::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-576::DEBUG::2014-04-10 19:05:50,454::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-576::DEBUG::2014-04-10 19:05:50,455::task::974::TaskManager.Task::(_decref) Task=`943b2b5e-7315-4932-84fc-887fb6dbc257`::ref 0 aborting False
>Thread-577::DEBUG::2014-04-10 19:05:50,463::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-577::DEBUG::2014-04-10 19:05:50,464::task::579::TaskManager.Task::(_updateState) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::moving from state init -> state preparing
>Thread-577::INFO::2014-04-10 19:05:50,464::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-577::DEBUG::2014-04-10 19:05:50,465::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7aa0edf7-8fc1-4e88-bfe0-c51af4a69482`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-577::DEBUG::2014-04-10 19:05:50,465::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-577::DEBUG::2014-04-10 19:05:50,465::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-577::DEBUG::2014-04-10 19:05:50,465::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7aa0edf7-8fc1-4e88-bfe0-c51af4a69482`::Granted request
>Thread-577::DEBUG::2014-04-10 19:05:50,466::task::811::TaskManager.Task::(resourceAcquired) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-577::DEBUG::2014-04-10 19:05:50,466::task::974::TaskManager.Task::(_decref) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::ref 1 aborting False
>Thread-577::INFO::2014-04-10 19:05:50,469::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-577::DEBUG::2014-04-10 19:05:50,469::task::1168::TaskManager.Task::(prepare) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-577::DEBUG::2014-04-10 19:05:50,469::task::579::TaskManager.Task::(_updateState) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::moving from state preparing -> state finished
>Thread-577::DEBUG::2014-04-10 19:05:50,469::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-577::DEBUG::2014-04-10 19:05:50,469::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-577::DEBUG::2014-04-10 19:05:50,470::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-577::DEBUG::2014-04-10 19:05:50,470::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-577::DEBUG::2014-04-10 19:05:50,470::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-577::DEBUG::2014-04-10 19:05:50,470::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-577::DEBUG::2014-04-10 19:05:50,470::task::974::TaskManager.Task::(_decref) Task=`60e2ca6b-0831-4c1e-a252-5b49e00260e6`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:05:51,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:05:51,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00053141 s, 1.2 MB/s\n'; <rc> = 0
>Thread-579::DEBUG::2014-04-10 19:05:53,727::task::579::TaskManager.Task::(_updateState) Task=`a9379231-97c7-4980-9747-330382cb10e1`::moving from state init -> state preparing
>Thread-579::INFO::2014-04-10 19:05:53,728::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-579::INFO::2014-04-10 19:05:53,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053141', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000232959', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000718259', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572624', 'lastCheck': '5.1', 'valid': True}}
>Thread-579::DEBUG::2014-04-10 19:05:53,728::task::1168::TaskManager.Task::(prepare) Task=`a9379231-97c7-4980-9747-330382cb10e1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053141', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000232959', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000718259', 'lastCheck': '3.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572624', 'lastCheck': '5.1', 'valid': True}}
>Thread-579::DEBUG::2014-04-10 19:05:53,728::task::579::TaskManager.Task::(_updateState) Task=`a9379231-97c7-4980-9747-330382cb10e1`::moving from state preparing -> state finished
>Thread-579::DEBUG::2014-04-10 19:05:53,729::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-579::DEBUG::2014-04-10 19:05:53,729::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-579::DEBUG::2014-04-10 19:05:53,729::task::974::TaskManager.Task::(_decref) Task=`a9379231-97c7-4980-9747-330382cb10e1`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:05:58,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:05:58,695::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000550049 s, 669 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:06:00,365::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:00,372::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0002465 s, 2.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:00,429::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:00,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000242137 s, 2.8 MB/s\n'; <rc> = 0
>Thread-583::DEBUG::2014-04-10 19:06:00,550::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-583::DEBUG::2014-04-10 19:06:00,550::task::579::TaskManager.Task::(_updateState) Task=`006771be-8fb0-4570-b196-0660998dc0a3`::moving from state init -> state preparing
>Thread-583::INFO::2014-04-10 19:06:00,551::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-583::INFO::2014-04-10 19:06:00,551::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-583::DEBUG::2014-04-10 19:06:00,551::task::1168::TaskManager.Task::(prepare) Task=`006771be-8fb0-4570-b196-0660998dc0a3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-583::DEBUG::2014-04-10 19:06:00,551::task::579::TaskManager.Task::(_updateState) Task=`006771be-8fb0-4570-b196-0660998dc0a3`::moving from state preparing -> state finished
>Thread-583::DEBUG::2014-04-10 19:06:00,551::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-583::DEBUG::2014-04-10 19:06:00,552::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-583::DEBUG::2014-04-10 19:06:00,552::task::974::TaskManager.Task::(_decref) Task=`006771be-8fb0-4570-b196-0660998dc0a3`::ref 0 aborting False
>Thread-584::DEBUG::2014-04-10 19:06:00,560::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-584::DEBUG::2014-04-10 19:06:00,561::task::579::TaskManager.Task::(_updateState) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::moving from state init -> state preparing
>Thread-584::INFO::2014-04-10 19:06:00,561::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-584::DEBUG::2014-04-10 19:06:00,561::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7bc57d5-1c4e-4b54-a911-a89a9130e19b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-584::DEBUG::2014-04-10 19:06:00,562::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-584::DEBUG::2014-04-10 19:06:00,562::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-584::DEBUG::2014-04-10 19:06:00,562::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a7bc57d5-1c4e-4b54-a911-a89a9130e19b`::Granted request
>Thread-584::DEBUG::2014-04-10 19:06:00,563::task::811::TaskManager.Task::(resourceAcquired) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-584::DEBUG::2014-04-10 19:06:00,563::task::974::TaskManager.Task::(_decref) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::ref 1 aborting False
>Thread-584::INFO::2014-04-10 19:06:00,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-584::DEBUG::2014-04-10 19:06:00,565::task::1168::TaskManager.Task::(prepare) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-584::DEBUG::2014-04-10 19:06:00,566::task::579::TaskManager.Task::(_updateState) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::moving from state preparing -> state finished
>Thread-584::DEBUG::2014-04-10 19:06:00,566::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-584::DEBUG::2014-04-10 19:06:00,566::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-584::DEBUG::2014-04-10 19:06:00,566::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-584::DEBUG::2014-04-10 19:06:00,566::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-584::DEBUG::2014-04-10 19:06:00,567::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-584::DEBUG::2014-04-10 19:06:00,567::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-584::DEBUG::2014-04-10 19:06:00,567::task::974::TaskManager.Task::(_decref) Task=`d6b1ef70-c645-4f4f-a839-2614063b682c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:01,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:01,916::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000555308 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:06:08,739::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:08,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000362741 s, 1.0 MB/s\n'; <rc> = 0
>Thread-587::DEBUG::2014-04-10 19:06:08,927::task::579::TaskManager.Task::(_updateState) Task=`67c7f157-84fe-4101-a32f-05de1fded59a`::moving from state init -> state preparing
>Thread-587::INFO::2014-04-10 19:06:08,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-587::INFO::2014-04-10 19:06:08,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555308', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000242137', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0002465', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362741', 'lastCheck': '0.2', 'valid': True}}
>Thread-587::DEBUG::2014-04-10 19:06:08,928::task::1168::TaskManager.Task::(prepare) Task=`67c7f157-84fe-4101-a32f-05de1fded59a`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000555308', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000242137', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.0002465', 'lastCheck': '8.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362741', 'lastCheck': '0.2', 'valid': True}}
>Thread-587::DEBUG::2014-04-10 19:06:08,928::task::579::TaskManager.Task::(_updateState) Task=`67c7f157-84fe-4101-a32f-05de1fded59a`::moving from state preparing -> state finished
>Thread-587::DEBUG::2014-04-10 19:06:08,929::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-587::DEBUG::2014-04-10 19:06:08,929::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-587::DEBUG::2014-04-10 19:06:08,929::task::974::TaskManager.Task::(_decref) Task=`67c7f157-84fe-4101-a32f-05de1fded59a`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:06:10,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:10,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000274087 s, 2.4 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:10,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:10,447::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000245152 s, 2.7 MB/s\n'; <rc> = 0
>Thread-589::DEBUG::2014-04-10 19:06:10,658::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-589::DEBUG::2014-04-10 19:06:10,658::task::579::TaskManager.Task::(_updateState) Task=`fe981063-f4b8-48a8-a70c-b6707dc48998`::moving from state init -> state preparing
>Thread-589::INFO::2014-04-10 19:06:10,658::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-589::INFO::2014-04-10 19:06:10,659::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-589::DEBUG::2014-04-10 19:06:10,659::task::1168::TaskManager.Task::(prepare) Task=`fe981063-f4b8-48a8-a70c-b6707dc48998`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-589::DEBUG::2014-04-10 19:06:10,659::task::579::TaskManager.Task::(_updateState) Task=`fe981063-f4b8-48a8-a70c-b6707dc48998`::moving from state preparing -> state finished
>Thread-589::DEBUG::2014-04-10 19:06:10,659::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-589::DEBUG::2014-04-10 19:06:10,659::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-589::DEBUG::2014-04-10 19:06:10,659::task::974::TaskManager.Task::(_decref) Task=`fe981063-f4b8-48a8-a70c-b6707dc48998`::ref 0 aborting False
>Thread-590::DEBUG::2014-04-10 19:06:10,668::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-590::DEBUG::2014-04-10 19:06:10,668::task::579::TaskManager.Task::(_updateState) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::moving from state init -> state preparing
>Thread-590::INFO::2014-04-10 19:06:10,668::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-590::DEBUG::2014-04-10 19:06:10,669::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5643bee-170f-4cd0-b8bb-4d4236b5d008`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-590::DEBUG::2014-04-10 19:06:10,669::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-590::DEBUG::2014-04-10 19:06:10,669::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-590::DEBUG::2014-04-10 19:06:10,669::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5643bee-170f-4cd0-b8bb-4d4236b5d008`::Granted request
>Thread-590::DEBUG::2014-04-10 19:06:10,670::task::811::TaskManager.Task::(resourceAcquired) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-590::DEBUG::2014-04-10 19:06:10,670::task::974::TaskManager.Task::(_decref) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::ref 1 aborting False
>Thread-590::INFO::2014-04-10 19:06:10,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-590::DEBUG::2014-04-10 19:06:10,672::task::1168::TaskManager.Task::(prepare) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-590::DEBUG::2014-04-10 19:06:10,673::task::579::TaskManager.Task::(_updateState) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::moving from state preparing -> state finished
>Thread-590::DEBUG::2014-04-10 19:06:10,673::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-590::DEBUG::2014-04-10 19:06:10,673::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-590::DEBUG::2014-04-10 19:06:10,673::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-590::DEBUG::2014-04-10 19:06:10,673::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-590::DEBUG::2014-04-10 19:06:10,674::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-590::DEBUG::2014-04-10 19:06:10,674::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-590::DEBUG::2014-04-10 19:06:10,674::task::974::TaskManager.Task::(_decref) Task=`f4f2124b-1ea3-47ca-b5fc-15a3864a2e06`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:11,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:11,935::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00049898 s, 1.3 MB/s\n'; <rc> = 0
>Thread-592::DEBUG::2014-04-10 19:06:12,356::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1768f22c]
>Thread-592::DEBUG::2014-04-10 19:06:12,357::task::579::TaskManager.Task::(_updateState) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::moving from state init -> state preparing
>Thread-592::INFO::2014-04-10 19:06:12,357::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-592::DEBUG::2014-04-10 19:06:12,358::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f59ebaf1-c828-4f42-ac5b-d1402f803164`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-592::DEBUG::2014-04-10 19:06:12,358::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-592::DEBUG::2014-04-10 19:06:12,358::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-592::DEBUG::2014-04-10 19:06:12,358::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f59ebaf1-c828-4f42-ac5b-d1402f803164`::Granted request
>Thread-592::DEBUG::2014-04-10 19:06:12,359::task::811::TaskManager.Task::(resourceAcquired) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-592::DEBUG::2014-04-10 19:06:12,359::task::974::TaskManager.Task::(_decref) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::ref 1 aborting False
>Thread-592::INFO::2014-04-10 19:06:12,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-592::DEBUG::2014-04-10 19:06:12,361::task::1168::TaskManager.Task::(prepare) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-592::DEBUG::2014-04-10 19:06:12,361::task::579::TaskManager.Task::(_updateState) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::moving from state preparing -> state finished
>Thread-592::DEBUG::2014-04-10 19:06:12,361::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-592::DEBUG::2014-04-10 19:06:12,361::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-592::DEBUG::2014-04-10 19:06:12,362::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-592::DEBUG::2014-04-10 19:06:12,362::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-592::DEBUG::2014-04-10 19:06:12,362::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-592::DEBUG::2014-04-10 19:06:12,362::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-592::DEBUG::2014-04-10 19:06:12,362::task::974::TaskManager.Task::(_decref) Task=`70d133c3-2360-4193-9457-ac9591d59f29`::ref 0 aborting False
>Thread-593::DEBUG::2014-04-10 19:06:12,433::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmCreate with ({'custom': {'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=3f4abec1-fd21-4c3d-8f71-b1110fc649d8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6cdevice_2f8a9f72-f5aa-4562-85a6-f4d4be037f46': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=2f8a9f72-f5aa-4562-85a6-f4d4be037f46, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=d4971727-a68a-4a36-9ce7-a977cadc3484, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6c': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=1b191d45-c2db-4105-86ba-e11fae154a6c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'cpuType': 'Conroe', 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'specParams': {}, 'readonly': 'false', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5'}, {'specParams': {}, 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'smartcardEnable': 'false', 'timeOffset': '0', 'memSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'smpCoresPerSocket': '1', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'memGuaranteedSize': 1024, 'vmName': 'vm1', 'display': 'qxl', 'transparentHugePages': 'true', 'nice': '0'},) {} flowID [1768f22c]
>Thread-593::INFO::2014-04-10 19:06:12,436::API::648::vds::(_getNetworkIp) network None: using 0
>Thread-593::INFO::2014-04-10 19:06:12,436::clientIF::394::vds::(createVm) vmContainerLock acquired by vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>Thread-593::DEBUG::2014-04-10 19:06:12,439::clientIF::407::vds::(createVm) Total desktops after creation of 350aed0d-0065-47c3-81db-3ae5dc8dbf53 is 1
>Thread-594::DEBUG::2014-04-10 19:06:12,439::vm::2156::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Start
>Thread-593::DEBUG::2014-04-10 19:06:12,439::BindingXMLRPC::982::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=3f4abec1-fd21-4c3d-8f71-b1110fc649d8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6cdevice_2f8a9f72-f5aa-4562-85a6-f4d4be037f46': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=2f8a9f72-f5aa-4562-85a6-f4d4be037f46, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=d4971727-a68a-4a36-9ce7-a977cadc3484, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6c': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=1b191d45-c2db-4105-86ba-e11fae154a6c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'specParams': {}, 'readonly': 'false', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5'}, {'specParams': {}, 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'display': 'qxl', 'nice': '0'}}
>Thread-594::DEBUG::2014-04-10 19:06:12,440::vm::2160::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations acquired
>Thread-594::INFO::2014-04-10 19:06:12,442::vm::3011::vm.Vm::(_run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::VM wrapper has started
>Thread-594::DEBUG::2014-04-10 19:06:12,443::task::579::TaskManager.Task::(_updateState) Task=`fd51a8ea-c242-4ed7-b526-7843dd092e60`::moving from state init -> state preparing
>Thread-594::INFO::2014-04-10 19:06:12,443::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID='24018d18-27a2-462e-94df-c84585e4a0df', options=None)
>Thread-594::INFO::2014-04-10 19:06:12,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-594::DEBUG::2014-04-10 19:06:12,448::task::1168::TaskManager.Task::(prepare) Task=`fd51a8ea-c242-4ed7-b526-7843dd092e60`::finished: {'truesize': '0', 'apparentsize': '5368709120'}
>Thread-594::DEBUG::2014-04-10 19:06:12,449::task::579::TaskManager.Task::(_updateState) Task=`fd51a8ea-c242-4ed7-b526-7843dd092e60`::moving from state preparing -> state finished
>Thread-594::DEBUG::2014-04-10 19:06:12,449::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-594::DEBUG::2014-04-10 19:06:12,449::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-594::DEBUG::2014-04-10 19:06:12,449::task::974::TaskManager.Task::(_decref) Task=`fd51a8ea-c242-4ed7-b526-7843dd092e60`::ref 0 aborting False
>Thread-594::INFO::2014-04-10 19:06:12,449::clientIF::353::vds::(prepareVolumePath) prepared volume path: 
>Thread-594::DEBUG::2014-04-10 19:06:12,449::task::579::TaskManager.Task::(_updateState) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::moving from state init -> state preparing
>Thread-594::INFO::2014-04-10 19:06:12,450::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', leafUUID='24018d18-27a2-462e-94df-c84585e4a0df')
>Thread-594::DEBUG::2014-04-10 19:06:12,450::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`7938ef91-1df0-425a-a00e-47d0a643ba44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3256' at 'prepareImage'
>Thread-594::DEBUG::2014-04-10 19:06:12,450::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-594::DEBUG::2014-04-10 19:06:12,450::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-594::DEBUG::2014-04-10 19:06:12,450::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`7938ef91-1df0-425a-a00e-47d0a643ba44`::Granted request
>Thread-594::DEBUG::2014-04-10 19:06:12,451::task::811::TaskManager.Task::(resourceAcquired) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-594::DEBUG::2014-04-10 19:06:12,451::task::974::TaskManager.Task::(_decref) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::ref 1 aborting False
>Thread-594::WARNING::2014-04-10 19:06:12,455::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/dbec8cee-b5e4-4011-9dd5-7c122389a878 already exists
>Thread-594::DEBUG::2014-04-10 19:06:12,455::fileSD::429::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/dbec8cee-b5e4-4011-9dd5-7c122389a878/ca8224e3-4aff-4e35-87f6-c12059aeb202
>Thread-594::DEBUG::2014-04-10 19:06:12,456::fileVolume::528::Storage.Volume::(validateVolumePath) validate path for 24018d18-27a2-462e-94df-c84585e4a0df
>Thread-594::INFO::2014-04-10 19:06:12,458::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'imgVolumesInfo': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}]}
>Thread-594::DEBUG::2014-04-10 19:06:12,458::task::1168::TaskManager.Task::(prepare) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::finished: {'info': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'imgVolumesInfo': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}]}
>Thread-594::DEBUG::2014-04-10 19:06:12,458::task::579::TaskManager.Task::(_updateState) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::moving from state preparing -> state finished
>Thread-594::DEBUG::2014-04-10 19:06:12,458::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-594::DEBUG::2014-04-10 19:06:12,459::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-594::DEBUG::2014-04-10 19:06:12,459::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-594::DEBUG::2014-04-10 19:06:12,459::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-594::DEBUG::2014-04-10 19:06:12,459::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-594::DEBUG::2014-04-10 19:06:12,459::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-594::DEBUG::2014-04-10 19:06:12,459::task::974::TaskManager.Task::(_decref) Task=`6a82ec26-4b2d-46a9-89b1-bb74ae7304ad`::ref 0 aborting False
>Thread-594::INFO::2014-04-10 19:06:12,460::clientIF::353::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df
>Thread-594::DEBUG::2014-04-10 19:06:12,468::vm::1486::vm.Vm::(blockDev) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unable to determine if the path '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df' is a block device
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 1483, in blockDev
>    self._blockDev = utils.isBlockDevice(self.path)
>  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 101, in isBlockDevice
>    return stat.S_ISBLK(os.stat(path).st_mode)
>OSError: [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'
>Thread-594::DEBUG::2014-04-10 19:06:12,469::vm::1486::vm.Vm::(blockDev) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Unable to determine if the path '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df' is a block device
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 1483, in blockDev
>    self._blockDev = utils.isBlockDevice(self.path)
>  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 101, in isBlockDevice
>    return stat.S_ISBLK(os.stat(path).st_mode)
>OSError: [Errno 2] No such file or directory: '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df'
>Thread-594::DEBUG::2014-04-10 19:06:12,474::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/10_faqemu' (cwd None)
>Thread-594::DEBUG::2014-04-10 19:06:12,528::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-594::INFO::2014-04-10 19:06:12,529::hooks::100::root::(_runHooksDir) 
>Thread-594::DEBUG::2014-04-10 19:06:12,529::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_qemucmdline' (cwd None)
>Thread-594::DEBUG::2014-04-10 19:06:12,586::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-594::INFO::2014-04-10 19:06:12,587::hooks::100::root::(_runHooksDir) 
>Thread-594::DEBUG::2014-04-10 19:06:12,587::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_vhostmd' (cwd None)
>Thread-594::DEBUG::2014-04-10 19:06:12,641::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-594::INFO::2014-04-10 19:06:12,642::hooks::100::root::(_runHooksDir) 
>Thread-594::DEBUG::2014-04-10 19:06:12,642::vm::3073::vm.Vm::(_run) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::<?xml version="1.0" encoding="utf-8"?>
><domain type="kvm">
>	<name>vm1</name>
>	<uuid>350aed0d-0065-47c3-81db-3ae5dc8dbf53</uuid>
>	<memory>1048576</memory>
>	<currentMemory>1048576</currentMemory>
>	<vcpu>1</vcpu>
>	<memtune>
>		<min_guarantee>1048576</min_guarantee>
>	</memtune>
>	<devices>
>		<channel type="unix">
>			<target name="com.redhat.rhevm.vdsm" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm"/>
>		</channel>
>		<channel type="unix">
>			<target name="org.qemu.guest_agent.0" type="virtio"/>
>			<source mode="bind" path="/var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.org.qemu.guest_agent.0"/>
>		</channel>
>		<input bus="ps2" type="mouse"/>
>		<channel type="spicevmc">
>			<target name="com.redhat.spice.0" type="virtio"/>
>		</channel>
>		<graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice">
>			<channel mode="secure" name="main"/>
>			<channel mode="secure" name="inputs"/>
>			<channel mode="secure" name="cursor"/>
>			<channel mode="secure" name="playback"/>
>			<channel mode="secure" name="record"/>
>			<channel mode="secure" name="display"/>
>			<channel mode="secure" name="usbredir"/>
>			<channel mode="secure" name="smartcard"/>
>		</graphics>
>		<controller model="virtio-scsi" type="scsi">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/>
>		</controller>
>		<video>
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/>
>			<model heads="1" type="qxl" vram="32768"/>
>		</video>
>		<interface type="bridge">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/>
>			<mac address="00:01:a4:a5:a5:07"/>
>			<model type="virtio"/>
>			<source bridge="rhevm"/>
>			<filterref filter="vdsm-no-mac-spoofing"/>
>			<link state="up"/>
>		</interface>
>		<disk device="cdrom" snapshot="no" type="file">
>			<address bus="1" controller="0" target="0" type="drive" unit="0"/>
>			<source file="" startupPolicy="optional"/>
>			<target bus="ide" dev="hdc"/>
>			<readonly/>
>			<serial/>
>		</disk>
>		<disk device="disk" snapshot="no" type="file">
>			<address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/>
>			<source file="/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df"/>
>			<target bus="virtio" dev="vda"/>
>			<serial>ca8224e3-4aff-4e35-87f6-c12059aeb202</serial>
>			<driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/>
>		</disk>
>		<memballoon model="virtio"/>
>	</devices>
>	<os>
>		<type arch="x86_64" machine="rhel6.5.0">hvm</type>
>		<smbios mode="sysinfo"/>
>	</os>
>	<sysinfo type="smbios">
>		<system>
>			<entry name="manufacturer">Red Hat</entry>
>			<entry name="product">RHEV Hypervisor</entry>
>			<entry name="version">6Server-6.5.0.1.el6</entry>
>			<entry name="serial">94B5D8DC-EC1C-11E1-8DE0-6CAE8B208082</entry>
>			<entry name="uuid">350aed0d-0065-47c3-81db-3ae5dc8dbf53</entry>
>		</system>
>	</sysinfo>
>	<clock adjustment="0" offset="variable">
>		<timer name="rtc" tickpolicy="catchup"/>
>	</clock>
>	<features>
>		<acpi/>
>	</features>
>	<cpu match="exact">
>		<model>Conroe</model>
>		<topology cores="1" sockets="1" threads="1"/>
>	</cpu>
></domain>
>
>Thread-594::DEBUG::2014-04-10 19:06:12,648::libvirtconnection::108::libvirtconnection::(wrapper) Unknown libvirterror: ecode: 38 edom: 18 level: 2 message: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory
>Thread-594::DEBUG::2014-04-10 19:06:12,649::vm::2177::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::_ongoingCreations released
>Thread-594::ERROR::2014-04-10 19:06:12,649::vm::2203::vm.Vm::(_startUnderlyingVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::The vm start process failed
>Traceback (most recent call last):
>  File "/usr/share/vdsm/vm.py", line 2163, in _startUnderlyingVm
>    self._run()
>  File "/usr/share/vdsm/vm.py", line 3107, in _run
>    self._connection.createXML(domxml, flags),
>  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper
>    ret = f(*args, **kwargs)
>  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2665, in createXML
>    if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)
>libvirtError: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory
>Thread-594::DEBUG::2014-04-10 19:06:12,655::vm::2657::vm.Vm::(setDownStatus) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Changed state to Down: cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory
>Thread-597::DEBUG::2014-04-10 19:06:15,058::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmGetStats with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-597::DEBUG::2014-04-10 19:06:15,058::BindingXMLRPC::982::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '0', 'exitMessage': "cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory", 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'timeOffset': '0', 'exitCode': 1}]}
>Thread-598::DEBUG::2014-04-10 19:06:15,075::BindingXMLRPC::975::vds::(wrapper) client [10.66.4.132]::call vmDestroy with ('350aed0d-0065-47c3-81db-3ae5dc8dbf53',) {}
>Thread-598::INFO::2014-04-10 19:06:15,075::API::324::vds::(destroy) vmContainerLock acquired by vm 350aed0d-0065-47c3-81db-3ae5dc8dbf53
>Thread-598::DEBUG::2014-04-10 19:06:15,075::vm::4533::vm.Vm::(destroy) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::destroy Called
>Thread-598::INFO::2014-04-10 19:06:15,076::vm::4479::vm.Vm::(releaseVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Release VM resources
>Thread-598::WARNING::2014-04-10 19:06:15,076::vm::1851::vm.Vm::(_set_lastStatus) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::trying to set state to Powering down when already Down
>Thread-598::WARNING::2014-04-10 19:06:15,076::clientIF::365::vds::(teardownVolumePath) Drive is not a vdsm image: VOLWM_CHUNK_MB:1024 VOLWM_CHUNK_REPLICATE_MULT:2 VOLWM_FREE_PCT:50 _blockDev:False _checkIoTuneCategories:<bound method Drive._checkIoTuneCategories of <vm.Drive object at 0x1587050>> _customize:<bound method Drive._customize of <vm.Drive object at 0x1587050>> _deviceXML:<disk device="cdrom" snapshot="no" type="file"><address  bus="1"  controller="0"  target="0"  type="drive" unit="0"/><source file="" startupPolicy="optional"/><target bus="ide" dev="hdc"/><readonly/><serial></serial></disk> _makeName:<bound method Drive._makeName of <vm.Drive object at 0x1587050>> _setExtSharedState:<bound method Drive._setExtSharedState of <vm.Drive object at 0x1587050>> _validateIoTuneParams:<bound method Drive._validateIoTuneParams of <vm.Drive object at 0x1587050>> address:{' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'} apparentsize:0 blockDev:False cache:none conf:{'status': 'Down', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '350aed0d-0065-47c3-81db-3ae5dc8dbf53', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Conroe', 'custom': {'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=3f4abec1-fd21-4c3d-8f71-b1110fc649d8, device=virtio-serial, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x05, function=0x0}, managed=false, plugged=true, readOnly=false, deviceAlias=virtio-serial0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6cdevice_2f8a9f72-f5aa-4562-85a6-f4d4be037f46': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=2f8a9f72-f5aa-4562-85a6-f4d4be037f46, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={port=3, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=d4971727-a68a-4a36-9ce7-a977cadc3484, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={bus=0x00, domain=0x0000, type=pci, slot=0x01, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=1, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null}', 'device_d4971727-a68a-4a36-9ce7-a977cadc3484device_3f4abec1-fd21-4c3d-8f71-b1110fc649d8device_c01e3c68-3bd9-4cbb-b84e-f23f1d1711e8device_1b191d45-c2db-4105-86ba-e11fae154a6c': 'VmDevice {vmId=350aed0d-0065-47c3-81db-3ae5dc8dbf53, deviceId=1b191d45-c2db-4105-86ba-e11fae154a6c, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={port=2, bus=0, controller=0, type=virtio-serial}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null}'}, 'clientIp': '', 'exitCode': 1, 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'exitMessage': "cannot open file '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df': No such file or directory", 'transparentHugePages': 'true', 'devices': [{'specParams': {}, 'deviceId': 'dc36bdf0-a786-4b15-9bce-18f438d3dfaa', 'address': {'bus': '0x00', ' slot': '0x04', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '6f155de8-f0c1-46b4-8eba-52e8d87d3246', 'address': {'bus': '0x00', ' slot': '0x02', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}}, {'nicModel': 'pv', 'macAddr': '00:01:a4:a5:a5:07', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '0c69aabf-88dd-40ba-8b2c-f88e94fdc369', 'address': {'bus': '0x00', ' slot': '0x03', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '2', 'iface': 'ide', 'address': {' controller': '0', ' target': '0', 'unit': '0', ' bus': '1', ' type': 'drive'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': 'f6e39fc9-32fc-4ad5-9b64-8a672306722c', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'address': {'bus': '0x00', ' slot': '0x06', ' domain': '0x0000', ' type': 'pci', ' function': '0x0'}, 'volumeInfo': {'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '5368709120', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'readonly': 'false', 'shared': 'false', 'truesize': '0', 'type': 'disk', 'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'reqsize': '0', 'format': 'raw', 'deviceId': 'ca8224e3-4aff-4e35-87f6-c12059aeb202', 'poolID': 'f721168f-5edd-4f5f-8976-591eb93f960e', 'device': 'disk', 'path': '/rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'propagateErrors': 'off', 'optional': 'false', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'specParams': {}, 'volumeChain': [{'domainID': 'dbec8cee-b5e4-4011-9dd5-7c122389a878', 'volType': 'path', 'leaseOffset': 0, 'path': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df', 'volumeID': '24018d18-27a2-462e-94df-c84585e4a0df', 'leasePath': '/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/images/ca8224e3-4aff-4e35-87f6-c12059aeb202/24018d18-27a2-462e-94df-c84585e4a0df.lease', 'imageID': 'ca8224e3-4aff-4e35-87f6-c12059aeb202'}]}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': '93f81c08-0d20-4da7-997a-1d109dbfffa5', 'target': 1048576}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'vm1', 'display': 'qxl', 'nice': '0'} createXmlElem:<bound method Drive.createXmlElem of <vm.Drive object at 0x1587050>> device:cdrom deviceId:f6e39fc9-32fc-4ad5-9b64-8a672306722c extSharedState:none getLeasesXML:<bound method Drive.getLeasesXML of <vm.Drive object at 0x1587050>> getNextVolumeSize:<bound method Drive.getNextVolumeSize of <vm.Drive object at 0x1587050>> getXML:<bound method Drive.getXML of <vm.Drive object at 0x1587050>> hasVolumeLeases:False iface:ide index:2 isDiskReplicationInProgress:<bound method Drive.isDiskReplicationInProgress of <vm.Drive object at 0x1587050>> isVdsmImage:<bound method Drive.isVdsmImage of <vm.Drive object at 0x1587050>> log:<logUtils.SimpleLogAdapter instance at 0x7fcc7c610cf8> name:hdc networkDev:False path: readonly:true reqsize:0 serial: shared:false specParams:{'path': ''} transientDisk:False truesize:0 type:disk volExtensionChunk:1024 watermarkLimit:536870912
>Traceback (most recent call last):
>  File "/usr/share/vdsm/clientIF.py", line 359, in teardownVolumePath
>    res = self.irs.teardownImage(drive['domainID'],
>  File "/usr/share/vdsm/vm.py", line 1431, in __getitem__
>    raise KeyError(key)
>KeyError: 'domainID'
>Thread-598::DEBUG::2014-04-10 19:06:15,078::task::579::TaskManager.Task::(_updateState) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::moving from state init -> state preparing
>Thread-598::INFO::2014-04-10 19:06:15,078::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', volUUID=None)
>Thread-598::DEBUG::2014-04-10 19:06:15,078::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`8232edb8-709c-4466-aa27-6cd63b0250f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'teardownImage'
>Thread-598::DEBUG::2014-04-10 19:06:15,079::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-598::DEBUG::2014-04-10 19:06:15,079::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-598::DEBUG::2014-04-10 19:06:15,079::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`8232edb8-709c-4466-aa27-6cd63b0250f7`::Granted request
>Thread-598::DEBUG::2014-04-10 19:06:15,079::task::811::TaskManager.Task::(resourceAcquired) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-598::DEBUG::2014-04-10 19:06:15,080::task::974::TaskManager.Task::(_decref) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::ref 1 aborting False
>Thread-598::INFO::2014-04-10 19:06:15,080::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None
>Thread-598::DEBUG::2014-04-10 19:06:15,080::task::1168::TaskManager.Task::(prepare) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::finished: None
>Thread-598::DEBUG::2014-04-10 19:06:15,080::task::579::TaskManager.Task::(_updateState) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::moving from state preparing -> state finished
>Thread-598::DEBUG::2014-04-10 19:06:15,080::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>Thread-598::DEBUG::2014-04-10 19:06:15,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-598::DEBUG::2014-04-10 19:06:15,081::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>Thread-598::DEBUG::2014-04-10 19:06:15,081::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>Thread-598::DEBUG::2014-04-10 19:06:15,081::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>Thread-598::DEBUG::2014-04-10 19:06:15,081::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>Thread-598::DEBUG::2014-04-10 19:06:15,082::task::974::TaskManager.Task::(_decref) Task=`51944355-1ba4-49ed-aab8-a64abfe8193b`::ref 0 aborting False
>Thread-598::WARNING::2014-04-10 19:06:15,082::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.com.redhat.rhevm.vdsm already removed
>Thread-598::WARNING::2014-04-10 19:06:15,082::utils::114::root::(rmFile) File: /var/lib/libvirt/qemu/channels/350aed0d-0065-47c3-81db-3ae5dc8dbf53.org.qemu.guest_agent.0 already removed
>Thread-598::DEBUG::2014-04-10 19:06:15,082::task::579::TaskManager.Task::(_updateState) Task=`ee67de76-ca5d-402e-9945-b3d9af54bbb9`::moving from state init -> state preparing
>Thread-598::INFO::2014-04-10 19:06:15,083::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='350aed0d-0065-47c3-81db-3ae5dc8dbf53')
>Thread-598::INFO::2014-04-10 19:06:15,096::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None
>Thread-598::DEBUG::2014-04-10 19:06:15,096::task::1168::TaskManager.Task::(prepare) Task=`ee67de76-ca5d-402e-9945-b3d9af54bbb9`::finished: None
>Thread-598::DEBUG::2014-04-10 19:06:15,096::task::579::TaskManager.Task::(_updateState) Task=`ee67de76-ca5d-402e-9945-b3d9af54bbb9`::moving from state preparing -> state finished
>Thread-598::DEBUG::2014-04-10 19:06:15,097::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-598::DEBUG::2014-04-10 19:06:15,097::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-598::DEBUG::2014-04-10 19:06:15,097::task::974::TaskManager.Task::(_decref) Task=`ee67de76-ca5d-402e-9945-b3d9af54bbb9`::ref 0 aborting False
>Thread-598::DEBUG::2014-04-10 19:06:15,097::utils::505::root::(execCmd) '/usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd' (cwd None)
>Thread-598::DEBUG::2014-04-10 19:06:15,343::utils::525::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-598::INFO::2014-04-10 19:06:15,343::hooks::100::root::(_runHooksDir) 
>Thread-598::DEBUG::2014-04-10 19:06:15,343::vm::4527::vm.Vm::(deleteVm) vmId=`350aed0d-0065-47c3-81db-3ae5dc8dbf53`::Total desktops after destroy of 350aed0d-0065-47c3-81db-3ae5dc8dbf53 is 0
>Thread-598::DEBUG::2014-04-10 19:06:15,344::BindingXMLRPC::982::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}}
>Thread-67::DEBUG::2014-04-10 19:06:18,770::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:18,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509012 s, 723 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:06:20,394::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:20,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395065 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:20,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:20,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370955 s, 1.8 MB/s\n'; <rc> = 0
>Thread-602::DEBUG::2014-04-10 19:06:20,748::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-602::DEBUG::2014-04-10 19:06:20,749::task::579::TaskManager.Task::(_updateState) Task=`d03c6a1b-bec8-4cd3-a302-393147cf6ff7`::moving from state init -> state preparing
>Thread-602::INFO::2014-04-10 19:06:20,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-602::INFO::2014-04-10 19:06:20,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-602::DEBUG::2014-04-10 19:06:20,749::task::1168::TaskManager.Task::(prepare) Task=`d03c6a1b-bec8-4cd3-a302-393147cf6ff7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-602::DEBUG::2014-04-10 19:06:20,750::task::579::TaskManager.Task::(_updateState) Task=`d03c6a1b-bec8-4cd3-a302-393147cf6ff7`::moving from state preparing -> state finished
>Thread-602::DEBUG::2014-04-10 19:06:20,750::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-602::DEBUG::2014-04-10 19:06:20,750::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-602::DEBUG::2014-04-10 19:06:20,750::task::974::TaskManager.Task::(_decref) Task=`d03c6a1b-bec8-4cd3-a302-393147cf6ff7`::ref 0 aborting False
>Thread-603::DEBUG::2014-04-10 19:06:20,758::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-603::DEBUG::2014-04-10 19:06:20,759::task::579::TaskManager.Task::(_updateState) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::moving from state init -> state preparing
>Thread-603::INFO::2014-04-10 19:06:20,759::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-603::DEBUG::2014-04-10 19:06:20,759::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a95b41c-800f-49b1-a4ca-0233cec59510`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-603::DEBUG::2014-04-10 19:06:20,760::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-603::DEBUG::2014-04-10 19:06:20,760::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-603::DEBUG::2014-04-10 19:06:20,760::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3a95b41c-800f-49b1-a4ca-0233cec59510`::Granted request
>Thread-603::DEBUG::2014-04-10 19:06:20,761::task::811::TaskManager.Task::(resourceAcquired) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-603::DEBUG::2014-04-10 19:06:20,761::task::974::TaskManager.Task::(_decref) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::ref 1 aborting False
>Thread-603::INFO::2014-04-10 19:06:20,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-603::DEBUG::2014-04-10 19:06:20,763::task::1168::TaskManager.Task::(prepare) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-603::DEBUG::2014-04-10 19:06:20,764::task::579::TaskManager.Task::(_updateState) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::moving from state preparing -> state finished
>Thread-603::DEBUG::2014-04-10 19:06:20,764::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-603::DEBUG::2014-04-10 19:06:20,764::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-603::DEBUG::2014-04-10 19:06:20,764::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-603::DEBUG::2014-04-10 19:06:20,764::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-603::DEBUG::2014-04-10 19:06:20,764::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-603::DEBUG::2014-04-10 19:06:20,765::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-603::DEBUG::2014-04-10 19:06:20,765::task::974::TaskManager.Task::(_decref) Task=`e1b474f2-3daf-4072-9851-aa01eb7416cc`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:21,943::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:21,951::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000532204 s, 1.2 MB/s\n'; <rc> = 0
>Thread-605::DEBUG::2014-04-10 19:06:24,496::task::579::TaskManager.Task::(_updateState) Task=`b9bc4a92-02d4-4780-a269-72f18c7093e5`::moving from state init -> state preparing
>Thread-605::INFO::2014-04-10 19:06:24,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-605::INFO::2014-04-10 19:06:24,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532204', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370955', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395065', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509012', 'lastCheck': '5.7', 'valid': True}}
>Thread-605::DEBUG::2014-04-10 19:06:24,497::task::1168::TaskManager.Task::(prepare) Task=`b9bc4a92-02d4-4780-a269-72f18c7093e5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532204', 'lastCheck': '2.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370955', 'lastCheck': '4.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395065', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509012', 'lastCheck': '5.7', 'valid': True}}
>Thread-605::DEBUG::2014-04-10 19:06:24,497::task::579::TaskManager.Task::(_updateState) Task=`b9bc4a92-02d4-4780-a269-72f18c7093e5`::moving from state preparing -> state finished
>Thread-605::DEBUG::2014-04-10 19:06:24,498::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-605::DEBUG::2014-04-10 19:06:24,498::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-605::DEBUG::2014-04-10 19:06:24,498::task::974::TaskManager.Task::(_decref) Task=`b9bc4a92-02d4-4780-a269-72f18c7093e5`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:06:28,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:28,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000516849 s, 712 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:06:30,409::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:30,415::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000262177 s, 2.6 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:30,468::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:30,473::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000282251 s, 2.4 MB/s\n'; <rc> = 0
>Thread-609::DEBUG::2014-04-10 19:06:30,856::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-609::DEBUG::2014-04-10 19:06:30,857::task::579::TaskManager.Task::(_updateState) Task=`f081e97f-b475-46e7-a386-f068ad35a1dc`::moving from state init -> state preparing
>Thread-609::INFO::2014-04-10 19:06:30,857::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-609::INFO::2014-04-10 19:06:30,857::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-609::DEBUG::2014-04-10 19:06:30,858::task::1168::TaskManager.Task::(prepare) Task=`f081e97f-b475-46e7-a386-f068ad35a1dc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-609::DEBUG::2014-04-10 19:06:30,858::task::579::TaskManager.Task::(_updateState) Task=`f081e97f-b475-46e7-a386-f068ad35a1dc`::moving from state preparing -> state finished
>Thread-609::DEBUG::2014-04-10 19:06:30,858::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-609::DEBUG::2014-04-10 19:06:30,858::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-609::DEBUG::2014-04-10 19:06:30,858::task::974::TaskManager.Task::(_decref) Task=`f081e97f-b475-46e7-a386-f068ad35a1dc`::ref 0 aborting False
>Thread-610::DEBUG::2014-04-10 19:06:30,867::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-610::DEBUG::2014-04-10 19:06:30,868::task::579::TaskManager.Task::(_updateState) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::moving from state init -> state preparing
>Thread-610::INFO::2014-04-10 19:06:30,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-610::DEBUG::2014-04-10 19:06:30,868::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8adaf940-bc04-411b-b09b-2ad8c41ebb3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-610::DEBUG::2014-04-10 19:06:30,868::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-610::DEBUG::2014-04-10 19:06:30,869::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-610::DEBUG::2014-04-10 19:06:30,869::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8adaf940-bc04-411b-b09b-2ad8c41ebb3b`::Granted request
>Thread-610::DEBUG::2014-04-10 19:06:30,869::task::811::TaskManager.Task::(resourceAcquired) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-610::DEBUG::2014-04-10 19:06:30,869::task::974::TaskManager.Task::(_decref) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::ref 1 aborting False
>Thread-610::INFO::2014-04-10 19:06:30,872::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-610::DEBUG::2014-04-10 19:06:30,872::task::1168::TaskManager.Task::(prepare) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-610::DEBUG::2014-04-10 19:06:30,872::task::579::TaskManager.Task::(_updateState) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::moving from state preparing -> state finished
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-610::DEBUG::2014-04-10 19:06:30,873::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-610::DEBUG::2014-04-10 19:06:30,874::task::974::TaskManager.Task::(_decref) Task=`8d22089f-a28d-4524-b89d-6bca7855cd4d`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:31,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:31,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000460967 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:06:38,803::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:38,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000490756 s, 750 kB/s\n'; <rc> = 0
>Thread-613::DEBUG::2014-04-10 19:06:39,711::task::579::TaskManager.Task::(_updateState) Task=`46be94d4-689b-484e-a76a-c5a1a6abff59`::moving from state init -> state preparing
>Thread-613::INFO::2014-04-10 19:06:39,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-613::INFO::2014-04-10 19:06:39,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460967', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282251', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262177', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490756', 'lastCheck': '0.9', 'valid': True}}
>Thread-613::DEBUG::2014-04-10 19:06:39,711::task::1168::TaskManager.Task::(prepare) Task=`46be94d4-689b-484e-a76a-c5a1a6abff59`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460967', 'lastCheck': '7.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000282251', 'lastCheck': '9.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000262177', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000490756', 'lastCheck': '0.9', 'valid': True}}
>Thread-613::DEBUG::2014-04-10 19:06:39,711::task::579::TaskManager.Task::(_updateState) Task=`46be94d4-689b-484e-a76a-c5a1a6abff59`::moving from state preparing -> state finished
>Thread-613::DEBUG::2014-04-10 19:06:39,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-613::DEBUG::2014-04-10 19:06:39,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-613::DEBUG::2014-04-10 19:06:39,712::task::974::TaskManager.Task::(_decref) Task=`46be94d4-689b-484e-a76a-c5a1a6abff59`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:06:40,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:40,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000326405 s, 2.1 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:40,482::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:40,488::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000348821 s, 1.9 MB/s\n'; <rc> = 0
>Thread-615::DEBUG::2014-04-10 19:06:40,950::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-615::DEBUG::2014-04-10 19:06:40,951::task::579::TaskManager.Task::(_updateState) Task=`5499a8a3-6cf8-4cb6-9cd8-2b5cb0eebed8`::moving from state init -> state preparing
>Thread-615::INFO::2014-04-10 19:06:40,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-615::INFO::2014-04-10 19:06:40,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-615::DEBUG::2014-04-10 19:06:40,951::task::1168::TaskManager.Task::(prepare) Task=`5499a8a3-6cf8-4cb6-9cd8-2b5cb0eebed8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-615::DEBUG::2014-04-10 19:06:40,952::task::579::TaskManager.Task::(_updateState) Task=`5499a8a3-6cf8-4cb6-9cd8-2b5cb0eebed8`::moving from state preparing -> state finished
>Thread-615::DEBUG::2014-04-10 19:06:40,952::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-615::DEBUG::2014-04-10 19:06:40,952::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-615::DEBUG::2014-04-10 19:06:40,952::task::974::TaskManager.Task::(_decref) Task=`5499a8a3-6cf8-4cb6-9cd8-2b5cb0eebed8`::ref 0 aborting False
>Thread-616::DEBUG::2014-04-10 19:06:40,961::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-616::DEBUG::2014-04-10 19:06:40,961::task::579::TaskManager.Task::(_updateState) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::moving from state init -> state preparing
>Thread-616::INFO::2014-04-10 19:06:40,962::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-616::DEBUG::2014-04-10 19:06:40,962::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f35ace1-1910-49ef-9778-88467b6ef6e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-616::DEBUG::2014-04-10 19:06:40,962::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-616::DEBUG::2014-04-10 19:06:40,963::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-616::DEBUG::2014-04-10 19:06:40,963::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f35ace1-1910-49ef-9778-88467b6ef6e1`::Granted request
>Thread-616::DEBUG::2014-04-10 19:06:40,964::task::811::TaskManager.Task::(resourceAcquired) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-616::DEBUG::2014-04-10 19:06:40,964::task::974::TaskManager.Task::(_decref) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::ref 1 aborting False
>Thread-616::INFO::2014-04-10 19:06:40,967::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-616::DEBUG::2014-04-10 19:06:40,967::task::1168::TaskManager.Task::(prepare) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-616::DEBUG::2014-04-10 19:06:40,967::task::579::TaskManager.Task::(_updateState) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::moving from state preparing -> state finished
>Thread-616::DEBUG::2014-04-10 19:06:40,967::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-616::DEBUG::2014-04-10 19:06:40,967::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-616::DEBUG::2014-04-10 19:06:40,968::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-616::DEBUG::2014-04-10 19:06:40,968::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-616::DEBUG::2014-04-10 19:06:40,968::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-616::DEBUG::2014-04-10 19:06:40,968::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-616::DEBUG::2014-04-10 19:06:40,968::task::974::TaskManager.Task::(_decref) Task=`06d638ce-46d7-45a2-b992-ae661c7227ca`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:41,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:41,985::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000547308 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:06:48,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:48,826::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000483851 s, 761 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:06:50,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:06:50,446::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037307 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:06:50,497::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:06:50,502::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320461 s, 2.1 MB/s\n'; <rc> = 0
>Thread-620::DEBUG::2014-04-10 19:06:51,046::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-620::DEBUG::2014-04-10 19:06:51,047::task::579::TaskManager.Task::(_updateState) Task=`6b49859c-f207-48f7-a016-29fc84164795`::moving from state init -> state preparing
>Thread-620::INFO::2014-04-10 19:06:51,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-620::INFO::2014-04-10 19:06:51,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-620::DEBUG::2014-04-10 19:06:51,047::task::1168::TaskManager.Task::(prepare) Task=`6b49859c-f207-48f7-a016-29fc84164795`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-620::DEBUG::2014-04-10 19:06:51,048::task::579::TaskManager.Task::(_updateState) Task=`6b49859c-f207-48f7-a016-29fc84164795`::moving from state preparing -> state finished
>Thread-620::DEBUG::2014-04-10 19:06:51,048::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-620::DEBUG::2014-04-10 19:06:51,048::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-620::DEBUG::2014-04-10 19:06:51,048::task::974::TaskManager.Task::(_decref) Task=`6b49859c-f207-48f7-a016-29fc84164795`::ref 0 aborting False
>Thread-621::DEBUG::2014-04-10 19:06:51,056::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-621::DEBUG::2014-04-10 19:06:51,057::task::579::TaskManager.Task::(_updateState) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::moving from state init -> state preparing
>Thread-621::INFO::2014-04-10 19:06:51,057::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-621::DEBUG::2014-04-10 19:06:51,058::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`11942333-c191-4431-a67a-49785cb667d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-621::DEBUG::2014-04-10 19:06:51,058::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-621::DEBUG::2014-04-10 19:06:51,058::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-621::DEBUG::2014-04-10 19:06:51,058::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`11942333-c191-4431-a67a-49785cb667d5`::Granted request
>Thread-621::DEBUG::2014-04-10 19:06:51,059::task::811::TaskManager.Task::(resourceAcquired) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-621::DEBUG::2014-04-10 19:06:51,059::task::974::TaskManager.Task::(_decref) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::ref 1 aborting False
>Thread-621::INFO::2014-04-10 19:06:51,061::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-621::DEBUG::2014-04-10 19:06:51,061::task::1168::TaskManager.Task::(prepare) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-621::DEBUG::2014-04-10 19:06:51,061::task::579::TaskManager.Task::(_updateState) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::moving from state preparing -> state finished
>Thread-621::DEBUG::2014-04-10 19:06:51,062::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-621::DEBUG::2014-04-10 19:06:51,062::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-621::DEBUG::2014-04-10 19:06:51,062::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-621::DEBUG::2014-04-10 19:06:51,062::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-621::DEBUG::2014-04-10 19:06:51,062::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-621::DEBUG::2014-04-10 19:06:51,063::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-621::DEBUG::2014-04-10 19:06:51,063::task::974::TaskManager.Task::(_decref) Task=`4f3a522e-6499-4b86-aee6-3c214fb49030`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:06:51,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:06:51,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000431108 s, 1.5 MB/s\n'; <rc> = 0
>Thread-623::DEBUG::2014-04-10 19:06:55,028::task::579::TaskManager.Task::(_updateState) Task=`018f4a72-9ab2-4557-8a9f-60e890634c59`::moving from state init -> state preparing
>Thread-623::INFO::2014-04-10 19:06:55,029::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-623::INFO::2014-04-10 19:06:55,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431108', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320461', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037307', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483851', 'lastCheck': '6.2', 'valid': True}}
>Thread-623::DEBUG::2014-04-10 19:06:55,029::task::1168::TaskManager.Task::(prepare) Task=`018f4a72-9ab2-4557-8a9f-60e890634c59`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431108', 'lastCheck': '3.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320461', 'lastCheck': '4.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037307', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483851', 'lastCheck': '6.2', 'valid': True}}
>Thread-623::DEBUG::2014-04-10 19:06:55,029::task::579::TaskManager.Task::(_updateState) Task=`018f4a72-9ab2-4557-8a9f-60e890634c59`::moving from state preparing -> state finished
>Thread-623::DEBUG::2014-04-10 19:06:55,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-623::DEBUG::2014-04-10 19:06:55,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-623::DEBUG::2014-04-10 19:06:55,030::task::974::TaskManager.Task::(_decref) Task=`018f4a72-9ab2-4557-8a9f-60e890634c59`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:06:58,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:06:58,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000484679 s, 759 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:07:00,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:00,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000352079 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:00,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:00,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000319766 s, 2.1 MB/s\n'; <rc> = 0
>Thread-627::DEBUG::2014-04-10 19:07:01,151::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-627::DEBUG::2014-04-10 19:07:01,152::task::579::TaskManager.Task::(_updateState) Task=`874b3719-4f45-4b42-95f0-01893de83633`::moving from state init -> state preparing
>Thread-627::INFO::2014-04-10 19:07:01,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-627::INFO::2014-04-10 19:07:01,152::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-627::DEBUG::2014-04-10 19:07:01,153::task::1168::TaskManager.Task::(prepare) Task=`874b3719-4f45-4b42-95f0-01893de83633`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-627::DEBUG::2014-04-10 19:07:01,153::task::579::TaskManager.Task::(_updateState) Task=`874b3719-4f45-4b42-95f0-01893de83633`::moving from state preparing -> state finished
>Thread-627::DEBUG::2014-04-10 19:07:01,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-627::DEBUG::2014-04-10 19:07:01,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-627::DEBUG::2014-04-10 19:07:01,153::task::974::TaskManager.Task::(_decref) Task=`874b3719-4f45-4b42-95f0-01893de83633`::ref 0 aborting False
>Thread-628::DEBUG::2014-04-10 19:07:01,162::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-628::DEBUG::2014-04-10 19:07:01,163::task::579::TaskManager.Task::(_updateState) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::moving from state init -> state preparing
>Thread-628::INFO::2014-04-10 19:07:01,163::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-628::DEBUG::2014-04-10 19:07:01,163::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c6e75be2-33a0-4f29-9228-22c9c9147267`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-628::DEBUG::2014-04-10 19:07:01,163::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-628::DEBUG::2014-04-10 19:07:01,164::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-628::DEBUG::2014-04-10 19:07:01,164::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c6e75be2-33a0-4f29-9228-22c9c9147267`::Granted request
>Thread-628::DEBUG::2014-04-10 19:07:01,164::task::811::TaskManager.Task::(resourceAcquired) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-628::DEBUG::2014-04-10 19:07:01,164::task::974::TaskManager.Task::(_decref) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::ref 1 aborting False
>Thread-628::INFO::2014-04-10 19:07:01,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-628::DEBUG::2014-04-10 19:07:01,167::task::1168::TaskManager.Task::(prepare) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-628::DEBUG::2014-04-10 19:07:01,167::task::579::TaskManager.Task::(_updateState) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::moving from state preparing -> state finished
>Thread-628::DEBUG::2014-04-10 19:07:01,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-628::DEBUG::2014-04-10 19:07:01,168::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-628::DEBUG::2014-04-10 19:07:01,168::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-628::DEBUG::2014-04-10 19:07:01,168::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-628::DEBUG::2014-04-10 19:07:01,168::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-628::DEBUG::2014-04-10 19:07:01,168::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-628::DEBUG::2014-04-10 19:07:01,169::task::974::TaskManager.Task::(_decref) Task=`a785a720-996d-4c99-ab47-b0f14462af16`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:02,008::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:02,014::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000523346 s, 1.3 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:07:08,850::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:08,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474133 s, 776 kB/s\n'; <rc> = 0
>Thread-631::DEBUG::2014-04-10 19:07:10,213::task::579::TaskManager.Task::(_updateState) Task=`553a493e-7340-4828-82ea-671c82846c14`::moving from state init -> state preparing
>Thread-631::INFO::2014-04-10 19:07:10,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-631::INFO::2014-04-10 19:07:10,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523346', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319766', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352079', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474133', 'lastCheck': '1.4', 'valid': True}}
>Thread-631::DEBUG::2014-04-10 19:07:10,213::task::1168::TaskManager.Task::(prepare) Task=`553a493e-7340-4828-82ea-671c82846c14`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523346', 'lastCheck': '8.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319766', 'lastCheck': '9.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000352079', 'lastCheck': '9.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474133', 'lastCheck': '1.4', 'valid': True}}
>Thread-631::DEBUG::2014-04-10 19:07:10,214::task::579::TaskManager.Task::(_updateState) Task=`553a493e-7340-4828-82ea-671c82846c14`::moving from state preparing -> state finished
>Thread-631::DEBUG::2014-04-10 19:07:10,214::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-631::DEBUG::2014-04-10 19:07:10,214::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-631::DEBUG::2014-04-10 19:07:10,214::task::974::TaskManager.Task::(_decref) Task=`553a493e-7340-4828-82ea-671c82846c14`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:07:10,477::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:10,484::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358788 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:10,523::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:10,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032685 s, 2.1 MB/s\n'; <rc> = 0
>Thread-633::DEBUG::2014-04-10 19:07:11,251::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-633::DEBUG::2014-04-10 19:07:11,252::task::579::TaskManager.Task::(_updateState) Task=`fe2ae443-0758-4c6d-8bfe-93783f9bf265`::moving from state init -> state preparing
>Thread-633::INFO::2014-04-10 19:07:11,252::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-633::INFO::2014-04-10 19:07:11,252::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-633::DEBUG::2014-04-10 19:07:11,253::task::1168::TaskManager.Task::(prepare) Task=`fe2ae443-0758-4c6d-8bfe-93783f9bf265`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-633::DEBUG::2014-04-10 19:07:11,253::task::579::TaskManager.Task::(_updateState) Task=`fe2ae443-0758-4c6d-8bfe-93783f9bf265`::moving from state preparing -> state finished
>Thread-633::DEBUG::2014-04-10 19:07:11,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-633::DEBUG::2014-04-10 19:07:11,253::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-633::DEBUG::2014-04-10 19:07:11,253::task::974::TaskManager.Task::(_decref) Task=`fe2ae443-0758-4c6d-8bfe-93783f9bf265`::ref 0 aborting False
>Thread-634::DEBUG::2014-04-10 19:07:11,262::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-634::DEBUG::2014-04-10 19:07:11,262::task::579::TaskManager.Task::(_updateState) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::moving from state init -> state preparing
>Thread-634::INFO::2014-04-10 19:07:11,262::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-634::DEBUG::2014-04-10 19:07:11,263::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5cb862b9-14b5-4d39-a955-3b4d8f41a38d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-634::DEBUG::2014-04-10 19:07:11,263::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-634::DEBUG::2014-04-10 19:07:11,263::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-634::DEBUG::2014-04-10 19:07:11,263::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5cb862b9-14b5-4d39-a955-3b4d8f41a38d`::Granted request
>Thread-634::DEBUG::2014-04-10 19:07:11,264::task::811::TaskManager.Task::(resourceAcquired) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-634::DEBUG::2014-04-10 19:07:11,264::task::974::TaskManager.Task::(_decref) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::ref 1 aborting False
>Thread-634::INFO::2014-04-10 19:07:11,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-634::DEBUG::2014-04-10 19:07:11,266::task::1168::TaskManager.Task::(prepare) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-634::DEBUG::2014-04-10 19:07:11,267::task::579::TaskManager.Task::(_updateState) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::moving from state preparing -> state finished
>Thread-634::DEBUG::2014-04-10 19:07:11,267::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-634::DEBUG::2014-04-10 19:07:11,267::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-634::DEBUG::2014-04-10 19:07:11,267::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-634::DEBUG::2014-04-10 19:07:11,267::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-634::DEBUG::2014-04-10 19:07:11,268::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-634::DEBUG::2014-04-10 19:07:11,268::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-634::DEBUG::2014-04-10 19:07:11,268::task::974::TaskManager.Task::(_decref) Task=`d5e4bb8a-30e1-4932-a908-03603ad1442d`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:12,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:12,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000567345 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:07:18,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:18,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000430339 s, 855 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:07:20,493::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:20,500::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000360847 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:20,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:20,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333972 s, 2.0 MB/s\n'; <rc> = 0
>Thread-638::DEBUG::2014-04-10 19:07:21,367::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-638::DEBUG::2014-04-10 19:07:21,372::task::579::TaskManager.Task::(_updateState) Task=`8a5db2e0-b3d4-4890-92ea-e42abdc5612f`::moving from state init -> state preparing
>Thread-638::INFO::2014-04-10 19:07:21,372::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-638::INFO::2014-04-10 19:07:21,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-638::DEBUG::2014-04-10 19:07:21,372::task::1168::TaskManager.Task::(prepare) Task=`8a5db2e0-b3d4-4890-92ea-e42abdc5612f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-638::DEBUG::2014-04-10 19:07:21,373::task::579::TaskManager.Task::(_updateState) Task=`8a5db2e0-b3d4-4890-92ea-e42abdc5612f`::moving from state preparing -> state finished
>Thread-638::DEBUG::2014-04-10 19:07:21,373::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-638::DEBUG::2014-04-10 19:07:21,373::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-638::DEBUG::2014-04-10 19:07:21,373::task::974::TaskManager.Task::(_decref) Task=`8a5db2e0-b3d4-4890-92ea-e42abdc5612f`::ref 0 aborting False
>Thread-639::DEBUG::2014-04-10 19:07:21,382::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-639::DEBUG::2014-04-10 19:07:21,382::task::579::TaskManager.Task::(_updateState) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::moving from state init -> state preparing
>Thread-639::INFO::2014-04-10 19:07:21,382::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-639::DEBUG::2014-04-10 19:07:21,383::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e5c7fa3-0ec2-4542-9432-4c03d03a59ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-639::DEBUG::2014-04-10 19:07:21,383::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-639::DEBUG::2014-04-10 19:07:21,383::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-639::DEBUG::2014-04-10 19:07:21,383::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0e5c7fa3-0ec2-4542-9432-4c03d03a59ae`::Granted request
>Thread-639::DEBUG::2014-04-10 19:07:21,385::task::811::TaskManager.Task::(resourceAcquired) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-639::DEBUG::2014-04-10 19:07:21,385::task::974::TaskManager.Task::(_decref) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::ref 1 aborting False
>Thread-639::INFO::2014-04-10 19:07:21,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-639::DEBUG::2014-04-10 19:07:21,387::task::1168::TaskManager.Task::(prepare) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-639::DEBUG::2014-04-10 19:07:21,388::task::579::TaskManager.Task::(_updateState) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::moving from state preparing -> state finished
>Thread-639::DEBUG::2014-04-10 19:07:21,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-639::DEBUG::2014-04-10 19:07:21,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-639::DEBUG::2014-04-10 19:07:21,388::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-639::DEBUG::2014-04-10 19:07:21,388::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-639::DEBUG::2014-04-10 19:07:21,389::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-639::DEBUG::2014-04-10 19:07:21,389::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-639::DEBUG::2014-04-10 19:07:21,389::task::974::TaskManager.Task::(_decref) Task=`61d9d24a-d4fd-4f12-b941-75a00df0f035`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:22,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:22,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000518348 s, 1.3 MB/s\n'; <rc> = 0
>Thread-641::DEBUG::2014-04-10 19:07:25,401::task::579::TaskManager.Task::(_updateState) Task=`eb94fc5d-12da-4679-8a19-a6d09d107606`::moving from state init -> state preparing
>Thread-641::INFO::2014-04-10 19:07:25,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-641::INFO::2014-04-10 19:07:25,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518348', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333972', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360847', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430339', 'lastCheck': '6.5', 'valid': True}}
>Thread-641::DEBUG::2014-04-10 19:07:25,402::task::1168::TaskManager.Task::(prepare) Task=`eb94fc5d-12da-4679-8a19-a6d09d107606`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518348', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333972', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360847', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430339', 'lastCheck': '6.5', 'valid': True}}
>Thread-641::DEBUG::2014-04-10 19:07:25,402::task::579::TaskManager.Task::(_updateState) Task=`eb94fc5d-12da-4679-8a19-a6d09d107606`::moving from state preparing -> state finished
>Thread-641::DEBUG::2014-04-10 19:07:25,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-641::DEBUG::2014-04-10 19:07:25,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-641::DEBUG::2014-04-10 19:07:25,403::task::974::TaskManager.Task::(_decref) Task=`eb94fc5d-12da-4679-8a19-a6d09d107606`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:07:28,880::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:28,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474356 s, 776 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:07:30,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:30,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295879 s, 2.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:30,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:30,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370685 s, 1.8 MB/s\n'; <rc> = 0
>Thread-644::DEBUG::2014-04-10 19:07:31,485::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-644::DEBUG::2014-04-10 19:07:31,486::task::579::TaskManager.Task::(_updateState) Task=`9e355c0a-2f70-4397-8ca4-dff1be532f87`::moving from state init -> state preparing
>Thread-644::INFO::2014-04-10 19:07:31,486::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-644::INFO::2014-04-10 19:07:31,487::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-644::DEBUG::2014-04-10 19:07:31,487::task::1168::TaskManager.Task::(prepare) Task=`9e355c0a-2f70-4397-8ca4-dff1be532f87`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-644::DEBUG::2014-04-10 19:07:31,487::task::579::TaskManager.Task::(_updateState) Task=`9e355c0a-2f70-4397-8ca4-dff1be532f87`::moving from state preparing -> state finished
>Thread-644::DEBUG::2014-04-10 19:07:31,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-644::DEBUG::2014-04-10 19:07:31,487::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-644::DEBUG::2014-04-10 19:07:31,487::task::974::TaskManager.Task::(_decref) Task=`9e355c0a-2f70-4397-8ca4-dff1be532f87`::ref 0 aborting False
>Thread-645::DEBUG::2014-04-10 19:07:31,496::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-645::DEBUG::2014-04-10 19:07:31,496::task::579::TaskManager.Task::(_updateState) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::moving from state init -> state preparing
>Thread-645::INFO::2014-04-10 19:07:31,497::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-645::DEBUG::2014-04-10 19:07:31,497::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`960ac541-0598-4d29-a952-c0d03dd2ecd9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-645::DEBUG::2014-04-10 19:07:31,497::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-645::DEBUG::2014-04-10 19:07:31,498::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-645::DEBUG::2014-04-10 19:07:31,498::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`960ac541-0598-4d29-a952-c0d03dd2ecd9`::Granted request
>Thread-645::DEBUG::2014-04-10 19:07:31,498::task::811::TaskManager.Task::(resourceAcquired) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-645::DEBUG::2014-04-10 19:07:31,498::task::974::TaskManager.Task::(_decref) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::ref 1 aborting False
>Thread-645::INFO::2014-04-10 19:07:31,501::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-645::DEBUG::2014-04-10 19:07:31,501::task::1168::TaskManager.Task::(prepare) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-645::DEBUG::2014-04-10 19:07:31,501::task::579::TaskManager.Task::(_updateState) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::moving from state preparing -> state finished
>Thread-645::DEBUG::2014-04-10 19:07:31,501::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-645::DEBUG::2014-04-10 19:07:31,501::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-645::DEBUG::2014-04-10 19:07:31,502::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-645::DEBUG::2014-04-10 19:07:31,502::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-645::DEBUG::2014-04-10 19:07:31,502::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-645::DEBUG::2014-04-10 19:07:31,502::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-645::DEBUG::2014-04-10 19:07:31,502::task::974::TaskManager.Task::(_decref) Task=`aeadebf0-ef3d-4c6c-a833-eaaa878414b2`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:32,055::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:32,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000460267 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:07:38,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:38,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000448157 s, 821 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:07:40,524::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:40,531::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000387493 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:40,565::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:40,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000369441 s, 1.8 MB/s\n'; <rc> = 0
>Thread-649::DEBUG::2014-04-10 19:07:40,603::task::579::TaskManager.Task::(_updateState) Task=`8d832fd0-f190-4567-8ff0-ccf396af65ab`::moving from state init -> state preparing
>Thread-649::INFO::2014-04-10 19:07:40,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-649::INFO::2014-04-10 19:07:40,604::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460267', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369441', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387493', 'lastCheck': '0.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448157', 'lastCheck': '1.7', 'valid': True}}
>Thread-649::DEBUG::2014-04-10 19:07:40,604::task::1168::TaskManager.Task::(prepare) Task=`8d832fd0-f190-4567-8ff0-ccf396af65ab`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460267', 'lastCheck': '8.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369441', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387493', 'lastCheck': '0.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448157', 'lastCheck': '1.7', 'valid': True}}
>Thread-649::DEBUG::2014-04-10 19:07:40,604::task::579::TaskManager.Task::(_updateState) Task=`8d832fd0-f190-4567-8ff0-ccf396af65ab`::moving from state preparing -> state finished
>Thread-649::DEBUG::2014-04-10 19:07:40,604::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-649::DEBUG::2014-04-10 19:07:40,604::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-649::DEBUG::2014-04-10 19:07:40,605::task::974::TaskManager.Task::(_decref) Task=`8d832fd0-f190-4567-8ff0-ccf396af65ab`::ref 0 aborting False
>Thread-651::DEBUG::2014-04-10 19:07:41,583::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-651::DEBUG::2014-04-10 19:07:41,583::task::579::TaskManager.Task::(_updateState) Task=`45675e98-b693-463f-8e71-4c5f8013d22d`::moving from state init -> state preparing
>Thread-651::INFO::2014-04-10 19:07:41,583::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-651::INFO::2014-04-10 19:07:41,584::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-651::DEBUG::2014-04-10 19:07:41,584::task::1168::TaskManager.Task::(prepare) Task=`45675e98-b693-463f-8e71-4c5f8013d22d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-651::DEBUG::2014-04-10 19:07:41,584::task::579::TaskManager.Task::(_updateState) Task=`45675e98-b693-463f-8e71-4c5f8013d22d`::moving from state preparing -> state finished
>Thread-651::DEBUG::2014-04-10 19:07:41,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-651::DEBUG::2014-04-10 19:07:41,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-651::DEBUG::2014-04-10 19:07:41,585::task::974::TaskManager.Task::(_decref) Task=`45675e98-b693-463f-8e71-4c5f8013d22d`::ref 0 aborting False
>Thread-652::DEBUG::2014-04-10 19:07:41,593::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-652::DEBUG::2014-04-10 19:07:41,593::task::579::TaskManager.Task::(_updateState) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::moving from state init -> state preparing
>Thread-652::INFO::2014-04-10 19:07:41,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-652::DEBUG::2014-04-10 19:07:41,594::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d8b3722-c2d7-4337-b6d2-71c14653bb31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-652::DEBUG::2014-04-10 19:07:41,594::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-652::DEBUG::2014-04-10 19:07:41,594::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-652::DEBUG::2014-04-10 19:07:41,594::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d8b3722-c2d7-4337-b6d2-71c14653bb31`::Granted request
>Thread-652::DEBUG::2014-04-10 19:07:41,595::task::811::TaskManager.Task::(resourceAcquired) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-652::DEBUG::2014-04-10 19:07:41,595::task::974::TaskManager.Task::(_decref) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::ref 1 aborting False
>Thread-652::INFO::2014-04-10 19:07:41,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-652::DEBUG::2014-04-10 19:07:41,597::task::1168::TaskManager.Task::(prepare) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-652::DEBUG::2014-04-10 19:07:41,598::task::579::TaskManager.Task::(_updateState) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::moving from state preparing -> state finished
>Thread-652::DEBUG::2014-04-10 19:07:41,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-652::DEBUG::2014-04-10 19:07:41,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-652::DEBUG::2014-04-10 19:07:41,598::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-652::DEBUG::2014-04-10 19:07:41,599::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-652::DEBUG::2014-04-10 19:07:41,599::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-652::DEBUG::2014-04-10 19:07:41,599::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-652::DEBUG::2014-04-10 19:07:41,599::task::974::TaskManager.Task::(_decref) Task=`1496e40c-88ef-4d0a-8b4d-afb79ebece4e`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:42,073::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:42,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000433771 s, 1.5 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:07:48,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:48,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00054429 s, 676 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:07:50,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:07:50,547::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000359563 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:07:50,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:07:50,586::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341535 s, 2.0 MB/s\n'; <rc> = 0
>Thread-656::DEBUG::2014-04-10 19:07:51,673::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-656::DEBUG::2014-04-10 19:07:51,674::task::579::TaskManager.Task::(_updateState) Task=`4c7e676d-e06e-4c8e-938b-5da4eb488bbc`::moving from state init -> state preparing
>Thread-656::INFO::2014-04-10 19:07:51,674::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-656::INFO::2014-04-10 19:07:51,675::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-656::DEBUG::2014-04-10 19:07:51,675::task::1168::TaskManager.Task::(prepare) Task=`4c7e676d-e06e-4c8e-938b-5da4eb488bbc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-656::DEBUG::2014-04-10 19:07:51,675::task::579::TaskManager.Task::(_updateState) Task=`4c7e676d-e06e-4c8e-938b-5da4eb488bbc`::moving from state preparing -> state finished
>Thread-656::DEBUG::2014-04-10 19:07:51,675::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-656::DEBUG::2014-04-10 19:07:51,675::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-656::DEBUG::2014-04-10 19:07:51,675::task::974::TaskManager.Task::(_decref) Task=`4c7e676d-e06e-4c8e-938b-5da4eb488bbc`::ref 0 aborting False
>Thread-657::DEBUG::2014-04-10 19:07:51,683::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-657::DEBUG::2014-04-10 19:07:51,684::task::579::TaskManager.Task::(_updateState) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::moving from state init -> state preparing
>Thread-657::INFO::2014-04-10 19:07:51,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-657::DEBUG::2014-04-10 19:07:51,684::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f1e2809-e018-4625-be94-e05e42e424cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-657::DEBUG::2014-04-10 19:07:51,685::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-657::DEBUG::2014-04-10 19:07:51,685::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-657::DEBUG::2014-04-10 19:07:51,685::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9f1e2809-e018-4625-be94-e05e42e424cb`::Granted request
>Thread-657::DEBUG::2014-04-10 19:07:51,685::task::811::TaskManager.Task::(resourceAcquired) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-657::DEBUG::2014-04-10 19:07:51,685::task::974::TaskManager.Task::(_decref) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::ref 1 aborting False
>Thread-657::INFO::2014-04-10 19:07:51,687::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-657::DEBUG::2014-04-10 19:07:51,687::task::1168::TaskManager.Task::(prepare) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-657::DEBUG::2014-04-10 19:07:51,688::task::579::TaskManager.Task::(_updateState) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::moving from state preparing -> state finished
>Thread-657::DEBUG::2014-04-10 19:07:51,688::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-657::DEBUG::2014-04-10 19:07:51,688::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-657::DEBUG::2014-04-10 19:07:51,688::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-657::DEBUG::2014-04-10 19:07:51,688::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-657::DEBUG::2014-04-10 19:07:51,689::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-657::DEBUG::2014-04-10 19:07:51,689::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-657::DEBUG::2014-04-10 19:07:51,689::task::974::TaskManager.Task::(_decref) Task=`dbf93d30-41ff-473f-ad1c-9ce33be6abff`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:07:52,088::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:07:52,094::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000360083 s, 1.8 MB/s\n'; <rc> = 0
>Thread-659::DEBUG::2014-04-10 19:07:55,888::task::579::TaskManager.Task::(_updateState) Task=`270165fe-e0db-462e-8ace-21cb9c33ec91`::moving from state init -> state preparing
>Thread-659::INFO::2014-04-10 19:07:55,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-659::INFO::2014-04-10 19:07:55,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360083', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341535', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359563', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054429', 'lastCheck': '7.0', 'valid': True}}
>Thread-659::DEBUG::2014-04-10 19:07:55,889::task::1168::TaskManager.Task::(prepare) Task=`270165fe-e0db-462e-8ace-21cb9c33ec91`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360083', 'lastCheck': '3.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341535', 'lastCheck': '5.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359563', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00054429', 'lastCheck': '7.0', 'valid': True}}
>Thread-659::DEBUG::2014-04-10 19:07:55,889::task::579::TaskManager.Task::(_updateState) Task=`270165fe-e0db-462e-8ace-21cb9c33ec91`::moving from state preparing -> state finished
>Thread-659::DEBUG::2014-04-10 19:07:55,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-659::DEBUG::2014-04-10 19:07:55,889::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-659::DEBUG::2014-04-10 19:07:55,889::task::974::TaskManager.Task::(_decref) Task=`270165fe-e0db-462e-8ace-21cb9c33ec91`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:07:58,926::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:07:58,932::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000517424 s, 711 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:00,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:00,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000371823 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:00,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:00,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000248758 s, 2.7 MB/s\n'; <rc> = 0
>Thread-662::DEBUG::2014-04-10 19:08:01,773::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-662::DEBUG::2014-04-10 19:08:01,774::task::579::TaskManager.Task::(_updateState) Task=`1eeee32d-9650-4f0b-931f-737670f59ab1`::moving from state init -> state preparing
>Thread-662::INFO::2014-04-10 19:08:01,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-662::INFO::2014-04-10 19:08:01,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-662::DEBUG::2014-04-10 19:08:01,774::task::1168::TaskManager.Task::(prepare) Task=`1eeee32d-9650-4f0b-931f-737670f59ab1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-662::DEBUG::2014-04-10 19:08:01,775::task::579::TaskManager.Task::(_updateState) Task=`1eeee32d-9650-4f0b-931f-737670f59ab1`::moving from state preparing -> state finished
>Thread-662::DEBUG::2014-04-10 19:08:01,775::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-662::DEBUG::2014-04-10 19:08:01,775::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-662::DEBUG::2014-04-10 19:08:01,775::task::974::TaskManager.Task::(_decref) Task=`1eeee32d-9650-4f0b-931f-737670f59ab1`::ref 0 aborting False
>Thread-663::DEBUG::2014-04-10 19:08:01,784::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-663::DEBUG::2014-04-10 19:08:01,784::task::579::TaskManager.Task::(_updateState) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::moving from state init -> state preparing
>Thread-663::INFO::2014-04-10 19:08:01,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-663::DEBUG::2014-04-10 19:08:01,785::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b06f9aeb-f858-4c03-a368-110767d85d74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-663::DEBUG::2014-04-10 19:08:01,785::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-663::DEBUG::2014-04-10 19:08:01,785::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-663::DEBUG::2014-04-10 19:08:01,785::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b06f9aeb-f858-4c03-a368-110767d85d74`::Granted request
>Thread-663::DEBUG::2014-04-10 19:08:01,787::task::811::TaskManager.Task::(resourceAcquired) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-663::DEBUG::2014-04-10 19:08:01,787::task::974::TaskManager.Task::(_decref) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::ref 1 aborting False
>Thread-663::INFO::2014-04-10 19:08:01,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-663::DEBUG::2014-04-10 19:08:01,790::task::1168::TaskManager.Task::(prepare) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-663::DEBUG::2014-04-10 19:08:01,790::task::579::TaskManager.Task::(_updateState) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::moving from state preparing -> state finished
>Thread-663::DEBUG::2014-04-10 19:08:01,790::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-663::DEBUG::2014-04-10 19:08:01,790::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-663::DEBUG::2014-04-10 19:08:01,790::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-663::DEBUG::2014-04-10 19:08:01,791::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-663::DEBUG::2014-04-10 19:08:01,791::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-663::DEBUG::2014-04-10 19:08:01,791::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-663::DEBUG::2014-04-10 19:08:01,791::task::974::TaskManager.Task::(_decref) Task=`dffc070b-1e3b-4e70-8cae-f536c3ce104e`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:08:02,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:02,109::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000432725 s, 1.5 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:08:08,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:08,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000525257 s, 701 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:10,568::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:10,574::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379926 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:10,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:10,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260141 s, 2.6 MB/s\n'; <rc> = 0
>Thread-667::DEBUG::2014-04-10 19:08:11,080::task::579::TaskManager.Task::(_updateState) Task=`cc54d2ac-cca7-414c-9a70-8b311f0a2810`::moving from state init -> state preparing
>Thread-667::INFO::2014-04-10 19:08:11,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-667::INFO::2014-04-10 19:08:11,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432725', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260141', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379926', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525257', 'lastCheck': '2.1', 'valid': True}}
>Thread-667::DEBUG::2014-04-10 19:08:11,080::task::1168::TaskManager.Task::(prepare) Task=`cc54d2ac-cca7-414c-9a70-8b311f0a2810`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432725', 'lastCheck': '9.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260141', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379926', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525257', 'lastCheck': '2.1', 'valid': True}}
>Thread-667::DEBUG::2014-04-10 19:08:11,081::task::579::TaskManager.Task::(_updateState) Task=`cc54d2ac-cca7-414c-9a70-8b311f0a2810`::moving from state preparing -> state finished
>Thread-667::DEBUG::2014-04-10 19:08:11,081::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-667::DEBUG::2014-04-10 19:08:11,081::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-667::DEBUG::2014-04-10 19:08:11,081::task::974::TaskManager.Task::(_decref) Task=`cc54d2ac-cca7-414c-9a70-8b311f0a2810`::ref 0 aborting False
>Thread-669::DEBUG::2014-04-10 19:08:11,871::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-669::DEBUG::2014-04-10 19:08:11,871::task::579::TaskManager.Task::(_updateState) Task=`88a3286e-d100-4323-b9b8-6f31a1036b4a`::moving from state init -> state preparing
>Thread-669::INFO::2014-04-10 19:08:11,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-669::INFO::2014-04-10 19:08:11,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-669::DEBUG::2014-04-10 19:08:11,872::task::1168::TaskManager.Task::(prepare) Task=`88a3286e-d100-4323-b9b8-6f31a1036b4a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-669::DEBUG::2014-04-10 19:08:11,872::task::579::TaskManager.Task::(_updateState) Task=`88a3286e-d100-4323-b9b8-6f31a1036b4a`::moving from state preparing -> state finished
>Thread-669::DEBUG::2014-04-10 19:08:11,872::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-669::DEBUG::2014-04-10 19:08:11,872::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-669::DEBUG::2014-04-10 19:08:11,872::task::974::TaskManager.Task::(_decref) Task=`88a3286e-d100-4323-b9b8-6f31a1036b4a`::ref 0 aborting False
>Thread-670::DEBUG::2014-04-10 19:08:11,881::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-670::DEBUG::2014-04-10 19:08:11,881::task::579::TaskManager.Task::(_updateState) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::moving from state init -> state preparing
>Thread-670::INFO::2014-04-10 19:08:11,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-670::DEBUG::2014-04-10 19:08:11,882::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2dce36b8-c177-4c21-8c44-2cecbff6cf32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-670::DEBUG::2014-04-10 19:08:11,882::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-670::DEBUG::2014-04-10 19:08:11,882::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-670::DEBUG::2014-04-10 19:08:11,883::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2dce36b8-c177-4c21-8c44-2cecbff6cf32`::Granted request
>Thread-670::DEBUG::2014-04-10 19:08:11,883::task::811::TaskManager.Task::(resourceAcquired) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-670::DEBUG::2014-04-10 19:08:11,883::task::974::TaskManager.Task::(_decref) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::ref 1 aborting False
>Thread-670::INFO::2014-04-10 19:08:11,885::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-670::DEBUG::2014-04-10 19:08:11,886::task::1168::TaskManager.Task::(prepare) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-670::DEBUG::2014-04-10 19:08:11,886::task::579::TaskManager.Task::(_updateState) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::moving from state preparing -> state finished
>Thread-670::DEBUG::2014-04-10 19:08:11,886::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-670::DEBUG::2014-04-10 19:08:11,886::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-670::DEBUG::2014-04-10 19:08:11,886::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-670::DEBUG::2014-04-10 19:08:11,887::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-670::DEBUG::2014-04-10 19:08:11,887::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-670::DEBUG::2014-04-10 19:08:11,887::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-670::DEBUG::2014-04-10 19:08:11,887::task::974::TaskManager.Task::(_decref) Task=`ca0f2084-4a1e-44de-8abf-abb7383ccef9`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:08:12,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:12,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000481416 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:08:18,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:18,962::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000504034 s, 730 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:20,583::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:20,589::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376451 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:20,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:20,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028076 s, 2.4 MB/s\n'; <rc> = 0
>Thread-674::DEBUG::2014-04-10 19:08:21,961::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-674::DEBUG::2014-04-10 19:08:21,961::task::579::TaskManager.Task::(_updateState) Task=`c3375cc6-e958-4e37-b23c-24d3293ae370`::moving from state init -> state preparing
>Thread-674::INFO::2014-04-10 19:08:21,962::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-674::INFO::2014-04-10 19:08:21,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-674::DEBUG::2014-04-10 19:08:21,962::task::1168::TaskManager.Task::(prepare) Task=`c3375cc6-e958-4e37-b23c-24d3293ae370`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-674::DEBUG::2014-04-10 19:08:21,962::task::579::TaskManager.Task::(_updateState) Task=`c3375cc6-e958-4e37-b23c-24d3293ae370`::moving from state preparing -> state finished
>Thread-674::DEBUG::2014-04-10 19:08:21,963::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-674::DEBUG::2014-04-10 19:08:21,963::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-674::DEBUG::2014-04-10 19:08:21,963::task::974::TaskManager.Task::(_decref) Task=`c3375cc6-e958-4e37-b23c-24d3293ae370`::ref 0 aborting False
>Thread-675::DEBUG::2014-04-10 19:08:21,972::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-675::DEBUG::2014-04-10 19:08:21,973::task::579::TaskManager.Task::(_updateState) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::moving from state init -> state preparing
>Thread-675::INFO::2014-04-10 19:08:21,973::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-675::DEBUG::2014-04-10 19:08:21,973::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`844845ab-5cc4-4e9c-9487-b7b43930ce42`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-675::DEBUG::2014-04-10 19:08:21,974::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-675::DEBUG::2014-04-10 19:08:21,974::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-675::DEBUG::2014-04-10 19:08:21,974::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`844845ab-5cc4-4e9c-9487-b7b43930ce42`::Granted request
>Thread-675::DEBUG::2014-04-10 19:08:21,974::task::811::TaskManager.Task::(resourceAcquired) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-675::DEBUG::2014-04-10 19:08:21,974::task::974::TaskManager.Task::(_decref) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::ref 1 aborting False
>Thread-675::INFO::2014-04-10 19:08:21,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-675::DEBUG::2014-04-10 19:08:21,977::task::1168::TaskManager.Task::(prepare) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-675::DEBUG::2014-04-10 19:08:21,977::task::579::TaskManager.Task::(_updateState) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::moving from state preparing -> state finished
>Thread-675::DEBUG::2014-04-10 19:08:21,977::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-675::DEBUG::2014-04-10 19:08:21,977::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-675::DEBUG::2014-04-10 19:08:21,977::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-675::DEBUG::2014-04-10 19:08:21,978::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-675::DEBUG::2014-04-10 19:08:21,978::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-675::DEBUG::2014-04-10 19:08:21,978::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-675::DEBUG::2014-04-10 19:08:21,978::task::974::TaskManager.Task::(_decref) Task=`6349f80c-8c82-429a-83b0-835651f2aac5`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:08:22,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:22,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000543412 s, 1.2 MB/s\n'; <rc> = 0
>Thread-677::DEBUG::2014-04-10 19:08:26,298::task::579::TaskManager.Task::(_updateState) Task=`8a238fb1-3d47-4607-9f2f-65e757792d25`::moving from state init -> state preparing
>Thread-677::INFO::2014-04-10 19:08:26,298::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-677::INFO::2014-04-10 19:08:26,299::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543412', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028076', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376451', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504034', 'lastCheck': '7.3', 'valid': True}}
>Thread-677::DEBUG::2014-04-10 19:08:26,299::task::1168::TaskManager.Task::(prepare) Task=`8a238fb1-3d47-4607-9f2f-65e757792d25`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543412', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028076', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376451', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504034', 'lastCheck': '7.3', 'valid': True}}
>Thread-677::DEBUG::2014-04-10 19:08:26,299::task::579::TaskManager.Task::(_updateState) Task=`8a238fb1-3d47-4607-9f2f-65e757792d25`::moving from state preparing -> state finished
>Thread-677::DEBUG::2014-04-10 19:08:26,299::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-677::DEBUG::2014-04-10 19:08:26,299::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-677::DEBUG::2014-04-10 19:08:26,299::task::974::TaskManager.Task::(_decref) Task=`8a238fb1-3d47-4607-9f2f-65e757792d25`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:08:28,971::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:28,977::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000565697 s, 651 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:30,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:30,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000339195 s, 2.0 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:30,638::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:30,646::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00124335 s, 540 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:08:32,142::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:08:32,155::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:08:32,156::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 19:08:32,162::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 19:08:32,164::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 19:08:32,164::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 19:08:32,164::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 19:08:32,170::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:32,176::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000481544 s, 1.4 MB/s\n'; <rc> = 0
>Thread-684::DEBUG::2014-04-10 19:08:32,372::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-684::DEBUG::2014-04-10 19:08:32,373::task::579::TaskManager.Task::(_updateState) Task=`bce99873-0b79-4a12-b626-1f1ee9340b6d`::moving from state init -> state preparing
>Thread-684::INFO::2014-04-10 19:08:32,373::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-684::INFO::2014-04-10 19:08:32,373::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-684::DEBUG::2014-04-10 19:08:32,373::task::1168::TaskManager.Task::(prepare) Task=`bce99873-0b79-4a12-b626-1f1ee9340b6d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-684::DEBUG::2014-04-10 19:08:32,374::task::579::TaskManager.Task::(_updateState) Task=`bce99873-0b79-4a12-b626-1f1ee9340b6d`::moving from state preparing -> state finished
>Thread-684::DEBUG::2014-04-10 19:08:32,374::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-684::DEBUG::2014-04-10 19:08:32,374::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-684::DEBUG::2014-04-10 19:08:32,374::task::974::TaskManager.Task::(_decref) Task=`bce99873-0b79-4a12-b626-1f1ee9340b6d`::ref 0 aborting False
>Thread-685::DEBUG::2014-04-10 19:08:32,383::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-685::DEBUG::2014-04-10 19:08:32,383::task::579::TaskManager.Task::(_updateState) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::moving from state init -> state preparing
>Thread-685::INFO::2014-04-10 19:08:32,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-685::DEBUG::2014-04-10 19:08:32,384::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acba37d6-6dc9-4321-aa8d-5fc9f9604182`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-685::DEBUG::2014-04-10 19:08:32,384::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-685::DEBUG::2014-04-10 19:08:32,384::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-685::DEBUG::2014-04-10 19:08:32,385::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`acba37d6-6dc9-4321-aa8d-5fc9f9604182`::Granted request
>Thread-685::DEBUG::2014-04-10 19:08:32,385::task::811::TaskManager.Task::(resourceAcquired) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-685::DEBUG::2014-04-10 19:08:32,385::task::974::TaskManager.Task::(_decref) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::ref 1 aborting False
>Thread-685::INFO::2014-04-10 19:08:32,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-685::DEBUG::2014-04-10 19:08:32,388::task::1168::TaskManager.Task::(prepare) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-685::DEBUG::2014-04-10 19:08:32,388::task::579::TaskManager.Task::(_updateState) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::moving from state preparing -> state finished
>Thread-685::DEBUG::2014-04-10 19:08:32,388::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-685::DEBUG::2014-04-10 19:08:32,388::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-685::DEBUG::2014-04-10 19:08:32,389::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-685::DEBUG::2014-04-10 19:08:32,389::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-685::DEBUG::2014-04-10 19:08:32,389::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-685::DEBUG::2014-04-10 19:08:32,389::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-685::DEBUG::2014-04-10 19:08:32,389::task::974::TaskManager.Task::(_decref) Task=`835022af-59f0-4d94-aa39-0719ae3d0dcd`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:08:38,979::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:08:38,994::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:08:38,996::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 19:08:39,002::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 19:08:39,003::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 19:08:39,004::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 19:08:39,004::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 19:08:39,009::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:39,016::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000456952 s, 805 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:40,612::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:40,618::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000386326 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:40,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:40,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374249 s, 1.8 MB/s\n'; <rc> = 0
>Thread-693::DEBUG::2014-04-10 19:08:41,509::task::579::TaskManager.Task::(_updateState) Task=`fabd8ce1-f451-495e-9a16-92dac8b75f9f`::moving from state init -> state preparing
>Thread-693::INFO::2014-04-10 19:08:41,509::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-693::INFO::2014-04-10 19:08:41,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481544', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374249', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386326', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456952', 'lastCheck': '2.5', 'valid': True}}
>Thread-693::DEBUG::2014-04-10 19:08:41,510::task::1168::TaskManager.Task::(prepare) Task=`fabd8ce1-f451-495e-9a16-92dac8b75f9f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481544', 'lastCheck': '9.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374249', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386326', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456952', 'lastCheck': '2.5', 'valid': True}}
>Thread-693::DEBUG::2014-04-10 19:08:41,510::task::579::TaskManager.Task::(_updateState) Task=`fabd8ce1-f451-495e-9a16-92dac8b75f9f`::moving from state preparing -> state finished
>Thread-693::DEBUG::2014-04-10 19:08:41,510::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-693::DEBUG::2014-04-10 19:08:41,510::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-693::DEBUG::2014-04-10 19:08:41,510::task::974::TaskManager.Task::(_decref) Task=`fabd8ce1-f451-495e-9a16-92dac8b75f9f`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:08:42,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:42,193::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000501683 s, 1.3 MB/s\n'; <rc> = 0
>Thread-695::DEBUG::2014-04-10 19:08:42,466::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-695::DEBUG::2014-04-10 19:08:42,467::task::579::TaskManager.Task::(_updateState) Task=`5a6da4ee-6f6c-4fea-92a2-112a7080b2e8`::moving from state init -> state preparing
>Thread-695::INFO::2014-04-10 19:08:42,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-695::INFO::2014-04-10 19:08:42,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-695::DEBUG::2014-04-10 19:08:42,468::task::1168::TaskManager.Task::(prepare) Task=`5a6da4ee-6f6c-4fea-92a2-112a7080b2e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-695::DEBUG::2014-04-10 19:08:42,468::task::579::TaskManager.Task::(_updateState) Task=`5a6da4ee-6f6c-4fea-92a2-112a7080b2e8`::moving from state preparing -> state finished
>Thread-695::DEBUG::2014-04-10 19:08:42,468::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-695::DEBUG::2014-04-10 19:08:42,468::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-695::DEBUG::2014-04-10 19:08:42,469::task::974::TaskManager.Task::(_decref) Task=`5a6da4ee-6f6c-4fea-92a2-112a7080b2e8`::ref 0 aborting False
>Thread-696::DEBUG::2014-04-10 19:08:42,477::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-696::DEBUG::2014-04-10 19:08:42,478::task::579::TaskManager.Task::(_updateState) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::moving from state init -> state preparing
>Thread-696::INFO::2014-04-10 19:08:42,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-696::DEBUG::2014-04-10 19:08:42,478::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e77a850e-88c2-4676-bddc-7470b6fc7fc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-696::DEBUG::2014-04-10 19:08:42,479::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-696::DEBUG::2014-04-10 19:08:42,479::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-696::DEBUG::2014-04-10 19:08:42,479::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e77a850e-88c2-4676-bddc-7470b6fc7fc2`::Granted request
>Thread-696::DEBUG::2014-04-10 19:08:42,505::task::811::TaskManager.Task::(resourceAcquired) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-696::DEBUG::2014-04-10 19:08:42,505::task::974::TaskManager.Task::(_decref) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::ref 1 aborting False
>Thread-696::INFO::2014-04-10 19:08:42,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-696::DEBUG::2014-04-10 19:08:42,508::task::1168::TaskManager.Task::(prepare) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-696::DEBUG::2014-04-10 19:08:42,508::task::579::TaskManager.Task::(_updateState) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::moving from state preparing -> state finished
>Thread-696::DEBUG::2014-04-10 19:08:42,508::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-696::DEBUG::2014-04-10 19:08:42,508::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-696::DEBUG::2014-04-10 19:08:42,508::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-696::DEBUG::2014-04-10 19:08:42,508::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-696::DEBUG::2014-04-10 19:08:42,509::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-696::DEBUG::2014-04-10 19:08:42,509::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-696::DEBUG::2014-04-10 19:08:42,509::task::974::TaskManager.Task::(_decref) Task=`9f3436e0-ad7a-4d94-9ab7-164e9f13d9da`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:08:49,024::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:49,031::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000519784 s, 708 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:08:50,628::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:08:50,634::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000370665 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:08:50,671::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:08:50,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329351 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:08:52,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:08:52,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00055463 s, 1.2 MB/s\n'; <rc> = 0
>Thread-700::DEBUG::2014-04-10 19:08:52,582::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-700::DEBUG::2014-04-10 19:08:52,583::task::579::TaskManager.Task::(_updateState) Task=`5a0f558e-3e5d-421e-83dc-7ea7f0a70022`::moving from state init -> state preparing
>Thread-700::INFO::2014-04-10 19:08:52,583::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-700::INFO::2014-04-10 19:08:52,584::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-700::DEBUG::2014-04-10 19:08:52,584::task::1168::TaskManager.Task::(prepare) Task=`5a0f558e-3e5d-421e-83dc-7ea7f0a70022`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-700::DEBUG::2014-04-10 19:08:52,584::task::579::TaskManager.Task::(_updateState) Task=`5a0f558e-3e5d-421e-83dc-7ea7f0a70022`::moving from state preparing -> state finished
>Thread-700::DEBUG::2014-04-10 19:08:52,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-700::DEBUG::2014-04-10 19:08:52,584::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-700::DEBUG::2014-04-10 19:08:52,585::task::974::TaskManager.Task::(_decref) Task=`5a0f558e-3e5d-421e-83dc-7ea7f0a70022`::ref 0 aborting False
>Thread-701::DEBUG::2014-04-10 19:08:52,593::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-701::DEBUG::2014-04-10 19:08:52,593::task::579::TaskManager.Task::(_updateState) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::moving from state init -> state preparing
>Thread-701::INFO::2014-04-10 19:08:52,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-701::DEBUG::2014-04-10 19:08:52,594::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`231448c7-3bd2-4968-b204-a17832f12935`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-701::DEBUG::2014-04-10 19:08:52,594::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-701::DEBUG::2014-04-10 19:08:52,595::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-701::DEBUG::2014-04-10 19:08:52,595::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`231448c7-3bd2-4968-b204-a17832f12935`::Granted request
>Thread-701::DEBUG::2014-04-10 19:08:52,595::task::811::TaskManager.Task::(resourceAcquired) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-701::DEBUG::2014-04-10 19:08:52,595::task::974::TaskManager.Task::(_decref) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::ref 1 aborting False
>Thread-701::INFO::2014-04-10 19:08:52,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-701::DEBUG::2014-04-10 19:08:52,598::task::1168::TaskManager.Task::(prepare) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-701::DEBUG::2014-04-10 19:08:52,598::task::579::TaskManager.Task::(_updateState) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::moving from state preparing -> state finished
>Thread-701::DEBUG::2014-04-10 19:08:52,598::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-701::DEBUG::2014-04-10 19:08:52,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-701::DEBUG::2014-04-10 19:08:52,599::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-701::DEBUG::2014-04-10 19:08:52,599::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-701::DEBUG::2014-04-10 19:08:52,599::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-701::DEBUG::2014-04-10 19:08:52,599::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-701::DEBUG::2014-04-10 19:08:52,599::task::974::TaskManager.Task::(_decref) Task=`1bce4beb-2ade-497c-9c27-cfb6deabcc41`::ref 0 aborting False
>Thread-703::DEBUG::2014-04-10 19:08:56,689::task::579::TaskManager.Task::(_updateState) Task=`5708e5f1-e87e-42a4-b371-176075c856f5`::moving from state init -> state preparing
>Thread-703::INFO::2014-04-10 19:08:56,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-703::INFO::2014-04-10 19:08:56,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055463', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329351', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370665', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519784', 'lastCheck': '7.7', 'valid': True}}
>Thread-703::DEBUG::2014-04-10 19:08:56,689::task::1168::TaskManager.Task::(prepare) Task=`5708e5f1-e87e-42a4-b371-176075c856f5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055463', 'lastCheck': '4.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329351', 'lastCheck': '6.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370665', 'lastCheck': '6.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519784', 'lastCheck': '7.7', 'valid': True}}
>Thread-703::DEBUG::2014-04-10 19:08:56,690::task::579::TaskManager.Task::(_updateState) Task=`5708e5f1-e87e-42a4-b371-176075c856f5`::moving from state preparing -> state finished
>Thread-703::DEBUG::2014-04-10 19:08:56,690::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-703::DEBUG::2014-04-10 19:08:56,690::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-703::DEBUG::2014-04-10 19:08:56,690::task::974::TaskManager.Task::(_decref) Task=`5708e5f1-e87e-42a4-b371-176075c856f5`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:08:59,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:08:59,046::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000509996 s, 722 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:00,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:00,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342751 s, 2.0 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:00,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:00,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000406903 s, 1.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:09:02,216::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:02,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000485364 s, 1.4 MB/s\n'; <rc> = 0
>Thread-706::DEBUG::2014-04-10 19:09:02,681::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-706::DEBUG::2014-04-10 19:09:02,681::task::579::TaskManager.Task::(_updateState) Task=`917137f7-df87-48b1-ba1f-d7f3a69a1bcd`::moving from state init -> state preparing
>Thread-706::INFO::2014-04-10 19:09:02,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-706::INFO::2014-04-10 19:09:02,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-706::DEBUG::2014-04-10 19:09:02,682::task::1168::TaskManager.Task::(prepare) Task=`917137f7-df87-48b1-ba1f-d7f3a69a1bcd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-706::DEBUG::2014-04-10 19:09:02,682::task::579::TaskManager.Task::(_updateState) Task=`917137f7-df87-48b1-ba1f-d7f3a69a1bcd`::moving from state preparing -> state finished
>Thread-706::DEBUG::2014-04-10 19:09:02,682::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-706::DEBUG::2014-04-10 19:09:02,683::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-706::DEBUG::2014-04-10 19:09:02,683::task::974::TaskManager.Task::(_decref) Task=`917137f7-df87-48b1-ba1f-d7f3a69a1bcd`::ref 0 aborting False
>Thread-707::DEBUG::2014-04-10 19:09:02,691::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-707::DEBUG::2014-04-10 19:09:02,691::task::579::TaskManager.Task::(_updateState) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::moving from state init -> state preparing
>Thread-707::INFO::2014-04-10 19:09:02,692::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-707::DEBUG::2014-04-10 19:09:02,692::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0d414566-77c9-47f4-b4ab-8b8e54259f16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-707::DEBUG::2014-04-10 19:09:02,692::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-707::DEBUG::2014-04-10 19:09:02,693::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-707::DEBUG::2014-04-10 19:09:02,693::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0d414566-77c9-47f4-b4ab-8b8e54259f16`::Granted request
>Thread-707::DEBUG::2014-04-10 19:09:02,693::task::811::TaskManager.Task::(resourceAcquired) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-707::DEBUG::2014-04-10 19:09:02,693::task::974::TaskManager.Task::(_decref) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::ref 1 aborting False
>Thread-707::INFO::2014-04-10 19:09:02,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-707::DEBUG::2014-04-10 19:09:02,696::task::1168::TaskManager.Task::(prepare) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-707::DEBUG::2014-04-10 19:09:02,696::task::579::TaskManager.Task::(_updateState) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::moving from state preparing -> state finished
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-707::DEBUG::2014-04-10 19:09:02,697::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-707::DEBUG::2014-04-10 19:09:02,698::task::974::TaskManager.Task::(_decref) Task=`c8a4a7b0-1fe1-49d7-9344-aeb2e2b41a21`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:09,054::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:09,061::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000500371 s, 735 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:10,656::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:10,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347637 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:10,698::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:10,707::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00318793 s, 210 kB/s\n'; <rc> = 0
>Thread-711::DEBUG::2014-04-10 19:09:11,860::task::579::TaskManager.Task::(_updateState) Task=`d90c2432-f558-48e3-9032-01e7f857bccb`::moving from state init -> state preparing
>Thread-711::INFO::2014-04-10 19:09:11,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-711::INFO::2014-04-10 19:09:11,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485364', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00318793', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347637', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500371', 'lastCheck': '2.8', 'valid': True}}
>Thread-711::DEBUG::2014-04-10 19:09:11,861::task::1168::TaskManager.Task::(prepare) Task=`d90c2432-f558-48e3-9032-01e7f857bccb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485364', 'lastCheck': '9.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00318793', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347637', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500371', 'lastCheck': '2.8', 'valid': True}}
>Thread-711::DEBUG::2014-04-10 19:09:11,861::task::579::TaskManager.Task::(_updateState) Task=`d90c2432-f558-48e3-9032-01e7f857bccb`::moving from state preparing -> state finished
>Thread-711::DEBUG::2014-04-10 19:09:11,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-711::DEBUG::2014-04-10 19:09:11,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-711::DEBUG::2014-04-10 19:09:11,862::task::974::TaskManager.Task::(_decref) Task=`d90c2432-f558-48e3-9032-01e7f857bccb`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:09:12,231::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:12,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000504077 s, 1.3 MB/s\n'; <rc> = 0
>Thread-713::DEBUG::2014-04-10 19:09:12,779::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-713::DEBUG::2014-04-10 19:09:12,779::task::579::TaskManager.Task::(_updateState) Task=`0a2ca966-61b6-4588-b1ed-bd7ea955f77c`::moving from state init -> state preparing
>Thread-713::INFO::2014-04-10 19:09:12,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-713::INFO::2014-04-10 19:09:12,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-713::DEBUG::2014-04-10 19:09:12,780::task::1168::TaskManager.Task::(prepare) Task=`0a2ca966-61b6-4588-b1ed-bd7ea955f77c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-713::DEBUG::2014-04-10 19:09:12,780::task::579::TaskManager.Task::(_updateState) Task=`0a2ca966-61b6-4588-b1ed-bd7ea955f77c`::moving from state preparing -> state finished
>Thread-713::DEBUG::2014-04-10 19:09:12,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-713::DEBUG::2014-04-10 19:09:12,780::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-713::DEBUG::2014-04-10 19:09:12,780::task::974::TaskManager.Task::(_decref) Task=`0a2ca966-61b6-4588-b1ed-bd7ea955f77c`::ref 0 aborting False
>Thread-714::DEBUG::2014-04-10 19:09:12,789::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-714::DEBUG::2014-04-10 19:09:12,789::task::579::TaskManager.Task::(_updateState) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::moving from state init -> state preparing
>Thread-714::INFO::2014-04-10 19:09:12,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-714::DEBUG::2014-04-10 19:09:12,790::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`22980ba8-085a-49f8-9676-68878cf31b67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-714::DEBUG::2014-04-10 19:09:12,790::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-714::DEBUG::2014-04-10 19:09:12,790::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-714::DEBUG::2014-04-10 19:09:12,790::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`22980ba8-085a-49f8-9676-68878cf31b67`::Granted request
>Thread-714::DEBUG::2014-04-10 19:09:12,791::task::811::TaskManager.Task::(resourceAcquired) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-714::DEBUG::2014-04-10 19:09:12,791::task::974::TaskManager.Task::(_decref) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::ref 1 aborting False
>Thread-714::INFO::2014-04-10 19:09:12,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-714::DEBUG::2014-04-10 19:09:12,793::task::1168::TaskManager.Task::(prepare) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-714::DEBUG::2014-04-10 19:09:12,793::task::579::TaskManager.Task::(_updateState) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::moving from state preparing -> state finished
>Thread-714::DEBUG::2014-04-10 19:09:12,793::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-714::DEBUG::2014-04-10 19:09:12,793::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-714::DEBUG::2014-04-10 19:09:12,794::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-714::DEBUG::2014-04-10 19:09:12,794::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-714::DEBUG::2014-04-10 19:09:12,794::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-714::DEBUG::2014-04-10 19:09:12,794::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-714::DEBUG::2014-04-10 19:09:12,794::task::974::TaskManager.Task::(_decref) Task=`c3b0d410-6b1f-4d37-960c-7f1534a1b1bf`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:19,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:19,076::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000414259 s, 888 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:20,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:20,676::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000396909 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:20,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:20,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000422363 s, 1.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:09:22,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:22,251::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000521302 s, 1.3 MB/s\n'; <rc> = 0
>Thread-718::DEBUG::2014-04-10 19:09:23,184::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-718::DEBUG::2014-04-10 19:09:23,185::task::579::TaskManager.Task::(_updateState) Task=`b8871fdc-d2dd-42c5-b8ea-785a4398bd4d`::moving from state init -> state preparing
>Thread-718::INFO::2014-04-10 19:09:23,185::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-718::INFO::2014-04-10 19:09:23,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-718::DEBUG::2014-04-10 19:09:23,186::task::1168::TaskManager.Task::(prepare) Task=`b8871fdc-d2dd-42c5-b8ea-785a4398bd4d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-718::DEBUG::2014-04-10 19:09:23,186::task::579::TaskManager.Task::(_updateState) Task=`b8871fdc-d2dd-42c5-b8ea-785a4398bd4d`::moving from state preparing -> state finished
>Thread-718::DEBUG::2014-04-10 19:09:23,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-718::DEBUG::2014-04-10 19:09:23,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-718::DEBUG::2014-04-10 19:09:23,186::task::974::TaskManager.Task::(_decref) Task=`b8871fdc-d2dd-42c5-b8ea-785a4398bd4d`::ref 0 aborting False
>Thread-719::DEBUG::2014-04-10 19:09:23,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-719::DEBUG::2014-04-10 19:09:23,193::task::579::TaskManager.Task::(_updateState) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::moving from state init -> state preparing
>Thread-719::INFO::2014-04-10 19:09:23,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-719::DEBUG::2014-04-10 19:09:23,194::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f428d80e-5fa9-43f5-aaa3-c228a2fe8f3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-719::DEBUG::2014-04-10 19:09:23,194::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-719::DEBUG::2014-04-10 19:09:23,194::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-719::DEBUG::2014-04-10 19:09:23,194::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f428d80e-5fa9-43f5-aaa3-c228a2fe8f3e`::Granted request
>Thread-719::DEBUG::2014-04-10 19:09:23,195::task::811::TaskManager.Task::(resourceAcquired) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-719::DEBUG::2014-04-10 19:09:23,195::task::974::TaskManager.Task::(_decref) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::ref 1 aborting False
>Thread-719::INFO::2014-04-10 19:09:23,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-719::DEBUG::2014-04-10 19:09:23,197::task::1168::TaskManager.Task::(prepare) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-719::DEBUG::2014-04-10 19:09:23,197::task::579::TaskManager.Task::(_updateState) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::moving from state preparing -> state finished
>Thread-719::DEBUG::2014-04-10 19:09:23,198::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-719::DEBUG::2014-04-10 19:09:23,198::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-719::DEBUG::2014-04-10 19:09:23,198::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-719::DEBUG::2014-04-10 19:09:23,198::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-719::DEBUG::2014-04-10 19:09:23,198::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-719::DEBUG::2014-04-10 19:09:23,199::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-719::DEBUG::2014-04-10 19:09:23,199::task::974::TaskManager.Task::(_decref) Task=`2fe13667-cf93-48e5-b2d1-ca469fef5520`::ref 0 aborting False
>Thread-721::DEBUG::2014-04-10 19:09:27,054::task::579::TaskManager.Task::(_updateState) Task=`0324799b-9319-4c20-92c9-dfcae5a192ee`::moving from state init -> state preparing
>Thread-721::INFO::2014-04-10 19:09:27,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-721::INFO::2014-04-10 19:09:27,055::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521302', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422363', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396909', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414259', 'lastCheck': '8.0', 'valid': True}}
>Thread-721::DEBUG::2014-04-10 19:09:27,055::task::1168::TaskManager.Task::(prepare) Task=`0324799b-9319-4c20-92c9-dfcae5a192ee`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521302', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422363', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000396909', 'lastCheck': '6.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414259', 'lastCheck': '8.0', 'valid': True}}
>Thread-721::DEBUG::2014-04-10 19:09:27,055::task::579::TaskManager.Task::(_updateState) Task=`0324799b-9319-4c20-92c9-dfcae5a192ee`::moving from state preparing -> state finished
>Thread-721::DEBUG::2014-04-10 19:09:27,055::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-721::DEBUG::2014-04-10 19:09:27,055::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-721::DEBUG::2014-04-10 19:09:27,055::task::974::TaskManager.Task::(_decref) Task=`0324799b-9319-4c20-92c9-dfcae5a192ee`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:29,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:29,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000503521 s, 731 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:30,684::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:30,690::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035799 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:30,731::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:30,737::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00047111 s, 1.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:09:32,261::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:32,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000523166 s, 1.3 MB/s\n'; <rc> = 0
>Thread-725::DEBUG::2014-04-10 19:09:33,292::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-725::DEBUG::2014-04-10 19:09:33,293::task::579::TaskManager.Task::(_updateState) Task=`e8a809be-1fe6-42c0-9d6a-660fbd5e7a79`::moving from state init -> state preparing
>Thread-725::INFO::2014-04-10 19:09:33,293::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-725::INFO::2014-04-10 19:09:33,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-725::DEBUG::2014-04-10 19:09:33,294::task::1168::TaskManager.Task::(prepare) Task=`e8a809be-1fe6-42c0-9d6a-660fbd5e7a79`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-725::DEBUG::2014-04-10 19:09:33,294::task::579::TaskManager.Task::(_updateState) Task=`e8a809be-1fe6-42c0-9d6a-660fbd5e7a79`::moving from state preparing -> state finished
>Thread-725::DEBUG::2014-04-10 19:09:33,294::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-725::DEBUG::2014-04-10 19:09:33,294::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-725::DEBUG::2014-04-10 19:09:33,294::task::974::TaskManager.Task::(_decref) Task=`e8a809be-1fe6-42c0-9d6a-660fbd5e7a79`::ref 0 aborting False
>Thread-726::DEBUG::2014-04-10 19:09:33,303::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-726::DEBUG::2014-04-10 19:09:33,304::task::579::TaskManager.Task::(_updateState) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::moving from state init -> state preparing
>Thread-726::INFO::2014-04-10 19:09:33,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-726::DEBUG::2014-04-10 19:09:33,305::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c7912704-65c3-43cf-9ae5-2115536bcc44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-726::DEBUG::2014-04-10 19:09:33,305::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-726::DEBUG::2014-04-10 19:09:33,305::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-726::DEBUG::2014-04-10 19:09:33,305::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c7912704-65c3-43cf-9ae5-2115536bcc44`::Granted request
>Thread-726::DEBUG::2014-04-10 19:09:33,306::task::811::TaskManager.Task::(resourceAcquired) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-726::DEBUG::2014-04-10 19:09:33,306::task::974::TaskManager.Task::(_decref) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::ref 1 aborting False
>Thread-726::INFO::2014-04-10 19:09:33,308::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-726::DEBUG::2014-04-10 19:09:33,308::task::1168::TaskManager.Task::(prepare) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-726::DEBUG::2014-04-10 19:09:33,309::task::579::TaskManager.Task::(_updateState) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::moving from state preparing -> state finished
>Thread-726::DEBUG::2014-04-10 19:09:33,309::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-726::DEBUG::2014-04-10 19:09:33,309::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-726::DEBUG::2014-04-10 19:09:33,309::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-726::DEBUG::2014-04-10 19:09:33,309::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-726::DEBUG::2014-04-10 19:09:33,310::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-726::DEBUG::2014-04-10 19:09:33,310::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-726::DEBUG::2014-04-10 19:09:33,310::task::974::TaskManager.Task::(_decref) Task=`e876e642-39b3-4cf9-a834-43280ea7b793`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:39,101::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:39,107::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044225 s, 832 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:40,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:40,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000373219 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:40,746::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:40,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000379267 s, 1.8 MB/s\n'; <rc> = 0
>Thread-729::DEBUG::2014-04-10 19:09:42,252::task::579::TaskManager.Task::(_updateState) Task=`19c76222-af4e-4881-886a-20a1c01c111c`::moving from state init -> state preparing
>Thread-729::INFO::2014-04-10 19:09:42,253::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-729::INFO::2014-04-10 19:09:42,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523166', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379267', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373219', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044225', 'lastCheck': '3.1', 'valid': True}}
>Thread-729::DEBUG::2014-04-10 19:09:42,253::task::1168::TaskManager.Task::(prepare) Task=`19c76222-af4e-4881-886a-20a1c01c111c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523166', 'lastCheck': '10.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379267', 'lastCheck': '1.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000373219', 'lastCheck': '1.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00044225', 'lastCheck': '3.1', 'valid': True}}
>Thread-729::DEBUG::2014-04-10 19:09:42,253::task::579::TaskManager.Task::(_updateState) Task=`19c76222-af4e-4881-886a-20a1c01c111c`::moving from state preparing -> state finished
>Thread-729::DEBUG::2014-04-10 19:09:42,253::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-729::DEBUG::2014-04-10 19:09:42,254::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-729::DEBUG::2014-04-10 19:09:42,254::task::974::TaskManager.Task::(_decref) Task=`19c76222-af4e-4881-886a-20a1c01c111c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:09:42,282::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:42,288::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000490649 s, 1.3 MB/s\n'; <rc> = 0
>Thread-731::DEBUG::2014-04-10 19:09:43,423::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-731::DEBUG::2014-04-10 19:09:43,423::task::579::TaskManager.Task::(_updateState) Task=`f4643252-d7cc-48f9-ac9f-072f9818bd02`::moving from state init -> state preparing
>Thread-731::INFO::2014-04-10 19:09:43,424::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-731::INFO::2014-04-10 19:09:43,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-731::DEBUG::2014-04-10 19:09:43,424::task::1168::TaskManager.Task::(prepare) Task=`f4643252-d7cc-48f9-ac9f-072f9818bd02`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-731::DEBUG::2014-04-10 19:09:43,424::task::579::TaskManager.Task::(_updateState) Task=`f4643252-d7cc-48f9-ac9f-072f9818bd02`::moving from state preparing -> state finished
>Thread-731::DEBUG::2014-04-10 19:09:43,424::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-731::DEBUG::2014-04-10 19:09:43,425::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-731::DEBUG::2014-04-10 19:09:43,425::task::974::TaskManager.Task::(_decref) Task=`f4643252-d7cc-48f9-ac9f-072f9818bd02`::ref 0 aborting False
>Thread-732::DEBUG::2014-04-10 19:09:43,433::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-732::DEBUG::2014-04-10 19:09:43,433::task::579::TaskManager.Task::(_updateState) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::moving from state init -> state preparing
>Thread-732::INFO::2014-04-10 19:09:43,433::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-732::DEBUG::2014-04-10 19:09:43,434::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6c26141c-693d-4fd4-8cc9-700355bb0d2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-732::DEBUG::2014-04-10 19:09:43,434::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-732::DEBUG::2014-04-10 19:09:43,434::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-732::DEBUG::2014-04-10 19:09:43,434::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6c26141c-693d-4fd4-8cc9-700355bb0d2a`::Granted request
>Thread-732::DEBUG::2014-04-10 19:09:43,435::task::811::TaskManager.Task::(resourceAcquired) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-732::DEBUG::2014-04-10 19:09:43,435::task::974::TaskManager.Task::(_decref) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::ref 1 aborting False
>Thread-732::INFO::2014-04-10 19:09:43,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-732::DEBUG::2014-04-10 19:09:43,437::task::1168::TaskManager.Task::(prepare) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-732::DEBUG::2014-04-10 19:09:43,437::task::579::TaskManager.Task::(_updateState) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::moving from state preparing -> state finished
>Thread-732::DEBUG::2014-04-10 19:09:43,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-732::DEBUG::2014-04-10 19:09:43,438::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-732::DEBUG::2014-04-10 19:09:43,438::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-732::DEBUG::2014-04-10 19:09:43,438::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-732::DEBUG::2014-04-10 19:09:43,438::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-732::DEBUG::2014-04-10 19:09:43,438::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-732::DEBUG::2014-04-10 19:09:43,438::task::974::TaskManager.Task::(_decref) Task=`9cdeab95-d476-435b-9f37-ea734b250674`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:49,116::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:49,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000564318 s, 652 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:09:50,715::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:09:50,721::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00155405 s, 432 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:09:50,760::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:09:50,765::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000376977 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:09:52,297::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:09:52,302::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000445224 s, 1.5 MB/s\n'; <rc> = 0
>Thread-736::DEBUG::2014-04-10 19:09:53,530::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-736::DEBUG::2014-04-10 19:09:53,538::task::579::TaskManager.Task::(_updateState) Task=`436d392e-8255-4dea-bf64-a2a5791bd03c`::moving from state init -> state preparing
>Thread-736::INFO::2014-04-10 19:09:53,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-736::INFO::2014-04-10 19:09:53,538::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-736::DEBUG::2014-04-10 19:09:53,538::task::1168::TaskManager.Task::(prepare) Task=`436d392e-8255-4dea-bf64-a2a5791bd03c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-736::DEBUG::2014-04-10 19:09:53,538::task::579::TaskManager.Task::(_updateState) Task=`436d392e-8255-4dea-bf64-a2a5791bd03c`::moving from state preparing -> state finished
>Thread-736::DEBUG::2014-04-10 19:09:53,539::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-736::DEBUG::2014-04-10 19:09:53,539::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-736::DEBUG::2014-04-10 19:09:53,539::task::974::TaskManager.Task::(_decref) Task=`436d392e-8255-4dea-bf64-a2a5791bd03c`::ref 0 aborting False
>Thread-737::DEBUG::2014-04-10 19:09:53,548::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-737::DEBUG::2014-04-10 19:09:53,548::task::579::TaskManager.Task::(_updateState) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::moving from state init -> state preparing
>Thread-737::INFO::2014-04-10 19:09:53,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-737::DEBUG::2014-04-10 19:09:53,549::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db8fa6b0-f77c-4341-bab4-1d8c131a0cc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-737::DEBUG::2014-04-10 19:09:53,549::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-737::DEBUG::2014-04-10 19:09:53,549::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-737::DEBUG::2014-04-10 19:09:53,549::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`db8fa6b0-f77c-4341-bab4-1d8c131a0cc3`::Granted request
>Thread-737::DEBUG::2014-04-10 19:09:53,550::task::811::TaskManager.Task::(resourceAcquired) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-737::DEBUG::2014-04-10 19:09:53,550::task::974::TaskManager.Task::(_decref) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::ref 1 aborting False
>Thread-737::INFO::2014-04-10 19:09:53,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-737::DEBUG::2014-04-10 19:09:53,552::task::1168::TaskManager.Task::(prepare) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-737::DEBUG::2014-04-10 19:09:53,553::task::579::TaskManager.Task::(_updateState) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::moving from state preparing -> state finished
>Thread-737::DEBUG::2014-04-10 19:09:53,553::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-737::DEBUG::2014-04-10 19:09:53,553::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-737::DEBUG::2014-04-10 19:09:53,553::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-737::DEBUG::2014-04-10 19:09:53,554::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-737::DEBUG::2014-04-10 19:09:53,554::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-737::DEBUG::2014-04-10 19:09:53,554::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-737::DEBUG::2014-04-10 19:09:53,554::task::974::TaskManager.Task::(_decref) Task=`0be8f684-1a24-4b24-9c58-142e907045d5`::ref 0 aborting False
>Thread-739::DEBUG::2014-04-10 19:09:57,435::task::579::TaskManager.Task::(_updateState) Task=`4c2bd48b-f72d-40c0-b5a7-9c5195b22483`::moving from state init -> state preparing
>Thread-739::INFO::2014-04-10 19:09:57,436::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-739::INFO::2014-04-10 19:09:57,436::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445224', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376977', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00155405', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564318', 'lastCheck': '8.3', 'valid': True}}
>Thread-739::DEBUG::2014-04-10 19:09:57,436::task::1168::TaskManager.Task::(prepare) Task=`4c2bd48b-f72d-40c0-b5a7-9c5195b22483`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445224', 'lastCheck': '5.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376977', 'lastCheck': '6.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00155405', 'lastCheck': '6.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564318', 'lastCheck': '8.3', 'valid': True}}
>Thread-739::DEBUG::2014-04-10 19:09:57,436::task::579::TaskManager.Task::(_updateState) Task=`4c2bd48b-f72d-40c0-b5a7-9c5195b22483`::moving from state preparing -> state finished
>Thread-739::DEBUG::2014-04-10 19:09:57,436::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-739::DEBUG::2014-04-10 19:09:57,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-739::DEBUG::2014-04-10 19:09:57,437::task::974::TaskManager.Task::(_decref) Task=`4c2bd48b-f72d-40c0-b5a7-9c5195b22483`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:09:59,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:09:59,137::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000499162 s, 737 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:00,730::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:00,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402999 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:10:00,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:00,779::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336355 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:02,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:02,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000432243 s, 1.5 MB/s\n'; <rc> = 0
>Thread-743::DEBUG::2014-04-10 19:10:03,633::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-743::DEBUG::2014-04-10 19:10:03,634::task::579::TaskManager.Task::(_updateState) Task=`5758f82b-de2c-4654-bbbe-6478d7ccc8e9`::moving from state init -> state preparing
>Thread-743::INFO::2014-04-10 19:10:03,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-743::INFO::2014-04-10 19:10:03,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-743::DEBUG::2014-04-10 19:10:03,635::task::1168::TaskManager.Task::(prepare) Task=`5758f82b-de2c-4654-bbbe-6478d7ccc8e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-743::DEBUG::2014-04-10 19:10:03,635::task::579::TaskManager.Task::(_updateState) Task=`5758f82b-de2c-4654-bbbe-6478d7ccc8e9`::moving from state preparing -> state finished
>Thread-743::DEBUG::2014-04-10 19:10:03,635::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-743::DEBUG::2014-04-10 19:10:03,635::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-743::DEBUG::2014-04-10 19:10:03,635::task::974::TaskManager.Task::(_decref) Task=`5758f82b-de2c-4654-bbbe-6478d7ccc8e9`::ref 0 aborting False
>Thread-744::DEBUG::2014-04-10 19:10:03,653::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-744::DEBUG::2014-04-10 19:10:03,654::task::579::TaskManager.Task::(_updateState) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::moving from state init -> state preparing
>Thread-744::INFO::2014-04-10 19:10:03,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-744::DEBUG::2014-04-10 19:10:03,654::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5868a689-6d90-4ec0-9c04-a03489a1de01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-744::DEBUG::2014-04-10 19:10:03,655::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-744::DEBUG::2014-04-10 19:10:03,655::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-744::DEBUG::2014-04-10 19:10:03,655::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5868a689-6d90-4ec0-9c04-a03489a1de01`::Granted request
>Thread-744::DEBUG::2014-04-10 19:10:03,655::task::811::TaskManager.Task::(resourceAcquired) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-744::DEBUG::2014-04-10 19:10:03,655::task::974::TaskManager.Task::(_decref) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::ref 1 aborting False
>Thread-744::INFO::2014-04-10 19:10:03,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-744::DEBUG::2014-04-10 19:10:03,658::task::1168::TaskManager.Task::(prepare) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-744::DEBUG::2014-04-10 19:10:03,658::task::579::TaskManager.Task::(_updateState) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::moving from state preparing -> state finished
>Thread-744::DEBUG::2014-04-10 19:10:03,658::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-744::DEBUG::2014-04-10 19:10:03,658::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-744::DEBUG::2014-04-10 19:10:03,658::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-744::DEBUG::2014-04-10 19:10:03,659::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-744::DEBUG::2014-04-10 19:10:03,659::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-744::DEBUG::2014-04-10 19:10:03,659::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-744::DEBUG::2014-04-10 19:10:03,659::task::974::TaskManager.Task::(_decref) Task=`21567991-f028-4fc8-afaf-47c453691ad5`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:09,152::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:09,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000552375 s, 666 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:10,743::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:10,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036589 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:10:10,787::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:10,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000374394 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:12,331::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:12,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000551457 s, 1.2 MB/s\n'; <rc> = 0
>Thread-747::DEBUG::2014-04-10 19:10:12,663::task::579::TaskManager.Task::(_updateState) Task=`9cd57aad-623f-41f1-9462-f48022c0d99c`::moving from state init -> state preparing
>Thread-747::INFO::2014-04-10 19:10:12,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-747::INFO::2014-04-10 19:10:12,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551457', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374394', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036589', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552375', 'lastCheck': '3.5', 'valid': True}}
>Thread-747::DEBUG::2014-04-10 19:10:12,663::task::1168::TaskManager.Task::(prepare) Task=`9cd57aad-623f-41f1-9462-f48022c0d99c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551457', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374394', 'lastCheck': '1.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036589', 'lastCheck': '1.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552375', 'lastCheck': '3.5', 'valid': True}}
>Thread-747::DEBUG::2014-04-10 19:10:12,664::task::579::TaskManager.Task::(_updateState) Task=`9cd57aad-623f-41f1-9462-f48022c0d99c`::moving from state preparing -> state finished
>Thread-747::DEBUG::2014-04-10 19:10:12,664::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-747::DEBUG::2014-04-10 19:10:12,664::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-747::DEBUG::2014-04-10 19:10:12,664::task::974::TaskManager.Task::(_decref) Task=`9cd57aad-623f-41f1-9462-f48022c0d99c`::ref 0 aborting False
>Thread-749::DEBUG::2014-04-10 19:10:13,761::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-749::DEBUG::2014-04-10 19:10:13,761::task::579::TaskManager.Task::(_updateState) Task=`ef5959af-21e3-4ee7-aac8-7dcf3a7e5b8f`::moving from state init -> state preparing
>Thread-749::INFO::2014-04-10 19:10:13,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-749::INFO::2014-04-10 19:10:13,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-749::DEBUG::2014-04-10 19:10:13,762::task::1168::TaskManager.Task::(prepare) Task=`ef5959af-21e3-4ee7-aac8-7dcf3a7e5b8f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-749::DEBUG::2014-04-10 19:10:13,762::task::579::TaskManager.Task::(_updateState) Task=`ef5959af-21e3-4ee7-aac8-7dcf3a7e5b8f`::moving from state preparing -> state finished
>Thread-749::DEBUG::2014-04-10 19:10:13,762::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-749::DEBUG::2014-04-10 19:10:13,762::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-749::DEBUG::2014-04-10 19:10:13,763::task::974::TaskManager.Task::(_decref) Task=`ef5959af-21e3-4ee7-aac8-7dcf3a7e5b8f`::ref 0 aborting False
>Thread-750::DEBUG::2014-04-10 19:10:13,771::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-750::DEBUG::2014-04-10 19:10:13,771::task::579::TaskManager.Task::(_updateState) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::moving from state init -> state preparing
>Thread-750::INFO::2014-04-10 19:10:13,772::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-750::DEBUG::2014-04-10 19:10:13,772::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d0e0276c-275a-46ab-84dc-b2abf1e6133d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-750::DEBUG::2014-04-10 19:10:13,772::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-750::DEBUG::2014-04-10 19:10:13,772::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-750::DEBUG::2014-04-10 19:10:13,773::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d0e0276c-275a-46ab-84dc-b2abf1e6133d`::Granted request
>Thread-750::DEBUG::2014-04-10 19:10:13,773::task::811::TaskManager.Task::(resourceAcquired) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-750::DEBUG::2014-04-10 19:10:13,773::task::974::TaskManager.Task::(_decref) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::ref 1 aborting False
>Thread-750::INFO::2014-04-10 19:10:13,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-750::DEBUG::2014-04-10 19:10:13,775::task::1168::TaskManager.Task::(prepare) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-750::DEBUG::2014-04-10 19:10:13,775::task::579::TaskManager.Task::(_updateState) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::moving from state preparing -> state finished
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-750::DEBUG::2014-04-10 19:10:13,776::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-750::DEBUG::2014-04-10 19:10:13,777::task::974::TaskManager.Task::(_decref) Task=`0de285d8-9a39-479f-b052-85b1cfbcfd1a`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:19,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:19,174::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000551904 s, 667 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:20,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:20,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000385921 s, 1.7 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:10:20,801::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:20,806::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037868 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:22,344::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:22,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000572206 s, 1.1 MB/s\n'; <rc> = 0
>Thread-754::DEBUG::2014-04-10 19:10:23,880::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-754::DEBUG::2014-04-10 19:10:23,881::task::579::TaskManager.Task::(_updateState) Task=`02194f49-850b-40df-bf0d-64c05c7315c5`::moving from state init -> state preparing
>Thread-754::INFO::2014-04-10 19:10:23,881::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-754::INFO::2014-04-10 19:10:23,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-754::DEBUG::2014-04-10 19:10:23,882::task::1168::TaskManager.Task::(prepare) Task=`02194f49-850b-40df-bf0d-64c05c7315c5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-754::DEBUG::2014-04-10 19:10:23,882::task::579::TaskManager.Task::(_updateState) Task=`02194f49-850b-40df-bf0d-64c05c7315c5`::moving from state preparing -> state finished
>Thread-754::DEBUG::2014-04-10 19:10:23,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-754::DEBUG::2014-04-10 19:10:23,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-754::DEBUG::2014-04-10 19:10:23,882::task::974::TaskManager.Task::(_decref) Task=`02194f49-850b-40df-bf0d-64c05c7315c5`::ref 0 aborting False
>Thread-755::DEBUG::2014-04-10 19:10:23,891::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-755::DEBUG::2014-04-10 19:10:23,891::task::579::TaskManager.Task::(_updateState) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::moving from state init -> state preparing
>Thread-755::INFO::2014-04-10 19:10:23,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-755::DEBUG::2014-04-10 19:10:23,892::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40e9cae0-849c-45f4-9079-279dc65c6d54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-755::DEBUG::2014-04-10 19:10:23,892::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-755::DEBUG::2014-04-10 19:10:23,893::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-755::DEBUG::2014-04-10 19:10:23,893::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`40e9cae0-849c-45f4-9079-279dc65c6d54`::Granted request
>Thread-755::DEBUG::2014-04-10 19:10:23,893::task::811::TaskManager.Task::(resourceAcquired) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-755::DEBUG::2014-04-10 19:10:23,893::task::974::TaskManager.Task::(_decref) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::ref 1 aborting False
>Thread-755::INFO::2014-04-10 19:10:23,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-755::DEBUG::2014-04-10 19:10:23,902::task::1168::TaskManager.Task::(prepare) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-755::DEBUG::2014-04-10 19:10:23,902::task::579::TaskManager.Task::(_updateState) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::moving from state preparing -> state finished
>Thread-755::DEBUG::2014-04-10 19:10:23,903::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-755::DEBUG::2014-04-10 19:10:23,903::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-755::DEBUG::2014-04-10 19:10:23,903::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-755::DEBUG::2014-04-10 19:10:23,904::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-755::DEBUG::2014-04-10 19:10:23,904::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-755::DEBUG::2014-04-10 19:10:23,904::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-755::DEBUG::2014-04-10 19:10:23,904::task::974::TaskManager.Task::(_decref) Task=`ae94d48a-a889-49dd-a92b-db83334346c6`::ref 0 aborting False
>Thread-757::DEBUG::2014-04-10 19:10:27,855::task::579::TaskManager.Task::(_updateState) Task=`8703291a-c612-4e5c-b908-40568bf03457`::moving from state init -> state preparing
>Thread-757::INFO::2014-04-10 19:10:27,856::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-757::INFO::2014-04-10 19:10:27,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572206', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037868', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385921', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551904', 'lastCheck': '8.7', 'valid': True}}
>Thread-757::DEBUG::2014-04-10 19:10:27,856::task::1168::TaskManager.Task::(prepare) Task=`8703291a-c612-4e5c-b908-40568bf03457`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572206', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037868', 'lastCheck': '7.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000385921', 'lastCheck': '7.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551904', 'lastCheck': '8.7', 'valid': True}}
>Thread-757::DEBUG::2014-04-10 19:10:27,856::task::579::TaskManager.Task::(_updateState) Task=`8703291a-c612-4e5c-b908-40568bf03457`::moving from state preparing -> state finished
>Thread-757::DEBUG::2014-04-10 19:10:27,856::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-757::DEBUG::2014-04-10 19:10:27,856::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-757::DEBUG::2014-04-10 19:10:27,857::task::974::TaskManager.Task::(_decref) Task=`8703291a-c612-4e5c-b908-40568bf03457`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:29,183::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:29,189::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000412018 s, 893 kB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:30,768::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:10:30,768::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:10:30,768::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:10:30,768::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:10:30,769::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:30,815::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:30,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000439907 s, 1.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:30,933::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:10:30,934::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:10:30,934::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:10:30,955::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:10:30,957::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-66::DEBUG::2014-04-10 19:10:30,961::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-66::DEBUG::2014-04-10 19:10:30,963::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-66::INFO::2014-04-10 19:10:30,963::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-66::INFO::2014-04-10 19:10:30,963::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-66::DEBUG::2014-04-10 19:10:30,979::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:30,986::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000336823 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:32,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:32,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000473547 s, 1.4 MB/s\n'; <rc> = 0
>Thread-765::DEBUG::2014-04-10 19:10:34,015::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-765::DEBUG::2014-04-10 19:10:34,016::task::579::TaskManager.Task::(_updateState) Task=`8fd4e9ec-d760-4bb3-bab1-c1c885ea6d2b`::moving from state init -> state preparing
>Thread-765::INFO::2014-04-10 19:10:34,016::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-765::INFO::2014-04-10 19:10:34,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-765::DEBUG::2014-04-10 19:10:34,017::task::1168::TaskManager.Task::(prepare) Task=`8fd4e9ec-d760-4bb3-bab1-c1c885ea6d2b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-765::DEBUG::2014-04-10 19:10:34,017::task::579::TaskManager.Task::(_updateState) Task=`8fd4e9ec-d760-4bb3-bab1-c1c885ea6d2b`::moving from state preparing -> state finished
>Thread-765::DEBUG::2014-04-10 19:10:34,017::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-765::DEBUG::2014-04-10 19:10:34,017::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-765::DEBUG::2014-04-10 19:10:34,018::task::974::TaskManager.Task::(_decref) Task=`8fd4e9ec-d760-4bb3-bab1-c1c885ea6d2b`::ref 0 aborting False
>Thread-766::DEBUG::2014-04-10 19:10:34,030::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-766::DEBUG::2014-04-10 19:10:34,031::task::579::TaskManager.Task::(_updateState) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::moving from state init -> state preparing
>Thread-766::INFO::2014-04-10 19:10:34,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-766::DEBUG::2014-04-10 19:10:34,031::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e0c7fb84-0806-4074-9890-bbaca754a46a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-766::DEBUG::2014-04-10 19:10:34,031::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-766::DEBUG::2014-04-10 19:10:34,032::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-766::DEBUG::2014-04-10 19:10:34,032::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e0c7fb84-0806-4074-9890-bbaca754a46a`::Granted request
>Thread-766::DEBUG::2014-04-10 19:10:34,032::task::811::TaskManager.Task::(resourceAcquired) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-766::DEBUG::2014-04-10 19:10:34,033::task::974::TaskManager.Task::(_decref) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::ref 1 aborting False
>Thread-766::INFO::2014-04-10 19:10:34,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-766::DEBUG::2014-04-10 19:10:34,035::task::1168::TaskManager.Task::(prepare) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-766::DEBUG::2014-04-10 19:10:34,035::task::579::TaskManager.Task::(_updateState) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::moving from state preparing -> state finished
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-766::DEBUG::2014-04-10 19:10:34,036::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-766::DEBUG::2014-04-10 19:10:34,037::task::974::TaskManager.Task::(_decref) Task=`d9517c4d-cb84-4ea5-9ba9-1e266a0eee6a`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:39,199::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:39,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000530881 s, 693 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:10:40,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:40,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00042712 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:40,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:41,001::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000372265 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:42,378::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:42,383::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000481095 s, 1.4 MB/s\n'; <rc> = 0
>Thread-769::DEBUG::2014-04-10 19:10:43,081::task::579::TaskManager.Task::(_updateState) Task=`276f092c-6413-4e88-a3c6-ae8fb383394e`::moving from state init -> state preparing
>Thread-769::INFO::2014-04-10 19:10:43,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-769::INFO::2014-04-10 19:10:43,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481095', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042712', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372265', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530881', 'lastCheck': '3.9', 'valid': True}}
>Thread-769::DEBUG::2014-04-10 19:10:43,082::task::1168::TaskManager.Task::(prepare) Task=`276f092c-6413-4e88-a3c6-ae8fb383394e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481095', 'lastCheck': '0.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042712', 'lastCheck': '2.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372265', 'lastCheck': '2.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530881', 'lastCheck': '3.9', 'valid': True}}
>Thread-769::DEBUG::2014-04-10 19:10:43,083::task::579::TaskManager.Task::(_updateState) Task=`276f092c-6413-4e88-a3c6-ae8fb383394e`::moving from state preparing -> state finished
>Thread-769::DEBUG::2014-04-10 19:10:43,083::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-769::DEBUG::2014-04-10 19:10:43,083::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-769::DEBUG::2014-04-10 19:10:43,083::task::974::TaskManager.Task::(_decref) Task=`276f092c-6413-4e88-a3c6-ae8fb383394e`::ref 0 aborting False
>Thread-771::DEBUG::2014-04-10 19:10:44,131::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-771::DEBUG::2014-04-10 19:10:44,132::task::579::TaskManager.Task::(_updateState) Task=`8f36d52e-91a4-4087-ad38-45c293a3626b`::moving from state init -> state preparing
>Thread-771::INFO::2014-04-10 19:10:44,132::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-771::INFO::2014-04-10 19:10:44,132::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-771::DEBUG::2014-04-10 19:10:44,132::task::1168::TaskManager.Task::(prepare) Task=`8f36d52e-91a4-4087-ad38-45c293a3626b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-771::DEBUG::2014-04-10 19:10:44,133::task::579::TaskManager.Task::(_updateState) Task=`8f36d52e-91a4-4087-ad38-45c293a3626b`::moving from state preparing -> state finished
>Thread-771::DEBUG::2014-04-10 19:10:44,133::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-771::DEBUG::2014-04-10 19:10:44,133::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-771::DEBUG::2014-04-10 19:10:44,133::task::974::TaskManager.Task::(_decref) Task=`8f36d52e-91a4-4087-ad38-45c293a3626b`::ref 0 aborting False
>Thread-772::DEBUG::2014-04-10 19:10:44,142::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-772::DEBUG::2014-04-10 19:10:44,142::task::579::TaskManager.Task::(_updateState) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::moving from state init -> state preparing
>Thread-772::INFO::2014-04-10 19:10:44,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-772::DEBUG::2014-04-10 19:10:44,143::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9267be9e-27d9-4eb9-98bc-938b151905dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-772::DEBUG::2014-04-10 19:10:44,143::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-772::DEBUG::2014-04-10 19:10:44,143::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-772::DEBUG::2014-04-10 19:10:44,143::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9267be9e-27d9-4eb9-98bc-938b151905dc`::Granted request
>Thread-772::DEBUG::2014-04-10 19:10:44,144::task::811::TaskManager.Task::(resourceAcquired) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-772::DEBUG::2014-04-10 19:10:44,144::task::974::TaskManager.Task::(_decref) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::ref 1 aborting False
>Thread-772::INFO::2014-04-10 19:10:44,146::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-772::DEBUG::2014-04-10 19:10:44,146::task::1168::TaskManager.Task::(prepare) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-772::DEBUG::2014-04-10 19:10:44,147::task::579::TaskManager.Task::(_updateState) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::moving from state preparing -> state finished
>Thread-772::DEBUG::2014-04-10 19:10:44,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-772::DEBUG::2014-04-10 19:10:44,147::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-772::DEBUG::2014-04-10 19:10:44,147::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-772::DEBUG::2014-04-10 19:10:44,147::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-772::DEBUG::2014-04-10 19:10:44,148::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-772::DEBUG::2014-04-10 19:10:44,148::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-772::DEBUG::2014-04-10 19:10:44,148::task::974::TaskManager.Task::(_decref) Task=`843feb34-48f2-45ee-a0c0-6de620646b6c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:49,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:49,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000556244 s, 662 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:10:50,840::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:10:50,840::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:10:50,840::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:10:50,841::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:10:50,841::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:50,974::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:10:50,975::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:10:50,975::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:10:50,990::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:10:50,991::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-64::DEBUG::2014-04-10 19:10:50,995::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-64::DEBUG::2014-04-10 19:10:50,997::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::INFO::2014-04-10 19:10:50,997::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-64::INFO::2014-04-10 19:10:50,997::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-64::DEBUG::2014-04-10 19:10:51,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:10:51,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000217238 s, 3.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:10:51,040::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:10:51,045::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365181 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:10:52,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:10:52,398::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000567665 s, 1.2 MB/s\n'; <rc> = 0
>Thread-780::DEBUG::2014-04-10 19:10:54,239::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-780::DEBUG::2014-04-10 19:10:54,239::task::579::TaskManager.Task::(_updateState) Task=`58fcfa0a-4e7c-4bb9-9f61-87b2dabc0240`::moving from state init -> state preparing
>Thread-780::INFO::2014-04-10 19:10:54,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-780::INFO::2014-04-10 19:10:54,240::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-780::DEBUG::2014-04-10 19:10:54,240::task::1168::TaskManager.Task::(prepare) Task=`58fcfa0a-4e7c-4bb9-9f61-87b2dabc0240`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-780::DEBUG::2014-04-10 19:10:54,240::task::579::TaskManager.Task::(_updateState) Task=`58fcfa0a-4e7c-4bb9-9f61-87b2dabc0240`::moving from state preparing -> state finished
>Thread-780::DEBUG::2014-04-10 19:10:54,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-780::DEBUG::2014-04-10 19:10:54,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-780::DEBUG::2014-04-10 19:10:54,241::task::974::TaskManager.Task::(_decref) Task=`58fcfa0a-4e7c-4bb9-9f61-87b2dabc0240`::ref 0 aborting False
>Thread-781::DEBUG::2014-04-10 19:10:54,249::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [7f4c8759]
>Thread-781::DEBUG::2014-04-10 19:10:54,250::task::579::TaskManager.Task::(_updateState) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::moving from state init -> state preparing
>Thread-781::INFO::2014-04-10 19:10:54,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-781::DEBUG::2014-04-10 19:10:54,251::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d14aa3b9-a83e-4de9-8324-639bd694e5d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-781::DEBUG::2014-04-10 19:10:54,251::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-781::DEBUG::2014-04-10 19:10:54,251::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-781::DEBUG::2014-04-10 19:10:54,251::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d14aa3b9-a83e-4de9-8324-639bd694e5d6`::Granted request
>Thread-781::DEBUG::2014-04-10 19:10:54,252::task::811::TaskManager.Task::(resourceAcquired) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-781::DEBUG::2014-04-10 19:10:54,252::task::974::TaskManager.Task::(_decref) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::ref 1 aborting False
>Thread-781::INFO::2014-04-10 19:10:54,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-781::DEBUG::2014-04-10 19:10:54,254::task::1168::TaskManager.Task::(prepare) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-781::DEBUG::2014-04-10 19:10:54,255::task::579::TaskManager.Task::(_updateState) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::moving from state preparing -> state finished
>Thread-781::DEBUG::2014-04-10 19:10:54,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-781::DEBUG::2014-04-10 19:10:54,255::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-781::DEBUG::2014-04-10 19:10:54,255::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-781::DEBUG::2014-04-10 19:10:54,255::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-781::DEBUG::2014-04-10 19:10:54,256::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-781::DEBUG::2014-04-10 19:10:54,256::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-781::DEBUG::2014-04-10 19:10:54,256::task::974::TaskManager.Task::(_decref) Task=`e3b9862c-c9e3-4738-b862-1ca17c6a2ac1`::ref 0 aborting False
>Thread-783::DEBUG::2014-04-10 19:10:58,261::task::579::TaskManager.Task::(_updateState) Task=`68e302c8-01e0-4779-aebd-f3144d0f8af4`::moving from state init -> state preparing
>Thread-783::INFO::2014-04-10 19:10:58,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-783::INFO::2014-04-10 19:10:58,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567665', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000217238', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365181', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556244', 'lastCheck': '9.0', 'valid': True}}
>Thread-783::DEBUG::2014-04-10 19:10:58,261::task::1168::TaskManager.Task::(prepare) Task=`68e302c8-01e0-4779-aebd-f3144d0f8af4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567665', 'lastCheck': '5.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000217238', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365181', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556244', 'lastCheck': '9.0', 'valid': True}}
>Thread-783::DEBUG::2014-04-10 19:10:58,262::task::579::TaskManager.Task::(_updateState) Task=`68e302c8-01e0-4779-aebd-f3144d0f8af4`::moving from state preparing -> state finished
>Thread-783::DEBUG::2014-04-10 19:10:58,262::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-783::DEBUG::2014-04-10 19:10:58,262::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-783::DEBUG::2014-04-10 19:10:58,262::task::974::TaskManager.Task::(_decref) Task=`68e302c8-01e0-4779-aebd-f3144d0f8af4`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:10:59,232::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:10:59,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000491666 s, 748 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:01,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:01,066::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000438894 s, 1.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:01,080::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:01,086::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290522 s, 2.3 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:02,407::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:02,414::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000445366 s, 1.5 MB/s\n'; <rc> = 0
>Thread-786::DEBUG::2014-04-10 19:11:04,330::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-786::DEBUG::2014-04-10 19:11:04,331::task::579::TaskManager.Task::(_updateState) Task=`45688117-05dc-4fd0-92d6-a34f681fcdd0`::moving from state init -> state preparing
>Thread-786::INFO::2014-04-10 19:11:04,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-786::INFO::2014-04-10 19:11:04,331::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-786::DEBUG::2014-04-10 19:11:04,331::task::1168::TaskManager.Task::(prepare) Task=`45688117-05dc-4fd0-92d6-a34f681fcdd0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-786::DEBUG::2014-04-10 19:11:04,332::task::579::TaskManager.Task::(_updateState) Task=`45688117-05dc-4fd0-92d6-a34f681fcdd0`::moving from state preparing -> state finished
>Thread-786::DEBUG::2014-04-10 19:11:04,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-786::DEBUG::2014-04-10 19:11:04,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-786::DEBUG::2014-04-10 19:11:04,332::task::974::TaskManager.Task::(_decref) Task=`45688117-05dc-4fd0-92d6-a34f681fcdd0`::ref 0 aborting False
>Thread-787::DEBUG::2014-04-10 19:11:04,341::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-787::DEBUG::2014-04-10 19:11:04,341::task::579::TaskManager.Task::(_updateState) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::moving from state init -> state preparing
>Thread-787::INFO::2014-04-10 19:11:04,342::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-787::DEBUG::2014-04-10 19:11:04,342::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef878099-ba50-4e30-a6ba-3f9a9adee6f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-787::DEBUG::2014-04-10 19:11:04,342::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-787::DEBUG::2014-04-10 19:11:04,342::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-787::DEBUG::2014-04-10 19:11:04,343::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef878099-ba50-4e30-a6ba-3f9a9adee6f4`::Granted request
>Thread-787::DEBUG::2014-04-10 19:11:04,343::task::811::TaskManager.Task::(resourceAcquired) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-787::DEBUG::2014-04-10 19:11:04,343::task::974::TaskManager.Task::(_decref) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::ref 1 aborting False
>Thread-787::INFO::2014-04-10 19:11:04,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-787::DEBUG::2014-04-10 19:11:04,346::task::1168::TaskManager.Task::(prepare) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-787::DEBUG::2014-04-10 19:11:04,346::task::579::TaskManager.Task::(_updateState) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::moving from state preparing -> state finished
>Thread-787::DEBUG::2014-04-10 19:11:04,346::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-787::DEBUG::2014-04-10 19:11:04,346::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-787::DEBUG::2014-04-10 19:11:04,347::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-787::DEBUG::2014-04-10 19:11:04,347::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-787::DEBUG::2014-04-10 19:11:04,347::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-787::DEBUG::2014-04-10 19:11:04,347::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-787::DEBUG::2014-04-10 19:11:04,347::task::974::TaskManager.Task::(_decref) Task=`04ed3969-68f3-421b-936b-23c6a1eeed8b`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:09,247::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:09,254::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496582 s, 741 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:11,083::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:11,104::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000357841 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:11,124::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:11,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036138 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:12,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:12,428::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000533844 s, 1.2 MB/s\n'; <rc> = 0
>Thread-791::DEBUG::2014-04-10 19:11:13,456::task::579::TaskManager.Task::(_updateState) Task=`2cc07d25-154e-40df-80cf-c2eec086c8a4`::moving from state init -> state preparing
>Thread-791::INFO::2014-04-10 19:11:13,456::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-791::INFO::2014-04-10 19:11:13,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533844', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357841', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036138', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496582', 'lastCheck': '4.2', 'valid': True}}
>Thread-791::DEBUG::2014-04-10 19:11:13,457::task::1168::TaskManager.Task::(prepare) Task=`2cc07d25-154e-40df-80cf-c2eec086c8a4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533844', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357841', 'lastCheck': '2.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036138', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496582', 'lastCheck': '4.2', 'valid': True}}
>Thread-791::DEBUG::2014-04-10 19:11:13,457::task::579::TaskManager.Task::(_updateState) Task=`2cc07d25-154e-40df-80cf-c2eec086c8a4`::moving from state preparing -> state finished
>Thread-791::DEBUG::2014-04-10 19:11:13,457::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-791::DEBUG::2014-04-10 19:11:13,457::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-791::DEBUG::2014-04-10 19:11:13,457::task::974::TaskManager.Task::(_decref) Task=`2cc07d25-154e-40df-80cf-c2eec086c8a4`::ref 0 aborting False
>Thread-793::DEBUG::2014-04-10 19:11:14,427::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-793::DEBUG::2014-04-10 19:11:14,428::task::579::TaskManager.Task::(_updateState) Task=`973c12e4-9307-42a0-8bb7-820fed2a3290`::moving from state init -> state preparing
>Thread-793::INFO::2014-04-10 19:11:14,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-793::INFO::2014-04-10 19:11:14,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-793::DEBUG::2014-04-10 19:11:14,429::task::1168::TaskManager.Task::(prepare) Task=`973c12e4-9307-42a0-8bb7-820fed2a3290`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-793::DEBUG::2014-04-10 19:11:14,429::task::579::TaskManager.Task::(_updateState) Task=`973c12e4-9307-42a0-8bb7-820fed2a3290`::moving from state preparing -> state finished
>Thread-793::DEBUG::2014-04-10 19:11:14,429::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-793::DEBUG::2014-04-10 19:11:14,429::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-793::DEBUG::2014-04-10 19:11:14,429::task::974::TaskManager.Task::(_decref) Task=`973c12e4-9307-42a0-8bb7-820fed2a3290`::ref 0 aborting False
>Thread-794::DEBUG::2014-04-10 19:11:14,441::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-794::DEBUG::2014-04-10 19:11:14,441::task::579::TaskManager.Task::(_updateState) Task=`2ee89765-0685-4726-b896-0b695d34a600`::moving from state init -> state preparing
>Thread-794::INFO::2014-04-10 19:11:14,441::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-794::DEBUG::2014-04-10 19:11:14,442::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6925c339-4cec-45b3-8f92-ec9167ab2ca7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-794::DEBUG::2014-04-10 19:11:14,442::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-794::DEBUG::2014-04-10 19:11:14,442::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-794::DEBUG::2014-04-10 19:11:14,442::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6925c339-4cec-45b3-8f92-ec9167ab2ca7`::Granted request
>Thread-794::DEBUG::2014-04-10 19:11:14,443::task::811::TaskManager.Task::(resourceAcquired) Task=`2ee89765-0685-4726-b896-0b695d34a600`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-794::DEBUG::2014-04-10 19:11:14,443::task::974::TaskManager.Task::(_decref) Task=`2ee89765-0685-4726-b896-0b695d34a600`::ref 1 aborting False
>Thread-794::INFO::2014-04-10 19:11:14,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-794::DEBUG::2014-04-10 19:11:14,445::task::1168::TaskManager.Task::(prepare) Task=`2ee89765-0685-4726-b896-0b695d34a600`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-794::DEBUG::2014-04-10 19:11:14,446::task::579::TaskManager.Task::(_updateState) Task=`2ee89765-0685-4726-b896-0b695d34a600`::moving from state preparing -> state finished
>Thread-794::DEBUG::2014-04-10 19:11:14,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-794::DEBUG::2014-04-10 19:11:14,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-794::DEBUG::2014-04-10 19:11:14,446::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-794::DEBUG::2014-04-10 19:11:14,447::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-794::DEBUG::2014-04-10 19:11:14,447::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-794::DEBUG::2014-04-10 19:11:14,447::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-794::DEBUG::2014-04-10 19:11:14,447::task::974::TaskManager.Task::(_decref) Task=`2ee89765-0685-4726-b896-0b695d34a600`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:19,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:19,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000492772 s, 747 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:21,128::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:21,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00036286 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:21,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:21,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000414267 s, 1.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:22,436::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:22,443::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000543392 s, 1.2 MB/s\n'; <rc> = 0
>Thread-798::DEBUG::2014-04-10 19:11:24,783::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-798::DEBUG::2014-04-10 19:11:24,783::task::579::TaskManager.Task::(_updateState) Task=`99f1ab25-4b12-4a99-987e-c8527d73f49b`::moving from state init -> state preparing
>Thread-798::INFO::2014-04-10 19:11:24,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-798::INFO::2014-04-10 19:11:24,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-798::DEBUG::2014-04-10 19:11:24,784::task::1168::TaskManager.Task::(prepare) Task=`99f1ab25-4b12-4a99-987e-c8527d73f49b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-798::DEBUG::2014-04-10 19:11:24,784::task::579::TaskManager.Task::(_updateState) Task=`99f1ab25-4b12-4a99-987e-c8527d73f49b`::moving from state preparing -> state finished
>Thread-798::DEBUG::2014-04-10 19:11:24,784::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-798::DEBUG::2014-04-10 19:11:24,784::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-798::DEBUG::2014-04-10 19:11:24,785::task::974::TaskManager.Task::(_decref) Task=`99f1ab25-4b12-4a99-987e-c8527d73f49b`::ref 0 aborting False
>Thread-799::DEBUG::2014-04-10 19:11:24,793::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-799::DEBUG::2014-04-10 19:11:24,793::task::579::TaskManager.Task::(_updateState) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::moving from state init -> state preparing
>Thread-799::INFO::2014-04-10 19:11:24,794::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-799::DEBUG::2014-04-10 19:11:24,794::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aaeaba09-b96f-4f93-bcb5-41123cca80c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-799::DEBUG::2014-04-10 19:11:24,794::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-799::DEBUG::2014-04-10 19:11:24,794::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-799::DEBUG::2014-04-10 19:11:24,795::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`aaeaba09-b96f-4f93-bcb5-41123cca80c8`::Granted request
>Thread-799::DEBUG::2014-04-10 19:11:24,795::task::811::TaskManager.Task::(resourceAcquired) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-799::DEBUG::2014-04-10 19:11:24,795::task::974::TaskManager.Task::(_decref) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::ref 1 aborting False
>Thread-799::INFO::2014-04-10 19:11:24,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-799::DEBUG::2014-04-10 19:11:24,797::task::1168::TaskManager.Task::(prepare) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-799::DEBUG::2014-04-10 19:11:24,798::task::579::TaskManager.Task::(_updateState) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::moving from state preparing -> state finished
>Thread-799::DEBUG::2014-04-10 19:11:24,798::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-799::DEBUG::2014-04-10 19:11:24,798::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-799::DEBUG::2014-04-10 19:11:24,798::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-799::DEBUG::2014-04-10 19:11:24,798::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-799::DEBUG::2014-04-10 19:11:24,798::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-799::DEBUG::2014-04-10 19:11:24,799::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-799::DEBUG::2014-04-10 19:11:24,799::task::974::TaskManager.Task::(_decref) Task=`2661dc11-a7f7-48ec-bc7c-56e74d3c58cd`::ref 0 aborting False
>Thread-801::DEBUG::2014-04-10 19:11:28,621::task::579::TaskManager.Task::(_updateState) Task=`2c032707-fbdf-4bbf-a7ed-5349350487a8`::moving from state init -> state preparing
>Thread-801::INFO::2014-04-10 19:11:28,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-801::INFO::2014-04-10 19:11:28,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543392', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036286', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414267', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492772', 'lastCheck': '9.4', 'valid': True}}
>Thread-801::DEBUG::2014-04-10 19:11:28,622::task::1168::TaskManager.Task::(prepare) Task=`2c032707-fbdf-4bbf-a7ed-5349350487a8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543392', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036286', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414267', 'lastCheck': '7.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492772', 'lastCheck': '9.4', 'valid': True}}
>Thread-801::DEBUG::2014-04-10 19:11:28,622::task::579::TaskManager.Task::(_updateState) Task=`2c032707-fbdf-4bbf-a7ed-5349350487a8`::moving from state preparing -> state finished
>Thread-801::DEBUG::2014-04-10 19:11:28,622::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-801::DEBUG::2014-04-10 19:11:28,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-801::DEBUG::2014-04-10 19:11:28,623::task::974::TaskManager.Task::(_decref) Task=`2c032707-fbdf-4bbf-a7ed-5349350487a8`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:29,278::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:29,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485266 s, 758 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:31,167::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:31,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333644 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:31,200::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:31,206::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353813 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:32,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:32,461::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000487261 s, 1.4 MB/s\n'; <rc> = 0
>Thread-805::DEBUG::2014-04-10 19:11:35,091::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3bae4b09]
>Thread-805::DEBUG::2014-04-10 19:11:35,092::task::579::TaskManager.Task::(_updateState) Task=`09840147-d37d-43c3-be63-7bae810cb58a`::moving from state init -> state preparing
>Thread-805::INFO::2014-04-10 19:11:35,092::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-805::INFO::2014-04-10 19:11:35,092::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-805::DEBUG::2014-04-10 19:11:35,092::task::1168::TaskManager.Task::(prepare) Task=`09840147-d37d-43c3-be63-7bae810cb58a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-805::DEBUG::2014-04-10 19:11:35,093::task::579::TaskManager.Task::(_updateState) Task=`09840147-d37d-43c3-be63-7bae810cb58a`::moving from state preparing -> state finished
>Thread-805::DEBUG::2014-04-10 19:11:35,093::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-805::DEBUG::2014-04-10 19:11:35,093::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-805::DEBUG::2014-04-10 19:11:35,093::task::974::TaskManager.Task::(_decref) Task=`09840147-d37d-43c3-be63-7bae810cb58a`::ref 0 aborting False
>Thread-806::DEBUG::2014-04-10 19:11:35,101::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3bae4b09]
>Thread-806::DEBUG::2014-04-10 19:11:35,102::task::579::TaskManager.Task::(_updateState) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::moving from state init -> state preparing
>Thread-806::INFO::2014-04-10 19:11:35,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-806::DEBUG::2014-04-10 19:11:35,103::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e85f6efb-5b6b-49ca-b008-1e835b317e5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-806::DEBUG::2014-04-10 19:11:35,103::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-806::DEBUG::2014-04-10 19:11:35,103::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-806::DEBUG::2014-04-10 19:11:35,103::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e85f6efb-5b6b-49ca-b008-1e835b317e5a`::Granted request
>Thread-806::DEBUG::2014-04-10 19:11:35,104::task::811::TaskManager.Task::(resourceAcquired) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-806::DEBUG::2014-04-10 19:11:35,104::task::974::TaskManager.Task::(_decref) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::ref 1 aborting False
>Thread-806::INFO::2014-04-10 19:11:35,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-806::DEBUG::2014-04-10 19:11:35,106::task::1168::TaskManager.Task::(prepare) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-806::DEBUG::2014-04-10 19:11:35,107::task::579::TaskManager.Task::(_updateState) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::moving from state preparing -> state finished
>Thread-806::DEBUG::2014-04-10 19:11:35,107::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-806::DEBUG::2014-04-10 19:11:35,107::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-806::DEBUG::2014-04-10 19:11:35,107::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-806::DEBUG::2014-04-10 19:11:35,107::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-806::DEBUG::2014-04-10 19:11:35,108::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-806::DEBUG::2014-04-10 19:11:35,108::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-806::DEBUG::2014-04-10 19:11:35,108::task::974::TaskManager.Task::(_decref) Task=`c7148a66-6173-4252-b2b9-cd75c7c9a4e4`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:39,297::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:39,305::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496238 s, 742 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:41,205::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:41,227::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000303673 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:41,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:41,245::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000342503 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:42,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:42,479::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000473042 s, 1.4 MB/s\n'; <rc> = 0
>Thread-809::DEBUG::2014-04-10 19:11:43,861::task::579::TaskManager.Task::(_updateState) Task=`2ceb1f07-2ace-4e7a-8228-9afd6ceb8efc`::moving from state init -> state preparing
>Thread-809::INFO::2014-04-10 19:11:43,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-809::INFO::2014-04-10 19:11:43,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473042', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303673', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342503', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496238', 'lastCheck': '4.6', 'valid': True}}
>Thread-809::DEBUG::2014-04-10 19:11:43,861::task::1168::TaskManager.Task::(prepare) Task=`2ceb1f07-2ace-4e7a-8228-9afd6ceb8efc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473042', 'lastCheck': '1.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000303673', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342503', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496238', 'lastCheck': '4.6', 'valid': True}}
>Thread-809::DEBUG::2014-04-10 19:11:43,862::task::579::TaskManager.Task::(_updateState) Task=`2ceb1f07-2ace-4e7a-8228-9afd6ceb8efc`::moving from state preparing -> state finished
>Thread-809::DEBUG::2014-04-10 19:11:43,862::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-809::DEBUG::2014-04-10 19:11:43,862::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-809::DEBUG::2014-04-10 19:11:43,862::task::974::TaskManager.Task::(_decref) Task=`2ceb1f07-2ace-4e7a-8228-9afd6ceb8efc`::ref 0 aborting False
>Thread-811::DEBUG::2014-04-10 19:11:45,189::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-811::DEBUG::2014-04-10 19:11:45,190::task::579::TaskManager.Task::(_updateState) Task=`92f05ef5-45af-415c-a7ac-ac067ef86860`::moving from state init -> state preparing
>Thread-811::INFO::2014-04-10 19:11:45,190::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-811::INFO::2014-04-10 19:11:45,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-811::DEBUG::2014-04-10 19:11:45,190::task::1168::TaskManager.Task::(prepare) Task=`92f05ef5-45af-415c-a7ac-ac067ef86860`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-811::DEBUG::2014-04-10 19:11:45,191::task::579::TaskManager.Task::(_updateState) Task=`92f05ef5-45af-415c-a7ac-ac067ef86860`::moving from state preparing -> state finished
>Thread-811::DEBUG::2014-04-10 19:11:45,191::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-811::DEBUG::2014-04-10 19:11:45,191::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-811::DEBUG::2014-04-10 19:11:45,191::task::974::TaskManager.Task::(_decref) Task=`92f05ef5-45af-415c-a7ac-ac067ef86860`::ref 0 aborting False
>Thread-812::DEBUG::2014-04-10 19:11:45,199::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-812::DEBUG::2014-04-10 19:11:45,200::task::579::TaskManager.Task::(_updateState) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::moving from state init -> state preparing
>Thread-812::INFO::2014-04-10 19:11:45,200::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-812::DEBUG::2014-04-10 19:11:45,201::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec8aa790-3031-4165-873e-7ac8ef469463`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-812::DEBUG::2014-04-10 19:11:45,201::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-812::DEBUG::2014-04-10 19:11:45,201::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-812::DEBUG::2014-04-10 19:11:45,201::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec8aa790-3031-4165-873e-7ac8ef469463`::Granted request
>Thread-812::DEBUG::2014-04-10 19:11:45,202::task::811::TaskManager.Task::(resourceAcquired) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-812::DEBUG::2014-04-10 19:11:45,202::task::974::TaskManager.Task::(_decref) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::ref 1 aborting False
>Thread-812::INFO::2014-04-10 19:11:45,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-812::DEBUG::2014-04-10 19:11:45,204::task::1168::TaskManager.Task::(prepare) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-812::DEBUG::2014-04-10 19:11:45,205::task::579::TaskManager.Task::(_updateState) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::moving from state preparing -> state finished
>Thread-812::DEBUG::2014-04-10 19:11:45,205::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-812::DEBUG::2014-04-10 19:11:45,205::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-812::DEBUG::2014-04-10 19:11:45,205::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-812::DEBUG::2014-04-10 19:11:45,205::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-812::DEBUG::2014-04-10 19:11:45,206::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-812::DEBUG::2014-04-10 19:11:45,206::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-812::DEBUG::2014-04-10 19:11:45,206::task::974::TaskManager.Task::(_decref) Task=`ffe92280-3e98-4ebf-8ce2-5159e70fe458`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:49,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:49,319::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000493378 s, 746 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:11:51,243::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:11:51,267::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317393 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:11:51,280::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:11:51,285::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355204 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:11:52,487::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:11:52,494::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000488346 s, 1.3 MB/s\n'; <rc> = 0
>Thread-816::DEBUG::2014-04-10 19:11:55,296::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-816::DEBUG::2014-04-10 19:11:55,297::task::579::TaskManager.Task::(_updateState) Task=`54849d89-0b34-434e-bbbb-cc9a3f11fe1f`::moving from state init -> state preparing
>Thread-816::INFO::2014-04-10 19:11:55,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-816::INFO::2014-04-10 19:11:55,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-816::DEBUG::2014-04-10 19:11:55,297::task::1168::TaskManager.Task::(prepare) Task=`54849d89-0b34-434e-bbbb-cc9a3f11fe1f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-816::DEBUG::2014-04-10 19:11:55,298::task::579::TaskManager.Task::(_updateState) Task=`54849d89-0b34-434e-bbbb-cc9a3f11fe1f`::moving from state preparing -> state finished
>Thread-816::DEBUG::2014-04-10 19:11:55,298::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-816::DEBUG::2014-04-10 19:11:55,298::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-816::DEBUG::2014-04-10 19:11:55,298::task::974::TaskManager.Task::(_decref) Task=`54849d89-0b34-434e-bbbb-cc9a3f11fe1f`::ref 0 aborting False
>Thread-817::DEBUG::2014-04-10 19:11:55,315::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-817::DEBUG::2014-04-10 19:11:55,315::task::579::TaskManager.Task::(_updateState) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::moving from state init -> state preparing
>Thread-817::INFO::2014-04-10 19:11:55,315::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-817::DEBUG::2014-04-10 19:11:55,316::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13bd3a20-05f3-4d1e-bead-dcc55acb43d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-817::DEBUG::2014-04-10 19:11:55,316::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-817::DEBUG::2014-04-10 19:11:55,316::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-817::DEBUG::2014-04-10 19:11:55,316::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`13bd3a20-05f3-4d1e-bead-dcc55acb43d4`::Granted request
>Thread-817::DEBUG::2014-04-10 19:11:55,317::task::811::TaskManager.Task::(resourceAcquired) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-817::DEBUG::2014-04-10 19:11:55,317::task::974::TaskManager.Task::(_decref) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::ref 1 aborting False
>Thread-817::INFO::2014-04-10 19:11:55,319::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-817::DEBUG::2014-04-10 19:11:55,319::task::1168::TaskManager.Task::(prepare) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-817::DEBUG::2014-04-10 19:11:55,319::task::579::TaskManager.Task::(_updateState) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::moving from state preparing -> state finished
>Thread-817::DEBUG::2014-04-10 19:11:55,319::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-817::DEBUG::2014-04-10 19:11:55,320::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-817::DEBUG::2014-04-10 19:11:55,320::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-817::DEBUG::2014-04-10 19:11:55,320::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-817::DEBUG::2014-04-10 19:11:55,320::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-817::DEBUG::2014-04-10 19:11:55,320::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-817::DEBUG::2014-04-10 19:11:55,320::task::974::TaskManager.Task::(_decref) Task=`b5414270-b6c1-4117-93ad-ff431efbd4ed`::ref 0 aborting False
>Thread-819::DEBUG::2014-04-10 19:11:59,056::task::579::TaskManager.Task::(_updateState) Task=`dee9e03c-231f-41d0-86ba-bf7cc1f18761`::moving from state init -> state preparing
>Thread-819::INFO::2014-04-10 19:11:59,057::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-819::INFO::2014-04-10 19:11:59,057::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488346', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317393', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355204', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493378', 'lastCheck': '9.7', 'valid': True}}
>Thread-819::DEBUG::2014-04-10 19:11:59,057::task::1168::TaskManager.Task::(prepare) Task=`dee9e03c-231f-41d0-86ba-bf7cc1f18761`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488346', 'lastCheck': '6.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000317393', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355204', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493378', 'lastCheck': '9.7', 'valid': True}}
>Thread-819::DEBUG::2014-04-10 19:11:59,057::task::579::TaskManager.Task::(_updateState) Task=`dee9e03c-231f-41d0-86ba-bf7cc1f18761`::moving from state preparing -> state finished
>Thread-819::DEBUG::2014-04-10 19:11:59,057::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-819::DEBUG::2014-04-10 19:11:59,058::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-819::DEBUG::2014-04-10 19:11:59,058::task::974::TaskManager.Task::(_decref) Task=`dee9e03c-231f-41d0-86ba-bf7cc1f18761`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:11:59,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:11:59,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000454047 s, 810 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:12:01,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:01,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000383021 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:01,318::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:01,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365232 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:02,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:02,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000424533 s, 1.5 MB/s\n'; <rc> = 0
>Thread-823::DEBUG::2014-04-10 19:12:05,403::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-823::DEBUG::2014-04-10 19:12:05,404::task::579::TaskManager.Task::(_updateState) Task=`3ad26cc6-4b8e-4b4f-b8de-1e4e3aef6d99`::moving from state init -> state preparing
>Thread-823::INFO::2014-04-10 19:12:05,404::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-823::INFO::2014-04-10 19:12:05,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-823::DEBUG::2014-04-10 19:12:05,404::task::1168::TaskManager.Task::(prepare) Task=`3ad26cc6-4b8e-4b4f-b8de-1e4e3aef6d99`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-823::DEBUG::2014-04-10 19:12:05,405::task::579::TaskManager.Task::(_updateState) Task=`3ad26cc6-4b8e-4b4f-b8de-1e4e3aef6d99`::moving from state preparing -> state finished
>Thread-823::DEBUG::2014-04-10 19:12:05,405::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-823::DEBUG::2014-04-10 19:12:05,405::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-823::DEBUG::2014-04-10 19:12:05,405::task::974::TaskManager.Task::(_decref) Task=`3ad26cc6-4b8e-4b4f-b8de-1e4e3aef6d99`::ref 0 aborting False
>Thread-824::DEBUG::2014-04-10 19:12:05,414::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-824::DEBUG::2014-04-10 19:12:05,414::task::579::TaskManager.Task::(_updateState) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::moving from state init -> state preparing
>Thread-824::INFO::2014-04-10 19:12:05,414::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-824::DEBUG::2014-04-10 19:12:05,415::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6d9c97f-dd8e-4f6e-9b3a-421b24727ed7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-824::DEBUG::2014-04-10 19:12:05,415::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-824::DEBUG::2014-04-10 19:12:05,416::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-824::DEBUG::2014-04-10 19:12:05,416::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a6d9c97f-dd8e-4f6e-9b3a-421b24727ed7`::Granted request
>Thread-824::DEBUG::2014-04-10 19:12:05,417::task::811::TaskManager.Task::(resourceAcquired) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-824::DEBUG::2014-04-10 19:12:05,417::task::974::TaskManager.Task::(_decref) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::ref 1 aborting False
>Thread-824::INFO::2014-04-10 19:12:05,419::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-824::DEBUG::2014-04-10 19:12:05,420::task::1168::TaskManager.Task::(prepare) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-824::DEBUG::2014-04-10 19:12:05,420::task::579::TaskManager.Task::(_updateState) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::moving from state preparing -> state finished
>Thread-824::DEBUG::2014-04-10 19:12:05,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-824::DEBUG::2014-04-10 19:12:05,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-824::DEBUG::2014-04-10 19:12:05,420::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-824::DEBUG::2014-04-10 19:12:05,421::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-824::DEBUG::2014-04-10 19:12:05,421::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-824::DEBUG::2014-04-10 19:12:05,421::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-824::DEBUG::2014-04-10 19:12:05,421::task::974::TaskManager.Task::(_decref) Task=`12852156-f220-4b42-8f1f-2587004c93dc`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:09,339::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:09,346::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444397 s, 828 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:12:11,321::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:11,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000362294 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:11,357::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:11,362::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320608 s, 2.1 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:12,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:12,526::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00047671 s, 1.4 MB/s\n'; <rc> = 0
>Thread-827::DEBUG::2014-04-10 19:12:14,265::task::579::TaskManager.Task::(_updateState) Task=`4e663285-d8cf-4e94-89d9-e82ad68692ed`::moving from state init -> state preparing
>Thread-827::INFO::2014-04-10 19:12:14,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-827::INFO::2014-04-10 19:12:14,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047671', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362294', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320608', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444397', 'lastCheck': '4.9', 'valid': True}}
>Thread-827::DEBUG::2014-04-10 19:12:14,266::task::1168::TaskManager.Task::(prepare) Task=`4e663285-d8cf-4e94-89d9-e82ad68692ed`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047671', 'lastCheck': '1.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362294', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000320608', 'lastCheck': '2.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444397', 'lastCheck': '4.9', 'valid': True}}
>Thread-827::DEBUG::2014-04-10 19:12:14,266::task::579::TaskManager.Task::(_updateState) Task=`4e663285-d8cf-4e94-89d9-e82ad68692ed`::moving from state preparing -> state finished
>Thread-827::DEBUG::2014-04-10 19:12:14,266::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-827::DEBUG::2014-04-10 19:12:14,266::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-827::DEBUG::2014-04-10 19:12:14,266::task::974::TaskManager.Task::(_decref) Task=`4e663285-d8cf-4e94-89d9-e82ad68692ed`::ref 0 aborting False
>Thread-829::DEBUG::2014-04-10 19:12:15,502::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-829::DEBUG::2014-04-10 19:12:15,503::task::579::TaskManager.Task::(_updateState) Task=`56551a15-c628-4e75-8b9c-6cdbdae83481`::moving from state init -> state preparing
>Thread-829::INFO::2014-04-10 19:12:15,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-829::INFO::2014-04-10 19:12:15,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-829::DEBUG::2014-04-10 19:12:15,504::task::1168::TaskManager.Task::(prepare) Task=`56551a15-c628-4e75-8b9c-6cdbdae83481`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-829::DEBUG::2014-04-10 19:12:15,504::task::579::TaskManager.Task::(_updateState) Task=`56551a15-c628-4e75-8b9c-6cdbdae83481`::moving from state preparing -> state finished
>Thread-829::DEBUG::2014-04-10 19:12:15,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-829::DEBUG::2014-04-10 19:12:15,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-829::DEBUG::2014-04-10 19:12:15,505::task::974::TaskManager.Task::(_decref) Task=`56551a15-c628-4e75-8b9c-6cdbdae83481`::ref 0 aborting False
>Thread-830::DEBUG::2014-04-10 19:12:15,514::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-830::DEBUG::2014-04-10 19:12:15,514::task::579::TaskManager.Task::(_updateState) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::moving from state init -> state preparing
>Thread-830::INFO::2014-04-10 19:12:15,514::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-830::DEBUG::2014-04-10 19:12:15,515::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ba136d5c-86dd-457d-85c1-37ad424ac634`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-830::DEBUG::2014-04-10 19:12:15,515::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-830::DEBUG::2014-04-10 19:12:15,515::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-830::DEBUG::2014-04-10 19:12:15,516::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ba136d5c-86dd-457d-85c1-37ad424ac634`::Granted request
>Thread-830::DEBUG::2014-04-10 19:12:15,516::task::811::TaskManager.Task::(resourceAcquired) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-830::DEBUG::2014-04-10 19:12:15,516::task::974::TaskManager.Task::(_decref) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::ref 1 aborting False
>Thread-830::INFO::2014-04-10 19:12:15,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-830::DEBUG::2014-04-10 19:12:15,519::task::1168::TaskManager.Task::(prepare) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-830::DEBUG::2014-04-10 19:12:15,519::task::579::TaskManager.Task::(_updateState) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::moving from state preparing -> state finished
>Thread-830::DEBUG::2014-04-10 19:12:15,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-830::DEBUG::2014-04-10 19:12:15,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-830::DEBUG::2014-04-10 19:12:15,520::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-830::DEBUG::2014-04-10 19:12:15,520::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-830::DEBUG::2014-04-10 19:12:15,520::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-830::DEBUG::2014-04-10 19:12:15,520::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-830::DEBUG::2014-04-10 19:12:15,520::task::974::TaskManager.Task::(_decref) Task=`9b9618d2-9925-490c-bf7e-0a523a1144b9`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:19,353::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:19,360::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000478281 s, 769 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:12:21,361::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:21,385::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000378963 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:21,397::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:21,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347656 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:22,534::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:22,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000523507 s, 1.3 MB/s\n'; <rc> = 0
>Thread-834::DEBUG::2014-04-10 19:12:25,817::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-834::DEBUG::2014-04-10 19:12:25,818::task::579::TaskManager.Task::(_updateState) Task=`3fae9285-2c04-420f-a828-c6ee96d669ac`::moving from state init -> state preparing
>Thread-834::INFO::2014-04-10 19:12:25,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-834::INFO::2014-04-10 19:12:25,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-834::DEBUG::2014-04-10 19:12:25,818::task::1168::TaskManager.Task::(prepare) Task=`3fae9285-2c04-420f-a828-c6ee96d669ac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-834::DEBUG::2014-04-10 19:12:25,819::task::579::TaskManager.Task::(_updateState) Task=`3fae9285-2c04-420f-a828-c6ee96d669ac`::moving from state preparing -> state finished
>Thread-834::DEBUG::2014-04-10 19:12:25,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-834::DEBUG::2014-04-10 19:12:25,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-834::DEBUG::2014-04-10 19:12:25,819::task::974::TaskManager.Task::(_decref) Task=`3fae9285-2c04-420f-a828-c6ee96d669ac`::ref 0 aborting False
>Thread-835::DEBUG::2014-04-10 19:12:25,827::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-835::DEBUG::2014-04-10 19:12:25,828::task::579::TaskManager.Task::(_updateState) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::moving from state init -> state preparing
>Thread-835::INFO::2014-04-10 19:12:25,828::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-835::DEBUG::2014-04-10 19:12:25,828::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01339a3e-a905-4ce2-a9bb-4e1e09fdd4ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-835::DEBUG::2014-04-10 19:12:25,829::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-835::DEBUG::2014-04-10 19:12:25,829::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-835::DEBUG::2014-04-10 19:12:25,829::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`01339a3e-a905-4ce2-a9bb-4e1e09fdd4ea`::Granted request
>Thread-835::DEBUG::2014-04-10 19:12:25,829::task::811::TaskManager.Task::(resourceAcquired) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-835::DEBUG::2014-04-10 19:12:25,829::task::974::TaskManager.Task::(_decref) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::ref 1 aborting False
>Thread-835::INFO::2014-04-10 19:12:25,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-835::DEBUG::2014-04-10 19:12:25,832::task::1168::TaskManager.Task::(prepare) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-835::DEBUG::2014-04-10 19:12:25,832::task::579::TaskManager.Task::(_updateState) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::moving from state preparing -> state finished
>Thread-835::DEBUG::2014-04-10 19:12:25,832::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-835::DEBUG::2014-04-10 19:12:25,832::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-835::DEBUG::2014-04-10 19:12:25,832::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-835::DEBUG::2014-04-10 19:12:25,833::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-835::DEBUG::2014-04-10 19:12:25,833::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-835::DEBUG::2014-04-10 19:12:25,833::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-835::DEBUG::2014-04-10 19:12:25,833::task::974::TaskManager.Task::(_decref) Task=`915de7ef-8fa6-4fbb-99e3-490fe059299c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:29,367::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:29,373::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.0004531 s, 812 kB/s\n'; <rc> = 0
>Thread-837::DEBUG::2014-04-10 19:12:29,459::task::579::TaskManager.Task::(_updateState) Task=`1d4e9e4b-4513-44de-a86a-38a7ee2fb3ba`::moving from state init -> state preparing
>Thread-837::INFO::2014-04-10 19:12:29,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-837::INFO::2014-04-10 19:12:29,460::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523507', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378963', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347656', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004531', 'lastCheck': '0.1', 'valid': True}}
>Thread-837::DEBUG::2014-04-10 19:12:29,460::task::1168::TaskManager.Task::(prepare) Task=`1d4e9e4b-4513-44de-a86a-38a7ee2fb3ba`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523507', 'lastCheck': '6.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000378963', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000347656', 'lastCheck': '8.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004531', 'lastCheck': '0.1', 'valid': True}}
>Thread-837::DEBUG::2014-04-10 19:12:29,460::task::579::TaskManager.Task::(_updateState) Task=`1d4e9e4b-4513-44de-a86a-38a7ee2fb3ba`::moving from state preparing -> state finished
>Thread-837::DEBUG::2014-04-10 19:12:29,461::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-837::DEBUG::2014-04-10 19:12:29,461::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-837::DEBUG::2014-04-10 19:12:29,461::task::974::TaskManager.Task::(_decref) Task=`1d4e9e4b-4513-44de-a86a-38a7ee2fb3ba`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:12:31,401::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:31,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000289432 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:31,437::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:31,445::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0016248 s, 413 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:32,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:32,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000509623 s, 1.3 MB/s\n'; <rc> = 0
>Thread-841::DEBUG::2014-04-10 19:12:36,362::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-841::DEBUG::2014-04-10 19:12:36,363::task::579::TaskManager.Task::(_updateState) Task=`8cebcfd5-efb0-471c-a65f-ecbddbdd1ad3`::moving from state init -> state preparing
>Thread-841::INFO::2014-04-10 19:12:36,363::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-841::INFO::2014-04-10 19:12:36,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-841::DEBUG::2014-04-10 19:12:36,364::task::1168::TaskManager.Task::(prepare) Task=`8cebcfd5-efb0-471c-a65f-ecbddbdd1ad3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-841::DEBUG::2014-04-10 19:12:36,364::task::579::TaskManager.Task::(_updateState) Task=`8cebcfd5-efb0-471c-a65f-ecbddbdd1ad3`::moving from state preparing -> state finished
>Thread-841::DEBUG::2014-04-10 19:12:36,364::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-841::DEBUG::2014-04-10 19:12:36,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-841::DEBUG::2014-04-10 19:12:36,365::task::974::TaskManager.Task::(_decref) Task=`8cebcfd5-efb0-471c-a65f-ecbddbdd1ad3`::ref 0 aborting False
>Thread-842::DEBUG::2014-04-10 19:12:36,374::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-842::DEBUG::2014-04-10 19:12:36,374::task::579::TaskManager.Task::(_updateState) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::moving from state init -> state preparing
>Thread-842::INFO::2014-04-10 19:12:36,375::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-842::DEBUG::2014-04-10 19:12:36,375::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef89bea3-9a41-4297-958c-a3a126630790`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-842::DEBUG::2014-04-10 19:12:36,375::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-842::DEBUG::2014-04-10 19:12:36,376::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-842::DEBUG::2014-04-10 19:12:36,376::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ef89bea3-9a41-4297-958c-a3a126630790`::Granted request
>Thread-842::DEBUG::2014-04-10 19:12:36,376::task::811::TaskManager.Task::(resourceAcquired) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-842::DEBUG::2014-04-10 19:12:36,376::task::974::TaskManager.Task::(_decref) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::ref 1 aborting False
>Thread-842::INFO::2014-04-10 19:12:36,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-842::DEBUG::2014-04-10 19:12:36,379::task::1168::TaskManager.Task::(prepare) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-842::DEBUG::2014-04-10 19:12:36,379::task::579::TaskManager.Task::(_updateState) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::moving from state preparing -> state finished
>Thread-842::DEBUG::2014-04-10 19:12:36,379::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-842::DEBUG::2014-04-10 19:12:36,380::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-842::DEBUG::2014-04-10 19:12:36,380::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-842::DEBUG::2014-04-10 19:12:36,380::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-842::DEBUG::2014-04-10 19:12:36,380::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-842::DEBUG::2014-04-10 19:12:36,380::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-842::DEBUG::2014-04-10 19:12:36,381::task::974::TaskManager.Task::(_decref) Task=`fffa268c-6d3a-438a-832f-6f5defd383ca`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:39,382::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:39,390::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000488844 s, 753 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:12:41,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:41,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000465231 s, 1.4 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:41,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:41,471::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000402571 s, 1.7 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:42,569::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:42,576::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000530459 s, 1.2 MB/s\n'; <rc> = 0
>Thread-845::DEBUG::2014-04-10 19:12:44,688::task::579::TaskManager.Task::(_updateState) Task=`d820a4be-3c81-4fb8-83e2-bbd3172f4fc4`::moving from state init -> state preparing
>Thread-845::INFO::2014-04-10 19:12:44,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-845::INFO::2014-04-10 19:12:44,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530459', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465231', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402571', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488844', 'lastCheck': '5.3', 'valid': True}}
>Thread-845::DEBUG::2014-04-10 19:12:44,689::task::1168::TaskManager.Task::(prepare) Task=`d820a4be-3c81-4fb8-83e2-bbd3172f4fc4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530459', 'lastCheck': '2.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465231', 'lastCheck': '3.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402571', 'lastCheck': '3.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488844', 'lastCheck': '5.3', 'valid': True}}
>Thread-845::DEBUG::2014-04-10 19:12:44,689::task::579::TaskManager.Task::(_updateState) Task=`d820a4be-3c81-4fb8-83e2-bbd3172f4fc4`::moving from state preparing -> state finished
>Thread-845::DEBUG::2014-04-10 19:12:44,689::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-845::DEBUG::2014-04-10 19:12:44,689::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-845::DEBUG::2014-04-10 19:12:44,690::task::974::TaskManager.Task::(_decref) Task=`d820a4be-3c81-4fb8-83e2-bbd3172f4fc4`::ref 0 aborting False
>Thread-847::DEBUG::2014-04-10 19:12:46,481::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-847::DEBUG::2014-04-10 19:12:46,495::task::579::TaskManager.Task::(_updateState) Task=`ea829266-819b-4eab-9c1e-be16bcdfa33e`::moving from state init -> state preparing
>Thread-847::INFO::2014-04-10 19:12:46,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-847::INFO::2014-04-10 19:12:46,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-847::DEBUG::2014-04-10 19:12:46,496::task::1168::TaskManager.Task::(prepare) Task=`ea829266-819b-4eab-9c1e-be16bcdfa33e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-847::DEBUG::2014-04-10 19:12:46,496::task::579::TaskManager.Task::(_updateState) Task=`ea829266-819b-4eab-9c1e-be16bcdfa33e`::moving from state preparing -> state finished
>Thread-847::DEBUG::2014-04-10 19:12:46,496::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-847::DEBUG::2014-04-10 19:12:46,496::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-847::DEBUG::2014-04-10 19:12:46,496::task::974::TaskManager.Task::(_decref) Task=`ea829266-819b-4eab-9c1e-be16bcdfa33e`::ref 0 aborting False
>Thread-848::DEBUG::2014-04-10 19:12:46,505::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-848::DEBUG::2014-04-10 19:12:46,505::task::579::TaskManager.Task::(_updateState) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::moving from state init -> state preparing
>Thread-848::INFO::2014-04-10 19:12:46,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-848::DEBUG::2014-04-10 19:12:46,506::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6d8da297-07e6-40f2-954b-794103a15e05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-848::DEBUG::2014-04-10 19:12:46,506::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-848::DEBUG::2014-04-10 19:12:46,507::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-848::DEBUG::2014-04-10 19:12:46,507::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6d8da297-07e6-40f2-954b-794103a15e05`::Granted request
>Thread-848::DEBUG::2014-04-10 19:12:46,508::task::811::TaskManager.Task::(resourceAcquired) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-848::DEBUG::2014-04-10 19:12:46,508::task::974::TaskManager.Task::(_decref) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::ref 1 aborting False
>Thread-848::INFO::2014-04-10 19:12:46,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-848::DEBUG::2014-04-10 19:12:46,510::task::1168::TaskManager.Task::(prepare) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-848::DEBUG::2014-04-10 19:12:46,511::task::579::TaskManager.Task::(_updateState) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::moving from state preparing -> state finished
>Thread-848::DEBUG::2014-04-10 19:12:46,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-848::DEBUG::2014-04-10 19:12:46,511::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-848::DEBUG::2014-04-10 19:12:46,511::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-848::DEBUG::2014-04-10 19:12:46,511::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-848::DEBUG::2014-04-10 19:12:46,511::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-848::DEBUG::2014-04-10 19:12:46,512::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-848::DEBUG::2014-04-10 19:12:46,512::task::974::TaskManager.Task::(_decref) Task=`8b8123a7-7a63-447c-9385-336a8c6f163c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:49,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:49,403::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000441869 s, 833 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:12:51,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:12:51,491::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000368936 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:12:51,510::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:12:51,518::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00035459 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:12:52,584::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:12:52,590::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000439785 s, 1.5 MB/s\n'; <rc> = 0
>Thread-852::DEBUG::2014-04-10 19:12:56,589::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-852::DEBUG::2014-04-10 19:12:56,596::task::579::TaskManager.Task::(_updateState) Task=`905aa873-3317-416a-a9c6-ddc42205f6e9`::moving from state init -> state preparing
>Thread-852::INFO::2014-04-10 19:12:56,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-852::INFO::2014-04-10 19:12:56,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-852::DEBUG::2014-04-10 19:12:56,597::task::1168::TaskManager.Task::(prepare) Task=`905aa873-3317-416a-a9c6-ddc42205f6e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-852::DEBUG::2014-04-10 19:12:56,597::task::579::TaskManager.Task::(_updateState) Task=`905aa873-3317-416a-a9c6-ddc42205f6e9`::moving from state preparing -> state finished
>Thread-852::DEBUG::2014-04-10 19:12:56,597::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-852::DEBUG::2014-04-10 19:12:56,598::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-852::DEBUG::2014-04-10 19:12:56,598::task::974::TaskManager.Task::(_decref) Task=`905aa873-3317-416a-a9c6-ddc42205f6e9`::ref 0 aborting False
>Thread-853::DEBUG::2014-04-10 19:12:56,606::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-853::DEBUG::2014-04-10 19:12:56,607::task::579::TaskManager.Task::(_updateState) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::moving from state init -> state preparing
>Thread-853::INFO::2014-04-10 19:12:56,607::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-853::DEBUG::2014-04-10 19:12:56,608::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`85c87daf-9c5f-4708-a0e1-cd80bb147708`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-853::DEBUG::2014-04-10 19:12:56,608::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-853::DEBUG::2014-04-10 19:12:56,608::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-853::DEBUG::2014-04-10 19:12:56,608::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`85c87daf-9c5f-4708-a0e1-cd80bb147708`::Granted request
>Thread-853::DEBUG::2014-04-10 19:12:56,608::task::811::TaskManager.Task::(resourceAcquired) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-853::DEBUG::2014-04-10 19:12:56,609::task::974::TaskManager.Task::(_decref) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::ref 1 aborting False
>Thread-853::INFO::2014-04-10 19:12:56,611::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-853::DEBUG::2014-04-10 19:12:56,611::task::1168::TaskManager.Task::(prepare) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-853::DEBUG::2014-04-10 19:12:56,611::task::579::TaskManager.Task::(_updateState) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::moving from state preparing -> state finished
>Thread-853::DEBUG::2014-04-10 19:12:56,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-853::DEBUG::2014-04-10 19:12:56,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-853::DEBUG::2014-04-10 19:12:56,612::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-853::DEBUG::2014-04-10 19:12:56,612::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-853::DEBUG::2014-04-10 19:12:56,612::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-853::DEBUG::2014-04-10 19:12:56,612::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-853::DEBUG::2014-04-10 19:12:56,612::task::974::TaskManager.Task::(_decref) Task=`870fc45b-2273-4227-865f-dd761d6fa885`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:12:59,410::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:12:59,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000553505 s, 665 kB/s\n'; <rc> = 0
>Thread-855::DEBUG::2014-04-10 19:12:59,873::task::579::TaskManager.Task::(_updateState) Task=`69bdd767-0c9f-4ab0-b47d-49e49324089d`::moving from state init -> state preparing
>Thread-855::INFO::2014-04-10 19:12:59,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-855::INFO::2014-04-10 19:12:59,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439785', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368936', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035459', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553505', 'lastCheck': '0.5', 'valid': True}}
>Thread-855::DEBUG::2014-04-10 19:12:59,873::task::1168::TaskManager.Task::(prepare) Task=`69bdd767-0c9f-4ab0-b47d-49e49324089d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439785', 'lastCheck': '7.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368936', 'lastCheck': '8.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00035459', 'lastCheck': '8.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553505', 'lastCheck': '0.5', 'valid': True}}
>Thread-855::DEBUG::2014-04-10 19:12:59,874::task::579::TaskManager.Task::(_updateState) Task=`69bdd767-0c9f-4ab0-b47d-49e49324089d`::moving from state preparing -> state finished
>Thread-855::DEBUG::2014-04-10 19:12:59,874::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-855::DEBUG::2014-04-10 19:12:59,874::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-855::DEBUG::2014-04-10 19:12:59,874::task::974::TaskManager.Task::(_decref) Task=`69bdd767-0c9f-4ab0-b47d-49e49324089d`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:13:01,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:01,520::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000421863 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:01,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:01,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000395479 s, 1.7 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:02,599::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:02,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000490243 s, 1.3 MB/s\n'; <rc> = 0
>Thread-859::DEBUG::2014-04-10 19:13:06,704::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-859::DEBUG::2014-04-10 19:13:06,704::task::579::TaskManager.Task::(_updateState) Task=`cabea2b4-49ad-41fb-8dc0-d641d5060537`::moving from state init -> state preparing
>Thread-859::INFO::2014-04-10 19:13:06,704::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-859::INFO::2014-04-10 19:13:06,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-859::DEBUG::2014-04-10 19:13:06,705::task::1168::TaskManager.Task::(prepare) Task=`cabea2b4-49ad-41fb-8dc0-d641d5060537`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-859::DEBUG::2014-04-10 19:13:06,705::task::579::TaskManager.Task::(_updateState) Task=`cabea2b4-49ad-41fb-8dc0-d641d5060537`::moving from state preparing -> state finished
>Thread-859::DEBUG::2014-04-10 19:13:06,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-859::DEBUG::2014-04-10 19:13:06,706::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-859::DEBUG::2014-04-10 19:13:06,706::task::974::TaskManager.Task::(_decref) Task=`cabea2b4-49ad-41fb-8dc0-d641d5060537`::ref 0 aborting False
>Thread-860::DEBUG::2014-04-10 19:13:06,714::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-860::DEBUG::2014-04-10 19:13:06,715::task::579::TaskManager.Task::(_updateState) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::moving from state init -> state preparing
>Thread-860::INFO::2014-04-10 19:13:06,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-860::DEBUG::2014-04-10 19:13:06,715::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`275d6f57-973e-4801-b77a-60be01993932`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-860::DEBUG::2014-04-10 19:13:06,715::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-860::DEBUG::2014-04-10 19:13:06,716::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-860::DEBUG::2014-04-10 19:13:06,716::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`275d6f57-973e-4801-b77a-60be01993932`::Granted request
>Thread-860::DEBUG::2014-04-10 19:13:06,716::task::811::TaskManager.Task::(resourceAcquired) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-860::DEBUG::2014-04-10 19:13:06,716::task::974::TaskManager.Task::(_decref) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::ref 1 aborting False
>Thread-860::INFO::2014-04-10 19:13:06,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-860::DEBUG::2014-04-10 19:13:06,719::task::1168::TaskManager.Task::(prepare) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-860::DEBUG::2014-04-10 19:13:06,719::task::579::TaskManager.Task::(_updateState) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::moving from state preparing -> state finished
>Thread-860::DEBUG::2014-04-10 19:13:06,720::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-860::DEBUG::2014-04-10 19:13:06,720::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-860::DEBUG::2014-04-10 19:13:06,720::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-860::DEBUG::2014-04-10 19:13:06,720::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-860::DEBUG::2014-04-10 19:13:06,720::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-860::DEBUG::2014-04-10 19:13:06,721::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-860::DEBUG::2014-04-10 19:13:06,721::task::974::TaskManager.Task::(_decref) Task=`a28e427a-5c96-48b7-8833-1cb936312732`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:09,424::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:09,431::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464518 s, 792 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:13:11,532::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:11,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420519 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:11,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:11,561::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000269859 s, 2.5 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:12,613::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:12,619::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000505884 s, 1.3 MB/s\n'; <rc> = 0
>Thread-863::DEBUG::2014-04-10 19:13:15,065::task::579::TaskManager.Task::(_updateState) Task=`b91ab06b-d8f8-4c3d-ab09-8272ddcb1169`::moving from state init -> state preparing
>Thread-863::INFO::2014-04-10 19:13:15,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-863::INFO::2014-04-10 19:13:15,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505884', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420519', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269859', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464518', 'lastCheck': '5.6', 'valid': True}}
>Thread-863::DEBUG::2014-04-10 19:13:15,066::task::1168::TaskManager.Task::(prepare) Task=`b91ab06b-d8f8-4c3d-ab09-8272ddcb1169`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505884', 'lastCheck': '2.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420519', 'lastCheck': '3.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000269859', 'lastCheck': '3.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464518', 'lastCheck': '5.6', 'valid': True}}
>Thread-863::DEBUG::2014-04-10 19:13:15,066::task::579::TaskManager.Task::(_updateState) Task=`b91ab06b-d8f8-4c3d-ab09-8272ddcb1169`::moving from state preparing -> state finished
>Thread-863::DEBUG::2014-04-10 19:13:15,066::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-863::DEBUG::2014-04-10 19:13:15,066::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-863::DEBUG::2014-04-10 19:13:15,067::task::974::TaskManager.Task::(_decref) Task=`b91ab06b-d8f8-4c3d-ab09-8272ddcb1169`::ref 0 aborting False
>Thread-865::DEBUG::2014-04-10 19:13:16,802::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-865::DEBUG::2014-04-10 19:13:16,802::task::579::TaskManager.Task::(_updateState) Task=`3cedeaf6-ba71-4d8e-a8cb-7e8417bec8b6`::moving from state init -> state preparing
>Thread-865::INFO::2014-04-10 19:13:16,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-865::INFO::2014-04-10 19:13:16,803::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-865::DEBUG::2014-04-10 19:13:16,803::task::1168::TaskManager.Task::(prepare) Task=`3cedeaf6-ba71-4d8e-a8cb-7e8417bec8b6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-865::DEBUG::2014-04-10 19:13:16,803::task::579::TaskManager.Task::(_updateState) Task=`3cedeaf6-ba71-4d8e-a8cb-7e8417bec8b6`::moving from state preparing -> state finished
>Thread-865::DEBUG::2014-04-10 19:13:16,803::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-865::DEBUG::2014-04-10 19:13:16,804::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-865::DEBUG::2014-04-10 19:13:16,804::task::974::TaskManager.Task::(_decref) Task=`3cedeaf6-ba71-4d8e-a8cb-7e8417bec8b6`::ref 0 aborting False
>Thread-866::DEBUG::2014-04-10 19:13:16,812::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-866::DEBUG::2014-04-10 19:13:16,812::task::579::TaskManager.Task::(_updateState) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::moving from state init -> state preparing
>Thread-866::INFO::2014-04-10 19:13:16,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-866::DEBUG::2014-04-10 19:13:16,813::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59554b6b-67ae-419d-bee0-4c1bf674febd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-866::DEBUG::2014-04-10 19:13:16,813::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-866::DEBUG::2014-04-10 19:13:16,813::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-866::DEBUG::2014-04-10 19:13:16,814::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59554b6b-67ae-419d-bee0-4c1bf674febd`::Granted request
>Thread-866::DEBUG::2014-04-10 19:13:16,814::task::811::TaskManager.Task::(resourceAcquired) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-866::DEBUG::2014-04-10 19:13:16,814::task::974::TaskManager.Task::(_decref) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::ref 1 aborting False
>Thread-866::INFO::2014-04-10 19:13:16,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-866::DEBUG::2014-04-10 19:13:16,816::task::1168::TaskManager.Task::(prepare) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-866::DEBUG::2014-04-10 19:13:16,816::task::579::TaskManager.Task::(_updateState) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::moving from state preparing -> state finished
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-866::DEBUG::2014-04-10 19:13:16,817::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-866::DEBUG::2014-04-10 19:13:16,818::task::974::TaskManager.Task::(_decref) Task=`ad857e5f-17ab-476c-a5d2-0bb632ad53b2`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:19,442::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:19,449::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00044512 s, 827 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:13:21,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:21,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000327774 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:21,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:21,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00025109 s, 2.7 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:22,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:22,632::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000493155 s, 1.3 MB/s\n'; <rc> = 0
>Thread-870::DEBUG::2014-04-10 19:13:27,125::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-870::DEBUG::2014-04-10 19:13:27,126::task::579::TaskManager.Task::(_updateState) Task=`23eeca10-8c9c-499d-8f69-1f7d9270da75`::moving from state init -> state preparing
>Thread-870::INFO::2014-04-10 19:13:27,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-870::INFO::2014-04-10 19:13:27,127::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-870::DEBUG::2014-04-10 19:13:27,127::task::1168::TaskManager.Task::(prepare) Task=`23eeca10-8c9c-499d-8f69-1f7d9270da75`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-870::DEBUG::2014-04-10 19:13:27,127::task::579::TaskManager.Task::(_updateState) Task=`23eeca10-8c9c-499d-8f69-1f7d9270da75`::moving from state preparing -> state finished
>Thread-870::DEBUG::2014-04-10 19:13:27,127::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-870::DEBUG::2014-04-10 19:13:27,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-870::DEBUG::2014-04-10 19:13:27,128::task::974::TaskManager.Task::(_decref) Task=`23eeca10-8c9c-499d-8f69-1f7d9270da75`::ref 0 aborting False
>Thread-871::DEBUG::2014-04-10 19:13:27,136::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-871::DEBUG::2014-04-10 19:13:27,137::task::579::TaskManager.Task::(_updateState) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::moving from state init -> state preparing
>Thread-871::INFO::2014-04-10 19:13:27,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-871::DEBUG::2014-04-10 19:13:27,138::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbe6ba2a-1d57-46fc-8bec-a5e13d59608f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-871::DEBUG::2014-04-10 19:13:27,138::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-871::DEBUG::2014-04-10 19:13:27,138::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-871::DEBUG::2014-04-10 19:13:27,138::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cbe6ba2a-1d57-46fc-8bec-a5e13d59608f`::Granted request
>Thread-871::DEBUG::2014-04-10 19:13:27,140::task::811::TaskManager.Task::(resourceAcquired) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-871::DEBUG::2014-04-10 19:13:27,140::task::974::TaskManager.Task::(_decref) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::ref 1 aborting False
>Thread-871::INFO::2014-04-10 19:13:27,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-871::DEBUG::2014-04-10 19:13:27,143::task::1168::TaskManager.Task::(prepare) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-871::DEBUG::2014-04-10 19:13:27,143::task::579::TaskManager.Task::(_updateState) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::moving from state preparing -> state finished
>Thread-871::DEBUG::2014-04-10 19:13:27,143::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-871::DEBUG::2014-04-10 19:13:27,143::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-871::DEBUG::2014-04-10 19:13:27,144::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-871::DEBUG::2014-04-10 19:13:27,144::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-871::DEBUG::2014-04-10 19:13:27,144::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-871::DEBUG::2014-04-10 19:13:27,144::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-871::DEBUG::2014-04-10 19:13:27,144::task::974::TaskManager.Task::(_decref) Task=`734185e7-9662-4bb0-8477-75128f5c79ad`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:29,456::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:29,463::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000520536 s, 707 kB/s\n'; <rc> = 0
>Thread-873::DEBUG::2014-04-10 19:13:30,266::task::579::TaskManager.Task::(_updateState) Task=`8ab4bff1-b641-4555-bb3c-dd3831db6c6c`::moving from state init -> state preparing
>Thread-873::INFO::2014-04-10 19:13:30,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-873::INFO::2014-04-10 19:13:30,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493155', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327774', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025109', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520536', 'lastCheck': '0.8', 'valid': True}}
>Thread-873::DEBUG::2014-04-10 19:13:30,267::task::1168::TaskManager.Task::(prepare) Task=`8ab4bff1-b641-4555-bb3c-dd3831db6c6c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493155', 'lastCheck': '7.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327774', 'lastCheck': '8.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00025109', 'lastCheck': '8.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520536', 'lastCheck': '0.8', 'valid': True}}
>Thread-873::DEBUG::2014-04-10 19:13:30,267::task::579::TaskManager.Task::(_updateState) Task=`8ab4bff1-b641-4555-bb3c-dd3831db6c6c`::moving from state preparing -> state finished
>Thread-873::DEBUG::2014-04-10 19:13:30,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-873::DEBUG::2014-04-10 19:13:30,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-873::DEBUG::2014-04-10 19:13:30,268::task::974::TaskManager.Task::(_decref) Task=`8ab4bff1-b641-4555-bb3c-dd3831db6c6c`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:13:31,590::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:31,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00038895 s, 1.7 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:31,621::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:31,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000310326 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:32,635::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:13:32,649::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:13:32,651::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 19:13:32,656::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 19:13:32,658::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 19:13:32,658::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 19:13:32,658::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 19:13:32,664::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:32,670::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000372393 s, 1.8 MB/s\n'; <rc> = 0
>Thread-881::DEBUG::2014-04-10 19:13:37,241::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-881::DEBUG::2014-04-10 19:13:37,241::task::579::TaskManager.Task::(_updateState) Task=`dfb1bb79-e1bd-4019-963f-a236cb1052b8`::moving from state init -> state preparing
>Thread-881::INFO::2014-04-10 19:13:37,242::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-881::INFO::2014-04-10 19:13:37,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-881::DEBUG::2014-04-10 19:13:37,242::task::1168::TaskManager.Task::(prepare) Task=`dfb1bb79-e1bd-4019-963f-a236cb1052b8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-881::DEBUG::2014-04-10 19:13:37,242::task::579::TaskManager.Task::(_updateState) Task=`dfb1bb79-e1bd-4019-963f-a236cb1052b8`::moving from state preparing -> state finished
>Thread-881::DEBUG::2014-04-10 19:13:37,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-881::DEBUG::2014-04-10 19:13:37,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-881::DEBUG::2014-04-10 19:13:37,243::task::974::TaskManager.Task::(_decref) Task=`dfb1bb79-e1bd-4019-963f-a236cb1052b8`::ref 0 aborting False
>Thread-882::DEBUG::2014-04-10 19:13:37,252::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-882::DEBUG::2014-04-10 19:13:37,252::task::579::TaskManager.Task::(_updateState) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::moving from state init -> state preparing
>Thread-882::INFO::2014-04-10 19:13:37,252::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-882::DEBUG::2014-04-10 19:13:37,253::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a46e05df-3662-4a78-9695-83d855cb067b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-882::DEBUG::2014-04-10 19:13:37,253::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-882::DEBUG::2014-04-10 19:13:37,253::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-882::DEBUG::2014-04-10 19:13:37,253::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a46e05df-3662-4a78-9695-83d855cb067b`::Granted request
>Thread-882::DEBUG::2014-04-10 19:13:37,254::task::811::TaskManager.Task::(resourceAcquired) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-882::DEBUG::2014-04-10 19:13:37,254::task::974::TaskManager.Task::(_decref) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::ref 1 aborting False
>Thread-882::INFO::2014-04-10 19:13:37,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-882::DEBUG::2014-04-10 19:13:37,256::task::1168::TaskManager.Task::(prepare) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-882::DEBUG::2014-04-10 19:13:37,256::task::579::TaskManager.Task::(_updateState) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::moving from state preparing -> state finished
>Thread-882::DEBUG::2014-04-10 19:13:37,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-882::DEBUG::2014-04-10 19:13:37,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-882::DEBUG::2014-04-10 19:13:37,257::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-882::DEBUG::2014-04-10 19:13:37,257::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-882::DEBUG::2014-04-10 19:13:37,257::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-882::DEBUG::2014-04-10 19:13:37,257::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-882::DEBUG::2014-04-10 19:13:37,257::task::974::TaskManager.Task::(_decref) Task=`e21b87b2-0180-43d4-8cd8-fe8fc9de0aec`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:39,465::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:13:39,471::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:13:39,472::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 19:13:39,478::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 19:13:39,480::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 19:13:39,480::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 19:13:39,480::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 19:13:39,485::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:39,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000446289 s, 825 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:13:41,625::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:41,642::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000295889 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:41,657::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:41,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279489 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:42,681::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:42,687::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000502388 s, 1.3 MB/s\n'; <rc> = 0
>Thread-889::DEBUG::2014-04-10 19:13:45,779::task::579::TaskManager.Task::(_updateState) Task=`da96c987-af62-4c81-8c99-ba3d7d5227a8`::moving from state init -> state preparing
>Thread-889::INFO::2014-04-10 19:13:45,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-889::INFO::2014-04-10 19:13:45,780::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502388', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295889', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279489', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446289', 'lastCheck': '6.3', 'valid': True}}
>Thread-889::DEBUG::2014-04-10 19:13:45,780::task::1168::TaskManager.Task::(prepare) Task=`da96c987-af62-4c81-8c99-ba3d7d5227a8`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502388', 'lastCheck': '3.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000295889', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000279489', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446289', 'lastCheck': '6.3', 'valid': True}}
>Thread-889::DEBUG::2014-04-10 19:13:45,780::task::579::TaskManager.Task::(_updateState) Task=`da96c987-af62-4c81-8c99-ba3d7d5227a8`::moving from state preparing -> state finished
>Thread-889::DEBUG::2014-04-10 19:13:45,780::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-889::DEBUG::2014-04-10 19:13:45,781::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-889::DEBUG::2014-04-10 19:13:45,781::task::974::TaskManager.Task::(_decref) Task=`da96c987-af62-4c81-8c99-ba3d7d5227a8`::ref 0 aborting False
>Thread-891::DEBUG::2014-04-10 19:13:47,339::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-891::DEBUG::2014-04-10 19:13:47,340::task::579::TaskManager.Task::(_updateState) Task=`10fa7f86-0a7a-4218-81c0-714cd7a66441`::moving from state init -> state preparing
>Thread-891::INFO::2014-04-10 19:13:47,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-891::INFO::2014-04-10 19:13:47,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-891::DEBUG::2014-04-10 19:13:47,340::task::1168::TaskManager.Task::(prepare) Task=`10fa7f86-0a7a-4218-81c0-714cd7a66441`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-891::DEBUG::2014-04-10 19:13:47,340::task::579::TaskManager.Task::(_updateState) Task=`10fa7f86-0a7a-4218-81c0-714cd7a66441`::moving from state preparing -> state finished
>Thread-891::DEBUG::2014-04-10 19:13:47,340::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-891::DEBUG::2014-04-10 19:13:47,341::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-891::DEBUG::2014-04-10 19:13:47,341::task::974::TaskManager.Task::(_decref) Task=`10fa7f86-0a7a-4218-81c0-714cd7a66441`::ref 0 aborting False
>Thread-892::DEBUG::2014-04-10 19:13:47,349::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-892::DEBUG::2014-04-10 19:13:47,349::task::579::TaskManager.Task::(_updateState) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::moving from state init -> state preparing
>Thread-892::INFO::2014-04-10 19:13:47,349::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-892::DEBUG::2014-04-10 19:13:47,349::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`605d7fd9-2708-4bad-8f6e-8cf319907c5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-892::DEBUG::2014-04-10 19:13:47,350::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-892::DEBUG::2014-04-10 19:13:47,350::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-892::DEBUG::2014-04-10 19:13:47,350::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`605d7fd9-2708-4bad-8f6e-8cf319907c5c`::Granted request
>Thread-892::DEBUG::2014-04-10 19:13:47,350::task::811::TaskManager.Task::(resourceAcquired) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-892::DEBUG::2014-04-10 19:13:47,351::task::974::TaskManager.Task::(_decref) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::ref 1 aborting False
>Thread-892::INFO::2014-04-10 19:13:47,353::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-892::DEBUG::2014-04-10 19:13:47,353::task::1168::TaskManager.Task::(prepare) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-892::DEBUG::2014-04-10 19:13:47,353::task::579::TaskManager.Task::(_updateState) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::moving from state preparing -> state finished
>Thread-892::DEBUG::2014-04-10 19:13:47,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-892::DEBUG::2014-04-10 19:13:47,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-892::DEBUG::2014-04-10 19:13:47,353::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-892::DEBUG::2014-04-10 19:13:47,354::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-892::DEBUG::2014-04-10 19:13:47,354::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-892::DEBUG::2014-04-10 19:13:47,354::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-892::DEBUG::2014-04-10 19:13:47,354::task::974::TaskManager.Task::(_decref) Task=`c0fcee92-72b9-4a8c-a531-23c6dc45b19a`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:49,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:49,505::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000450187 s, 817 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:13:51,661::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:13:51,677::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323272 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:13:51,689::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:13:51,695::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333177 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:13:52,696::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:13:52,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000404871 s, 1.6 MB/s\n'; <rc> = 0
>Thread-896::DEBUG::2014-04-10 19:13:57,679::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-896::DEBUG::2014-04-10 19:13:57,680::task::579::TaskManager.Task::(_updateState) Task=`2d40450e-dc38-426e-89c1-11df9e9b4933`::moving from state init -> state preparing
>Thread-896::INFO::2014-04-10 19:13:57,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-896::INFO::2014-04-10 19:13:57,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-896::DEBUG::2014-04-10 19:13:57,681::task::1168::TaskManager.Task::(prepare) Task=`2d40450e-dc38-426e-89c1-11df9e9b4933`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-896::DEBUG::2014-04-10 19:13:57,681::task::579::TaskManager.Task::(_updateState) Task=`2d40450e-dc38-426e-89c1-11df9e9b4933`::moving from state preparing -> state finished
>Thread-896::DEBUG::2014-04-10 19:13:57,681::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-896::DEBUG::2014-04-10 19:13:57,681::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-896::DEBUG::2014-04-10 19:13:57,681::task::974::TaskManager.Task::(_decref) Task=`2d40450e-dc38-426e-89c1-11df9e9b4933`::ref 0 aborting False
>Thread-897::DEBUG::2014-04-10 19:13:57,690::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-897::DEBUG::2014-04-10 19:13:57,691::task::579::TaskManager.Task::(_updateState) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::moving from state init -> state preparing
>Thread-897::INFO::2014-04-10 19:13:57,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-897::DEBUG::2014-04-10 19:13:57,691::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0730fb17-e0b3-4f2c-815c-06e34e74200a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-897::DEBUG::2014-04-10 19:13:57,692::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-897::DEBUG::2014-04-10 19:13:57,692::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-897::DEBUG::2014-04-10 19:13:57,692::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0730fb17-e0b3-4f2c-815c-06e34e74200a`::Granted request
>Thread-897::DEBUG::2014-04-10 19:13:57,692::task::811::TaskManager.Task::(resourceAcquired) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-897::DEBUG::2014-04-10 19:13:57,693::task::974::TaskManager.Task::(_decref) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::ref 1 aborting False
>Thread-897::INFO::2014-04-10 19:13:57,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-897::DEBUG::2014-04-10 19:13:57,695::task::1168::TaskManager.Task::(prepare) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-897::DEBUG::2014-04-10 19:13:57,696::task::579::TaskManager.Task::(_updateState) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::moving from state preparing -> state finished
>Thread-897::DEBUG::2014-04-10 19:13:57,696::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-897::DEBUG::2014-04-10 19:13:57,696::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-897::DEBUG::2014-04-10 19:13:57,696::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-897::DEBUG::2014-04-10 19:13:57,696::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-897::DEBUG::2014-04-10 19:13:57,696::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-897::DEBUG::2014-04-10 19:13:57,697::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-897::DEBUG::2014-04-10 19:13:57,697::task::974::TaskManager.Task::(_decref) Task=`7c1cceb6-d694-41b9-8e1c-6a6716e819fc`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:13:59,513::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:13:59,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00052163 s, 705 kB/s\n'; <rc> = 0
>Thread-899::DEBUG::2014-04-10 19:14:00,980::task::579::TaskManager.Task::(_updateState) Task=`921a1d88-03da-4715-bf92-1ae0dd6dd84c`::moving from state init -> state preparing
>Thread-899::INFO::2014-04-10 19:14:00,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-899::INFO::2014-04-10 19:14:00,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404871', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323272', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333177', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052163', 'lastCheck': '1.5', 'valid': True}}
>Thread-899::DEBUG::2014-04-10 19:14:00,981::task::1168::TaskManager.Task::(prepare) Task=`921a1d88-03da-4715-bf92-1ae0dd6dd84c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000404871', 'lastCheck': '8.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323272', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333177', 'lastCheck': '9.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052163', 'lastCheck': '1.5', 'valid': True}}
>Thread-899::DEBUG::2014-04-10 19:14:00,981::task::579::TaskManager.Task::(_updateState) Task=`921a1d88-03da-4715-bf92-1ae0dd6dd84c`::moving from state preparing -> state finished
>Thread-899::DEBUG::2014-04-10 19:14:00,981::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-899::DEBUG::2014-04-10 19:14:00,981::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-899::DEBUG::2014-04-10 19:14:00,981::task::974::TaskManager.Task::(_decref) Task=`921a1d88-03da-4715-bf92-1ae0dd6dd84c`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:14:01,693::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:01,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364014 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:01,724::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:01,729::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000237777 s, 2.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:02,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:02,717::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000543458 s, 1.2 MB/s\n'; <rc> = 0
>Thread-903::DEBUG::2014-04-10 19:14:07,778::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [33d74f3d]
>Thread-903::DEBUG::2014-04-10 19:14:07,785::task::579::TaskManager.Task::(_updateState) Task=`fb57534b-2584-41a5-853c-5150bc8581c2`::moving from state init -> state preparing
>Thread-903::INFO::2014-04-10 19:14:07,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-903::INFO::2014-04-10 19:14:07,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-903::DEBUG::2014-04-10 19:14:07,786::task::1168::TaskManager.Task::(prepare) Task=`fb57534b-2584-41a5-853c-5150bc8581c2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-903::DEBUG::2014-04-10 19:14:07,786::task::579::TaskManager.Task::(_updateState) Task=`fb57534b-2584-41a5-853c-5150bc8581c2`::moving from state preparing -> state finished
>Thread-903::DEBUG::2014-04-10 19:14:07,786::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-903::DEBUG::2014-04-10 19:14:07,786::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-903::DEBUG::2014-04-10 19:14:07,787::task::974::TaskManager.Task::(_decref) Task=`fb57534b-2584-41a5-853c-5150bc8581c2`::ref 0 aborting False
>Thread-904::DEBUG::2014-04-10 19:14:07,795::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [33d74f3d]
>Thread-904::DEBUG::2014-04-10 19:14:07,795::task::579::TaskManager.Task::(_updateState) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::moving from state init -> state preparing
>Thread-904::INFO::2014-04-10 19:14:07,796::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-904::DEBUG::2014-04-10 19:14:07,796::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b0feb0b-7469-4385-8715-b1750d5c134f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-904::DEBUG::2014-04-10 19:14:07,796::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-904::DEBUG::2014-04-10 19:14:07,796::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-904::DEBUG::2014-04-10 19:14:07,797::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7b0feb0b-7469-4385-8715-b1750d5c134f`::Granted request
>Thread-904::DEBUG::2014-04-10 19:14:07,798::task::811::TaskManager.Task::(resourceAcquired) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-904::DEBUG::2014-04-10 19:14:07,798::task::974::TaskManager.Task::(_decref) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::ref 1 aborting False
>Thread-904::INFO::2014-04-10 19:14:07,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-904::DEBUG::2014-04-10 19:14:07,800::task::1168::TaskManager.Task::(prepare) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-904::DEBUG::2014-04-10 19:14:07,800::task::579::TaskManager.Task::(_updateState) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::moving from state preparing -> state finished
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-904::DEBUG::2014-04-10 19:14:07,801::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-904::DEBUG::2014-04-10 19:14:07,802::task::974::TaskManager.Task::(_decref) Task=`c19279bf-dca9-459a-91f4-deb7df8a5e4d`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:09,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:09,533::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000485342 s, 758 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:14:11,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:11,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000338827 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:11,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:11,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000341843 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:12,732::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:12,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000580662 s, 1.1 MB/s\n'; <rc> = 0
>Thread-907::DEBUG::2014-04-10 19:14:16,160::task::579::TaskManager.Task::(_updateState) Task=`2adfa19b-2e3c-4747-b92b-234dad9a276d`::moving from state init -> state preparing
>Thread-907::INFO::2014-04-10 19:14:16,160::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-907::INFO::2014-04-10 19:14:16,160::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580662', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338827', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341843', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485342', 'lastCheck': '6.6', 'valid': True}}
>Thread-907::DEBUG::2014-04-10 19:14:16,161::task::1168::TaskManager.Task::(prepare) Task=`2adfa19b-2e3c-4747-b92b-234dad9a276d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580662', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000338827', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341843', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485342', 'lastCheck': '6.6', 'valid': True}}
>Thread-907::DEBUG::2014-04-10 19:14:16,161::task::579::TaskManager.Task::(_updateState) Task=`2adfa19b-2e3c-4747-b92b-234dad9a276d`::moving from state preparing -> state finished
>Thread-907::DEBUG::2014-04-10 19:14:16,161::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-907::DEBUG::2014-04-10 19:14:16,161::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-907::DEBUG::2014-04-10 19:14:16,161::task::974::TaskManager.Task::(_decref) Task=`2adfa19b-2e3c-4747-b92b-234dad9a276d`::ref 0 aborting False
>Thread-909::DEBUG::2014-04-10 19:14:18,085::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-909::DEBUG::2014-04-10 19:14:18,085::task::579::TaskManager.Task::(_updateState) Task=`7f05195d-8e0d-4efc-97fb-592c51ff58fb`::moving from state init -> state preparing
>Thread-909::INFO::2014-04-10 19:14:18,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-909::INFO::2014-04-10 19:14:18,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-909::DEBUG::2014-04-10 19:14:18,086::task::1168::TaskManager.Task::(prepare) Task=`7f05195d-8e0d-4efc-97fb-592c51ff58fb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-909::DEBUG::2014-04-10 19:14:18,086::task::579::TaskManager.Task::(_updateState) Task=`7f05195d-8e0d-4efc-97fb-592c51ff58fb`::moving from state preparing -> state finished
>Thread-909::DEBUG::2014-04-10 19:14:18,086::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-909::DEBUG::2014-04-10 19:14:18,086::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-909::DEBUG::2014-04-10 19:14:18,086::task::974::TaskManager.Task::(_decref) Task=`7f05195d-8e0d-4efc-97fb-592c51ff58fb`::ref 0 aborting False
>Thread-910::DEBUG::2014-04-10 19:14:18,094::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-910::DEBUG::2014-04-10 19:14:18,095::task::579::TaskManager.Task::(_updateState) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::moving from state init -> state preparing
>Thread-910::INFO::2014-04-10 19:14:18,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-910::DEBUG::2014-04-10 19:14:18,095::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`78a15501-adb2-4eeb-ab83-3d90f0caa4c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-910::DEBUG::2014-04-10 19:14:18,095::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-910::DEBUG::2014-04-10 19:14:18,096::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-910::DEBUG::2014-04-10 19:14:18,096::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`78a15501-adb2-4eeb-ab83-3d90f0caa4c2`::Granted request
>Thread-910::DEBUG::2014-04-10 19:14:18,096::task::811::TaskManager.Task::(resourceAcquired) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-910::DEBUG::2014-04-10 19:14:18,096::task::974::TaskManager.Task::(_decref) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::ref 1 aborting False
>Thread-910::INFO::2014-04-10 19:14:18,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-910::DEBUG::2014-04-10 19:14:18,099::task::1168::TaskManager.Task::(prepare) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-910::DEBUG::2014-04-10 19:14:18,099::task::579::TaskManager.Task::(_updateState) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::moving from state preparing -> state finished
>Thread-910::DEBUG::2014-04-10 19:14:18,099::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-910::DEBUG::2014-04-10 19:14:18,099::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-910::DEBUG::2014-04-10 19:14:18,099::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-910::DEBUG::2014-04-10 19:14:18,099::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-910::DEBUG::2014-04-10 19:14:18,100::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-910::DEBUG::2014-04-10 19:14:18,100::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-910::DEBUG::2014-04-10 19:14:18,100::task::974::TaskManager.Task::(_decref) Task=`4b268526-ae64-4646-bbcc-d8148a3eb514`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:19,541::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:19,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047781 s, 770 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:14:21,761::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:21,782::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000364689 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:21,799::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:21,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324937 s, 2.1 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:22,748::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:22,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000567493 s, 1.2 MB/s\n'; <rc> = 0
>Thread-914::DEBUG::2014-04-10 19:14:28,192::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-914::DEBUG::2014-04-10 19:14:28,192::task::579::TaskManager.Task::(_updateState) Task=`92ebb262-d35e-4517-a413-faee8844f95f`::moving from state init -> state preparing
>Thread-914::INFO::2014-04-10 19:14:28,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-914::INFO::2014-04-10 19:14:28,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-914::DEBUG::2014-04-10 19:14:28,193::task::1168::TaskManager.Task::(prepare) Task=`92ebb262-d35e-4517-a413-faee8844f95f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-914::DEBUG::2014-04-10 19:14:28,193::task::579::TaskManager.Task::(_updateState) Task=`92ebb262-d35e-4517-a413-faee8844f95f`::moving from state preparing -> state finished
>Thread-914::DEBUG::2014-04-10 19:14:28,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-914::DEBUG::2014-04-10 19:14:28,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-914::DEBUG::2014-04-10 19:14:28,194::task::974::TaskManager.Task::(_decref) Task=`92ebb262-d35e-4517-a413-faee8844f95f`::ref 0 aborting False
>Thread-915::DEBUG::2014-04-10 19:14:28,202::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-915::DEBUG::2014-04-10 19:14:28,202::task::579::TaskManager.Task::(_updateState) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::moving from state init -> state preparing
>Thread-915::INFO::2014-04-10 19:14:28,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-915::DEBUG::2014-04-10 19:14:28,203::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b9ae8b4-43b2-4215-8c5b-fcc9c956206b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-915::DEBUG::2014-04-10 19:14:28,203::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-915::DEBUG::2014-04-10 19:14:28,203::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-915::DEBUG::2014-04-10 19:14:28,203::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6b9ae8b4-43b2-4215-8c5b-fcc9c956206b`::Granted request
>Thread-915::DEBUG::2014-04-10 19:14:28,204::task::811::TaskManager.Task::(resourceAcquired) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-915::DEBUG::2014-04-10 19:14:28,204::task::974::TaskManager.Task::(_decref) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::ref 1 aborting False
>Thread-915::INFO::2014-04-10 19:14:28,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-915::DEBUG::2014-04-10 19:14:28,206::task::1168::TaskManager.Task::(prepare) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-915::DEBUG::2014-04-10 19:14:28,206::task::579::TaskManager.Task::(_updateState) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::moving from state preparing -> state finished
>Thread-915::DEBUG::2014-04-10 19:14:28,206::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-915::DEBUG::2014-04-10 19:14:28,206::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-915::DEBUG::2014-04-10 19:14:28,207::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-915::DEBUG::2014-04-10 19:14:28,207::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-915::DEBUG::2014-04-10 19:14:28,207::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-915::DEBUG::2014-04-10 19:14:28,207::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-915::DEBUG::2014-04-10 19:14:28,207::task::974::TaskManager.Task::(_decref) Task=`bb366d65-0737-45ef-9401-3008c9ec33e0`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:29,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:29,562::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000489305 s, 752 kB/s\n'; <rc> = 0
>Thread-917::DEBUG::2014-04-10 19:14:31,330::task::579::TaskManager.Task::(_updateState) Task=`3d8adb22-ba7f-4c89-a5c5-db5697fc852e`::moving from state init -> state preparing
>Thread-917::INFO::2014-04-10 19:14:31,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-917::INFO::2014-04-10 19:14:31,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567493', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364689', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324937', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489305', 'lastCheck': '1.8', 'valid': True}}
>Thread-917::DEBUG::2014-04-10 19:14:31,331::task::1168::TaskManager.Task::(prepare) Task=`3d8adb22-ba7f-4c89-a5c5-db5697fc852e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567493', 'lastCheck': '8.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364689', 'lastCheck': '9.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324937', 'lastCheck': '9.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489305', 'lastCheck': '1.8', 'valid': True}}
>Thread-917::DEBUG::2014-04-10 19:14:31,331::task::579::TaskManager.Task::(_updateState) Task=`3d8adb22-ba7f-4c89-a5c5-db5697fc852e`::moving from state preparing -> state finished
>Thread-917::DEBUG::2014-04-10 19:14:31,332::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-917::DEBUG::2014-04-10 19:14:31,332::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-917::DEBUG::2014-04-10 19:14:31,332::task::974::TaskManager.Task::(_decref) Task=`3d8adb22-ba7f-4c89-a5c5-db5697fc852e`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:14:31,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:31,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334939 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:31,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:31,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276644 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:32,766::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:32,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000562341 s, 1.2 MB/s\n'; <rc> = 0
>Thread-921::DEBUG::2014-04-10 19:14:38,290::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-921::DEBUG::2014-04-10 19:14:38,290::task::579::TaskManager.Task::(_updateState) Task=`4afe0e38-7550-4a1e-a5a7-94173cd7d6c3`::moving from state init -> state preparing
>Thread-921::INFO::2014-04-10 19:14:38,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-921::INFO::2014-04-10 19:14:38,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-921::DEBUG::2014-04-10 19:14:38,291::task::1168::TaskManager.Task::(prepare) Task=`4afe0e38-7550-4a1e-a5a7-94173cd7d6c3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-921::DEBUG::2014-04-10 19:14:38,291::task::579::TaskManager.Task::(_updateState) Task=`4afe0e38-7550-4a1e-a5a7-94173cd7d6c3`::moving from state preparing -> state finished
>Thread-921::DEBUG::2014-04-10 19:14:38,291::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-921::DEBUG::2014-04-10 19:14:38,291::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-921::DEBUG::2014-04-10 19:14:38,292::task::974::TaskManager.Task::(_decref) Task=`4afe0e38-7550-4a1e-a5a7-94173cd7d6c3`::ref 0 aborting False
>Thread-922::DEBUG::2014-04-10 19:14:38,300::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-922::DEBUG::2014-04-10 19:14:38,300::task::579::TaskManager.Task::(_updateState) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::moving from state init -> state preparing
>Thread-922::INFO::2014-04-10 19:14:38,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-922::DEBUG::2014-04-10 19:14:38,301::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`730f42e7-0fda-40d7-b548-e205bdfd0b1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-922::DEBUG::2014-04-10 19:14:38,301::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-922::DEBUG::2014-04-10 19:14:38,301::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-922::DEBUG::2014-04-10 19:14:38,301::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`730f42e7-0fda-40d7-b548-e205bdfd0b1f`::Granted request
>Thread-922::DEBUG::2014-04-10 19:14:38,302::task::811::TaskManager.Task::(resourceAcquired) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-922::DEBUG::2014-04-10 19:14:38,302::task::974::TaskManager.Task::(_decref) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::ref 1 aborting False
>Thread-922::INFO::2014-04-10 19:14:38,304::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-922::DEBUG::2014-04-10 19:14:38,304::task::1168::TaskManager.Task::(prepare) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-922::DEBUG::2014-04-10 19:14:38,304::task::579::TaskManager.Task::(_updateState) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::moving from state preparing -> state finished
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-922::DEBUG::2014-04-10 19:14:38,305::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-922::DEBUG::2014-04-10 19:14:38,306::task::974::TaskManager.Task::(_decref) Task=`70d30972-fa69-4321-bd3e-9d2035d637d1`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:39,571::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:39,578::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000479965 s, 767 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:14:41,835::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:41,851::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366383 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:41,866::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:41,872::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256975 s, 2.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:42,785::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:42,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000492403 s, 1.3 MB/s\n'; <rc> = 0
>Thread-925::DEBUG::2014-04-10 19:14:46,503::task::579::TaskManager.Task::(_updateState) Task=`64d89ecd-162a-4403-87ce-ab604a4ce935`::moving from state init -> state preparing
>Thread-925::INFO::2014-04-10 19:14:46,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-925::INFO::2014-04-10 19:14:46,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492403', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366383', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256975', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479965', 'lastCheck': '6.9', 'valid': True}}
>Thread-925::DEBUG::2014-04-10 19:14:46,504::task::1168::TaskManager.Task::(prepare) Task=`64d89ecd-162a-4403-87ce-ab604a4ce935`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492403', 'lastCheck': '3.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366383', 'lastCheck': '4.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256975', 'lastCheck': '4.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479965', 'lastCheck': '6.9', 'valid': True}}
>Thread-925::DEBUG::2014-04-10 19:14:46,504::task::579::TaskManager.Task::(_updateState) Task=`64d89ecd-162a-4403-87ce-ab604a4ce935`::moving from state preparing -> state finished
>Thread-925::DEBUG::2014-04-10 19:14:46,504::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-925::DEBUG::2014-04-10 19:14:46,504::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-925::DEBUG::2014-04-10 19:14:46,504::task::974::TaskManager.Task::(_decref) Task=`64d89ecd-162a-4403-87ce-ab604a4ce935`::ref 0 aborting False
>Thread-927::DEBUG::2014-04-10 19:14:48,514::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-927::DEBUG::2014-04-10 19:14:48,514::task::579::TaskManager.Task::(_updateState) Task=`e23e1a5e-87f8-4a2d-82cd-c30963a87f17`::moving from state init -> state preparing
>Thread-927::INFO::2014-04-10 19:14:48,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-927::INFO::2014-04-10 19:14:48,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-927::DEBUG::2014-04-10 19:14:48,515::task::1168::TaskManager.Task::(prepare) Task=`e23e1a5e-87f8-4a2d-82cd-c30963a87f17`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-927::DEBUG::2014-04-10 19:14:48,515::task::579::TaskManager.Task::(_updateState) Task=`e23e1a5e-87f8-4a2d-82cd-c30963a87f17`::moving from state preparing -> state finished
>Thread-927::DEBUG::2014-04-10 19:14:48,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-927::DEBUG::2014-04-10 19:14:48,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-927::DEBUG::2014-04-10 19:14:48,515::task::974::TaskManager.Task::(_decref) Task=`e23e1a5e-87f8-4a2d-82cd-c30963a87f17`::ref 0 aborting False
>Thread-928::DEBUG::2014-04-10 19:14:48,523::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-928::DEBUG::2014-04-10 19:14:48,524::task::579::TaskManager.Task::(_updateState) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::moving from state init -> state preparing
>Thread-928::INFO::2014-04-10 19:14:48,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-928::DEBUG::2014-04-10 19:14:48,525::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`becbd3cc-8651-4061-a4fd-dae7530f0b89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-928::DEBUG::2014-04-10 19:14:48,525::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-928::DEBUG::2014-04-10 19:14:48,525::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-928::DEBUG::2014-04-10 19:14:48,525::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`becbd3cc-8651-4061-a4fd-dae7530f0b89`::Granted request
>Thread-928::DEBUG::2014-04-10 19:14:48,527::task::811::TaskManager.Task::(resourceAcquired) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-928::DEBUG::2014-04-10 19:14:48,527::task::974::TaskManager.Task::(_decref) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::ref 1 aborting False
>Thread-928::INFO::2014-04-10 19:14:48,530::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-928::DEBUG::2014-04-10 19:14:48,530::task::1168::TaskManager.Task::(prepare) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-928::DEBUG::2014-04-10 19:14:48,530::task::579::TaskManager.Task::(_updateState) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::moving from state preparing -> state finished
>Thread-928::DEBUG::2014-04-10 19:14:48,530::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-928::DEBUG::2014-04-10 19:14:48,530::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-928::DEBUG::2014-04-10 19:14:48,531::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-928::DEBUG::2014-04-10 19:14:48,531::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-928::DEBUG::2014-04-10 19:14:48,531::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-928::DEBUG::2014-04-10 19:14:48,531::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-928::DEBUG::2014-04-10 19:14:48,532::task::974::TaskManager.Task::(_decref) Task=`5d7c6b61-72a1-4be7-bf9c-72fb7be59b81`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:49,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:49,594::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000480004 s, 767 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:14:51,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:14:51,886::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000361959 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:14:51,900::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:14:51,905::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311177 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:14:52,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:14:52,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000602691 s, 1.1 MB/s\n'; <rc> = 0
>Thread-932::DEBUG::2014-04-10 19:14:58,611::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-932::DEBUG::2014-04-10 19:14:58,612::task::579::TaskManager.Task::(_updateState) Task=`878b0938-e101-44a6-a9dd-6ede4650877b`::moving from state init -> state preparing
>Thread-932::INFO::2014-04-10 19:14:58,612::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-932::INFO::2014-04-10 19:14:58,612::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-932::DEBUG::2014-04-10 19:14:58,612::task::1168::TaskManager.Task::(prepare) Task=`878b0938-e101-44a6-a9dd-6ede4650877b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-932::DEBUG::2014-04-10 19:14:58,613::task::579::TaskManager.Task::(_updateState) Task=`878b0938-e101-44a6-a9dd-6ede4650877b`::moving from state preparing -> state finished
>Thread-932::DEBUG::2014-04-10 19:14:58,613::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-932::DEBUG::2014-04-10 19:14:58,613::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-932::DEBUG::2014-04-10 19:14:58,613::task::974::TaskManager.Task::(_decref) Task=`878b0938-e101-44a6-a9dd-6ede4650877b`::ref 0 aborting False
>Thread-933::DEBUG::2014-04-10 19:14:58,621::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-933::DEBUG::2014-04-10 19:14:58,621::task::579::TaskManager.Task::(_updateState) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::moving from state init -> state preparing
>Thread-933::INFO::2014-04-10 19:14:58,622::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-933::DEBUG::2014-04-10 19:14:58,622::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3ca8ea7b-5851-4ed3-94d4-e66a5b235335`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-933::DEBUG::2014-04-10 19:14:58,622::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-933::DEBUG::2014-04-10 19:14:58,623::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-933::DEBUG::2014-04-10 19:14:58,623::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3ca8ea7b-5851-4ed3-94d4-e66a5b235335`::Granted request
>Thread-933::DEBUG::2014-04-10 19:14:58,623::task::811::TaskManager.Task::(resourceAcquired) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-933::DEBUG::2014-04-10 19:14:58,623::task::974::TaskManager.Task::(_decref) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::ref 1 aborting False
>Thread-933::INFO::2014-04-10 19:14:58,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-933::DEBUG::2014-04-10 19:14:58,625::task::1168::TaskManager.Task::(prepare) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-933::DEBUG::2014-04-10 19:14:58,626::task::579::TaskManager.Task::(_updateState) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::moving from state preparing -> state finished
>Thread-933::DEBUG::2014-04-10 19:14:58,626::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-933::DEBUG::2014-04-10 19:14:58,626::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-933::DEBUG::2014-04-10 19:14:58,626::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-933::DEBUG::2014-04-10 19:14:58,626::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-933::DEBUG::2014-04-10 19:14:58,626::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-933::DEBUG::2014-04-10 19:14:58,627::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-933::DEBUG::2014-04-10 19:14:58,627::task::974::TaskManager.Task::(_decref) Task=`4a341121-aa51-468c-adf4-fed16c7b1e63`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:14:59,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:14:59,608::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000539427 s, 682 kB/s\n'; <rc> = 0
>Thread-935::DEBUG::2014-04-10 19:15:01,729::task::579::TaskManager.Task::(_updateState) Task=`186e0f8b-b9bf-44d4-b8fc-f505548cf6f4`::moving from state init -> state preparing
>Thread-935::INFO::2014-04-10 19:15:01,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-935::INFO::2014-04-10 19:15:01,730::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602691', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361959', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311177', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539427', 'lastCheck': '2.1', 'valid': True}}
>Thread-935::DEBUG::2014-04-10 19:15:01,730::task::1168::TaskManager.Task::(prepare) Task=`186e0f8b-b9bf-44d4-b8fc-f505548cf6f4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000602691', 'lastCheck': '8.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000361959', 'lastCheck': '9.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311177', 'lastCheck': '9.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539427', 'lastCheck': '2.1', 'valid': True}}
>Thread-935::DEBUG::2014-04-10 19:15:01,730::task::579::TaskManager.Task::(_updateState) Task=`186e0f8b-b9bf-44d4-b8fc-f505548cf6f4`::moving from state preparing -> state finished
>Thread-935::DEBUG::2014-04-10 19:15:01,730::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-935::DEBUG::2014-04-10 19:15:01,730::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-935::DEBUG::2014-04-10 19:15:01,731::task::974::TaskManager.Task::(_decref) Task=`186e0f8b-b9bf-44d4-b8fc-f505548cf6f4`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:15:01,903::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:01,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000367621 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:15:01,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:01,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000333314 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:02,819::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:02,827::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000492439 s, 1.3 MB/s\n'; <rc> = 0
>Thread-939::DEBUG::2014-04-10 19:15:08,710::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-939::DEBUG::2014-04-10 19:15:08,711::task::579::TaskManager.Task::(_updateState) Task=`50414f49-f935-4f06-aa0f-31cb62af12bc`::moving from state init -> state preparing
>Thread-939::INFO::2014-04-10 19:15:08,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-939::INFO::2014-04-10 19:15:08,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-939::DEBUG::2014-04-10 19:15:08,711::task::1168::TaskManager.Task::(prepare) Task=`50414f49-f935-4f06-aa0f-31cb62af12bc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-939::DEBUG::2014-04-10 19:15:08,712::task::579::TaskManager.Task::(_updateState) Task=`50414f49-f935-4f06-aa0f-31cb62af12bc`::moving from state preparing -> state finished
>Thread-939::DEBUG::2014-04-10 19:15:08,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-939::DEBUG::2014-04-10 19:15:08,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-939::DEBUG::2014-04-10 19:15:08,712::task::974::TaskManager.Task::(_decref) Task=`50414f49-f935-4f06-aa0f-31cb62af12bc`::ref 0 aborting False
>Thread-940::DEBUG::2014-04-10 19:15:08,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-940::DEBUG::2014-04-10 19:15:08,720::task::579::TaskManager.Task::(_updateState) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::moving from state init -> state preparing
>Thread-940::INFO::2014-04-10 19:15:08,720::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-940::DEBUG::2014-04-10 19:15:08,721::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`022eee0c-5db8-4360-bad0-d39c6a18f39e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-940::DEBUG::2014-04-10 19:15:08,721::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-940::DEBUG::2014-04-10 19:15:08,721::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-940::DEBUG::2014-04-10 19:15:08,721::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`022eee0c-5db8-4360-bad0-d39c6a18f39e`::Granted request
>Thread-940::DEBUG::2014-04-10 19:15:08,722::task::811::TaskManager.Task::(resourceAcquired) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-940::DEBUG::2014-04-10 19:15:08,722::task::974::TaskManager.Task::(_decref) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::ref 1 aborting False
>Thread-940::INFO::2014-04-10 19:15:08,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-940::DEBUG::2014-04-10 19:15:08,724::task::1168::TaskManager.Task::(prepare) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-940::DEBUG::2014-04-10 19:15:08,724::task::579::TaskManager.Task::(_updateState) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::moving from state preparing -> state finished
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-940::DEBUG::2014-04-10 19:15:08,725::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-940::DEBUG::2014-04-10 19:15:08,726::task::974::TaskManager.Task::(_decref) Task=`5c5d7e5b-5521-472e-97c8-26cc2e1593fb`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:09,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:09,622::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000523256 s, 703 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:15:11,944::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:11,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355526 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:15:11,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:11,988::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296767 s, 2.3 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:12,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:12,843::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000557963 s, 1.2 MB/s\n'; <rc> = 0
>Thread-943::DEBUG::2014-04-10 19:15:16,899::task::579::TaskManager.Task::(_updateState) Task=`8c9844ff-5a76-4ac9-9a5e-70952525bfb9`::moving from state init -> state preparing
>Thread-943::INFO::2014-04-10 19:15:16,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-943::INFO::2014-04-10 19:15:16,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557963', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355526', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296767', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523256', 'lastCheck': '7.3', 'valid': True}}
>Thread-943::DEBUG::2014-04-10 19:15:16,900::task::1168::TaskManager.Task::(prepare) Task=`8c9844ff-5a76-4ac9-9a5e-70952525bfb9`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557963', 'lastCheck': '4.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355526', 'lastCheck': '4.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296767', 'lastCheck': '4.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523256', 'lastCheck': '7.3', 'valid': True}}
>Thread-943::DEBUG::2014-04-10 19:15:16,900::task::579::TaskManager.Task::(_updateState) Task=`8c9844ff-5a76-4ac9-9a5e-70952525bfb9`::moving from state preparing -> state finished
>Thread-943::DEBUG::2014-04-10 19:15:16,900::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-943::DEBUG::2014-04-10 19:15:16,900::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-943::DEBUG::2014-04-10 19:15:16,900::task::974::TaskManager.Task::(_decref) Task=`8c9844ff-5a76-4ac9-9a5e-70952525bfb9`::ref 0 aborting False
>Thread-945::DEBUG::2014-04-10 19:15:18,808::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-945::DEBUG::2014-04-10 19:15:18,809::task::579::TaskManager.Task::(_updateState) Task=`6857307f-9ce3-4ddd-b5a5-779a5ba5e1f5`::moving from state init -> state preparing
>Thread-945::INFO::2014-04-10 19:15:18,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-945::INFO::2014-04-10 19:15:18,809::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-945::DEBUG::2014-04-10 19:15:18,809::task::1168::TaskManager.Task::(prepare) Task=`6857307f-9ce3-4ddd-b5a5-779a5ba5e1f5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-945::DEBUG::2014-04-10 19:15:18,809::task::579::TaskManager.Task::(_updateState) Task=`6857307f-9ce3-4ddd-b5a5-779a5ba5e1f5`::moving from state preparing -> state finished
>Thread-945::DEBUG::2014-04-10 19:15:18,810::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-945::DEBUG::2014-04-10 19:15:18,810::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-945::DEBUG::2014-04-10 19:15:18,810::task::974::TaskManager.Task::(_decref) Task=`6857307f-9ce3-4ddd-b5a5-779a5ba5e1f5`::ref 0 aborting False
>Thread-946::DEBUG::2014-04-10 19:15:18,817::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-946::DEBUG::2014-04-10 19:15:18,818::task::579::TaskManager.Task::(_updateState) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::moving from state init -> state preparing
>Thread-946::INFO::2014-04-10 19:15:18,818::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-946::DEBUG::2014-04-10 19:15:18,818::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`45de0f5d-cdf0-4ae4-97f8-18f699520d94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-946::DEBUG::2014-04-10 19:15:18,819::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-946::DEBUG::2014-04-10 19:15:18,819::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-946::DEBUG::2014-04-10 19:15:18,819::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`45de0f5d-cdf0-4ae4-97f8-18f699520d94`::Granted request
>Thread-946::DEBUG::2014-04-10 19:15:18,819::task::811::TaskManager.Task::(resourceAcquired) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-946::DEBUG::2014-04-10 19:15:18,819::task::974::TaskManager.Task::(_decref) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::ref 1 aborting False
>Thread-946::INFO::2014-04-10 19:15:18,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-946::DEBUG::2014-04-10 19:15:18,822::task::1168::TaskManager.Task::(prepare) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-946::DEBUG::2014-04-10 19:15:18,822::task::579::TaskManager.Task::(_updateState) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::moving from state preparing -> state finished
>Thread-946::DEBUG::2014-04-10 19:15:18,822::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-946::DEBUG::2014-04-10 19:15:18,822::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-946::DEBUG::2014-04-10 19:15:18,822::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-946::DEBUG::2014-04-10 19:15:18,822::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-946::DEBUG::2014-04-10 19:15:18,823::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-946::DEBUG::2014-04-10 19:15:18,823::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-946::DEBUG::2014-04-10 19:15:18,823::task::974::TaskManager.Task::(_decref) Task=`e2515436-9adb-4cb2-81dc-cf2bd3b6d920`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:19,629::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:19,636::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000562526 s, 654 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:15:21,987::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:22,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337983 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:15:22,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:22,023::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281938 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:22,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:22,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000535135 s, 1.2 MB/s\n'; <rc> = 0
>Thread-950::DEBUG::2014-04-10 19:15:28,982::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-950::DEBUG::2014-04-10 19:15:28,983::task::579::TaskManager.Task::(_updateState) Task=`80d66e73-2840-4aed-9250-8c57bcd86204`::moving from state init -> state preparing
>Thread-950::INFO::2014-04-10 19:15:28,983::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-950::INFO::2014-04-10 19:15:28,984::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-950::DEBUG::2014-04-10 19:15:28,984::task::1168::TaskManager.Task::(prepare) Task=`80d66e73-2840-4aed-9250-8c57bcd86204`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-950::DEBUG::2014-04-10 19:15:28,984::task::579::TaskManager.Task::(_updateState) Task=`80d66e73-2840-4aed-9250-8c57bcd86204`::moving from state preparing -> state finished
>Thread-950::DEBUG::2014-04-10 19:15:28,984::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-950::DEBUG::2014-04-10 19:15:28,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-950::DEBUG::2014-04-10 19:15:28,984::task::974::TaskManager.Task::(_decref) Task=`80d66e73-2840-4aed-9250-8c57bcd86204`::ref 0 aborting False
>Thread-951::DEBUG::2014-04-10 19:15:28,992::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-951::DEBUG::2014-04-10 19:15:28,992::task::579::TaskManager.Task::(_updateState) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::moving from state init -> state preparing
>Thread-951::INFO::2014-04-10 19:15:28,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-951::DEBUG::2014-04-10 19:15:28,993::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b413c48c-3572-4d23-bb86-f7054de94487`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-951::DEBUG::2014-04-10 19:15:28,993::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-951::DEBUG::2014-04-10 19:15:28,993::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-951::DEBUG::2014-04-10 19:15:28,994::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b413c48c-3572-4d23-bb86-f7054de94487`::Granted request
>Thread-951::DEBUG::2014-04-10 19:15:28,995::task::811::TaskManager.Task::(resourceAcquired) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-951::DEBUG::2014-04-10 19:15:28,995::task::974::TaskManager.Task::(_decref) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::ref 1 aborting False
>Thread-951::INFO::2014-04-10 19:15:28,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-951::DEBUG::2014-04-10 19:15:28,997::task::1168::TaskManager.Task::(prepare) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-951::DEBUG::2014-04-10 19:15:28,998::task::579::TaskManager.Task::(_updateState) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::moving from state preparing -> state finished
>Thread-951::DEBUG::2014-04-10 19:15:28,998::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-951::DEBUG::2014-04-10 19:15:28,998::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-951::DEBUG::2014-04-10 19:15:28,998::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-951::DEBUG::2014-04-10 19:15:28,998::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-951::DEBUG::2014-04-10 19:15:28,998::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-951::DEBUG::2014-04-10 19:15:28,999::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-951::DEBUG::2014-04-10 19:15:28,999::task::974::TaskManager.Task::(_decref) Task=`b2aab017-b3ca-470f-9784-03d6805c725b`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:29,644::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:29,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000598387 s, 615 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:15:32,022::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:32,027::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:15:32,028::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:15:32,028::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:15:32,030::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-66::DEBUG::2014-04-10 19:15:32,037::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:32,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353278 s, 1.9 MB/s\n'; <rc> = 0
>Thread-953::DEBUG::2014-04-10 19:15:32,065::task::579::TaskManager.Task::(_updateState) Task=`211532c1-acdc-40a4-9047-bba53aab5d39`::moving from state init -> state preparing
>Thread-953::INFO::2014-04-10 19:15:32,066::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-953::INFO::2014-04-10 19:15:32,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535135', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353278', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281938', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598387', 'lastCheck': '2.4', 'valid': True}}
>Thread-953::DEBUG::2014-04-10 19:15:32,067::task::1168::TaskManager.Task::(prepare) Task=`211532c1-acdc-40a4-9047-bba53aab5d39`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535135', 'lastCheck': '9.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353278', 'lastCheck': '0.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000281938', 'lastCheck': '10.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598387', 'lastCheck': '2.4', 'valid': True}}
>Thread-953::DEBUG::2014-04-10 19:15:32,067::task::579::TaskManager.Task::(_updateState) Task=`211532c1-acdc-40a4-9047-bba53aab5d39`::moving from state preparing -> state finished
>Thread-953::DEBUG::2014-04-10 19:15:32,067::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-953::DEBUG::2014-04-10 19:15:32,067::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-953::DEBUG::2014-04-10 19:15:32,067::task::974::TaskManager.Task::(_decref) Task=`211532c1-acdc-40a4-9047-bba53aab5d39`::ref 0 aborting False
>Thread-66::DEBUG::2014-04-10 19:15:32,174::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:15:32,174::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:15:32,175::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:15:32,190::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:15:32,191::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-66::DEBUG::2014-04-10 19:15:32,195::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-66::DEBUG::2014-04-10 19:15:32,197::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-66::INFO::2014-04-10 19:15:32,197::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-66::INFO::2014-04-10 19:15:32,197::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-66::DEBUG::2014-04-10 19:15:32,202::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:32,208::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00037179 s, 1.8 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:32,871::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:32,879::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000545728 s, 1.2 MB/s\n'; <rc> = 0
>Thread-961::DEBUG::2014-04-10 19:15:39,090::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-961::DEBUG::2014-04-10 19:15:39,091::task::579::TaskManager.Task::(_updateState) Task=`9ca32099-3e29-4f0b-9ddf-0ab8dda66f80`::moving from state init -> state preparing
>Thread-961::INFO::2014-04-10 19:15:39,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-961::INFO::2014-04-10 19:15:39,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-961::DEBUG::2014-04-10 19:15:39,091::task::1168::TaskManager.Task::(prepare) Task=`9ca32099-3e29-4f0b-9ddf-0ab8dda66f80`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-961::DEBUG::2014-04-10 19:15:39,092::task::579::TaskManager.Task::(_updateState) Task=`9ca32099-3e29-4f0b-9ddf-0ab8dda66f80`::moving from state preparing -> state finished
>Thread-961::DEBUG::2014-04-10 19:15:39,092::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-961::DEBUG::2014-04-10 19:15:39,092::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-961::DEBUG::2014-04-10 19:15:39,092::task::974::TaskManager.Task::(_decref) Task=`9ca32099-3e29-4f0b-9ddf-0ab8dda66f80`::ref 0 aborting False
>Thread-962::DEBUG::2014-04-10 19:15:39,100::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-962::DEBUG::2014-04-10 19:15:39,101::task::579::TaskManager.Task::(_updateState) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::moving from state init -> state preparing
>Thread-962::INFO::2014-04-10 19:15:39,101::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-962::DEBUG::2014-04-10 19:15:39,101::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2d1a76e-8dd8-42a2-87d7-91fbf4fbe4b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-962::DEBUG::2014-04-10 19:15:39,101::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-962::DEBUG::2014-04-10 19:15:39,102::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-962::DEBUG::2014-04-10 19:15:39,102::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e2d1a76e-8dd8-42a2-87d7-91fbf4fbe4b5`::Granted request
>Thread-962::DEBUG::2014-04-10 19:15:39,102::task::811::TaskManager.Task::(resourceAcquired) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-962::DEBUG::2014-04-10 19:15:39,102::task::974::TaskManager.Task::(_decref) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::ref 1 aborting False
>Thread-962::INFO::2014-04-10 19:15:39,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-962::DEBUG::2014-04-10 19:15:39,105::task::1168::TaskManager.Task::(prepare) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-962::DEBUG::2014-04-10 19:15:39,105::task::579::TaskManager.Task::(_updateState) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::moving from state preparing -> state finished
>Thread-962::DEBUG::2014-04-10 19:15:39,105::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-962::DEBUG::2014-04-10 19:15:39,105::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-962::DEBUG::2014-04-10 19:15:39,105::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-962::DEBUG::2014-04-10 19:15:39,106::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-962::DEBUG::2014-04-10 19:15:39,106::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-962::DEBUG::2014-04-10 19:15:39,106::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-962::DEBUG::2014-04-10 19:15:39,106::task::974::TaskManager.Task::(_decref) Task=`ffed49e2-04b3-46c2-bd4e-0433cff3d791`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:39,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:39,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00046788 s, 787 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:15:42,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:42,060::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000418612 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:15:42,217::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:42,223::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354112 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:42,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:42,897::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000494301 s, 1.3 MB/s\n'; <rc> = 0
>Thread-965::DEBUG::2014-04-10 19:15:47,243::task::579::TaskManager.Task::(_updateState) Task=`6aa56fa9-c02e-4f49-a8de-85dbddc2ac6e`::moving from state init -> state preparing
>Thread-965::INFO::2014-04-10 19:15:47,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-965::INFO::2014-04-10 19:15:47,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494301', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418612', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354112', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046788', 'lastCheck': '7.6', 'valid': True}}
>Thread-965::DEBUG::2014-04-10 19:15:47,244::task::1168::TaskManager.Task::(prepare) Task=`6aa56fa9-c02e-4f49-a8de-85dbddc2ac6e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494301', 'lastCheck': '4.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418612', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354112', 'lastCheck': '5.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046788', 'lastCheck': '7.6', 'valid': True}}
>Thread-965::DEBUG::2014-04-10 19:15:47,244::task::579::TaskManager.Task::(_updateState) Task=`6aa56fa9-c02e-4f49-a8de-85dbddc2ac6e`::moving from state preparing -> state finished
>Thread-965::DEBUG::2014-04-10 19:15:47,244::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-965::DEBUG::2014-04-10 19:15:47,244::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-965::DEBUG::2014-04-10 19:15:47,244::task::974::TaskManager.Task::(_decref) Task=`6aa56fa9-c02e-4f49-a8de-85dbddc2ac6e`::ref 0 aborting False
>Thread-967::DEBUG::2014-04-10 19:15:49,196::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-967::DEBUG::2014-04-10 19:15:49,196::task::579::TaskManager.Task::(_updateState) Task=`37ea0195-9f26-4c2a-a603-9610240cc812`::moving from state init -> state preparing
>Thread-967::INFO::2014-04-10 19:15:49,196::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-967::INFO::2014-04-10 19:15:49,197::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-967::DEBUG::2014-04-10 19:15:49,197::task::1168::TaskManager.Task::(prepare) Task=`37ea0195-9f26-4c2a-a603-9610240cc812`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-967::DEBUG::2014-04-10 19:15:49,197::task::579::TaskManager.Task::(_updateState) Task=`37ea0195-9f26-4c2a-a603-9610240cc812`::moving from state preparing -> state finished
>Thread-967::DEBUG::2014-04-10 19:15:49,197::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-967::DEBUG::2014-04-10 19:15:49,197::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-967::DEBUG::2014-04-10 19:15:49,197::task::974::TaskManager.Task::(_decref) Task=`37ea0195-9f26-4c2a-a603-9610240cc812`::ref 0 aborting False
>Thread-968::DEBUG::2014-04-10 19:15:49,205::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-968::DEBUG::2014-04-10 19:15:49,206::task::579::TaskManager.Task::(_updateState) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::moving from state init -> state preparing
>Thread-968::INFO::2014-04-10 19:15:49,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-968::DEBUG::2014-04-10 19:15:49,206::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8c3bf3f4-5524-4b46-9c51-a78fae4b8762`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-968::DEBUG::2014-04-10 19:15:49,206::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-968::DEBUG::2014-04-10 19:15:49,207::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-968::DEBUG::2014-04-10 19:15:49,207::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`8c3bf3f4-5524-4b46-9c51-a78fae4b8762`::Granted request
>Thread-968::DEBUG::2014-04-10 19:15:49,207::task::811::TaskManager.Task::(resourceAcquired) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-968::DEBUG::2014-04-10 19:15:49,207::task::974::TaskManager.Task::(_decref) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::ref 1 aborting False
>Thread-968::INFO::2014-04-10 19:15:49,209::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-968::DEBUG::2014-04-10 19:15:49,209::task::1168::TaskManager.Task::(prepare) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-968::DEBUG::2014-04-10 19:15:49,210::task::579::TaskManager.Task::(_updateState) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::moving from state preparing -> state finished
>Thread-968::DEBUG::2014-04-10 19:15:49,210::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-968::DEBUG::2014-04-10 19:15:49,210::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-968::DEBUG::2014-04-10 19:15:49,210::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-968::DEBUG::2014-04-10 19:15:49,210::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-968::DEBUG::2014-04-10 19:15:49,211::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-968::DEBUG::2014-04-10 19:15:49,211::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-968::DEBUG::2014-04-10 19:15:49,211::task::974::TaskManager.Task::(_decref) Task=`64392bcb-e5c3-4271-b025-02aa110c2910`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:49,674::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:49,680::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000547062 s, 673 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:15:52,064::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:15:52,064::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:15:52,065::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:15:52,065::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:15:52,065::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:52,202::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:15:52,203::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:15:52,203::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:15:52,218::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:15:52,219::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-64::DEBUG::2014-04-10 19:15:52,224::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-64::DEBUG::2014-04-10 19:15:52,225::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::INFO::2014-04-10 19:15:52,225::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-64::INFO::2014-04-10 19:15:52,225::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-64::DEBUG::2014-04-10 19:15:52,260::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:15:52,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:15:52,279::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000286228 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:15:52,282::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000280891 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:15:52,907::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:15:52,914::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000454926 s, 1.4 MB/s\n'; <rc> = 0
>Thread-976::DEBUG::2014-04-10 19:15:59,288::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-976::DEBUG::2014-04-10 19:15:59,289::task::579::TaskManager.Task::(_updateState) Task=`5873b61b-0626-4d9f-89ca-546c488852bb`::moving from state init -> state preparing
>Thread-976::INFO::2014-04-10 19:15:59,289::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-976::INFO::2014-04-10 19:15:59,289::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-976::DEBUG::2014-04-10 19:15:59,289::task::1168::TaskManager.Task::(prepare) Task=`5873b61b-0626-4d9f-89ca-546c488852bb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-976::DEBUG::2014-04-10 19:15:59,289::task::579::TaskManager.Task::(_updateState) Task=`5873b61b-0626-4d9f-89ca-546c488852bb`::moving from state preparing -> state finished
>Thread-976::DEBUG::2014-04-10 19:15:59,290::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-976::DEBUG::2014-04-10 19:15:59,290::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-976::DEBUG::2014-04-10 19:15:59,290::task::974::TaskManager.Task::(_decref) Task=`5873b61b-0626-4d9f-89ca-546c488852bb`::ref 0 aborting False
>Thread-977::DEBUG::2014-04-10 19:15:59,298::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-977::DEBUG::2014-04-10 19:15:59,298::task::579::TaskManager.Task::(_updateState) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::moving from state init -> state preparing
>Thread-977::INFO::2014-04-10 19:15:59,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-977::DEBUG::2014-04-10 19:15:59,299::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1040143a-fead-4c5c-8b19-6a95d66d6514`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-977::DEBUG::2014-04-10 19:15:59,299::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-977::DEBUG::2014-04-10 19:15:59,299::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-977::DEBUG::2014-04-10 19:15:59,299::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1040143a-fead-4c5c-8b19-6a95d66d6514`::Granted request
>Thread-977::DEBUG::2014-04-10 19:15:59,300::task::811::TaskManager.Task::(resourceAcquired) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-977::DEBUG::2014-04-10 19:15:59,300::task::974::TaskManager.Task::(_decref) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::ref 1 aborting False
>Thread-977::INFO::2014-04-10 19:15:59,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-977::DEBUG::2014-04-10 19:15:59,302::task::1168::TaskManager.Task::(prepare) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-977::DEBUG::2014-04-10 19:15:59,302::task::579::TaskManager.Task::(_updateState) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::moving from state preparing -> state finished
>Thread-977::DEBUG::2014-04-10 19:15:59,302::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-977::DEBUG::2014-04-10 19:15:59,302::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-977::DEBUG::2014-04-10 19:15:59,303::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-977::DEBUG::2014-04-10 19:15:59,303::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-977::DEBUG::2014-04-10 19:15:59,303::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-977::DEBUG::2014-04-10 19:15:59,303::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-977::DEBUG::2014-04-10 19:15:59,303::task::974::TaskManager.Task::(_decref) Task=`6f0db73a-b48a-41eb-99cd-01697650bdff`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:15:59,692::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:15:59,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00047848 s, 769 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:16:02,296::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:02,312::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:02,317::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029707 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:02,325::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000350754 s, 1.9 MB/s\n'; <rc> = 0
>Thread-979::DEBUG::2014-04-10 19:16:02,419::task::579::TaskManager.Task::(_updateState) Task=`19102976-76f2-4058-a149-c2900eb93137`::moving from state init -> state preparing
>Thread-979::INFO::2014-04-10 19:16:02,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-979::INFO::2014-04-10 19:16:02,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454926', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029707', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350754', 'lastCheck': '0.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047848', 'lastCheck': '2.7', 'valid': True}}
>Thread-979::DEBUG::2014-04-10 19:16:02,420::task::1168::TaskManager.Task::(prepare) Task=`19102976-76f2-4058-a149-c2900eb93137`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454926', 'lastCheck': '9.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029707', 'lastCheck': '0.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000350754', 'lastCheck': '0.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047848', 'lastCheck': '2.7', 'valid': True}}
>Thread-979::DEBUG::2014-04-10 19:16:02,420::task::579::TaskManager.Task::(_updateState) Task=`19102976-76f2-4058-a149-c2900eb93137`::moving from state preparing -> state finished
>Thread-979::DEBUG::2014-04-10 19:16:02,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-979::DEBUG::2014-04-10 19:16:02,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-979::DEBUG::2014-04-10 19:16:02,420::task::974::TaskManager.Task::(_decref) Task=`19102976-76f2-4058-a149-c2900eb93137`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:16:02,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:02,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000505639 s, 1.3 MB/s\n'; <rc> = 0
>Thread-983::DEBUG::2014-04-10 19:16:09,387::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-983::DEBUG::2014-04-10 19:16:09,388::task::579::TaskManager.Task::(_updateState) Task=`3af4e279-351e-47ed-9037-601723df9fc6`::moving from state init -> state preparing
>Thread-983::INFO::2014-04-10 19:16:09,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-983::INFO::2014-04-10 19:16:09,388::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-983::DEBUG::2014-04-10 19:16:09,388::task::1168::TaskManager.Task::(prepare) Task=`3af4e279-351e-47ed-9037-601723df9fc6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-983::DEBUG::2014-04-10 19:16:09,389::task::579::TaskManager.Task::(_updateState) Task=`3af4e279-351e-47ed-9037-601723df9fc6`::moving from state preparing -> state finished
>Thread-983::DEBUG::2014-04-10 19:16:09,389::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-983::DEBUG::2014-04-10 19:16:09,389::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-983::DEBUG::2014-04-10 19:16:09,389::task::974::TaskManager.Task::(_decref) Task=`3af4e279-351e-47ed-9037-601723df9fc6`::ref 0 aborting False
>Thread-984::DEBUG::2014-04-10 19:16:09,397::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-984::DEBUG::2014-04-10 19:16:09,397::task::579::TaskManager.Task::(_updateState) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::moving from state init -> state preparing
>Thread-984::INFO::2014-04-10 19:16:09,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-984::DEBUG::2014-04-10 19:16:09,398::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec3545f6-0a45-42a7-90bb-b8c5df4e7d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-984::DEBUG::2014-04-10 19:16:09,398::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-984::DEBUG::2014-04-10 19:16:09,398::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-984::DEBUG::2014-04-10 19:16:09,399::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ec3545f6-0a45-42a7-90bb-b8c5df4e7d50`::Granted request
>Thread-984::DEBUG::2014-04-10 19:16:09,400::task::811::TaskManager.Task::(resourceAcquired) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-984::DEBUG::2014-04-10 19:16:09,400::task::974::TaskManager.Task::(_decref) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::ref 1 aborting False
>Thread-984::INFO::2014-04-10 19:16:09,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-984::DEBUG::2014-04-10 19:16:09,402::task::1168::TaskManager.Task::(prepare) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-984::DEBUG::2014-04-10 19:16:09,402::task::579::TaskManager.Task::(_updateState) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::moving from state preparing -> state finished
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-984::DEBUG::2014-04-10 19:16:09,403::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-984::DEBUG::2014-04-10 19:16:09,404::task::974::TaskManager.Task::(_decref) Task=`9e060017-5543-4e93-90fd-d4b51fb0b07a`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:16:09,706::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:09,713::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000543102 s, 678 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:16:12,366::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:12,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:12,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331551 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:12,392::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294705 s, 2.3 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:16:12,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:12,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000492533 s, 1.3 MB/s\n'; <rc> = 0
>Thread-987::DEBUG::2014-04-10 19:16:17,588::task::579::TaskManager.Task::(_updateState) Task=`4c064d4d-7f88-4f71-9116-6991b34fafd5`::moving from state init -> state preparing
>Thread-987::INFO::2014-04-10 19:16:17,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-987::INFO::2014-04-10 19:16:17,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492533', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331551', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294705', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543102', 'lastCheck': '7.9', 'valid': True}}
>Thread-987::DEBUG::2014-04-10 19:16:17,589::task::1168::TaskManager.Task::(prepare) Task=`4c064d4d-7f88-4f71-9116-6991b34fafd5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492533', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331551', 'lastCheck': '5.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294705', 'lastCheck': '5.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543102', 'lastCheck': '7.9', 'valid': True}}
>Thread-987::DEBUG::2014-04-10 19:16:17,589::task::579::TaskManager.Task::(_updateState) Task=`4c064d4d-7f88-4f71-9116-6991b34fafd5`::moving from state preparing -> state finished
>Thread-987::DEBUG::2014-04-10 19:16:17,589::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-987::DEBUG::2014-04-10 19:16:17,590::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-987::DEBUG::2014-04-10 19:16:17,590::task::974::TaskManager.Task::(_decref) Task=`4c064d4d-7f88-4f71-9116-6991b34fafd5`::ref 0 aborting False
>Thread-989::DEBUG::2014-04-10 19:16:19,493::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-989::DEBUG::2014-04-10 19:16:19,493::task::579::TaskManager.Task::(_updateState) Task=`1c86ce6f-8cd8-4a37-84ef-f009df76c060`::moving from state init -> state preparing
>Thread-989::INFO::2014-04-10 19:16:19,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-989::INFO::2014-04-10 19:16:19,494::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-989::DEBUG::2014-04-10 19:16:19,494::task::1168::TaskManager.Task::(prepare) Task=`1c86ce6f-8cd8-4a37-84ef-f009df76c060`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-989::DEBUG::2014-04-10 19:16:19,494::task::579::TaskManager.Task::(_updateState) Task=`1c86ce6f-8cd8-4a37-84ef-f009df76c060`::moving from state preparing -> state finished
>Thread-989::DEBUG::2014-04-10 19:16:19,494::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-989::DEBUG::2014-04-10 19:16:19,494::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-989::DEBUG::2014-04-10 19:16:19,494::task::974::TaskManager.Task::(_decref) Task=`1c86ce6f-8cd8-4a37-84ef-f009df76c060`::ref 0 aborting False
>Thread-990::DEBUG::2014-04-10 19:16:19,502::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-990::DEBUG::2014-04-10 19:16:19,503::task::579::TaskManager.Task::(_updateState) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::moving from state init -> state preparing
>Thread-990::INFO::2014-04-10 19:16:19,503::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-990::DEBUG::2014-04-10 19:16:19,503::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74eabd54-5be3-4c95-acdf-ee01d1c0ec7a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-990::DEBUG::2014-04-10 19:16:19,504::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-990::DEBUG::2014-04-10 19:16:19,504::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-990::DEBUG::2014-04-10 19:16:19,504::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`74eabd54-5be3-4c95-acdf-ee01d1c0ec7a`::Granted request
>Thread-990::DEBUG::2014-04-10 19:16:19,504::task::811::TaskManager.Task::(resourceAcquired) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-990::DEBUG::2014-04-10 19:16:19,504::task::974::TaskManager.Task::(_decref) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::ref 1 aborting False
>Thread-990::INFO::2014-04-10 19:16:19,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-990::DEBUG::2014-04-10 19:16:19,507::task::1168::TaskManager.Task::(prepare) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-990::DEBUG::2014-04-10 19:16:19,507::task::579::TaskManager.Task::(_updateState) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::moving from state preparing -> state finished
>Thread-990::DEBUG::2014-04-10 19:16:19,507::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-990::DEBUG::2014-04-10 19:16:19,507::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-990::DEBUG::2014-04-10 19:16:19,508::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-990::DEBUG::2014-04-10 19:16:19,508::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-990::DEBUG::2014-04-10 19:16:19,508::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-990::DEBUG::2014-04-10 19:16:19,508::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-990::DEBUG::2014-04-10 19:16:19,508::task::974::TaskManager.Task::(_decref) Task=`c16d0bff-d9c9-4e5f-bc99-e18c73e5e3b1`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:16:19,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:19,727::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000539435 s, 682 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:16:22,405::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:22,416::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:22,422::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000296721 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:22,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00156302 s, 429 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:16:22,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:22,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000563916 s, 1.2 MB/s\n'; <rc> = 0
>Thread-994::DEBUG::2014-04-10 19:16:29,584::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1884cf23]
>Thread-994::DEBUG::2014-04-10 19:16:29,585::task::579::TaskManager.Task::(_updateState) Task=`bff8c3fe-ebf2-402a-a2bf-e9765e81e3f2`::moving from state init -> state preparing
>Thread-994::INFO::2014-04-10 19:16:29,585::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-994::INFO::2014-04-10 19:16:29,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-994::DEBUG::2014-04-10 19:16:29,586::task::1168::TaskManager.Task::(prepare) Task=`bff8c3fe-ebf2-402a-a2bf-e9765e81e3f2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-994::DEBUG::2014-04-10 19:16:29,586::task::579::TaskManager.Task::(_updateState) Task=`bff8c3fe-ebf2-402a-a2bf-e9765e81e3f2`::moving from state preparing -> state finished
>Thread-994::DEBUG::2014-04-10 19:16:29,586::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-994::DEBUG::2014-04-10 19:16:29,586::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-994::DEBUG::2014-04-10 19:16:29,586::task::974::TaskManager.Task::(_decref) Task=`bff8c3fe-ebf2-402a-a2bf-e9765e81e3f2`::ref 0 aborting False
>Thread-995::DEBUG::2014-04-10 19:16:29,594::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1884cf23]
>Thread-995::DEBUG::2014-04-10 19:16:29,595::task::579::TaskManager.Task::(_updateState) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::moving from state init -> state preparing
>Thread-995::INFO::2014-04-10 19:16:29,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-995::DEBUG::2014-04-10 19:16:29,595::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`917bd478-90b3-4bf1-a787-b669389b145b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-995::DEBUG::2014-04-10 19:16:29,595::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-995::DEBUG::2014-04-10 19:16:29,596::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-995::DEBUG::2014-04-10 19:16:29,596::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`917bd478-90b3-4bf1-a787-b669389b145b`::Granted request
>Thread-995::DEBUG::2014-04-10 19:16:29,596::task::811::TaskManager.Task::(resourceAcquired) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-995::DEBUG::2014-04-10 19:16:29,596::task::974::TaskManager.Task::(_decref) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::ref 1 aborting False
>Thread-995::INFO::2014-04-10 19:16:29,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-995::DEBUG::2014-04-10 19:16:29,599::task::1168::TaskManager.Task::(prepare) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-995::DEBUG::2014-04-10 19:16:29,599::task::579::TaskManager.Task::(_updateState) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::moving from state preparing -> state finished
>Thread-995::DEBUG::2014-04-10 19:16:29,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-995::DEBUG::2014-04-10 19:16:29,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-995::DEBUG::2014-04-10 19:16:29,599::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-995::DEBUG::2014-04-10 19:16:29,599::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-995::DEBUG::2014-04-10 19:16:29,600::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-995::DEBUG::2014-04-10 19:16:29,600::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-995::DEBUG::2014-04-10 19:16:29,600::task::974::TaskManager.Task::(_decref) Task=`83ec2613-f77b-4cf9-b624-3193f7a35099`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:16:29,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:29,747::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000445145 s, 827 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:16:32,438::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:32,453::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:32,460::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270377 s, 2.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:32,466::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000323932 s, 2.1 MB/s\n'; <rc> = 0
>Thread-997::DEBUG::2014-04-10 19:16:32,780::task::579::TaskManager.Task::(_updateState) Task=`75ffdf12-bfdd-4fc1-94c5-5e541d249b0c`::moving from state init -> state preparing
>Thread-997::INFO::2014-04-10 19:16:32,781::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-997::INFO::2014-04-10 19:16:32,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563916', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270377', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323932', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445145', 'lastCheck': '3.0', 'valid': True}}
>Thread-997::DEBUG::2014-04-10 19:16:32,781::task::1168::TaskManager.Task::(prepare) Task=`75ffdf12-bfdd-4fc1-94c5-5e541d249b0c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563916', 'lastCheck': '9.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270377', 'lastCheck': '0.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323932', 'lastCheck': '0.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445145', 'lastCheck': '3.0', 'valid': True}}
>Thread-997::DEBUG::2014-04-10 19:16:32,781::task::579::TaskManager.Task::(_updateState) Task=`75ffdf12-bfdd-4fc1-94c5-5e541d249b0c`::moving from state preparing -> state finished
>Thread-997::DEBUG::2014-04-10 19:16:32,782::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-997::DEBUG::2014-04-10 19:16:32,782::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-997::DEBUG::2014-04-10 19:16:32,782::task::974::TaskManager.Task::(_decref) Task=`75ffdf12-bfdd-4fc1-94c5-5e541d249b0c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:16:32,975::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:32,983::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000468201 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1001::DEBUG::2014-04-10 19:16:39,690::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1001::DEBUG::2014-04-10 19:16:39,690::task::579::TaskManager.Task::(_updateState) Task=`e725f976-5b37-425e-8a7d-eee0720c8b2b`::moving from state init -> state preparing
>Thread-1001::INFO::2014-04-10 19:16:39,691::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1001::INFO::2014-04-10 19:16:39,691::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1001::DEBUG::2014-04-10 19:16:39,691::task::1168::TaskManager.Task::(prepare) Task=`e725f976-5b37-425e-8a7d-eee0720c8b2b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1001::DEBUG::2014-04-10 19:16:39,691::task::579::TaskManager.Task::(_updateState) Task=`e725f976-5b37-425e-8a7d-eee0720c8b2b`::moving from state preparing -> state finished
>Thread-1001::DEBUG::2014-04-10 19:16:39,691::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1001::DEBUG::2014-04-10 19:16:39,692::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1001::DEBUG::2014-04-10 19:16:39,692::task::974::TaskManager.Task::(_decref) Task=`e725f976-5b37-425e-8a7d-eee0720c8b2b`::ref 0 aborting False
>Thread-1002::DEBUG::2014-04-10 19:16:39,700::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1002::DEBUG::2014-04-10 19:16:39,700::task::579::TaskManager.Task::(_updateState) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::moving from state init -> state preparing
>Thread-1002::INFO::2014-04-10 19:16:39,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1002::DEBUG::2014-04-10 19:16:39,701::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1ea7c00-4435-4ca6-8085-5c27a4957ad6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1002::DEBUG::2014-04-10 19:16:39,701::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1002::DEBUG::2014-04-10 19:16:39,701::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1002::DEBUG::2014-04-10 19:16:39,702::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1ea7c00-4435-4ca6-8085-5c27a4957ad6`::Granted request
>Thread-1002::DEBUG::2014-04-10 19:16:39,702::task::811::TaskManager.Task::(resourceAcquired) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1002::DEBUG::2014-04-10 19:16:39,702::task::974::TaskManager.Task::(_decref) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::ref 1 aborting False
>Thread-1002::INFO::2014-04-10 19:16:39,704::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1002::DEBUG::2014-04-10 19:16:39,704::task::1168::TaskManager.Task::(prepare) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::task::579::TaskManager.Task::(_updateState) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::moving from state preparing -> state finished
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1002::DEBUG::2014-04-10 19:16:39,705::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1002::DEBUG::2014-04-10 19:16:39,706::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1002::DEBUG::2014-04-10 19:16:39,706::task::974::TaskManager.Task::(_decref) Task=`a1aaf586-6022-4d0d-a0d2-6b29a9a0098e`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:16:39,756::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:39,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000431781 s, 852 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:16:42,503::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:42,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:42,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000314175 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:42,528::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255902 s, 2.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:16:42,994::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:43,002::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000561494 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1005::DEBUG::2014-04-10 19:16:47,964::task::579::TaskManager.Task::(_updateState) Task=`d54599b8-9089-460e-b076-d7430169cb41`::moving from state init -> state preparing
>Thread-1005::INFO::2014-04-10 19:16:47,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1005::INFO::2014-04-10 19:16:47,964::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561494', 'lastCheck': '5.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314175', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255902', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431781', 'lastCheck': '8.2', 'valid': True}}
>Thread-1005::DEBUG::2014-04-10 19:16:47,965::task::1168::TaskManager.Task::(prepare) Task=`d54599b8-9089-460e-b076-d7430169cb41`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561494', 'lastCheck': '5.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314175', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255902', 'lastCheck': '5.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431781', 'lastCheck': '8.2', 'valid': True}}
>Thread-1005::DEBUG::2014-04-10 19:16:47,965::task::579::TaskManager.Task::(_updateState) Task=`d54599b8-9089-460e-b076-d7430169cb41`::moving from state preparing -> state finished
>Thread-1005::DEBUG::2014-04-10 19:16:47,965::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1005::DEBUG::2014-04-10 19:16:47,965::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1005::DEBUG::2014-04-10 19:16:47,965::task::974::TaskManager.Task::(_decref) Task=`d54599b8-9089-460e-b076-d7430169cb41`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:16:49,771::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:49,778::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00050216 s, 733 kB/s\n'; <rc> = 0
>Thread-1007::DEBUG::2014-04-10 19:16:49,797::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1007::DEBUG::2014-04-10 19:16:49,798::task::579::TaskManager.Task::(_updateState) Task=`41b897d5-1a55-46ad-a015-444dd23b0f91`::moving from state init -> state preparing
>Thread-1007::INFO::2014-04-10 19:16:49,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1007::INFO::2014-04-10 19:16:49,799::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1007::DEBUG::2014-04-10 19:16:49,799::task::1168::TaskManager.Task::(prepare) Task=`41b897d5-1a55-46ad-a015-444dd23b0f91`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1007::DEBUG::2014-04-10 19:16:49,799::task::579::TaskManager.Task::(_updateState) Task=`41b897d5-1a55-46ad-a015-444dd23b0f91`::moving from state preparing -> state finished
>Thread-1007::DEBUG::2014-04-10 19:16:49,799::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1007::DEBUG::2014-04-10 19:16:49,799::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1007::DEBUG::2014-04-10 19:16:49,799::task::974::TaskManager.Task::(_decref) Task=`41b897d5-1a55-46ad-a015-444dd23b0f91`::ref 0 aborting False
>Thread-1008::DEBUG::2014-04-10 19:16:49,808::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1008::DEBUG::2014-04-10 19:16:49,808::task::579::TaskManager.Task::(_updateState) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::moving from state init -> state preparing
>Thread-1008::INFO::2014-04-10 19:16:49,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1008::DEBUG::2014-04-10 19:16:49,809::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e6265ec-c7f2-44eb-8e3b-850a05bc61d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1008::DEBUG::2014-04-10 19:16:49,809::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1008::DEBUG::2014-04-10 19:16:49,809::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1008::DEBUG::2014-04-10 19:16:49,809::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2e6265ec-c7f2-44eb-8e3b-850a05bc61d1`::Granted request
>Thread-1008::DEBUG::2014-04-10 19:16:49,811::task::811::TaskManager.Task::(resourceAcquired) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1008::DEBUG::2014-04-10 19:16:49,811::task::974::TaskManager.Task::(_decref) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::ref 1 aborting False
>Thread-1008::INFO::2014-04-10 19:16:49,813::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1008::DEBUG::2014-04-10 19:16:49,813::task::1168::TaskManager.Task::(prepare) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::task::579::TaskManager.Task::(_updateState) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::moving from state preparing -> state finished
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1008::DEBUG::2014-04-10 19:16:49,814::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1008::DEBUG::2014-04-10 19:16:49,815::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1008::DEBUG::2014-04-10 19:16:49,815::task::974::TaskManager.Task::(_decref) Task=`9fb30b37-023d-4472-8ba7-5ca0f4abc61e`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:16:52,539::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:16:52,555::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:16:52,560::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032097 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:16:52,567::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000279817 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:16:53,011::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:16:53,018::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000457569 s, 1.4 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:16:59,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:16:59,792::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000561321 s, 656 kB/s\n'; <rc> = 0
>Thread-1012::DEBUG::2014-04-10 19:16:59,888::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1012::DEBUG::2014-04-10 19:16:59,888::task::579::TaskManager.Task::(_updateState) Task=`e52fb22e-fcb6-42b4-b5f0-2e598678064e`::moving from state init -> state preparing
>Thread-1012::INFO::2014-04-10 19:16:59,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1012::INFO::2014-04-10 19:16:59,889::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1012::DEBUG::2014-04-10 19:16:59,889::task::1168::TaskManager.Task::(prepare) Task=`e52fb22e-fcb6-42b4-b5f0-2e598678064e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1012::DEBUG::2014-04-10 19:16:59,889::task::579::TaskManager.Task::(_updateState) Task=`e52fb22e-fcb6-42b4-b5f0-2e598678064e`::moving from state preparing -> state finished
>Thread-1012::DEBUG::2014-04-10 19:16:59,889::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1012::DEBUG::2014-04-10 19:16:59,890::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1012::DEBUG::2014-04-10 19:16:59,890::task::974::TaskManager.Task::(_decref) Task=`e52fb22e-fcb6-42b4-b5f0-2e598678064e`::ref 0 aborting False
>Thread-1013::DEBUG::2014-04-10 19:16:59,898::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1013::DEBUG::2014-04-10 19:16:59,898::task::579::TaskManager.Task::(_updateState) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::moving from state init -> state preparing
>Thread-1013::INFO::2014-04-10 19:16:59,898::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1013::DEBUG::2014-04-10 19:16:59,899::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4db27f4-8447-4c08-a032-71bff62b1209`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1013::DEBUG::2014-04-10 19:16:59,899::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1013::DEBUG::2014-04-10 19:16:59,899::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1013::DEBUG::2014-04-10 19:16:59,899::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c4db27f4-8447-4c08-a032-71bff62b1209`::Granted request
>Thread-1013::DEBUG::2014-04-10 19:16:59,900::task::811::TaskManager.Task::(resourceAcquired) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1013::DEBUG::2014-04-10 19:16:59,900::task::974::TaskManager.Task::(_decref) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::ref 1 aborting False
>Thread-1013::INFO::2014-04-10 19:16:59,904::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1013::DEBUG::2014-04-10 19:16:59,904::task::1168::TaskManager.Task::(prepare) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1013::DEBUG::2014-04-10 19:16:59,904::task::579::TaskManager.Task::(_updateState) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::moving from state preparing -> state finished
>Thread-1013::DEBUG::2014-04-10 19:16:59,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1013::DEBUG::2014-04-10 19:16:59,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1013::DEBUG::2014-04-10 19:16:59,905::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1013::DEBUG::2014-04-10 19:16:59,905::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1013::DEBUG::2014-04-10 19:16:59,905::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1013::DEBUG::2014-04-10 19:16:59,905::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1013::DEBUG::2014-04-10 19:16:59,905::task::974::TaskManager.Task::(_decref) Task=`3b788ebc-a759-4e46-9579-cc3cdd7ca6ba`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:02,577::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:02,593::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000346794 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:02,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:02,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278057 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:03,028::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:03,035::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000513916 s, 1.3 MB/s\n'; <rc> = 0
>Thread-1015::DEBUG::2014-04-10 19:17:03,153::task::579::TaskManager.Task::(_updateState) Task=`8f03e593-6d97-41b0-ad92-bdf1d7973cd1`::moving from state init -> state preparing
>Thread-1015::INFO::2014-04-10 19:17:03,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1015::INFO::2014-04-10 19:17:03,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513916', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346794', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278057', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561321', 'lastCheck': '3.4', 'valid': True}}
>Thread-1015::DEBUG::2014-04-10 19:17:03,154::task::1168::TaskManager.Task::(prepare) Task=`8f03e593-6d97-41b0-ad92-bdf1d7973cd1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513916', 'lastCheck': '0.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346794', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278057', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000561321', 'lastCheck': '3.4', 'valid': True}}
>Thread-1015::DEBUG::2014-04-10 19:17:03,154::task::579::TaskManager.Task::(_updateState) Task=`8f03e593-6d97-41b0-ad92-bdf1d7973cd1`::moving from state preparing -> state finished
>Thread-1015::DEBUG::2014-04-10 19:17:03,154::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1015::DEBUG::2014-04-10 19:17:03,154::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1015::DEBUG::2014-04-10 19:17:03,154::task::974::TaskManager.Task::(_decref) Task=`8f03e593-6d97-41b0-ad92-bdf1d7973cd1`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:17:09,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:09,807::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000445136 s, 827 kB/s\n'; <rc> = 0
>Thread-1019::DEBUG::2014-04-10 19:17:10,028::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1019::DEBUG::2014-04-10 19:17:10,029::task::579::TaskManager.Task::(_updateState) Task=`bac3041c-5f80-4bbc-b33d-36a63aa256e9`::moving from state init -> state preparing
>Thread-1019::INFO::2014-04-10 19:17:10,029::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1019::INFO::2014-04-10 19:17:10,029::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1019::DEBUG::2014-04-10 19:17:10,030::task::1168::TaskManager.Task::(prepare) Task=`bac3041c-5f80-4bbc-b33d-36a63aa256e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1019::DEBUG::2014-04-10 19:17:10,030::task::579::TaskManager.Task::(_updateState) Task=`bac3041c-5f80-4bbc-b33d-36a63aa256e9`::moving from state preparing -> state finished
>Thread-1019::DEBUG::2014-04-10 19:17:10,030::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1019::DEBUG::2014-04-10 19:17:10,030::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1019::DEBUG::2014-04-10 19:17:10,030::task::974::TaskManager.Task::(_decref) Task=`bac3041c-5f80-4bbc-b33d-36a63aa256e9`::ref 0 aborting False
>Thread-1020::DEBUG::2014-04-10 19:17:10,040::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1020::DEBUG::2014-04-10 19:17:10,040::task::579::TaskManager.Task::(_updateState) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::moving from state init -> state preparing
>Thread-1020::INFO::2014-04-10 19:17:10,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1020::DEBUG::2014-04-10 19:17:10,041::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5fa19823-aa6c-44dc-85eb-942350cb4c6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1020::DEBUG::2014-04-10 19:17:10,041::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1020::DEBUG::2014-04-10 19:17:10,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1020::DEBUG::2014-04-10 19:17:10,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5fa19823-aa6c-44dc-85eb-942350cb4c6c`::Granted request
>Thread-1020::DEBUG::2014-04-10 19:17:10,042::task::811::TaskManager.Task::(resourceAcquired) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1020::DEBUG::2014-04-10 19:17:10,042::task::974::TaskManager.Task::(_decref) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::ref 1 aborting False
>Thread-1020::INFO::2014-04-10 19:17:10,044::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1020::DEBUG::2014-04-10 19:17:10,044::task::1168::TaskManager.Task::(prepare) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1020::DEBUG::2014-04-10 19:17:10,045::task::579::TaskManager.Task::(_updateState) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::moving from state preparing -> state finished
>Thread-1020::DEBUG::2014-04-10 19:17:10,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1020::DEBUG::2014-04-10 19:17:10,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1020::DEBUG::2014-04-10 19:17:10,045::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1020::DEBUG::2014-04-10 19:17:10,046::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1020::DEBUG::2014-04-10 19:17:10,046::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1020::DEBUG::2014-04-10 19:17:10,046::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1020::DEBUG::2014-04-10 19:17:10,046::task::974::TaskManager.Task::(_decref) Task=`3897b3b0-6297-425d-ac5d-3a7d5de29ecd`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:12,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:12,650::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000271662 s, 2.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:12,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:12,666::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029905 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:13,044::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:13,052::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000477094 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1023::DEBUG::2014-04-10 19:17:18,344::task::579::TaskManager.Task::(_updateState) Task=`a2c22b75-7969-4144-864b-2bf97259ea6c`::moving from state init -> state preparing
>Thread-1023::INFO::2014-04-10 19:17:18,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1023::INFO::2014-04-10 19:17:18,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477094', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271662', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029905', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445136', 'lastCheck': '8.5', 'valid': True}}
>Thread-1023::DEBUG::2014-04-10 19:17:18,345::task::1168::TaskManager.Task::(prepare) Task=`a2c22b75-7969-4144-864b-2bf97259ea6c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477094', 'lastCheck': '5.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000271662', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029905', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445136', 'lastCheck': '8.5', 'valid': True}}
>Thread-1023::DEBUG::2014-04-10 19:17:18,345::task::579::TaskManager.Task::(_updateState) Task=`a2c22b75-7969-4144-864b-2bf97259ea6c`::moving from state preparing -> state finished
>Thread-1023::DEBUG::2014-04-10 19:17:18,345::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1023::DEBUG::2014-04-10 19:17:18,345::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1023::DEBUG::2014-04-10 19:17:18,346::task::974::TaskManager.Task::(_decref) Task=`a2c22b75-7969-4144-864b-2bf97259ea6c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:17:19,814::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:19,821::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00054102 s, 680 kB/s\n'; <rc> = 0
>Thread-1025::DEBUG::2014-04-10 19:17:20,127::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1025::DEBUG::2014-04-10 19:17:20,127::task::579::TaskManager.Task::(_updateState) Task=`6a1c6014-03ff-4b5e-a01d-f8fb36ebf8bd`::moving from state init -> state preparing
>Thread-1025::INFO::2014-04-10 19:17:20,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1025::INFO::2014-04-10 19:17:20,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1025::DEBUG::2014-04-10 19:17:20,128::task::1168::TaskManager.Task::(prepare) Task=`6a1c6014-03ff-4b5e-a01d-f8fb36ebf8bd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1025::DEBUG::2014-04-10 19:17:20,128::task::579::TaskManager.Task::(_updateState) Task=`6a1c6014-03ff-4b5e-a01d-f8fb36ebf8bd`::moving from state preparing -> state finished
>Thread-1025::DEBUG::2014-04-10 19:17:20,128::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1025::DEBUG::2014-04-10 19:17:20,128::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1025::DEBUG::2014-04-10 19:17:20,129::task::974::TaskManager.Task::(_decref) Task=`6a1c6014-03ff-4b5e-a01d-f8fb36ebf8bd`::ref 0 aborting False
>Thread-1026::DEBUG::2014-04-10 19:17:20,139::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1026::DEBUG::2014-04-10 19:17:20,139::task::579::TaskManager.Task::(_updateState) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::moving from state init -> state preparing
>Thread-1026::INFO::2014-04-10 19:17:20,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1026::DEBUG::2014-04-10 19:17:20,140::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`066be333-bba6-4281-8290-9594fc0480dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1026::DEBUG::2014-04-10 19:17:20,140::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1026::DEBUG::2014-04-10 19:17:20,140::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1026::DEBUG::2014-04-10 19:17:20,140::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`066be333-bba6-4281-8290-9594fc0480dc`::Granted request
>Thread-1026::DEBUG::2014-04-10 19:17:20,141::task::811::TaskManager.Task::(resourceAcquired) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1026::DEBUG::2014-04-10 19:17:20,141::task::974::TaskManager.Task::(_decref) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::ref 1 aborting False
>Thread-1026::INFO::2014-04-10 19:17:20,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1026::DEBUG::2014-04-10 19:17:20,143::task::1168::TaskManager.Task::(prepare) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1026::DEBUG::2014-04-10 19:17:20,143::task::579::TaskManager.Task::(_updateState) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::moving from state preparing -> state finished
>Thread-1026::DEBUG::2014-04-10 19:17:20,144::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1026::DEBUG::2014-04-10 19:17:20,144::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1026::DEBUG::2014-04-10 19:17:20,144::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1026::DEBUG::2014-04-10 19:17:20,144::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1026::DEBUG::2014-04-10 19:17:20,144::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1026::DEBUG::2014-04-10 19:17:20,145::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1026::DEBUG::2014-04-10 19:17:20,145::task::974::TaskManager.Task::(_decref) Task=`512a1e81-24e6-4f73-ba22-7ed2f6d71b3d`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:22,672::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:22,688::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000315251 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:22,699::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:22,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337041 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:23,061::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:23,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000542671 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:17:29,829::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:29,836::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000522843 s, 704 kB/s\n'; <rc> = 0
>Thread-1030::DEBUG::2014-04-10 19:17:30,225::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1030::DEBUG::2014-04-10 19:17:30,226::task::579::TaskManager.Task::(_updateState) Task=`4d149b78-0489-481d-b978-7bdc21b8a68d`::moving from state init -> state preparing
>Thread-1030::INFO::2014-04-10 19:17:30,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1030::INFO::2014-04-10 19:17:30,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1030::DEBUG::2014-04-10 19:17:30,226::task::1168::TaskManager.Task::(prepare) Task=`4d149b78-0489-481d-b978-7bdc21b8a68d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1030::DEBUG::2014-04-10 19:17:30,227::task::579::TaskManager.Task::(_updateState) Task=`4d149b78-0489-481d-b978-7bdc21b8a68d`::moving from state preparing -> state finished
>Thread-1030::DEBUG::2014-04-10 19:17:30,227::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1030::DEBUG::2014-04-10 19:17:30,227::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1030::DEBUG::2014-04-10 19:17:30,227::task::974::TaskManager.Task::(_decref) Task=`4d149b78-0489-481d-b978-7bdc21b8a68d`::ref 0 aborting False
>Thread-1031::DEBUG::2014-04-10 19:17:30,235::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1031::DEBUG::2014-04-10 19:17:30,236::task::579::TaskManager.Task::(_updateState) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::moving from state init -> state preparing
>Thread-1031::INFO::2014-04-10 19:17:30,236::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1031::DEBUG::2014-04-10 19:17:30,236::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97342ba6-5ea3-4f53-b527-dc3c9d92f473`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1031::DEBUG::2014-04-10 19:17:30,237::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1031::DEBUG::2014-04-10 19:17:30,237::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1031::DEBUG::2014-04-10 19:17:30,237::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`97342ba6-5ea3-4f53-b527-dc3c9d92f473`::Granted request
>Thread-1031::DEBUG::2014-04-10 19:17:30,239::task::811::TaskManager.Task::(resourceAcquired) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1031::DEBUG::2014-04-10 19:17:30,239::task::974::TaskManager.Task::(_decref) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::ref 1 aborting False
>Thread-1031::INFO::2014-04-10 19:17:30,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1031::DEBUG::2014-04-10 19:17:30,241::task::1168::TaskManager.Task::(prepare) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1031::DEBUG::2014-04-10 19:17:30,241::task::579::TaskManager.Task::(_updateState) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::moving from state preparing -> state finished
>Thread-1031::DEBUG::2014-04-10 19:17:30,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1031::DEBUG::2014-04-10 19:17:30,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1031::DEBUG::2014-04-10 19:17:30,242::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1031::DEBUG::2014-04-10 19:17:30,242::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1031::DEBUG::2014-04-10 19:17:30,242::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1031::DEBUG::2014-04-10 19:17:30,243::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1031::DEBUG::2014-04-10 19:17:30,243::task::974::TaskManager.Task::(_decref) Task=`d54373a2-d1e2-44c7-a0f5-a3752c0cb249`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:32,705::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:32,722::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000297149 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:32,735::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:32,740::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277082 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:33,079::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:33,087::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000551012 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1033::DEBUG::2014-04-10 19:17:33,532::task::579::TaskManager.Task::(_updateState) Task=`55521894-df13-4c16-a51c-ba31f6b4173f`::moving from state init -> state preparing
>Thread-1033::INFO::2014-04-10 19:17:33,532::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1033::INFO::2014-04-10 19:17:33,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551012', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297149', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277082', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522843', 'lastCheck': '3.7', 'valid': True}}
>Thread-1033::DEBUG::2014-04-10 19:17:33,533::task::1168::TaskManager.Task::(prepare) Task=`55521894-df13-4c16-a51c-ba31f6b4173f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000551012', 'lastCheck': '0.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000297149', 'lastCheck': '0.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277082', 'lastCheck': '0.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522843', 'lastCheck': '3.7', 'valid': True}}
>Thread-1033::DEBUG::2014-04-10 19:17:33,533::task::579::TaskManager.Task::(_updateState) Task=`55521894-df13-4c16-a51c-ba31f6b4173f`::moving from state preparing -> state finished
>Thread-1033::DEBUG::2014-04-10 19:17:33,533::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1033::DEBUG::2014-04-10 19:17:33,533::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1033::DEBUG::2014-04-10 19:17:33,534::task::974::TaskManager.Task::(_decref) Task=`55521894-df13-4c16-a51c-ba31f6b4173f`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:17:39,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:39,853::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000545937 s, 674 kB/s\n'; <rc> = 0
>Thread-1037::DEBUG::2014-04-10 19:17:40,316::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1037::DEBUG::2014-04-10 19:17:40,316::task::579::TaskManager.Task::(_updateState) Task=`9775e3e2-2cd9-417f-a349-9cbfc906fa6a`::moving from state init -> state preparing
>Thread-1037::INFO::2014-04-10 19:17:40,316::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1037::INFO::2014-04-10 19:17:40,317::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1037::DEBUG::2014-04-10 19:17:40,317::task::1168::TaskManager.Task::(prepare) Task=`9775e3e2-2cd9-417f-a349-9cbfc906fa6a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1037::DEBUG::2014-04-10 19:17:40,317::task::579::TaskManager.Task::(_updateState) Task=`9775e3e2-2cd9-417f-a349-9cbfc906fa6a`::moving from state preparing -> state finished
>Thread-1037::DEBUG::2014-04-10 19:17:40,317::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1037::DEBUG::2014-04-10 19:17:40,317::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1037::DEBUG::2014-04-10 19:17:40,317::task::974::TaskManager.Task::(_decref) Task=`9775e3e2-2cd9-417f-a349-9cbfc906fa6a`::ref 0 aborting False
>Thread-1038::DEBUG::2014-04-10 19:17:40,325::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1038::DEBUG::2014-04-10 19:17:40,326::task::579::TaskManager.Task::(_updateState) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::moving from state init -> state preparing
>Thread-1038::INFO::2014-04-10 19:17:40,326::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1038::DEBUG::2014-04-10 19:17:40,326::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5c0a9df-0f1f-4f0b-bc71-77520ad50bab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1038::DEBUG::2014-04-10 19:17:40,326::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1038::DEBUG::2014-04-10 19:17:40,327::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1038::DEBUG::2014-04-10 19:17:40,327::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f5c0a9df-0f1f-4f0b-bc71-77520ad50bab`::Granted request
>Thread-1038::DEBUG::2014-04-10 19:17:40,327::task::811::TaskManager.Task::(resourceAcquired) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1038::DEBUG::2014-04-10 19:17:40,327::task::974::TaskManager.Task::(_decref) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::ref 1 aborting False
>Thread-1038::INFO::2014-04-10 19:17:40,329::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1038::DEBUG::2014-04-10 19:17:40,329::task::1168::TaskManager.Task::(prepare) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::task::579::TaskManager.Task::(_updateState) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::moving from state preparing -> state finished
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1038::DEBUG::2014-04-10 19:17:40,330::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1038::DEBUG::2014-04-10 19:17:40,331::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1038::DEBUG::2014-04-10 19:17:40,331::task::974::TaskManager.Task::(_decref) Task=`1811b5d4-e63a-4aec-ad75-5ea6d21287ec`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:42,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:42,762::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288052 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:42,780::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:42,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000294121 s, 2.3 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:43,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:43,105::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000428569 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1041::DEBUG::2014-04-10 19:17:48,720::task::579::TaskManager.Task::(_updateState) Task=`568e86a4-f1d9-470a-999e-3d526fc06f3e`::moving from state init -> state preparing
>Thread-1041::INFO::2014-04-10 19:17:48,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1041::INFO::2014-04-10 19:17:48,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428569', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288052', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294121', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545937', 'lastCheck': '8.9', 'valid': True}}
>Thread-1041::DEBUG::2014-04-10 19:17:48,721::task::1168::TaskManager.Task::(prepare) Task=`568e86a4-f1d9-470a-999e-3d526fc06f3e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428569', 'lastCheck': '5.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288052', 'lastCheck': '5.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000294121', 'lastCheck': '5.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545937', 'lastCheck': '8.9', 'valid': True}}
>Thread-1041::DEBUG::2014-04-10 19:17:48,721::task::579::TaskManager.Task::(_updateState) Task=`568e86a4-f1d9-470a-999e-3d526fc06f3e`::moving from state preparing -> state finished
>Thread-1041::DEBUG::2014-04-10 19:17:48,722::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1041::DEBUG::2014-04-10 19:17:48,722::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1041::DEBUG::2014-04-10 19:17:48,722::task::974::TaskManager.Task::(_decref) Task=`568e86a4-f1d9-470a-999e-3d526fc06f3e`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:17:49,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:49,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000594009 s, 620 kB/s\n'; <rc> = 0
>Thread-1043::DEBUG::2014-04-10 19:17:50,422::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1043::DEBUG::2014-04-10 19:17:50,422::task::579::TaskManager.Task::(_updateState) Task=`b56e43f2-af88-4b70-83b0-9354a6dc53c9`::moving from state init -> state preparing
>Thread-1043::INFO::2014-04-10 19:17:50,423::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1043::INFO::2014-04-10 19:17:50,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1043::DEBUG::2014-04-10 19:17:50,423::task::1168::TaskManager.Task::(prepare) Task=`b56e43f2-af88-4b70-83b0-9354a6dc53c9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1043::DEBUG::2014-04-10 19:17:50,423::task::579::TaskManager.Task::(_updateState) Task=`b56e43f2-af88-4b70-83b0-9354a6dc53c9`::moving from state preparing -> state finished
>Thread-1043::DEBUG::2014-04-10 19:17:50,423::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1043::DEBUG::2014-04-10 19:17:50,424::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1043::DEBUG::2014-04-10 19:17:50,424::task::974::TaskManager.Task::(_decref) Task=`b56e43f2-af88-4b70-83b0-9354a6dc53c9`::ref 0 aborting False
>Thread-1044::DEBUG::2014-04-10 19:17:50,432::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1044::DEBUG::2014-04-10 19:17:50,432::task::579::TaskManager.Task::(_updateState) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::moving from state init -> state preparing
>Thread-1044::INFO::2014-04-10 19:17:50,433::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1044::DEBUG::2014-04-10 19:17:50,433::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`67f66829-1194-47ef-8837-e4634d7086f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1044::DEBUG::2014-04-10 19:17:50,433::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1044::DEBUG::2014-04-10 19:17:50,434::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1044::DEBUG::2014-04-10 19:17:50,434::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`67f66829-1194-47ef-8837-e4634d7086f4`::Granted request
>Thread-1044::DEBUG::2014-04-10 19:17:50,434::task::811::TaskManager.Task::(resourceAcquired) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1044::DEBUG::2014-04-10 19:17:50,434::task::974::TaskManager.Task::(_decref) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::ref 1 aborting False
>Thread-1044::INFO::2014-04-10 19:17:50,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1044::DEBUG::2014-04-10 19:17:50,437::task::1168::TaskManager.Task::(prepare) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1044::DEBUG::2014-04-10 19:17:50,437::task::579::TaskManager.Task::(_updateState) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::moving from state preparing -> state finished
>Thread-1044::DEBUG::2014-04-10 19:17:50,437::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1044::DEBUG::2014-04-10 19:17:50,437::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1044::DEBUG::2014-04-10 19:17:50,438::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1044::DEBUG::2014-04-10 19:17:50,438::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1044::DEBUG::2014-04-10 19:17:50,438::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1044::DEBUG::2014-04-10 19:17:50,438::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1044::DEBUG::2014-04-10 19:17:50,438::task::974::TaskManager.Task::(_decref) Task=`bc6672ab-7e57-4103-bcfa-5d9878cfa4a4`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:17:52,783::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:17:52,804::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031247 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:17:52,817::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:17:52,822::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000306288 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:17:53,114::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:17:53,122::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000522272 s, 1.3 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:17:59,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:17:59,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000586971 s, 627 kB/s\n'; <rc> = 0
>Thread-1048::DEBUG::2014-04-10 19:18:00,513::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1048::DEBUG::2014-04-10 19:18:00,514::task::579::TaskManager.Task::(_updateState) Task=`a12194f1-81e9-4804-9ab8-1fdf2c1cfeb6`::moving from state init -> state preparing
>Thread-1048::INFO::2014-04-10 19:18:00,514::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1048::INFO::2014-04-10 19:18:00,515::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1048::DEBUG::2014-04-10 19:18:00,515::task::1168::TaskManager.Task::(prepare) Task=`a12194f1-81e9-4804-9ab8-1fdf2c1cfeb6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1048::DEBUG::2014-04-10 19:18:00,515::task::579::TaskManager.Task::(_updateState) Task=`a12194f1-81e9-4804-9ab8-1fdf2c1cfeb6`::moving from state preparing -> state finished
>Thread-1048::DEBUG::2014-04-10 19:18:00,515::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1048::DEBUG::2014-04-10 19:18:00,515::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1048::DEBUG::2014-04-10 19:18:00,515::task::974::TaskManager.Task::(_decref) Task=`a12194f1-81e9-4804-9ab8-1fdf2c1cfeb6`::ref 0 aborting False
>Thread-1049::DEBUG::2014-04-10 19:18:00,524::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1049::DEBUG::2014-04-10 19:18:00,524::task::579::TaskManager.Task::(_updateState) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::moving from state init -> state preparing
>Thread-1049::INFO::2014-04-10 19:18:00,524::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1049::DEBUG::2014-04-10 19:18:00,525::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c39b791-b06b-4d19-99a5-d4ffc1c2e260`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1049::DEBUG::2014-04-10 19:18:00,525::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1049::DEBUG::2014-04-10 19:18:00,525::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1049::DEBUG::2014-04-10 19:18:00,525::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7c39b791-b06b-4d19-99a5-d4ffc1c2e260`::Granted request
>Thread-1049::DEBUG::2014-04-10 19:18:00,526::task::811::TaskManager.Task::(resourceAcquired) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1049::DEBUG::2014-04-10 19:18:00,526::task::974::TaskManager.Task::(_decref) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::ref 1 aborting False
>Thread-1049::INFO::2014-04-10 19:18:00,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1049::DEBUG::2014-04-10 19:18:00,528::task::1168::TaskManager.Task::(prepare) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1049::DEBUG::2014-04-10 19:18:00,529::task::579::TaskManager.Task::(_updateState) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::moving from state preparing -> state finished
>Thread-1049::DEBUG::2014-04-10 19:18:00,529::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1049::DEBUG::2014-04-10 19:18:00,529::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1049::DEBUG::2014-04-10 19:18:00,529::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1049::DEBUG::2014-04-10 19:18:00,529::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1049::DEBUG::2014-04-10 19:18:00,530::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1049::DEBUG::2014-04-10 19:18:00,530::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1049::DEBUG::2014-04-10 19:18:00,530::task::974::TaskManager.Task::(_decref) Task=`b1a00e5d-cdbe-424d-8225-affcd466def2`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:02,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:02,837::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000337972 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:02,848::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:02,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000330807 s, 2.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:03,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:03,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000532413 s, 1.2 MB/s\n'; <rc> = 0
>Thread-1051::DEBUG::2014-04-10 19:18:03,917::task::579::TaskManager.Task::(_updateState) Task=`6c575e49-e6f1-4be3-8f86-0ec31473f0af`::moving from state init -> state preparing
>Thread-1051::INFO::2014-04-10 19:18:03,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1051::INFO::2014-04-10 19:18:03,917::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532413', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337972', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330807', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586971', 'lastCheck': '4.0', 'valid': True}}
>Thread-1051::DEBUG::2014-04-10 19:18:03,918::task::1168::TaskManager.Task::(prepare) Task=`6c575e49-e6f1-4be3-8f86-0ec31473f0af`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532413', 'lastCheck': '0.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000337972', 'lastCheck': '1.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000330807', 'lastCheck': '1.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586971', 'lastCheck': '4.0', 'valid': True}}
>Thread-1051::DEBUG::2014-04-10 19:18:03,918::task::579::TaskManager.Task::(_updateState) Task=`6c575e49-e6f1-4be3-8f86-0ec31473f0af`::moving from state preparing -> state finished
>Thread-1051::DEBUG::2014-04-10 19:18:03,918::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1051::DEBUG::2014-04-10 19:18:03,918::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1051::DEBUG::2014-04-10 19:18:03,918::task::974::TaskManager.Task::(_decref) Task=`6c575e49-e6f1-4be3-8f86-0ec31473f0af`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:18:09,890::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:09,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000550916 s, 668 kB/s\n'; <rc> = 0
>Thread-1055::DEBUG::2014-04-10 19:18:10,618::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1055::DEBUG::2014-04-10 19:18:10,619::task::579::TaskManager.Task::(_updateState) Task=`286cf6a3-3d69-4260-8e1b-bbc9d98cfb28`::moving from state init -> state preparing
>Thread-1055::INFO::2014-04-10 19:18:10,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1055::INFO::2014-04-10 19:18:10,619::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1055::DEBUG::2014-04-10 19:18:10,619::task::1168::TaskManager.Task::(prepare) Task=`286cf6a3-3d69-4260-8e1b-bbc9d98cfb28`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1055::DEBUG::2014-04-10 19:18:10,620::task::579::TaskManager.Task::(_updateState) Task=`286cf6a3-3d69-4260-8e1b-bbc9d98cfb28`::moving from state preparing -> state finished
>Thread-1055::DEBUG::2014-04-10 19:18:10,620::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1055::DEBUG::2014-04-10 19:18:10,620::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1055::DEBUG::2014-04-10 19:18:10,620::task::974::TaskManager.Task::(_decref) Task=`286cf6a3-3d69-4260-8e1b-bbc9d98cfb28`::ref 0 aborting False
>Thread-1056::DEBUG::2014-04-10 19:18:10,628::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1056::DEBUG::2014-04-10 19:18:10,628::task::579::TaskManager.Task::(_updateState) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::moving from state init -> state preparing
>Thread-1056::INFO::2014-04-10 19:18:10,628::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1056::DEBUG::2014-04-10 19:18:10,629::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`032b7183-c4b1-4886-ad27-7c62e7763a3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1056::DEBUG::2014-04-10 19:18:10,629::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1056::DEBUG::2014-04-10 19:18:10,629::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1056::DEBUG::2014-04-10 19:18:10,629::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`032b7183-c4b1-4886-ad27-7c62e7763a3e`::Granted request
>Thread-1056::DEBUG::2014-04-10 19:18:10,631::task::811::TaskManager.Task::(resourceAcquired) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1056::DEBUG::2014-04-10 19:18:10,631::task::974::TaskManager.Task::(_decref) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::ref 1 aborting False
>Thread-1056::INFO::2014-04-10 19:18:10,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1056::DEBUG::2014-04-10 19:18:10,633::task::1168::TaskManager.Task::(prepare) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080826880', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1056::DEBUG::2014-04-10 19:18:10,633::task::579::TaskManager.Task::(_updateState) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::moving from state preparing -> state finished
>Thread-1056::DEBUG::2014-04-10 19:18:10,633::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1056::DEBUG::2014-04-10 19:18:10,634::task::974::TaskManager.Task::(_decref) Task=`ee9900b3-c7f1-4f12-a080-e61957ccf738`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:12,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:12,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000354623 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:12,888::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:12,893::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000311454 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:13,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:13,158::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000629841 s, 1.0 MB/s\n'; <rc> = 0
>Thread-1059::DEBUG::2014-04-10 19:18:19,166::task::579::TaskManager.Task::(_updateState) Task=`11987d42-9a89-4f3b-9cb2-a305f7e08d2c`::moving from state init -> state preparing
>Thread-1059::INFO::2014-04-10 19:18:19,166::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1059::INFO::2014-04-10 19:18:19,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629841', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354623', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311454', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550916', 'lastCheck': '9.3', 'valid': True}}
>Thread-1059::DEBUG::2014-04-10 19:18:19,167::task::1168::TaskManager.Task::(prepare) Task=`11987d42-9a89-4f3b-9cb2-a305f7e08d2c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629841', 'lastCheck': '6.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000354623', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311454', 'lastCheck': '6.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550916', 'lastCheck': '9.3', 'valid': True}}
>Thread-1059::DEBUG::2014-04-10 19:18:19,167::task::579::TaskManager.Task::(_updateState) Task=`11987d42-9a89-4f3b-9cb2-a305f7e08d2c`::moving from state preparing -> state finished
>Thread-1059::DEBUG::2014-04-10 19:18:19,167::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1059::DEBUG::2014-04-10 19:18:19,167::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1059::DEBUG::2014-04-10 19:18:19,168::task::974::TaskManager.Task::(_decref) Task=`11987d42-9a89-4f3b-9cb2-a305f7e08d2c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:18:19,904::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:19,911::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000391021 s, 941 kB/s\n'; <rc> = 0
>Thread-1061::DEBUG::2014-04-10 19:18:20,726::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1061::DEBUG::2014-04-10 19:18:20,754::task::579::TaskManager.Task::(_updateState) Task=`8f737b01-77ac-43a9-b6d9-16732aa14126`::moving from state init -> state preparing
>Thread-1061::INFO::2014-04-10 19:18:20,754::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1061::INFO::2014-04-10 19:18:20,755::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1061::DEBUG::2014-04-10 19:18:20,755::task::1168::TaskManager.Task::(prepare) Task=`8f737b01-77ac-43a9-b6d9-16732aa14126`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1061::DEBUG::2014-04-10 19:18:20,755::task::579::TaskManager.Task::(_updateState) Task=`8f737b01-77ac-43a9-b6d9-16732aa14126`::moving from state preparing -> state finished
>Thread-1061::DEBUG::2014-04-10 19:18:20,755::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1061::DEBUG::2014-04-10 19:18:20,755::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1061::DEBUG::2014-04-10 19:18:20,755::task::974::TaskManager.Task::(_decref) Task=`8f737b01-77ac-43a9-b6d9-16732aa14126`::ref 0 aborting False
>Thread-1062::DEBUG::2014-04-10 19:18:20,763::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1062::DEBUG::2014-04-10 19:18:20,764::task::579::TaskManager.Task::(_updateState) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::moving from state init -> state preparing
>Thread-1062::INFO::2014-04-10 19:18:20,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1062::DEBUG::2014-04-10 19:18:20,765::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb879268-51d8-4213-8891-d515b6c8c29a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1062::DEBUG::2014-04-10 19:18:20,765::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1062::DEBUG::2014-04-10 19:18:20,765::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1062::DEBUG::2014-04-10 19:18:20,765::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`eb879268-51d8-4213-8891-d515b6c8c29a`::Granted request
>Thread-1062::DEBUG::2014-04-10 19:18:20,766::task::811::TaskManager.Task::(resourceAcquired) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1062::DEBUG::2014-04-10 19:18:20,766::task::974::TaskManager.Task::(_decref) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::ref 1 aborting False
>Thread-1062::INFO::2014-04-10 19:18:20,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139079516160', 'isoprefix': '', 'alerts': [], 'disktotal': '910947778560', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139079516160', 'isoprefix': '', 'alerts': [], 'disktotal': '910947778560', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1062::DEBUG::2014-04-10 19:18:20,768::task::1168::TaskManager.Task::(prepare) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139079516160', 'isoprefix': '', 'alerts': [], 'disktotal': '910947778560', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139079516160', 'isoprefix': '', 'alerts': [], 'disktotal': '910947778560', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1062::DEBUG::2014-04-10 19:18:20,768::task::579::TaskManager.Task::(_updateState) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::moving from state preparing -> state finished
>Thread-1062::DEBUG::2014-04-10 19:18:20,769::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1062::DEBUG::2014-04-10 19:18:20,769::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1062::DEBUG::2014-04-10 19:18:20,769::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1062::DEBUG::2014-04-10 19:18:20,769::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1062::DEBUG::2014-04-10 19:18:20,769::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1062::DEBUG::2014-04-10 19:18:20,770::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1062::DEBUG::2014-04-10 19:18:20,770::task::974::TaskManager.Task::(_decref) Task=`13c41e6c-5aba-4cfc-bbed-e36c0f635c0d`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:22,891::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:22,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034827 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:22,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:22,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029865 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:23,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:23,175::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000530697 s, 1.2 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:18:29,918::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:29,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444656 s, 828 kB/s\n'; <rc> = 0
>Thread-1066::DEBUG::2014-04-10 19:18:30,857::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1066::DEBUG::2014-04-10 19:18:30,858::task::579::TaskManager.Task::(_updateState) Task=`9bae75a7-1df5-48c0-a2ab-18ee2ed4f26f`::moving from state init -> state preparing
>Thread-1066::INFO::2014-04-10 19:18:30,858::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1066::INFO::2014-04-10 19:18:30,859::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1066::DEBUG::2014-04-10 19:18:30,859::task::1168::TaskManager.Task::(prepare) Task=`9bae75a7-1df5-48c0-a2ab-18ee2ed4f26f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1066::DEBUG::2014-04-10 19:18:30,859::task::579::TaskManager.Task::(_updateState) Task=`9bae75a7-1df5-48c0-a2ab-18ee2ed4f26f`::moving from state preparing -> state finished
>Thread-1066::DEBUG::2014-04-10 19:18:30,859::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1066::DEBUG::2014-04-10 19:18:30,859::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1066::DEBUG::2014-04-10 19:18:30,860::task::974::TaskManager.Task::(_decref) Task=`9bae75a7-1df5-48c0-a2ab-18ee2ed4f26f`::ref 0 aborting False
>Thread-1067::DEBUG::2014-04-10 19:18:30,868::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1067::DEBUG::2014-04-10 19:18:30,868::task::579::TaskManager.Task::(_updateState) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::moving from state init -> state preparing
>Thread-1067::INFO::2014-04-10 19:18:30,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1067::DEBUG::2014-04-10 19:18:30,869::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ddc3f7c-3325-4b68-9f1e-28ceb04144ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1067::DEBUG::2014-04-10 19:18:30,869::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1067::DEBUG::2014-04-10 19:18:30,870::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1067::DEBUG::2014-04-10 19:18:30,870::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6ddc3f7c-3325-4b68-9f1e-28ceb04144ed`::Granted request
>Thread-1067::DEBUG::2014-04-10 19:18:30,870::task::811::TaskManager.Task::(resourceAcquired) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1067::DEBUG::2014-04-10 19:18:30,870::task::974::TaskManager.Task::(_decref) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::ref 1 aborting False
>Thread-1067::INFO::2014-04-10 19:18:30,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1067::DEBUG::2014-04-10 19:18:30,873::task::1168::TaskManager.Task::(prepare) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1067::DEBUG::2014-04-10 19:18:30,873::task::579::TaskManager.Task::(_updateState) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::moving from state preparing -> state finished
>Thread-1067::DEBUG::2014-04-10 19:18:30,873::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1067::DEBUG::2014-04-10 19:18:30,873::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1067::DEBUG::2014-04-10 19:18:30,874::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1067::DEBUG::2014-04-10 19:18:30,874::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1067::DEBUG::2014-04-10 19:18:30,874::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1067::DEBUG::2014-04-10 19:18:30,874::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1067::DEBUG::2014-04-10 19:18:30,874::task::974::TaskManager.Task::(_decref) Task=`c533ebca-3380-4480-9a41-7f9a6115656d`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:32,927::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:32,945::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284505 s, 2.4 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:32,958::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:32,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000278205 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:33,178::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:18:33,193::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:18:33,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 19:18:33,200::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 19:18:33,201::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 19:18:33,202::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 19:18:33,202::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 19:18:33,207::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:33,213::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000486659 s, 1.4 MB/s\n'; <rc> = 0
>Thread-1073::DEBUG::2014-04-10 19:18:34,352::task::579::TaskManager.Task::(_updateState) Task=`d9bc84eb-9266-4ed2-8313-16b4c1b48a42`::moving from state init -> state preparing
>Thread-1073::INFO::2014-04-10 19:18:34,352::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1073::INFO::2014-04-10 19:18:34,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486659', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284505', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278205', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444656', 'lastCheck': '4.4', 'valid': True}}
>Thread-1073::DEBUG::2014-04-10 19:18:34,353::task::1168::TaskManager.Task::(prepare) Task=`d9bc84eb-9266-4ed2-8313-16b4c1b48a42`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486659', 'lastCheck': '1.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284505', 'lastCheck': '1.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000278205', 'lastCheck': '1.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444656', 'lastCheck': '4.4', 'valid': True}}
>Thread-1073::DEBUG::2014-04-10 19:18:34,353::task::579::TaskManager.Task::(_updateState) Task=`d9bc84eb-9266-4ed2-8313-16b4c1b48a42`::moving from state preparing -> state finished
>Thread-1073::DEBUG::2014-04-10 19:18:34,353::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1073::DEBUG::2014-04-10 19:18:34,353::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1073::DEBUG::2014-04-10 19:18:34,353::task::974::TaskManager.Task::(_decref) Task=`d9bc84eb-9266-4ed2-8313-16b4c1b48a42`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:18:39,927::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:18:39,934::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:18:39,940::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 19:18:39,946::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 19:18:39,947::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 19:18:39,948::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 19:18:39,948::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 19:18:39,952::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:39,961::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000444849 s, 827 kB/s\n'; <rc> = 0
>Thread-1081::DEBUG::2014-04-10 19:18:40,955::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1081::DEBUG::2014-04-10 19:18:40,956::task::579::TaskManager.Task::(_updateState) Task=`c73cec9f-486a-455f-a117-0c72dd98e840`::moving from state init -> state preparing
>Thread-1081::INFO::2014-04-10 19:18:40,956::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1081::INFO::2014-04-10 19:18:40,957::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1081::DEBUG::2014-04-10 19:18:40,957::task::1168::TaskManager.Task::(prepare) Task=`c73cec9f-486a-455f-a117-0c72dd98e840`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1081::DEBUG::2014-04-10 19:18:40,957::task::579::TaskManager.Task::(_updateState) Task=`c73cec9f-486a-455f-a117-0c72dd98e840`::moving from state preparing -> state finished
>Thread-1081::DEBUG::2014-04-10 19:18:40,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1081::DEBUG::2014-04-10 19:18:40,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1081::DEBUG::2014-04-10 19:18:40,957::task::974::TaskManager.Task::(_decref) Task=`c73cec9f-486a-455f-a117-0c72dd98e840`::ref 0 aborting False
>Thread-1082::DEBUG::2014-04-10 19:18:40,965::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1082::DEBUG::2014-04-10 19:18:40,966::task::579::TaskManager.Task::(_updateState) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::moving from state init -> state preparing
>Thread-1082::INFO::2014-04-10 19:18:40,966::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1082::DEBUG::2014-04-10 19:18:40,966::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a9ac890-80ba-4a2b-9a80-e8894f319dec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1082::DEBUG::2014-04-10 19:18:40,966::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1082::DEBUG::2014-04-10 19:18:40,967::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1082::DEBUG::2014-04-10 19:18:40,967::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`5a9ac890-80ba-4a2b-9a80-e8894f319dec`::Granted request
>Thread-1082::DEBUG::2014-04-10 19:18:40,967::task::811::TaskManager.Task::(resourceAcquired) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1082::DEBUG::2014-04-10 19:18:40,967::task::974::TaskManager.Task::(_decref) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::ref 1 aborting False
>Thread-1082::INFO::2014-04-10 19:18:40,969::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1082::DEBUG::2014-04-10 19:18:40,969::task::1168::TaskManager.Task::(prepare) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080761344', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::task::579::TaskManager.Task::(_updateState) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::moving from state preparing -> state finished
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1082::DEBUG::2014-04-10 19:18:40,970::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1082::DEBUG::2014-04-10 19:18:40,971::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1082::DEBUG::2014-04-10 19:18:40,971::task::974::TaskManager.Task::(_decref) Task=`751c9d54-21fb-44c5-8c8b-0d03d4beb7d2`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:42,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:42,980::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00038065 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:42,993::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:42,999::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000247979 s, 2.7 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:43,222::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:43,228::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000434737 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1085::DEBUG::2014-04-10 19:18:49,898::task::579::TaskManager.Task::(_updateState) Task=`a45e33e7-c461-41e0-bbc2-0b9cccf1a704`::moving from state init -> state preparing
>Thread-1085::INFO::2014-04-10 19:18:49,898::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1085::INFO::2014-04-10 19:18:49,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434737', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038065', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247979', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444849', 'lastCheck': '9.9', 'valid': True}}
>Thread-1085::DEBUG::2014-04-10 19:18:49,899::task::1168::TaskManager.Task::(prepare) Task=`a45e33e7-c461-41e0-bbc2-0b9cccf1a704`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434737', 'lastCheck': '6.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038065', 'lastCheck': '6.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000247979', 'lastCheck': '6.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444849', 'lastCheck': '9.9', 'valid': True}}
>Thread-1085::DEBUG::2014-04-10 19:18:49,899::task::579::TaskManager.Task::(_updateState) Task=`a45e33e7-c461-41e0-bbc2-0b9cccf1a704`::moving from state preparing -> state finished
>Thread-1085::DEBUG::2014-04-10 19:18:49,899::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1085::DEBUG::2014-04-10 19:18:49,899::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1085::DEBUG::2014-04-10 19:18:49,900::task::974::TaskManager.Task::(_decref) Task=`a45e33e7-c461-41e0-bbc2-0b9cccf1a704`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:18:49,968::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:49,975::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000390823 s, 942 kB/s\n'; <rc> = 0
>Thread-1087::DEBUG::2014-04-10 19:18:51,058::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1087::DEBUG::2014-04-10 19:18:51,061::task::579::TaskManager.Task::(_updateState) Task=`5f92aaa3-79b7-4301-9157-e9b05842b5dd`::moving from state init -> state preparing
>Thread-1087::INFO::2014-04-10 19:18:51,063::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1087::INFO::2014-04-10 19:18:51,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1087::DEBUG::2014-04-10 19:18:51,067::task::1168::TaskManager.Task::(prepare) Task=`5f92aaa3-79b7-4301-9157-e9b05842b5dd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1087::DEBUG::2014-04-10 19:18:51,068::task::579::TaskManager.Task::(_updateState) Task=`5f92aaa3-79b7-4301-9157-e9b05842b5dd`::moving from state preparing -> state finished
>Thread-1087::DEBUG::2014-04-10 19:18:51,069::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1087::DEBUG::2014-04-10 19:18:51,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1087::DEBUG::2014-04-10 19:18:51,073::task::974::TaskManager.Task::(_decref) Task=`5f92aaa3-79b7-4301-9157-e9b05842b5dd`::ref 0 aborting False
>Thread-1088::DEBUG::2014-04-10 19:18:51,085::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1088::DEBUG::2014-04-10 19:18:51,086::task::579::TaskManager.Task::(_updateState) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::moving from state init -> state preparing
>Thread-1088::INFO::2014-04-10 19:18:51,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1088::DEBUG::2014-04-10 19:18:51,086::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7beaffcc-a4a5-48fe-a634-0bffd74ac332`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1088::DEBUG::2014-04-10 19:18:51,087::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1088::DEBUG::2014-04-10 19:18:51,087::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1088::DEBUG::2014-04-10 19:18:51,087::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7beaffcc-a4a5-48fe-a634-0bffd74ac332`::Granted request
>Thread-1088::DEBUG::2014-04-10 19:18:51,087::task::811::TaskManager.Task::(resourceAcquired) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1088::DEBUG::2014-04-10 19:18:51,088::task::974::TaskManager.Task::(_decref) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::ref 1 aborting False
>Thread-1088::INFO::2014-04-10 19:18:51,090::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1088::DEBUG::2014-04-10 19:18:51,090::task::1168::TaskManager.Task::(prepare) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1088::DEBUG::2014-04-10 19:18:51,090::task::579::TaskManager.Task::(_updateState) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::moving from state preparing -> state finished
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1088::DEBUG::2014-04-10 19:18:51,091::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1088::DEBUG::2014-04-10 19:18:51,092::task::974::TaskManager.Task::(_decref) Task=`c3b7a325-8924-4369-b0a7-c936f5eb6530`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:18:52,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:18:53,020::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000305804 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:18:53,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:18:53,038::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000281774 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:18:53,237::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:18:53,242::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000399769 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:18:59,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:18:59,989::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000402865 s, 913 kB/s\n'; <rc> = 0
>Thread-1092::DEBUG::2014-04-10 19:19:01,172::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1092::DEBUG::2014-04-10 19:19:01,172::task::579::TaskManager.Task::(_updateState) Task=`8c3e5cfd-4c1c-4b84-bc4a-7afbbbac12bf`::moving from state init -> state preparing
>Thread-1092::INFO::2014-04-10 19:19:01,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1092::INFO::2014-04-10 19:19:01,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1092::DEBUG::2014-04-10 19:19:01,173::task::1168::TaskManager.Task::(prepare) Task=`8c3e5cfd-4c1c-4b84-bc4a-7afbbbac12bf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1092::DEBUG::2014-04-10 19:19:01,173::task::579::TaskManager.Task::(_updateState) Task=`8c3e5cfd-4c1c-4b84-bc4a-7afbbbac12bf`::moving from state preparing -> state finished
>Thread-1092::DEBUG::2014-04-10 19:19:01,173::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1092::DEBUG::2014-04-10 19:19:01,173::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1092::DEBUG::2014-04-10 19:19:01,173::task::974::TaskManager.Task::(_decref) Task=`8c3e5cfd-4c1c-4b84-bc4a-7afbbbac12bf`::ref 0 aborting False
>Thread-1093::DEBUG::2014-04-10 19:19:01,181::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1093::DEBUG::2014-04-10 19:19:01,182::task::579::TaskManager.Task::(_updateState) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::moving from state init -> state preparing
>Thread-1093::INFO::2014-04-10 19:19:01,182::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1093::DEBUG::2014-04-10 19:19:01,182::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9f459b4-b3d2-479c-a8e2-ae8110f75b3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1093::DEBUG::2014-04-10 19:19:01,182::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1093::DEBUG::2014-04-10 19:19:01,183::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1093::DEBUG::2014-04-10 19:19:01,183::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b9f459b4-b3d2-479c-a8e2-ae8110f75b3a`::Granted request
>Thread-1093::DEBUG::2014-04-10 19:19:01,183::task::811::TaskManager.Task::(resourceAcquired) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1093::DEBUG::2014-04-10 19:19:01,183::task::974::TaskManager.Task::(_decref) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::ref 1 aborting False
>Thread-1093::INFO::2014-04-10 19:19:01,185::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1093::DEBUG::2014-04-10 19:19:01,185::task::1168::TaskManager.Task::(prepare) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::task::579::TaskManager.Task::(_updateState) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::moving from state preparing -> state finished
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1093::DEBUG::2014-04-10 19:19:01,186::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1093::DEBUG::2014-04-10 19:19:01,187::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1093::DEBUG::2014-04-10 19:19:01,187::task::974::TaskManager.Task::(_decref) Task=`160a44b5-7a8b-4924-93de-527293dbc452`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:03,036::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:03,053::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000324051 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:03,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:03,070::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267381 s, 2.5 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:03,250::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:03,256::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000408001 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1095::DEBUG::2014-04-10 19:19:05,095::task::579::TaskManager.Task::(_updateState) Task=`a55af2f6-dfb0-46b1-8a54-83180483156b`::moving from state init -> state preparing
>Thread-1095::INFO::2014-04-10 19:19:05,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1095::INFO::2014-04-10 19:19:05,096::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408001', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324051', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267381', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402865', 'lastCheck': '5.1', 'valid': True}}
>Thread-1095::DEBUG::2014-04-10 19:19:05,096::task::1168::TaskManager.Task::(prepare) Task=`a55af2f6-dfb0-46b1-8a54-83180483156b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000408001', 'lastCheck': '1.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324051', 'lastCheck': '2.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267381', 'lastCheck': '2.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000402865', 'lastCheck': '5.1', 'valid': True}}
>Thread-1095::DEBUG::2014-04-10 19:19:05,096::task::579::TaskManager.Task::(_updateState) Task=`a55af2f6-dfb0-46b1-8a54-83180483156b`::moving from state preparing -> state finished
>Thread-1095::DEBUG::2014-04-10 19:19:05,096::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1095::DEBUG::2014-04-10 19:19:05,096::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1095::DEBUG::2014-04-10 19:19:05,097::task::974::TaskManager.Task::(_decref) Task=`a55af2f6-dfb0-46b1-8a54-83180483156b`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:19:09,996::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:19:10,003::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000421518 s, 873 kB/s\n'; <rc> = 0
>Thread-1099::DEBUG::2014-04-10 19:19:12,018::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1099::DEBUG::2014-04-10 19:19:12,019::task::579::TaskManager.Task::(_updateState) Task=`13f278a6-823f-4b96-b41e-342522393055`::moving from state init -> state preparing
>Thread-1099::INFO::2014-04-10 19:19:12,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1099::INFO::2014-04-10 19:19:12,020::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1099::DEBUG::2014-04-10 19:19:12,020::task::1168::TaskManager.Task::(prepare) Task=`13f278a6-823f-4b96-b41e-342522393055`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1099::DEBUG::2014-04-10 19:19:12,020::task::579::TaskManager.Task::(_updateState) Task=`13f278a6-823f-4b96-b41e-342522393055`::moving from state preparing -> state finished
>Thread-1099::DEBUG::2014-04-10 19:19:12,020::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1099::DEBUG::2014-04-10 19:19:12,020::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1099::DEBUG::2014-04-10 19:19:12,021::task::974::TaskManager.Task::(_decref) Task=`13f278a6-823f-4b96-b41e-342522393055`::ref 0 aborting False
>Thread-1100::DEBUG::2014-04-10 19:19:12,030::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1100::DEBUG::2014-04-10 19:19:12,030::task::579::TaskManager.Task::(_updateState) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::moving from state init -> state preparing
>Thread-1100::INFO::2014-04-10 19:19:12,030::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1100::DEBUG::2014-04-10 19:19:12,031::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ed1fec6-d8f7-4c1a-ad3b-9a2d86e53d88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1100::DEBUG::2014-04-10 19:19:12,031::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1100::DEBUG::2014-04-10 19:19:12,031::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1100::DEBUG::2014-04-10 19:19:12,032::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0ed1fec6-d8f7-4c1a-ad3b-9a2d86e53d88`::Granted request
>Thread-1100::DEBUG::2014-04-10 19:19:12,032::task::811::TaskManager.Task::(resourceAcquired) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1100::DEBUG::2014-04-10 19:19:12,032::task::974::TaskManager.Task::(_decref) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::ref 1 aborting False
>Thread-1100::INFO::2014-04-10 19:19:12,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1100::DEBUG::2014-04-10 19:19:12,035::task::1168::TaskManager.Task::(prepare) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1100::DEBUG::2014-04-10 19:19:12,035::task::579::TaskManager.Task::(_updateState) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::moving from state preparing -> state finished
>Thread-1100::DEBUG::2014-04-10 19:19:12,035::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1100::DEBUG::2014-04-10 19:19:12,035::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1100::DEBUG::2014-04-10 19:19:12,036::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1100::DEBUG::2014-04-10 19:19:12,036::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1100::DEBUG::2014-04-10 19:19:12,036::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1100::DEBUG::2014-04-10 19:19:12,036::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1100::DEBUG::2014-04-10 19:19:12,036::task::974::TaskManager.Task::(_decref) Task=`4263d922-9b9f-44a6-8719-01eed43826c2`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:13,069::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:13,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000308814 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:13,098::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:13,103::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299731 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:13,263::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:13,269::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000401361 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:19:20,010::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:19:20,017::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000363309 s, 1.0 MB/s\n'; <rc> = 0
>Thread-1103::DEBUG::2014-04-10 19:19:20,262::task::579::TaskManager.Task::(_updateState) Task=`bd22eb51-1526-4d89-b844-5753232b7747`::moving from state init -> state preparing
>Thread-1103::INFO::2014-04-10 19:19:20,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1103::INFO::2014-04-10 19:19:20,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401361', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308814', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299731', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363309', 'lastCheck': '0.2', 'valid': True}}
>Thread-1103::DEBUG::2014-04-10 19:19:20,263::task::1168::TaskManager.Task::(prepare) Task=`bd22eb51-1526-4d89-b844-5753232b7747`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401361', 'lastCheck': '7.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308814', 'lastCheck': '7.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000299731', 'lastCheck': '7.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000363309', 'lastCheck': '0.2', 'valid': True}}
>Thread-1103::DEBUG::2014-04-10 19:19:20,263::task::579::TaskManager.Task::(_updateState) Task=`bd22eb51-1526-4d89-b844-5753232b7747`::moving from state preparing -> state finished
>Thread-1103::DEBUG::2014-04-10 19:19:20,263::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1103::DEBUG::2014-04-10 19:19:20,263::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1103::DEBUG::2014-04-10 19:19:20,263::task::974::TaskManager.Task::(_decref) Task=`bd22eb51-1526-4d89-b844-5753232b7747`::ref 0 aborting False
>Thread-1105::DEBUG::2014-04-10 19:19:22,143::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1105::DEBUG::2014-04-10 19:19:22,151::task::579::TaskManager.Task::(_updateState) Task=`546d2646-f44b-4bde-9d06-e26ac607a981`::moving from state init -> state preparing
>Thread-1105::INFO::2014-04-10 19:19:22,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1105::INFO::2014-04-10 19:19:22,152::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1105::DEBUG::2014-04-10 19:19:22,152::task::1168::TaskManager.Task::(prepare) Task=`546d2646-f44b-4bde-9d06-e26ac607a981`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1105::DEBUG::2014-04-10 19:19:22,152::task::579::TaskManager.Task::(_updateState) Task=`546d2646-f44b-4bde-9d06-e26ac607a981`::moving from state preparing -> state finished
>Thread-1105::DEBUG::2014-04-10 19:19:22,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1105::DEBUG::2014-04-10 19:19:22,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1105::DEBUG::2014-04-10 19:19:22,153::task::974::TaskManager.Task::(_decref) Task=`546d2646-f44b-4bde-9d06-e26ac607a981`::ref 0 aborting False
>Thread-1106::DEBUG::2014-04-10 19:19:22,161::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1106::DEBUG::2014-04-10 19:19:22,161::task::579::TaskManager.Task::(_updateState) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::moving from state init -> state preparing
>Thread-1106::INFO::2014-04-10 19:19:22,161::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1106::DEBUG::2014-04-10 19:19:22,162::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5e465f7-8133-48e2-bfd2-952c629e0fff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1106::DEBUG::2014-04-10 19:19:22,162::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1106::DEBUG::2014-04-10 19:19:22,162::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1106::DEBUG::2014-04-10 19:19:22,163::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b5e465f7-8133-48e2-bfd2-952c629e0fff`::Granted request
>Thread-1106::DEBUG::2014-04-10 19:19:22,163::task::811::TaskManager.Task::(resourceAcquired) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1106::DEBUG::2014-04-10 19:19:22,163::task::974::TaskManager.Task::(_decref) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::ref 1 aborting False
>Thread-1106::INFO::2014-04-10 19:19:22,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1106::DEBUG::2014-04-10 19:19:22,165::task::1168::TaskManager.Task::(prepare) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::task::579::TaskManager.Task::(_updateState) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::moving from state preparing -> state finished
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1106::DEBUG::2014-04-10 19:19:22,166::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1106::DEBUG::2014-04-10 19:19:22,167::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1106::DEBUG::2014-04-10 19:19:22,167::task::974::TaskManager.Task::(_decref) Task=`bc634d52-4ae0-46d0-8f14-13b804dfdbe3`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:23,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:23,119::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000344146 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:23,131::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:23,136::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299958 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:23,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:23,283::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000399414 s, 1.6 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:19:30,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:19:30,033::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00036733 s, 1.0 MB/s\n'; <rc> = 0
>Thread-1110::DEBUG::2014-04-10 19:19:32,241::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1110::DEBUG::2014-04-10 19:19:32,242::task::579::TaskManager.Task::(_updateState) Task=`897142f3-dc25-4849-a295-82d5edcffe07`::moving from state init -> state preparing
>Thread-1110::INFO::2014-04-10 19:19:32,242::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1110::INFO::2014-04-10 19:19:32,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1110::DEBUG::2014-04-10 19:19:32,242::task::1168::TaskManager.Task::(prepare) Task=`897142f3-dc25-4849-a295-82d5edcffe07`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1110::DEBUG::2014-04-10 19:19:32,243::task::579::TaskManager.Task::(_updateState) Task=`897142f3-dc25-4849-a295-82d5edcffe07`::moving from state preparing -> state finished
>Thread-1110::DEBUG::2014-04-10 19:19:32,243::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1110::DEBUG::2014-04-10 19:19:32,243::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1110::DEBUG::2014-04-10 19:19:32,243::task::974::TaskManager.Task::(_decref) Task=`897142f3-dc25-4849-a295-82d5edcffe07`::ref 0 aborting False
>Thread-1111::DEBUG::2014-04-10 19:19:32,251::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1111::DEBUG::2014-04-10 19:19:32,251::task::579::TaskManager.Task::(_updateState) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::moving from state init -> state preparing
>Thread-1111::INFO::2014-04-10 19:19:32,252::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1111::DEBUG::2014-04-10 19:19:32,252::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a417c34c-3ae7-455d-be2e-48b6dfdf6055`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1111::DEBUG::2014-04-10 19:19:32,252::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1111::DEBUG::2014-04-10 19:19:32,253::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1111::DEBUG::2014-04-10 19:19:32,253::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a417c34c-3ae7-455d-be2e-48b6dfdf6055`::Granted request
>Thread-1111::DEBUG::2014-04-10 19:19:32,253::task::811::TaskManager.Task::(resourceAcquired) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1111::DEBUG::2014-04-10 19:19:32,253::task::974::TaskManager.Task::(_decref) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::ref 1 aborting False
>Thread-1111::INFO::2014-04-10 19:19:32,256::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1111::DEBUG::2014-04-10 19:19:32,256::task::1168::TaskManager.Task::(prepare) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1111::DEBUG::2014-04-10 19:19:32,256::task::579::TaskManager.Task::(_updateState) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::moving from state preparing -> state finished
>Thread-1111::DEBUG::2014-04-10 19:19:32,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1111::DEBUG::2014-04-10 19:19:32,257::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1111::DEBUG::2014-04-10 19:19:32,257::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1111::DEBUG::2014-04-10 19:19:32,257::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1111::DEBUG::2014-04-10 19:19:32,257::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1111::DEBUG::2014-04-10 19:19:32,257::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1111::DEBUG::2014-04-10 19:19:32,258::task::974::TaskManager.Task::(_decref) Task=`faaf3704-7f3b-420b-b90f-b333aa3f7962`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:33,135::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:33,151::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000313592 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:33,164::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:33,169::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000277677 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:33,292::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:33,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.0004167 s, 1.6 MB/s\n'; <rc> = 0
>Thread-1113::DEBUG::2014-04-10 19:19:35,541::task::579::TaskManager.Task::(_updateState) Task=`799680db-af1f-4585-b34d-98d9ef8646b2`::moving from state init -> state preparing
>Thread-1113::INFO::2014-04-10 19:19:35,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1113::INFO::2014-04-10 19:19:35,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004167', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313592', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277677', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036733', 'lastCheck': '5.5', 'valid': True}}
>Thread-1113::DEBUG::2014-04-10 19:19:35,542::task::1168::TaskManager.Task::(prepare) Task=`799680db-af1f-4585-b34d-98d9ef8646b2`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004167', 'lastCheck': '2.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000313592', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000277677', 'lastCheck': '2.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00036733', 'lastCheck': '5.5', 'valid': True}}
>Thread-1113::DEBUG::2014-04-10 19:19:35,542::task::579::TaskManager.Task::(_updateState) Task=`799680db-af1f-4585-b34d-98d9ef8646b2`::moving from state preparing -> state finished
>Thread-1113::DEBUG::2014-04-10 19:19:35,543::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1113::DEBUG::2014-04-10 19:19:35,543::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1113::DEBUG::2014-04-10 19:19:35,543::task::974::TaskManager.Task::(_decref) Task=`799680db-af1f-4585-b34d-98d9ef8646b2`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:19:40,042::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:19:40,049::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000327949 s, 1.1 MB/s\n'; <rc> = 0
>Thread-1117::DEBUG::2014-04-10 19:19:42,331::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1117::DEBUG::2014-04-10 19:19:42,332::task::579::TaskManager.Task::(_updateState) Task=`16c7e105-5ec6-4116-b190-349948ed72d1`::moving from state init -> state preparing
>Thread-1117::INFO::2014-04-10 19:19:42,332::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1117::INFO::2014-04-10 19:19:42,333::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1117::DEBUG::2014-04-10 19:19:42,333::task::1168::TaskManager.Task::(prepare) Task=`16c7e105-5ec6-4116-b190-349948ed72d1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1117::DEBUG::2014-04-10 19:19:42,333::task::579::TaskManager.Task::(_updateState) Task=`16c7e105-5ec6-4116-b190-349948ed72d1`::moving from state preparing -> state finished
>Thread-1117::DEBUG::2014-04-10 19:19:42,333::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1117::DEBUG::2014-04-10 19:19:42,333::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1117::DEBUG::2014-04-10 19:19:42,333::task::974::TaskManager.Task::(_decref) Task=`16c7e105-5ec6-4116-b190-349948ed72d1`::ref 0 aborting False
>Thread-1118::DEBUG::2014-04-10 19:19:42,342::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1118::DEBUG::2014-04-10 19:19:42,342::task::579::TaskManager.Task::(_updateState) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::moving from state init -> state preparing
>Thread-1118::INFO::2014-04-10 19:19:42,342::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1118::DEBUG::2014-04-10 19:19:42,343::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`75e3aa4a-7aaf-414b-b4fe-0c9eb2e46657`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1118::DEBUG::2014-04-10 19:19:42,343::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1118::DEBUG::2014-04-10 19:19:42,343::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1118::DEBUG::2014-04-10 19:19:42,343::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`75e3aa4a-7aaf-414b-b4fe-0c9eb2e46657`::Granted request
>Thread-1118::DEBUG::2014-04-10 19:19:42,344::task::811::TaskManager.Task::(resourceAcquired) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1118::DEBUG::2014-04-10 19:19:42,344::task::974::TaskManager.Task::(_decref) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::ref 1 aborting False
>Thread-1118::INFO::2014-04-10 19:19:42,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1118::DEBUG::2014-04-10 19:19:42,347::task::1168::TaskManager.Task::(prepare) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1118::DEBUG::2014-04-10 19:19:42,347::task::579::TaskManager.Task::(_updateState) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::moving from state preparing -> state finished
>Thread-1118::DEBUG::2014-04-10 19:19:42,347::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1118::DEBUG::2014-04-10 19:19:42,347::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1118::DEBUG::2014-04-10 19:19:42,348::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1118::DEBUG::2014-04-10 19:19:42,348::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1118::DEBUG::2014-04-10 19:19:42,348::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1118::DEBUG::2014-04-10 19:19:42,348::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1118::DEBUG::2014-04-10 19:19:42,348::task::974::TaskManager.Task::(_decref) Task=`403393c9-b5ea-441e-ac56-f9c12d1a0a63`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:43,168::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:43,188::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000444921 s, 1.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:43,204::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:43,210::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000355035 s, 1.9 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:43,308::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:43,314::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000375129 s, 1.8 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:19:50,056::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:19:50,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000403681 s, 912 kB/s\n'; <rc> = 0
>Thread-1121::DEBUG::2014-04-10 19:19:50,707::task::579::TaskManager.Task::(_updateState) Task=`14772ae4-df9d-445b-88d6-4d209b89fd3d`::moving from state init -> state preparing
>Thread-1121::INFO::2014-04-10 19:19:50,707::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1121::INFO::2014-04-10 19:19:50,707::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375129', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444921', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355035', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403681', 'lastCheck': '0.6', 'valid': True}}
>Thread-1121::DEBUG::2014-04-10 19:19:50,707::task::1168::TaskManager.Task::(prepare) Task=`14772ae4-df9d-445b-88d6-4d209b89fd3d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375129', 'lastCheck': '7.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444921', 'lastCheck': '7.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000355035', 'lastCheck': '7.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000403681', 'lastCheck': '0.6', 'valid': True}}
>Thread-1121::DEBUG::2014-04-10 19:19:50,708::task::579::TaskManager.Task::(_updateState) Task=`14772ae4-df9d-445b-88d6-4d209b89fd3d`::moving from state preparing -> state finished
>Thread-1121::DEBUG::2014-04-10 19:19:50,708::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1121::DEBUG::2014-04-10 19:19:50,708::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1121::DEBUG::2014-04-10 19:19:50,708::task::974::TaskManager.Task::(_decref) Task=`14772ae4-df9d-445b-88d6-4d209b89fd3d`::ref 0 aborting False
>Thread-1123::DEBUG::2014-04-10 19:19:52,438::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1123::DEBUG::2014-04-10 19:19:52,438::task::579::TaskManager.Task::(_updateState) Task=`0cdc38a6-3e80-4fb7-a05d-6766245615da`::moving from state init -> state preparing
>Thread-1123::INFO::2014-04-10 19:19:52,439::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1123::INFO::2014-04-10 19:19:52,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1123::DEBUG::2014-04-10 19:19:52,439::task::1168::TaskManager.Task::(prepare) Task=`0cdc38a6-3e80-4fb7-a05d-6766245615da`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1123::DEBUG::2014-04-10 19:19:52,439::task::579::TaskManager.Task::(_updateState) Task=`0cdc38a6-3e80-4fb7-a05d-6766245615da`::moving from state preparing -> state finished
>Thread-1123::DEBUG::2014-04-10 19:19:52,439::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1123::DEBUG::2014-04-10 19:19:52,440::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1123::DEBUG::2014-04-10 19:19:52,440::task::974::TaskManager.Task::(_decref) Task=`0cdc38a6-3e80-4fb7-a05d-6766245615da`::ref 0 aborting False
>Thread-1124::DEBUG::2014-04-10 19:19:52,448::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1124::DEBUG::2014-04-10 19:19:52,449::task::579::TaskManager.Task::(_updateState) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::moving from state init -> state preparing
>Thread-1124::INFO::2014-04-10 19:19:52,449::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1124::DEBUG::2014-04-10 19:19:52,449::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d832b008-cf35-47e7-a016-16145c64947b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1124::DEBUG::2014-04-10 19:19:52,449::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1124::DEBUG::2014-04-10 19:19:52,450::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1124::DEBUG::2014-04-10 19:19:52,450::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d832b008-cf35-47e7-a016-16145c64947b`::Granted request
>Thread-1124::DEBUG::2014-04-10 19:19:52,450::task::811::TaskManager.Task::(resourceAcquired) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1124::DEBUG::2014-04-10 19:19:52,450::task::974::TaskManager.Task::(_decref) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::ref 1 aborting False
>Thread-1124::INFO::2014-04-10 19:19:52,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1124::DEBUG::2014-04-10 19:19:52,453::task::1168::TaskManager.Task::(prepare) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1124::DEBUG::2014-04-10 19:19:52,453::task::579::TaskManager.Task::(_updateState) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::moving from state preparing -> state finished
>Thread-1124::DEBUG::2014-04-10 19:19:52,453::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1124::DEBUG::2014-04-10 19:19:52,453::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1124::DEBUG::2014-04-10 19:19:52,453::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1124::DEBUG::2014-04-10 19:19:52,454::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1124::DEBUG::2014-04-10 19:19:52,454::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1124::DEBUG::2014-04-10 19:19:52,454::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1124::DEBUG::2014-04-10 19:19:52,454::task::974::TaskManager.Task::(_decref) Task=`0096bff8-4cbf-444b-8aff-770994f42fe6`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:19:53,208::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:19:53,224::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302378 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:19:53,235::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:19:53,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000244762 s, 2.7 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:19:53,322::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:19:53,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000387077 s, 1.7 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:20:00,071::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:00,078::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000370994 s, 992 kB/s\n'; <rc> = 0
>Thread-1128::DEBUG::2014-04-10 19:20:02,568::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1128::DEBUG::2014-04-10 19:20:02,569::task::579::TaskManager.Task::(_updateState) Task=`72a12b34-539d-4088-8c66-a8dfb8de3a72`::moving from state init -> state preparing
>Thread-1128::INFO::2014-04-10 19:20:02,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1128::INFO::2014-04-10 19:20:02,569::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1128::DEBUG::2014-04-10 19:20:02,570::task::1168::TaskManager.Task::(prepare) Task=`72a12b34-539d-4088-8c66-a8dfb8de3a72`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1128::DEBUG::2014-04-10 19:20:02,570::task::579::TaskManager.Task::(_updateState) Task=`72a12b34-539d-4088-8c66-a8dfb8de3a72`::moving from state preparing -> state finished
>Thread-1128::DEBUG::2014-04-10 19:20:02,570::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1128::DEBUG::2014-04-10 19:20:02,570::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1128::DEBUG::2014-04-10 19:20:02,570::task::974::TaskManager.Task::(_decref) Task=`72a12b34-539d-4088-8c66-a8dfb8de3a72`::ref 0 aborting False
>Thread-1129::DEBUG::2014-04-10 19:20:02,579::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1129::DEBUG::2014-04-10 19:20:02,579::task::579::TaskManager.Task::(_updateState) Task=`66a31248-187a-412d-b722-d77f13c784f2`::moving from state init -> state preparing
>Thread-1129::INFO::2014-04-10 19:20:02,580::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1129::DEBUG::2014-04-10 19:20:02,580::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc6f03a3-09b8-4b10-808e-54af7a33f33c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1129::DEBUG::2014-04-10 19:20:02,580::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1129::DEBUG::2014-04-10 19:20:02,581::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1129::DEBUG::2014-04-10 19:20:02,581::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`fc6f03a3-09b8-4b10-808e-54af7a33f33c`::Granted request
>Thread-1129::DEBUG::2014-04-10 19:20:02,581::task::811::TaskManager.Task::(resourceAcquired) Task=`66a31248-187a-412d-b722-d77f13c784f2`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1129::DEBUG::2014-04-10 19:20:02,581::task::974::TaskManager.Task::(_decref) Task=`66a31248-187a-412d-b722-d77f13c784f2`::ref 1 aborting False
>Thread-1129::INFO::2014-04-10 19:20:02,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1129::DEBUG::2014-04-10 19:20:02,584::task::1168::TaskManager.Task::(prepare) Task=`66a31248-187a-412d-b722-d77f13c784f2`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1129::DEBUG::2014-04-10 19:20:02,584::task::579::TaskManager.Task::(_updateState) Task=`66a31248-187a-412d-b722-d77f13c784f2`::moving from state preparing -> state finished
>Thread-1129::DEBUG::2014-04-10 19:20:02,584::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1129::DEBUG::2014-04-10 19:20:02,585::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1129::DEBUG::2014-04-10 19:20:02,585::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1129::DEBUG::2014-04-10 19:20:02,585::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1129::DEBUG::2014-04-10 19:20:02,585::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1129::DEBUG::2014-04-10 19:20:02,585::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1129::DEBUG::2014-04-10 19:20:02,586::task::974::TaskManager.Task::(_decref) Task=`66a31248-187a-412d-b722-d77f13c784f2`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:03,239::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:20:03,259::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287608 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:03,272::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:03,277::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000261975 s, 2.6 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:20:03,336::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:03,341::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000429502 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1131::DEBUG::2014-04-10 19:20:05,901::task::579::TaskManager.Task::(_updateState) Task=`18f43898-f830-41b1-9872-8875bc7a07f7`::moving from state init -> state preparing
>Thread-1131::INFO::2014-04-10 19:20:05,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1131::INFO::2014-04-10 19:20:05,901::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429502', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287608', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261975', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370994', 'lastCheck': '5.8', 'valid': True}}
>Thread-1131::DEBUG::2014-04-10 19:20:05,902::task::1168::TaskManager.Task::(prepare) Task=`18f43898-f830-41b1-9872-8875bc7a07f7`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000429502', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000287608', 'lastCheck': '2.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000261975', 'lastCheck': '2.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000370994', 'lastCheck': '5.8', 'valid': True}}
>Thread-1131::DEBUG::2014-04-10 19:20:05,902::task::579::TaskManager.Task::(_updateState) Task=`18f43898-f830-41b1-9872-8875bc7a07f7`::moving from state preparing -> state finished
>Thread-1131::DEBUG::2014-04-10 19:20:05,902::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1131::DEBUG::2014-04-10 19:20:05,902::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1131::DEBUG::2014-04-10 19:20:05,902::task::974::TaskManager.Task::(_decref) Task=`18f43898-f830-41b1-9872-8875bc7a07f7`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:20:10,085::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:10,091::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000408204 s, 902 kB/s\n'; <rc> = 0
>Thread-1135::DEBUG::2014-04-10 19:20:12,710::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1135::DEBUG::2014-04-10 19:20:12,710::task::579::TaskManager.Task::(_updateState) Task=`35749b4c-6ba8-41da-8bb4-baff0eb7f028`::moving from state init -> state preparing
>Thread-1135::INFO::2014-04-10 19:20:12,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1135::INFO::2014-04-10 19:20:12,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1135::DEBUG::2014-04-10 19:20:12,711::task::1168::TaskManager.Task::(prepare) Task=`35749b4c-6ba8-41da-8bb4-baff0eb7f028`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1135::DEBUG::2014-04-10 19:20:12,712::task::579::TaskManager.Task::(_updateState) Task=`35749b4c-6ba8-41da-8bb4-baff0eb7f028`::moving from state preparing -> state finished
>Thread-1135::DEBUG::2014-04-10 19:20:12,712::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1135::DEBUG::2014-04-10 19:20:12,712::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1135::DEBUG::2014-04-10 19:20:12,712::task::974::TaskManager.Task::(_decref) Task=`35749b4c-6ba8-41da-8bb4-baff0eb7f028`::ref 0 aborting False
>Thread-1136::DEBUG::2014-04-10 19:20:12,720::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1136::DEBUG::2014-04-10 19:20:12,721::task::579::TaskManager.Task::(_updateState) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::moving from state init -> state preparing
>Thread-1136::INFO::2014-04-10 19:20:12,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1136::DEBUG::2014-04-10 19:20:12,721::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1a10127-cba3-47c3-aadd-2f6882e435c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1136::DEBUG::2014-04-10 19:20:12,723::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1136::DEBUG::2014-04-10 19:20:12,723::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1136::DEBUG::2014-04-10 19:20:12,723::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`c1a10127-cba3-47c3-aadd-2f6882e435c4`::Granted request
>Thread-1136::DEBUG::2014-04-10 19:20:12,723::task::811::TaskManager.Task::(resourceAcquired) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1136::DEBUG::2014-04-10 19:20:12,724::task::974::TaskManager.Task::(_decref) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::ref 1 aborting False
>Thread-1136::INFO::2014-04-10 19:20:12,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1136::DEBUG::2014-04-10 19:20:12,726::task::1168::TaskManager.Task::(prepare) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1136::DEBUG::2014-04-10 19:20:12,726::task::579::TaskManager.Task::(_updateState) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::moving from state preparing -> state finished
>Thread-1136::DEBUG::2014-04-10 19:20:12,727::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1136::DEBUG::2014-04-10 19:20:12,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1136::DEBUG::2014-04-10 19:20:12,727::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1136::DEBUG::2014-04-10 19:20:12,727::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1136::DEBUG::2014-04-10 19:20:12,727::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1136::DEBUG::2014-04-10 19:20:12,728::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1136::DEBUG::2014-04-10 19:20:12,728::task::974::TaskManager.Task::(_decref) Task=`f31d0367-5a35-4131-9e83-ae8ef3bdb90a`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:13,274::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:20:13,294::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000300366 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:13,306::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:13,311::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000307823 s, 2.2 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:20:13,350::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:13,355::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000428091 s, 1.5 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:20:20,100::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:20,106::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000413602 s, 890 kB/s\n'; <rc> = 0
>Thread-1139::DEBUG::2014-04-10 19:20:21,108::task::579::TaskManager.Task::(_updateState) Task=`00598e63-6863-4f08-a03b-137d350e220e`::moving from state init -> state preparing
>Thread-1139::INFO::2014-04-10 19:20:21,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1139::INFO::2014-04-10 19:20:21,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428091', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300366', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307823', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413602', 'lastCheck': '1.0', 'valid': True}}
>Thread-1139::DEBUG::2014-04-10 19:20:21,109::task::1168::TaskManager.Task::(prepare) Task=`00598e63-6863-4f08-a03b-137d350e220e`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000428091', 'lastCheck': '7.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000300366', 'lastCheck': '7.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307823', 'lastCheck': '7.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413602', 'lastCheck': '1.0', 'valid': True}}
>Thread-1139::DEBUG::2014-04-10 19:20:21,109::task::579::TaskManager.Task::(_updateState) Task=`00598e63-6863-4f08-a03b-137d350e220e`::moving from state preparing -> state finished
>Thread-1139::DEBUG::2014-04-10 19:20:21,110::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1139::DEBUG::2014-04-10 19:20:21,110::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1139::DEBUG::2014-04-10 19:20:21,110::task::974::TaskManager.Task::(_decref) Task=`00598e63-6863-4f08-a03b-137d350e220e`::ref 0 aborting False
>Thread-1141::DEBUG::2014-04-10 19:20:22,817::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1141::DEBUG::2014-04-10 19:20:22,817::task::579::TaskManager.Task::(_updateState) Task=`47ce3360-c5d7-408f-97cc-a41b969ed47e`::moving from state init -> state preparing
>Thread-1141::INFO::2014-04-10 19:20:22,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1141::INFO::2014-04-10 19:20:22,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1141::DEBUG::2014-04-10 19:20:22,818::task::1168::TaskManager.Task::(prepare) Task=`47ce3360-c5d7-408f-97cc-a41b969ed47e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1141::DEBUG::2014-04-10 19:20:22,818::task::579::TaskManager.Task::(_updateState) Task=`47ce3360-c5d7-408f-97cc-a41b969ed47e`::moving from state preparing -> state finished
>Thread-1141::DEBUG::2014-04-10 19:20:22,819::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1141::DEBUG::2014-04-10 19:20:22,819::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1141::DEBUG::2014-04-10 19:20:22,819::task::974::TaskManager.Task::(_decref) Task=`47ce3360-c5d7-408f-97cc-a41b969ed47e`::ref 0 aborting False
>Thread-1142::DEBUG::2014-04-10 19:20:22,827::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1142::DEBUG::2014-04-10 19:20:22,827::task::579::TaskManager.Task::(_updateState) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::moving from state init -> state preparing
>Thread-1142::INFO::2014-04-10 19:20:22,827::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1142::DEBUG::2014-04-10 19:20:22,828::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0bead968-7630-4c03-8e83-e73478b79448`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1142::DEBUG::2014-04-10 19:20:22,828::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1142::DEBUG::2014-04-10 19:20:22,828::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1142::DEBUG::2014-04-10 19:20:22,828::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`0bead968-7630-4c03-8e83-e73478b79448`::Granted request
>Thread-1142::DEBUG::2014-04-10 19:20:22,829::task::811::TaskManager.Task::(resourceAcquired) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1142::DEBUG::2014-04-10 19:20:22,829::task::974::TaskManager.Task::(_decref) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::ref 1 aborting False
>Thread-1142::INFO::2014-04-10 19:20:22,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1142::DEBUG::2014-04-10 19:20:22,831::task::1168::TaskManager.Task::(prepare) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1142::DEBUG::2014-04-10 19:20:22,831::task::579::TaskManager.Task::(_updateState) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::moving from state preparing -> state finished
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1142::DEBUG::2014-04-10 19:20:22,832::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1142::DEBUG::2014-04-10 19:20:22,833::task::974::TaskManager.Task::(_decref) Task=`49a1685e-d907-4b87-b596-9027d027cc94`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:23,309::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:20:23,324::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000320026 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:23,337::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:23,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000276858 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:20:23,364::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:23,369::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000390042 s, 1.7 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:20:30,118::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:30,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000365669 s, 1.0 MB/s\n'; <rc> = 0
>Thread-1146::DEBUG::2014-04-10 19:20:32,924::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-1146::DEBUG::2014-04-10 19:20:32,934::task::579::TaskManager.Task::(_updateState) Task=`033dce70-9178-40d2-acf1-14877cd137ca`::moving from state init -> state preparing
>Thread-1146::INFO::2014-04-10 19:20:32,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1146::INFO::2014-04-10 19:20:32,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1146::DEBUG::2014-04-10 19:20:32,934::task::1168::TaskManager.Task::(prepare) Task=`033dce70-9178-40d2-acf1-14877cd137ca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1146::DEBUG::2014-04-10 19:20:32,935::task::579::TaskManager.Task::(_updateState) Task=`033dce70-9178-40d2-acf1-14877cd137ca`::moving from state preparing -> state finished
>Thread-1146::DEBUG::2014-04-10 19:20:32,935::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1146::DEBUG::2014-04-10 19:20:32,935::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1146::DEBUG::2014-04-10 19:20:32,935::task::974::TaskManager.Task::(_decref) Task=`033dce70-9178-40d2-acf1-14877cd137ca`::ref 0 aborting False
>Thread-1147::DEBUG::2014-04-10 19:20:32,944::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [26dce09e]
>Thread-1147::DEBUG::2014-04-10 19:20:32,944::task::579::TaskManager.Task::(_updateState) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::moving from state init -> state preparing
>Thread-1147::INFO::2014-04-10 19:20:32,944::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1147::DEBUG::2014-04-10 19:20:32,945::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f9093c9-6705-4e2e-8296-bc0d28fcacf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1147::DEBUG::2014-04-10 19:20:32,945::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1147::DEBUG::2014-04-10 19:20:32,945::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1147::DEBUG::2014-04-10 19:20:32,946::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3f9093c9-6705-4e2e-8296-bc0d28fcacf8`::Granted request
>Thread-1147::DEBUG::2014-04-10 19:20:32,946::task::811::TaskManager.Task::(resourceAcquired) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1147::DEBUG::2014-04-10 19:20:32,946::task::974::TaskManager.Task::(_decref) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::ref 1 aborting False
>Thread-1147::INFO::2014-04-10 19:20:32,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1147::DEBUG::2014-04-10 19:20:32,949::task::1168::TaskManager.Task::(prepare) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1147::DEBUG::2014-04-10 19:20:32,949::task::579::TaskManager.Task::(_updateState) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::moving from state preparing -> state finished
>Thread-1147::DEBUG::2014-04-10 19:20:32,949::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1147::DEBUG::2014-04-10 19:20:32,949::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1147::DEBUG::2014-04-10 19:20:32,950::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1147::DEBUG::2014-04-10 19:20:32,950::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1147::DEBUG::2014-04-10 19:20:32,950::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1147::DEBUG::2014-04-10 19:20:32,950::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1147::DEBUG::2014-04-10 19:20:32,950::task::974::TaskManager.Task::(_decref) Task=`ea574c28-254d-4ce2-99f9-1fa54fc78709`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:33,341::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:33,346::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:20:33,348::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:20:33,349::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:20:33,351::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:20:33,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000301932 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:33,356::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:33,379::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:33,386::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000405737 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:33,512::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:20:33,514::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:20:33,514::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:20:33,529::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:20:33,531::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-66::DEBUG::2014-04-10 19:20:33,535::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-66::DEBUG::2014-04-10 19:20:33,537::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-66::INFO::2014-04-10 19:20:33,537::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-66::INFO::2014-04-10 19:20:33,537::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-66::DEBUG::2014-04-10 19:20:33,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:33,548::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00022525 s, 3.0 MB/s\n'; <rc> = 0
>Thread-1153::DEBUG::2014-04-10 19:20:36,277::task::579::TaskManager.Task::(_updateState) Task=`a763f2c6-74cf-42db-893b-488121bdf201`::moving from state init -> state preparing
>Thread-1153::INFO::2014-04-10 19:20:36,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1153::INFO::2014-04-10 19:20:36,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405737', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301932', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022525', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365669', 'lastCheck': '6.2', 'valid': True}}
>Thread-1153::DEBUG::2014-04-10 19:20:36,278::task::1168::TaskManager.Task::(prepare) Task=`a763f2c6-74cf-42db-893b-488121bdf201`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405737', 'lastCheck': '2.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301932', 'lastCheck': '2.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00022525', 'lastCheck': '2.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365669', 'lastCheck': '6.2', 'valid': True}}
>Thread-1153::DEBUG::2014-04-10 19:20:36,278::task::579::TaskManager.Task::(_updateState) Task=`a763f2c6-74cf-42db-893b-488121bdf201`::moving from state preparing -> state finished
>Thread-1153::DEBUG::2014-04-10 19:20:36,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1153::DEBUG::2014-04-10 19:20:36,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1153::DEBUG::2014-04-10 19:20:36,278::task::974::TaskManager.Task::(_decref) Task=`a763f2c6-74cf-42db-893b-488121bdf201`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:20:40,133::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:40,141::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000371821 s, 990 kB/s\n'; <rc> = 0
>Thread-1157::DEBUG::2014-04-10 19:20:43,030::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1157::DEBUG::2014-04-10 19:20:43,030::task::579::TaskManager.Task::(_updateState) Task=`b57351ea-71a4-4075-97eb-c6ceda5e86e6`::moving from state init -> state preparing
>Thread-1157::INFO::2014-04-10 19:20:43,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1157::INFO::2014-04-10 19:20:43,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1157::DEBUG::2014-04-10 19:20:43,031::task::1168::TaskManager.Task::(prepare) Task=`b57351ea-71a4-4075-97eb-c6ceda5e86e6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1157::DEBUG::2014-04-10 19:20:43,031::task::579::TaskManager.Task::(_updateState) Task=`b57351ea-71a4-4075-97eb-c6ceda5e86e6`::moving from state preparing -> state finished
>Thread-1157::DEBUG::2014-04-10 19:20:43,032::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1157::DEBUG::2014-04-10 19:20:43,032::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1157::DEBUG::2014-04-10 19:20:43,032::task::974::TaskManager.Task::(_decref) Task=`b57351ea-71a4-4075-97eb-c6ceda5e86e6`::ref 0 aborting False
>Thread-1158::DEBUG::2014-04-10 19:20:43,040::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1158::DEBUG::2014-04-10 19:20:43,040::task::579::TaskManager.Task::(_updateState) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::moving from state init -> state preparing
>Thread-1158::INFO::2014-04-10 19:20:43,040::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1158::DEBUG::2014-04-10 19:20:43,041::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6923cef-66cd-43f5-9d14-bf1b0c8f15f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1158::DEBUG::2014-04-10 19:20:43,041::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1158::DEBUG::2014-04-10 19:20:43,041::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1158::DEBUG::2014-04-10 19:20:43,041::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6923cef-66cd-43f5-9d14-bf1b0c8f15f8`::Granted request
>Thread-1158::DEBUG::2014-04-10 19:20:43,042::task::811::TaskManager.Task::(resourceAcquired) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1158::DEBUG::2014-04-10 19:20:43,042::task::974::TaskManager.Task::(_decref) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::ref 1 aborting False
>Thread-1158::INFO::2014-04-10 19:20:43,045::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1158::DEBUG::2014-04-10 19:20:43,045::task::1168::TaskManager.Task::(prepare) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080302592', 'isoprefix': '', 'alerts': [], 'disktotal': '910948630528', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1158::DEBUG::2014-04-10 19:20:43,045::task::579::TaskManager.Task::(_updateState) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::moving from state preparing -> state finished
>Thread-1158::DEBUG::2014-04-10 19:20:43,045::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1158::DEBUG::2014-04-10 19:20:43,045::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1158::DEBUG::2014-04-10 19:20:43,046::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1158::DEBUG::2014-04-10 19:20:43,046::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1158::DEBUG::2014-04-10 19:20:43,046::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1158::DEBUG::2014-04-10 19:20:43,046::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1158::DEBUG::2014-04-10 19:20:43,046::task::974::TaskManager.Task::(_decref) Task=`c13e279c-0f20-424e-9485-ff1dcac709e7`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:43,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:20:43,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028457 s, 2.4 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:20:43,396::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:43,402::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000393018 s, 1.7 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:43,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:43,563::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270976 s, 2.5 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:20:50,150::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:20:50,157::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000413733 s, 889 kB/s\n'; <rc> = 0
>Thread-1161::DEBUG::2014-04-10 19:20:51,444::task::579::TaskManager.Task::(_updateState) Task=`0c46f15b-9fa5-492a-80a0-83c9a0cb7657`::moving from state init -> state preparing
>Thread-1161::INFO::2014-04-10 19:20:51,445::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1161::INFO::2014-04-10 19:20:51,445::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393018', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028457', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270976', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413733', 'lastCheck': '1.3', 'valid': True}}
>Thread-1161::DEBUG::2014-04-10 19:20:51,445::task::1168::TaskManager.Task::(prepare) Task=`0c46f15b-9fa5-492a-80a0-83c9a0cb7657`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393018', 'lastCheck': '8.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00028457', 'lastCheck': '8.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270976', 'lastCheck': '7.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413733', 'lastCheck': '1.3', 'valid': True}}
>Thread-1161::DEBUG::2014-04-10 19:20:51,446::task::579::TaskManager.Task::(_updateState) Task=`0c46f15b-9fa5-492a-80a0-83c9a0cb7657`::moving from state preparing -> state finished
>Thread-1161::DEBUG::2014-04-10 19:20:51,446::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1161::DEBUG::2014-04-10 19:20:51,446::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1161::DEBUG::2014-04-10 19:20:51,446::task::974::TaskManager.Task::(_decref) Task=`0c46f15b-9fa5-492a-80a0-83c9a0cb7657`::ref 0 aborting False
>Thread-1163::DEBUG::2014-04-10 19:20:53,130::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1163::DEBUG::2014-04-10 19:20:53,131::task::579::TaskManager.Task::(_updateState) Task=`506ce5c6-c481-4734-9ca4-b9f73fb03033`::moving from state init -> state preparing
>Thread-1163::INFO::2014-04-10 19:20:53,131::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1163::INFO::2014-04-10 19:20:53,131::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1163::DEBUG::2014-04-10 19:20:53,131::task::1168::TaskManager.Task::(prepare) Task=`506ce5c6-c481-4734-9ca4-b9f73fb03033`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1163::DEBUG::2014-04-10 19:20:53,132::task::579::TaskManager.Task::(_updateState) Task=`506ce5c6-c481-4734-9ca4-b9f73fb03033`::moving from state preparing -> state finished
>Thread-1163::DEBUG::2014-04-10 19:20:53,132::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1163::DEBUG::2014-04-10 19:20:53,132::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1163::DEBUG::2014-04-10 19:20:53,132::task::974::TaskManager.Task::(_decref) Task=`506ce5c6-c481-4734-9ca4-b9f73fb03033`::ref 0 aborting False
>Thread-1164::DEBUG::2014-04-10 19:20:53,141::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1164::DEBUG::2014-04-10 19:20:53,141::task::579::TaskManager.Task::(_updateState) Task=`5d7836a3-3798-4973-b594-ff505d334517`::moving from state init -> state preparing
>Thread-1164::INFO::2014-04-10 19:20:53,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1164::DEBUG::2014-04-10 19:20:53,142::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff4983ca-47c4-42b0-ba07-16880c8f7902`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1164::DEBUG::2014-04-10 19:20:53,142::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1164::DEBUG::2014-04-10 19:20:53,143::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1164::DEBUG::2014-04-10 19:20:53,144::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`ff4983ca-47c4-42b0-ba07-16880c8f7902`::Granted request
>Thread-1164::DEBUG::2014-04-10 19:20:53,144::task::811::TaskManager.Task::(resourceAcquired) Task=`5d7836a3-3798-4973-b594-ff505d334517`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1164::DEBUG::2014-04-10 19:20:53,144::task::974::TaskManager.Task::(_decref) Task=`5d7836a3-3798-4973-b594-ff505d334517`::ref 1 aborting False
>Thread-1164::INFO::2014-04-10 19:20:53,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1164::DEBUG::2014-04-10 19:20:53,147::task::1168::TaskManager.Task::(prepare) Task=`5d7836a3-3798-4973-b594-ff505d334517`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1164::DEBUG::2014-04-10 19:20:53,147::task::579::TaskManager.Task::(_updateState) Task=`5d7836a3-3798-4973-b594-ff505d334517`::moving from state preparing -> state finished
>Thread-1164::DEBUG::2014-04-10 19:20:53,147::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1164::DEBUG::2014-04-10 19:20:53,148::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1164::DEBUG::2014-04-10 19:20:53,148::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1164::DEBUG::2014-04-10 19:20:53,148::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1164::DEBUG::2014-04-10 19:20:53,148::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1164::DEBUG::2014-04-10 19:20:53,148::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1164::DEBUG::2014-04-10 19:20:53,149::task::974::TaskManager.Task::(_decref) Task=`5d7836a3-3798-4973-b594-ff505d334517`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:20:53,380::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:20:53,380::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::ERROR::2014-04-10 19:20:53,381::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:20:53,381::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:20:53,381::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 55cb7668-7c5e-4553-b263-c6f3f86b358f' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:53,411::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:20:53,417::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00040177 s, 1.6 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:20:53,518::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found\n  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f\n'; <rc> = 5
>Thread-64::WARNING::2014-04-10 19:20:53,519::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "55cb7668-7c5e-4553-b263-c6f3f86b358f" not found', '  Skipping volume group 55cb7668-7c5e-4553-b263-c6f3f86b358f']
>Thread-64::DEBUG::2014-04-10 19:20:53,519::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-64::DEBUG::2014-04-10 19:20:53,535::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:20:53,536::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-64::DEBUG::2014-04-10 19:20:53,541::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain2', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=6', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'ROLE=Master', 'SDUUID=55cb7668-7c5e-4553-b263-c6f3f86b358f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=92d1520f2f337422bda9a70b0fea7e8b139ab040']
>Thread-64::DEBUG::2014-04-10 19:20:53,543::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-64::INFO::2014-04-10 19:20:53,543::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_imageNS already registered
>Thread-64::INFO::2014-04-10 19:20:53,543::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 55cb7668-7c5e-4553-b263-c6f3f86b358f_volumeNS already registered
>Thread-64::DEBUG::2014-04-10 19:20:53,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:20:53,556::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.0003575 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:20:53,573::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:20:53,578::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000349786 s, 1.9 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:21:00,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:00,172::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474067 s, 776 kB/s\n'; <rc> = 0
>Thread-1172::DEBUG::2014-04-10 19:21:03,235::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1172::DEBUG::2014-04-10 19:21:03,241::task::579::TaskManager.Task::(_updateState) Task=`150aa77a-4988-46db-b376-01bf5175c8bb`::moving from state init -> state preparing
>Thread-1172::INFO::2014-04-10 19:21:03,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1172::INFO::2014-04-10 19:21:03,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1172::DEBUG::2014-04-10 19:21:03,241::task::1168::TaskManager.Task::(prepare) Task=`150aa77a-4988-46db-b376-01bf5175c8bb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1172::DEBUG::2014-04-10 19:21:03,242::task::579::TaskManager.Task::(_updateState) Task=`150aa77a-4988-46db-b376-01bf5175c8bb`::moving from state preparing -> state finished
>Thread-1172::DEBUG::2014-04-10 19:21:03,242::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1172::DEBUG::2014-04-10 19:21:03,242::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1172::DEBUG::2014-04-10 19:21:03,242::task::974::TaskManager.Task::(_decref) Task=`150aa77a-4988-46db-b376-01bf5175c8bb`::ref 0 aborting False
>Thread-1173::DEBUG::2014-04-10 19:21:03,250::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1173::DEBUG::2014-04-10 19:21:03,250::task::579::TaskManager.Task::(_updateState) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::moving from state init -> state preparing
>Thread-1173::INFO::2014-04-10 19:21:03,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1173::DEBUG::2014-04-10 19:21:03,251::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`99d3139b-9354-45b8-9f91-10e552e4be1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1173::DEBUG::2014-04-10 19:21:03,251::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1173::DEBUG::2014-04-10 19:21:03,252::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1173::DEBUG::2014-04-10 19:21:03,252::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`99d3139b-9354-45b8-9f91-10e552e4be1a`::Granted request
>Thread-1173::DEBUG::2014-04-10 19:21:03,252::task::811::TaskManager.Task::(resourceAcquired) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1173::DEBUG::2014-04-10 19:21:03,252::task::974::TaskManager.Task::(_decref) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::ref 1 aborting False
>Thread-1173::INFO::2014-04-10 19:21:03,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1173::DEBUG::2014-04-10 19:21:03,255::task::1168::TaskManager.Task::(prepare) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1173::DEBUG::2014-04-10 19:21:03,255::task::579::TaskManager.Task::(_updateState) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::moving from state preparing -> state finished
>Thread-1173::DEBUG::2014-04-10 19:21:03,255::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1173::DEBUG::2014-04-10 19:21:03,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1173::DEBUG::2014-04-10 19:21:03,256::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1173::DEBUG::2014-04-10 19:21:03,256::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1173::DEBUG::2014-04-10 19:21:03,256::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1173::DEBUG::2014-04-10 19:21:03,256::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1173::DEBUG::2014-04-10 19:21:03,257::task::974::TaskManager.Task::(_decref) Task=`a30220dc-e064-4d19-a529-28508fa0f4ac`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:21:03,426::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:21:03,433::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000536883 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:21:03,564::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:03,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029916 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:03,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:21:03,592::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000256742 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1175::DEBUG::2014-04-10 19:21:06,620::task::579::TaskManager.Task::(_updateState) Task=`b616e15c-9b2f-4649-93a5-a0fb50b52189`::moving from state init -> state preparing
>Thread-1175::INFO::2014-04-10 19:21:06,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1175::INFO::2014-04-10 19:21:06,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536883', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029916', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256742', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474067', 'lastCheck': '6.4', 'valid': True}}
>Thread-1175::DEBUG::2014-04-10 19:21:06,621::task::1168::TaskManager.Task::(prepare) Task=`b616e15c-9b2f-4649-93a5-a0fb50b52189`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536883', 'lastCheck': '3.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00029916', 'lastCheck': '3.0', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000256742', 'lastCheck': '3.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474067', 'lastCheck': '6.4', 'valid': True}}
>Thread-1175::DEBUG::2014-04-10 19:21:06,621::task::579::TaskManager.Task::(_updateState) Task=`b616e15c-9b2f-4649-93a5-a0fb50b52189`::moving from state preparing -> state finished
>Thread-1175::DEBUG::2014-04-10 19:21:06,621::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1175::DEBUG::2014-04-10 19:21:06,621::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1175::DEBUG::2014-04-10 19:21:06,621::task::974::TaskManager.Task::(_decref) Task=`b616e15c-9b2f-4649-93a5-a0fb50b52189`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:21:10,179::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:10,187::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000445694 s, 826 kB/s\n'; <rc> = 0
>Thread-1179::DEBUG::2014-04-10 19:21:13,334::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1179::DEBUG::2014-04-10 19:21:13,335::task::579::TaskManager.Task::(_updateState) Task=`87a1d25a-ca95-479f-9e04-f127d0b9b6e9`::moving from state init -> state preparing
>Thread-1179::INFO::2014-04-10 19:21:13,335::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1179::INFO::2014-04-10 19:21:13,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1179::DEBUG::2014-04-10 19:21:13,335::task::1168::TaskManager.Task::(prepare) Task=`87a1d25a-ca95-479f-9e04-f127d0b9b6e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1179::DEBUG::2014-04-10 19:21:13,336::task::579::TaskManager.Task::(_updateState) Task=`87a1d25a-ca95-479f-9e04-f127d0b9b6e9`::moving from state preparing -> state finished
>Thread-1179::DEBUG::2014-04-10 19:21:13,336::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1179::DEBUG::2014-04-10 19:21:13,336::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1179::DEBUG::2014-04-10 19:21:13,336::task::974::TaskManager.Task::(_decref) Task=`87a1d25a-ca95-479f-9e04-f127d0b9b6e9`::ref 0 aborting False
>Thread-1180::DEBUG::2014-04-10 19:21:13,344::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1180::DEBUG::2014-04-10 19:21:13,345::task::579::TaskManager.Task::(_updateState) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::moving from state init -> state preparing
>Thread-1180::INFO::2014-04-10 19:21:13,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1180::DEBUG::2014-04-10 19:21:13,345::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33ccaa6b-7f58-4222-9706-820cdd70db51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1180::DEBUG::2014-04-10 19:21:13,346::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1180::DEBUG::2014-04-10 19:21:13,346::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1180::DEBUG::2014-04-10 19:21:13,346::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`33ccaa6b-7f58-4222-9706-820cdd70db51`::Granted request
>Thread-1180::DEBUG::2014-04-10 19:21:13,346::task::811::TaskManager.Task::(resourceAcquired) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1180::DEBUG::2014-04-10 19:21:13,346::task::974::TaskManager.Task::(_decref) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::ref 1 aborting False
>Thread-1180::INFO::2014-04-10 19:21:13,348::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1180::DEBUG::2014-04-10 19:21:13,349::task::1168::TaskManager.Task::(prepare) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1180::DEBUG::2014-04-10 19:21:13,349::task::579::TaskManager.Task::(_updateState) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::moving from state preparing -> state finished
>Thread-1180::DEBUG::2014-04-10 19:21:13,349::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1180::DEBUG::2014-04-10 19:21:13,349::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1180::DEBUG::2014-04-10 19:21:13,349::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1180::DEBUG::2014-04-10 19:21:13,350::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1180::DEBUG::2014-04-10 19:21:13,350::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1180::DEBUG::2014-04-10 19:21:13,350::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1180::DEBUG::2014-04-10 19:21:13,350::task::974::TaskManager.Task::(_decref) Task=`3402127f-c96d-414e-b038-15c9e41bddd7`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:21:13,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:21:13,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000372962 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:21:13,580::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:13,587::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000366378 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:13,601::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:21:13,606::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335858 s, 2.0 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:21:20,194::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:20,201::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000524635 s, 701 kB/s\n'; <rc> = 0
>Thread-1183::DEBUG::2014-04-10 19:21:21,800::task::579::TaskManager.Task::(_updateState) Task=`eb21dec3-fa22-42d5-88f2-dd9964de4371`::moving from state init -> state preparing
>Thread-1183::INFO::2014-04-10 19:21:21,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1183::INFO::2014-04-10 19:21:21,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372962', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366378', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335858', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524635', 'lastCheck': '1.6', 'valid': True}}
>Thread-1183::DEBUG::2014-04-10 19:21:21,801::task::1168::TaskManager.Task::(prepare) Task=`eb21dec3-fa22-42d5-88f2-dd9964de4371`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372962', 'lastCheck': '8.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366378', 'lastCheck': '8.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000335858', 'lastCheck': '8.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524635', 'lastCheck': '1.6', 'valid': True}}
>Thread-1183::DEBUG::2014-04-10 19:21:21,801::task::579::TaskManager.Task::(_updateState) Task=`eb21dec3-fa22-42d5-88f2-dd9964de4371`::moving from state preparing -> state finished
>Thread-1183::DEBUG::2014-04-10 19:21:21,802::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1183::DEBUG::2014-04-10 19:21:21,802::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1183::DEBUG::2014-04-10 19:21:21,802::task::974::TaskManager.Task::(_decref) Task=`eb21dec3-fa22-42d5-88f2-dd9964de4371`::ref 0 aborting False
>Thread-1185::DEBUG::2014-04-10 19:21:23,441::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1185::DEBUG::2014-04-10 19:21:23,442::task::579::TaskManager.Task::(_updateState) Task=`ada0eac1-ee6d-4141-9c40-01932179b2f1`::moving from state init -> state preparing
>Thread-1185::INFO::2014-04-10 19:21:23,442::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1185::INFO::2014-04-10 19:21:23,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1185::DEBUG::2014-04-10 19:21:23,442::task::1168::TaskManager.Task::(prepare) Task=`ada0eac1-ee6d-4141-9c40-01932179b2f1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1185::DEBUG::2014-04-10 19:21:23,443::task::579::TaskManager.Task::(_updateState) Task=`ada0eac1-ee6d-4141-9c40-01932179b2f1`::moving from state preparing -> state finished
>Thread-1185::DEBUG::2014-04-10 19:21:23,443::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1185::DEBUG::2014-04-10 19:21:23,443::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1185::DEBUG::2014-04-10 19:21:23,443::task::974::TaskManager.Task::(_decref) Task=`ada0eac1-ee6d-4141-9c40-01932179b2f1`::ref 0 aborting False
>Thread-1186::DEBUG::2014-04-10 19:21:23,452::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1186::DEBUG::2014-04-10 19:21:23,454::task::579::TaskManager.Task::(_updateState) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::moving from state init -> state preparing
>Thread-1186::INFO::2014-04-10 19:21:23,456::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1186::DEBUG::2014-04-10 19:21:23,459::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cefd775c-f7b5-455b-8425-3a3699bbd728`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1186::DEBUG::2014-04-10 19:21:23,460::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1186::DEBUG::2014-04-10 19:21:23,462::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1186::DEBUG::2014-04-10 19:21:23,464::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cefd775c-f7b5-455b-8425-3a3699bbd728`::Granted request
>Thread-1186::DEBUG::2014-04-10 19:21:23,464::task::811::TaskManager.Task::(resourceAcquired) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1186::DEBUG::2014-04-10 19:21:23,465::task::974::TaskManager.Task::(_decref) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::ref 1 aborting False
>Thread-1186::INFO::2014-04-10 19:21:23,483::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1186::DEBUG::2014-04-10 19:21:23,485::task::1168::TaskManager.Task::(prepare) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1186::DEBUG::2014-04-10 19:21:23,486::task::579::TaskManager.Task::(_updateState) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::moving from state preparing -> state finished
>Thread-1186::DEBUG::2014-04-10 19:21:23,487::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1186::DEBUG::2014-04-10 19:21:23,489::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1186::DEBUG::2014-04-10 19:21:23,491::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-65::DEBUG::2014-04-10 19:21:23,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1186::DEBUG::2014-04-10 19:21:23,493::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1186::DEBUG::2014-04-10 19:21:23,499::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1186::DEBUG::2014-04-10 19:21:23,500::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1186::DEBUG::2014-04-10 19:21:23,502::task::974::TaskManager.Task::(_decref) Task=`9a6e042f-f8f9-403d-b7eb-c1bb59ebc90c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:21:23,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000349787 s, 1.9 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:21:23,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:23,603::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420141 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:23,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:21:23,620::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000335614 s, 2.0 MB/s\n'; <rc> = 0
>Thread-67::DEBUG::2014-04-10 19:21:30,208::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:30,215::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000360465 s, 1.0 MB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:21:33,519::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:21:33,527::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000579971 s, 1.1 MB/s\n'; <rc> = 0
>Thread-1190::DEBUG::2014-04-10 19:21:33,589::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1190::DEBUG::2014-04-10 19:21:33,589::task::579::TaskManager.Task::(_updateState) Task=`ca342159-c455-47bf-8222-24d889b8aea6`::moving from state init -> state preparing
>Thread-1190::INFO::2014-04-10 19:21:33,590::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1190::INFO::2014-04-10 19:21:33,590::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1190::DEBUG::2014-04-10 19:21:33,590::task::1168::TaskManager.Task::(prepare) Task=`ca342159-c455-47bf-8222-24d889b8aea6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1190::DEBUG::2014-04-10 19:21:33,590::task::579::TaskManager.Task::(_updateState) Task=`ca342159-c455-47bf-8222-24d889b8aea6`::moving from state preparing -> state finished
>Thread-1190::DEBUG::2014-04-10 19:21:33,591::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1190::DEBUG::2014-04-10 19:21:33,591::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1190::DEBUG::2014-04-10 19:21:33,591::task::974::TaskManager.Task::(_decref) Task=`ca342159-c455-47bf-8222-24d889b8aea6`::ref 0 aborting False
>Thread-1191::DEBUG::2014-04-10 19:21:33,599::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1191::DEBUG::2014-04-10 19:21:33,599::task::579::TaskManager.Task::(_updateState) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::moving from state init -> state preparing
>Thread-1191::INFO::2014-04-10 19:21:33,599::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1191::DEBUG::2014-04-10 19:21:33,600::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8d7b24d-e677-4138-89c1-aec4e604e407`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1191::DEBUG::2014-04-10 19:21:33,600::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1191::DEBUG::2014-04-10 19:21:33,600::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1191::DEBUG::2014-04-10 19:21:33,600::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b8d7b24d-e677-4138-89c1-aec4e604e407`::Granted request
>Thread-1191::DEBUG::2014-04-10 19:21:33,602::task::811::TaskManager.Task::(resourceAcquired) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1191::DEBUG::2014-04-10 19:21:33,602::task::974::TaskManager.Task::(_decref) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::ref 1 aborting False
>Thread-1191::INFO::2014-04-10 19:21:33,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1191::DEBUG::2014-04-10 19:21:33,605::task::1168::TaskManager.Task::(prepare) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1191::DEBUG::2014-04-10 19:21:33,605::task::579::TaskManager.Task::(_updateState) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::moving from state preparing -> state finished
>Thread-1191::DEBUG::2014-04-10 19:21:33,605::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1191::DEBUG::2014-04-10 19:21:33,605::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1191::DEBUG::2014-04-10 19:21:33,605::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1191::DEBUG::2014-04-10 19:21:33,606::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1191::DEBUG::2014-04-10 19:21:33,606::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1191::DEBUG::2014-04-10 19:21:33,606::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1191::DEBUG::2014-04-10 19:21:33,607::task::974::TaskManager.Task::(_decref) Task=`e0749fe4-8efd-4a15-8bc9-25c3d2cd6fa3`::ref 0 aborting False
>Thread-64::DEBUG::2014-04-10 19:21:33,627::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:33,648::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000288288 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:33,662::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:21:33,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000239829 s, 2.8 MB/s\n'; <rc> = 0
>Thread-1193::DEBUG::2014-04-10 19:21:36,982::task::579::TaskManager.Task::(_updateState) Task=`c00aa2a9-94e0-428f-9cd4-4dd3323dbb2d`::moving from state init -> state preparing
>Thread-1193::INFO::2014-04-10 19:21:36,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1193::INFO::2014-04-10 19:21:36,983::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579971', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288288', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239829', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360465', 'lastCheck': '6.8', 'valid': True}}
>Thread-1193::DEBUG::2014-04-10 19:21:36,983::task::1168::TaskManager.Task::(prepare) Task=`c00aa2a9-94e0-428f-9cd4-4dd3323dbb2d`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579971', 'lastCheck': '3.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000288288', 'lastCheck': '3.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000239829', 'lastCheck': '3.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360465', 'lastCheck': '6.8', 'valid': True}}
>Thread-1193::DEBUG::2014-04-10 19:21:36,983::task::579::TaskManager.Task::(_updateState) Task=`c00aa2a9-94e0-428f-9cd4-4dd3323dbb2d`::moving from state preparing -> state finished
>Thread-1193::DEBUG::2014-04-10 19:21:36,983::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1193::DEBUG::2014-04-10 19:21:36,984::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1193::DEBUG::2014-04-10 19:21:36,984::task::974::TaskManager.Task::(_decref) Task=`c00aa2a9-94e0-428f-9cd4-4dd3323dbb2d`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:21:40,226::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:40,233::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000514771 s, 715 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:21:43,542::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:21:43,549::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000434251 s, 1.5 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:21:43,667::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:43,686::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000228601 s, 2.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:43,701::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-1197::DEBUG::2014-04-10 19:21:43,711::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1197::DEBUG::2014-04-10 19:21:43,715::task::579::TaskManager.Task::(_updateState) Task=`b8ccfe71-83bc-4275-92a4-0bfb4b0a2619`::moving from state init -> state preparing
>Thread-1197::INFO::2014-04-10 19:21:43,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1197::INFO::2014-04-10 19:21:43,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1197::DEBUG::2014-04-10 19:21:43,722::task::1168::TaskManager.Task::(prepare) Task=`b8ccfe71-83bc-4275-92a4-0bfb4b0a2619`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1197::DEBUG::2014-04-10 19:21:43,724::task::579::TaskManager.Task::(_updateState) Task=`b8ccfe71-83bc-4275-92a4-0bfb4b0a2619`::moving from state preparing -> state finished
>Thread-1197::DEBUG::2014-04-10 19:21:43,726::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1197::DEBUG::2014-04-10 19:21:43,727::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-66::DEBUG::2014-04-10 19:21:43,728::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000301778 s, 2.2 MB/s\n'; <rc> = 0
>Thread-1197::DEBUG::2014-04-10 19:21:43,730::task::974::TaskManager.Task::(_decref) Task=`b8ccfe71-83bc-4275-92a4-0bfb4b0a2619`::ref 0 aborting False
>Thread-1198::DEBUG::2014-04-10 19:21:43,743::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1198::DEBUG::2014-04-10 19:21:43,743::task::579::TaskManager.Task::(_updateState) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::moving from state init -> state preparing
>Thread-1198::INFO::2014-04-10 19:21:43,744::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1198::DEBUG::2014-04-10 19:21:43,744::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3dda28d5-7364-43a8-b433-09e41ae1065d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1198::DEBUG::2014-04-10 19:21:43,744::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1198::DEBUG::2014-04-10 19:21:43,745::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1198::DEBUG::2014-04-10 19:21:43,745::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`3dda28d5-7364-43a8-b433-09e41ae1065d`::Granted request
>Thread-1198::DEBUG::2014-04-10 19:21:43,745::task::811::TaskManager.Task::(resourceAcquired) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1198::DEBUG::2014-04-10 19:21:43,745::task::974::TaskManager.Task::(_decref) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::ref 1 aborting False
>Thread-1198::INFO::2014-04-10 19:21:43,748::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1198::DEBUG::2014-04-10 19:21:43,748::task::1168::TaskManager.Task::(prepare) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1198::DEBUG::2014-04-10 19:21:43,748::task::579::TaskManager.Task::(_updateState) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::moving from state preparing -> state finished
>Thread-1198::DEBUG::2014-04-10 19:21:43,748::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1198::DEBUG::2014-04-10 19:21:43,749::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1198::DEBUG::2014-04-10 19:21:43,749::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1198::DEBUG::2014-04-10 19:21:43,749::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1198::DEBUG::2014-04-10 19:21:43,749::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1198::DEBUG::2014-04-10 19:21:43,749::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1198::DEBUG::2014-04-10 19:21:43,750::task::974::TaskManager.Task::(_decref) Task=`59fb3463-7666-4802-a1eb-2db6731bdc82`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:21:50,241::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:21:50,248::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00052357 s, 703 kB/s\n'; <rc> = 0
>Thread-1201::DEBUG::2014-04-10 19:21:52,206::task::579::TaskManager.Task::(_updateState) Task=`7f71295f-5287-461b-bc31-3f64dcdd8a3c`::moving from state init -> state preparing
>Thread-1201::INFO::2014-04-10 19:21:52,206::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1201::INFO::2014-04-10 19:21:52,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434251', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228601', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301778', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052357', 'lastCheck': '2.0', 'valid': True}}
>Thread-1201::DEBUG::2014-04-10 19:21:52,207::task::1168::TaskManager.Task::(prepare) Task=`7f71295f-5287-461b-bc31-3f64dcdd8a3c`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434251', 'lastCheck': '8.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000228601', 'lastCheck': '8.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301778', 'lastCheck': '8.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052357', 'lastCheck': '2.0', 'valid': True}}
>Thread-1201::DEBUG::2014-04-10 19:21:52,207::task::579::TaskManager.Task::(_updateState) Task=`7f71295f-5287-461b-bc31-3f64dcdd8a3c`::moving from state preparing -> state finished
>Thread-1201::DEBUG::2014-04-10 19:21:52,207::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1201::DEBUG::2014-04-10 19:21:52,207::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1201::DEBUG::2014-04-10 19:21:52,208::task::974::TaskManager.Task::(_decref) Task=`7f71295f-5287-461b-bc31-3f64dcdd8a3c`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:21:53,559::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:21:53,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000461943 s, 1.4 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:21:53,704::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:21:53,711::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000502839 s, 1.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:21:53,744::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:21:53,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000351965 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1203::DEBUG::2014-04-10 19:21:53,845::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1203::DEBUG::2014-04-10 19:21:53,846::task::579::TaskManager.Task::(_updateState) Task=`be1279de-2fca-457e-9832-321896a017fd`::moving from state init -> state preparing
>Thread-1203::INFO::2014-04-10 19:21:53,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1203::INFO::2014-04-10 19:21:53,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1203::DEBUG::2014-04-10 19:21:53,846::task::1168::TaskManager.Task::(prepare) Task=`be1279de-2fca-457e-9832-321896a017fd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1203::DEBUG::2014-04-10 19:21:53,847::task::579::TaskManager.Task::(_updateState) Task=`be1279de-2fca-457e-9832-321896a017fd`::moving from state preparing -> state finished
>Thread-1203::DEBUG::2014-04-10 19:21:53,847::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1203::DEBUG::2014-04-10 19:21:53,847::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1203::DEBUG::2014-04-10 19:21:53,847::task::974::TaskManager.Task::(_decref) Task=`be1279de-2fca-457e-9832-321896a017fd`::ref 0 aborting False
>Thread-1204::DEBUG::2014-04-10 19:21:53,855::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1204::DEBUG::2014-04-10 19:21:53,855::task::579::TaskManager.Task::(_updateState) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::moving from state init -> state preparing
>Thread-1204::INFO::2014-04-10 19:21:53,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1204::DEBUG::2014-04-10 19:21:53,856::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6825ae2c-acd2-41a2-be15-4b53b209134d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1204::DEBUG::2014-04-10 19:21:53,856::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1204::DEBUG::2014-04-10 19:21:53,856::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1204::DEBUG::2014-04-10 19:21:53,856::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`6825ae2c-acd2-41a2-be15-4b53b209134d`::Granted request
>Thread-1204::DEBUG::2014-04-10 19:21:53,857::task::811::TaskManager.Task::(resourceAcquired) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1204::DEBUG::2014-04-10 19:21:53,857::task::974::TaskManager.Task::(_decref) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::ref 1 aborting False
>Thread-1204::INFO::2014-04-10 19:21:53,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1204::DEBUG::2014-04-10 19:21:53,859::task::1168::TaskManager.Task::(prepare) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1204::DEBUG::2014-04-10 19:21:53,860::task::579::TaskManager.Task::(_updateState) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::moving from state preparing -> state finished
>Thread-1204::DEBUG::2014-04-10 19:21:53,860::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1204::DEBUG::2014-04-10 19:21:53,860::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1204::DEBUG::2014-04-10 19:21:53,860::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1204::DEBUG::2014-04-10 19:21:53,860::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1204::DEBUG::2014-04-10 19:21:53,861::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1204::DEBUG::2014-04-10 19:21:53,861::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1204::DEBUG::2014-04-10 19:21:53,861::task::974::TaskManager.Task::(_decref) Task=`5398864f-977a-48ef-bac9-49440ed77bdc`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:00,255::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:00,262::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000505091 s, 729 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:22:03,575::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:03,582::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000529059 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:03,720::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:03,725::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000345582 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:03,758::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:03,763::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000446899 s, 1.5 MB/s\n'; <rc> = 0
>Thread-1208::DEBUG::2014-04-10 19:22:04,495::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1208::DEBUG::2014-04-10 19:22:04,495::task::579::TaskManager.Task::(_updateState) Task=`dd1cb7d5-274c-4317-838a-2d0614281b0a`::moving from state init -> state preparing
>Thread-1208::INFO::2014-04-10 19:22:04,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1208::INFO::2014-04-10 19:22:04,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1208::DEBUG::2014-04-10 19:22:04,496::task::1168::TaskManager.Task::(prepare) Task=`dd1cb7d5-274c-4317-838a-2d0614281b0a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1208::DEBUG::2014-04-10 19:22:04,496::task::579::TaskManager.Task::(_updateState) Task=`dd1cb7d5-274c-4317-838a-2d0614281b0a`::moving from state preparing -> state finished
>Thread-1208::DEBUG::2014-04-10 19:22:04,497::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1208::DEBUG::2014-04-10 19:22:04,497::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1208::DEBUG::2014-04-10 19:22:04,497::task::974::TaskManager.Task::(_decref) Task=`dd1cb7d5-274c-4317-838a-2d0614281b0a`::ref 0 aborting False
>Thread-1210::DEBUG::2014-04-10 19:22:04,507::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1210::DEBUG::2014-04-10 19:22:04,507::task::579::TaskManager.Task::(_updateState) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::moving from state init -> state preparing
>Thread-1210::INFO::2014-04-10 19:22:04,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1210::DEBUG::2014-04-10 19:22:04,508::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2b45e4a8-f160-432b-9558-d785b99111f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1210::DEBUG::2014-04-10 19:22:04,508::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1210::DEBUG::2014-04-10 19:22:04,508::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1210::DEBUG::2014-04-10 19:22:04,508::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2b45e4a8-f160-432b-9558-d785b99111f4`::Granted request
>Thread-1210::DEBUG::2014-04-10 19:22:04,509::task::811::TaskManager.Task::(resourceAcquired) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1210::DEBUG::2014-04-10 19:22:04,509::task::974::TaskManager.Task::(_decref) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::ref 1 aborting False
>Thread-1210::INFO::2014-04-10 19:22:04,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1210::DEBUG::2014-04-10 19:22:04,511::task::1168::TaskManager.Task::(prepare) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1210::DEBUG::2014-04-10 19:22:04,511::task::579::TaskManager.Task::(_updateState) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::moving from state preparing -> state finished
>Thread-1210::DEBUG::2014-04-10 19:22:04,511::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1210::DEBUG::2014-04-10 19:22:04,512::task::974::TaskManager.Task::(_decref) Task=`63bc8dc6-8944-4e49-8d8b-4ba18710d5dd`::ref 0 aborting False
>Thread-1211::DEBUG::2014-04-10 19:22:07,518::task::579::TaskManager.Task::(_updateState) Task=`39a3bdb0-40c4-42ec-8f7b-674af7f74394`::moving from state init -> state preparing
>Thread-1211::INFO::2014-04-10 19:22:07,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1211::INFO::2014-04-10 19:22:07,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529059', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345582', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446899', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505091', 'lastCheck': '7.3', 'valid': True}}
>Thread-1211::DEBUG::2014-04-10 19:22:07,519::task::1168::TaskManager.Task::(prepare) Task=`39a3bdb0-40c4-42ec-8f7b-674af7f74394`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529059', 'lastCheck': '3.9', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000345582', 'lastCheck': '3.8', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446899', 'lastCheck': '3.8', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505091', 'lastCheck': '7.3', 'valid': True}}
>Thread-1211::DEBUG::2014-04-10 19:22:07,519::task::579::TaskManager.Task::(_updateState) Task=`39a3bdb0-40c4-42ec-8f7b-674af7f74394`::moving from state preparing -> state finished
>Thread-1211::DEBUG::2014-04-10 19:22:07,519::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1211::DEBUG::2014-04-10 19:22:07,519::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1211::DEBUG::2014-04-10 19:22:07,519::task::974::TaskManager.Task::(_decref) Task=`39a3bdb0-40c4-42ec-8f7b-674af7f74394`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:10,270::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:10,276::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000464349 s, 793 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:22:13,591::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:13,598::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000498223 s, 1.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:13,734::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:13,741::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358584 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:13,772::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:13,777::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000358292 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1215::DEBUG::2014-04-10 19:22:14,613::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1884cf23]
>Thread-1215::DEBUG::2014-04-10 19:22:14,614::task::579::TaskManager.Task::(_updateState) Task=`c582b1f3-a726-40d3-87ae-d3c848ddac78`::moving from state init -> state preparing
>Thread-1215::INFO::2014-04-10 19:22:14,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1215::INFO::2014-04-10 19:22:14,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1215::DEBUG::2014-04-10 19:22:14,615::task::1168::TaskManager.Task::(prepare) Task=`c582b1f3-a726-40d3-87ae-d3c848ddac78`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1215::DEBUG::2014-04-10 19:22:14,615::task::579::TaskManager.Task::(_updateState) Task=`c582b1f3-a726-40d3-87ae-d3c848ddac78`::moving from state preparing -> state finished
>Thread-1215::DEBUG::2014-04-10 19:22:14,615::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1215::DEBUG::2014-04-10 19:22:14,615::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1215::DEBUG::2014-04-10 19:22:14,615::task::974::TaskManager.Task::(_decref) Task=`c582b1f3-a726-40d3-87ae-d3c848ddac78`::ref 0 aborting False
>Thread-1216::DEBUG::2014-04-10 19:22:14,624::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1884cf23]
>Thread-1216::DEBUG::2014-04-10 19:22:14,624::task::579::TaskManager.Task::(_updateState) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::moving from state init -> state preparing
>Thread-1216::INFO::2014-04-10 19:22:14,624::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1216::DEBUG::2014-04-10 19:22:14,625::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3df5a3c-7e65-41ac-9881-a9b8d242558c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1216::DEBUG::2014-04-10 19:22:14,625::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1216::DEBUG::2014-04-10 19:22:14,625::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1216::DEBUG::2014-04-10 19:22:14,625::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d3df5a3c-7e65-41ac-9881-a9b8d242558c`::Granted request
>Thread-1216::DEBUG::2014-04-10 19:22:14,627::task::811::TaskManager.Task::(resourceAcquired) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1216::DEBUG::2014-04-10 19:22:14,627::task::974::TaskManager.Task::(_decref) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::ref 1 aborting False
>Thread-1216::INFO::2014-04-10 19:22:14,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1216::DEBUG::2014-04-10 19:22:14,630::task::1168::TaskManager.Task::(prepare) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1216::DEBUG::2014-04-10 19:22:14,630::task::579::TaskManager.Task::(_updateState) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::moving from state preparing -> state finished
>Thread-1216::DEBUG::2014-04-10 19:22:14,630::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1216::DEBUG::2014-04-10 19:22:14,630::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1216::DEBUG::2014-04-10 19:22:14,630::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1216::DEBUG::2014-04-10 19:22:14,631::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1216::DEBUG::2014-04-10 19:22:14,631::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1216::DEBUG::2014-04-10 19:22:14,631::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1216::DEBUG::2014-04-10 19:22:14,631::task::974::TaskManager.Task::(_decref) Task=`46e9f3b9-fdb5-40b9-9874-505dfdc07bb7`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:20,284::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:20,290::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000460773 s, 799 kB/s\n'; <rc> = 0
>Thread-1219::DEBUG::2014-04-10 19:22:22,682::task::579::TaskManager.Task::(_updateState) Task=`573aecfe-e9fa-463e-8317-d8b367559148`::moving from state init -> state preparing
>Thread-1219::INFO::2014-04-10 19:22:22,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1219::INFO::2014-04-10 19:22:22,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498223', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358584', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358292', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460773', 'lastCheck': '2.4', 'valid': True}}
>Thread-1219::DEBUG::2014-04-10 19:22:22,683::task::1168::TaskManager.Task::(prepare) Task=`573aecfe-e9fa-463e-8317-d8b367559148`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498223', 'lastCheck': '9.1', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358584', 'lastCheck': '8.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000358292', 'lastCheck': '8.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460773', 'lastCheck': '2.4', 'valid': True}}
>Thread-1219::DEBUG::2014-04-10 19:22:22,684::task::579::TaskManager.Task::(_updateState) Task=`573aecfe-e9fa-463e-8317-d8b367559148`::moving from state preparing -> state finished
>Thread-1219::DEBUG::2014-04-10 19:22:22,684::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1219::DEBUG::2014-04-10 19:22:22,684::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1219::DEBUG::2014-04-10 19:22:22,684::task::974::TaskManager.Task::(_decref) Task=`573aecfe-e9fa-463e-8317-d8b367559148`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:22:23,609::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:23,615::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000534274 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:23,749::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:23,755::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000460818 s, 1.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:23,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:23,791::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000347035 s, 1.9 MB/s\n'; <rc> = 0
>Thread-1221::DEBUG::2014-04-10 19:22:24,824::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1221::DEBUG::2014-04-10 19:22:24,833::task::579::TaskManager.Task::(_updateState) Task=`e7eb2769-5a5c-42a3-ab47-1afc121abbb5`::moving from state init -> state preparing
>Thread-1221::INFO::2014-04-10 19:22:24,833::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1221::INFO::2014-04-10 19:22:24,833::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1221::DEBUG::2014-04-10 19:22:24,833::task::1168::TaskManager.Task::(prepare) Task=`e7eb2769-5a5c-42a3-ab47-1afc121abbb5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1221::DEBUG::2014-04-10 19:22:24,834::task::579::TaskManager.Task::(_updateState) Task=`e7eb2769-5a5c-42a3-ab47-1afc121abbb5`::moving from state preparing -> state finished
>Thread-1221::DEBUG::2014-04-10 19:22:24,834::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1221::DEBUG::2014-04-10 19:22:24,834::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1221::DEBUG::2014-04-10 19:22:24,834::task::974::TaskManager.Task::(_decref) Task=`e7eb2769-5a5c-42a3-ab47-1afc121abbb5`::ref 0 aborting False
>Thread-1222::DEBUG::2014-04-10 19:22:24,843::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1222::DEBUG::2014-04-10 19:22:24,843::task::579::TaskManager.Task::(_updateState) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::moving from state init -> state preparing
>Thread-1222::INFO::2014-04-10 19:22:24,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1222::DEBUG::2014-04-10 19:22:24,844::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb09c84e-c240-4e88-a0d8-0e0e95c2e4a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1222::DEBUG::2014-04-10 19:22:24,844::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1222::DEBUG::2014-04-10 19:22:24,844::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1222::DEBUG::2014-04-10 19:22:24,845::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`cb09c84e-c240-4e88-a0d8-0e0e95c2e4a4`::Granted request
>Thread-1222::DEBUG::2014-04-10 19:22:24,845::task::811::TaskManager.Task::(resourceAcquired) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1222::DEBUG::2014-04-10 19:22:24,845::task::974::TaskManager.Task::(_decref) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::ref 1 aborting False
>Thread-1222::INFO::2014-04-10 19:22:24,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1222::DEBUG::2014-04-10 19:22:24,848::task::1168::TaskManager.Task::(prepare) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1222::DEBUG::2014-04-10 19:22:24,848::task::579::TaskManager.Task::(_updateState) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::moving from state preparing -> state finished
>Thread-1222::DEBUG::2014-04-10 19:22:24,848::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1222::DEBUG::2014-04-10 19:22:24,848::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1222::DEBUG::2014-04-10 19:22:24,849::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1222::DEBUG::2014-04-10 19:22:24,849::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1222::DEBUG::2014-04-10 19:22:24,849::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1222::DEBUG::2014-04-10 19:22:24,849::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1222::DEBUG::2014-04-10 19:22:24,849::task::974::TaskManager.Task::(_decref) Task=`40937c42-36e2-4359-8c28-66ca00f5f769`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:30,298::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:30,304::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000557151 s, 661 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:22:33,626::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:33,633::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000582014 s, 1.1 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:33,764::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:33,769::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000365995 s, 1.8 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:33,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:33,805::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000331164 s, 2.0 MB/s\n'; <rc> = 0
>Thread-1227::DEBUG::2014-04-10 19:22:34,922::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1227::DEBUG::2014-04-10 19:22:34,923::task::579::TaskManager.Task::(_updateState) Task=`112e5743-edb5-45e6-9f35-176940c00300`::moving from state init -> state preparing
>Thread-1227::INFO::2014-04-10 19:22:34,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1227::INFO::2014-04-10 19:22:34,923::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1227::DEBUG::2014-04-10 19:22:34,923::task::1168::TaskManager.Task::(prepare) Task=`112e5743-edb5-45e6-9f35-176940c00300`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1227::DEBUG::2014-04-10 19:22:34,924::task::579::TaskManager.Task::(_updateState) Task=`112e5743-edb5-45e6-9f35-176940c00300`::moving from state preparing -> state finished
>Thread-1227::DEBUG::2014-04-10 19:22:34,924::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1227::DEBUG::2014-04-10 19:22:34,924::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1227::DEBUG::2014-04-10 19:22:34,924::task::974::TaskManager.Task::(_decref) Task=`112e5743-edb5-45e6-9f35-176940c00300`::ref 0 aborting False
>Thread-1228::DEBUG::2014-04-10 19:22:34,932::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1228::DEBUG::2014-04-10 19:22:34,932::task::579::TaskManager.Task::(_updateState) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::moving from state init -> state preparing
>Thread-1228::INFO::2014-04-10 19:22:34,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1228::DEBUG::2014-04-10 19:22:34,933::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7924ab08-7a0c-4857-86e8-23eaea79ae23`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1228::DEBUG::2014-04-10 19:22:34,933::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1228::DEBUG::2014-04-10 19:22:34,933::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1228::DEBUG::2014-04-10 19:22:34,934::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`7924ab08-7a0c-4857-86e8-23eaea79ae23`::Granted request
>Thread-1228::DEBUG::2014-04-10 19:22:34,934::task::811::TaskManager.Task::(resourceAcquired) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1228::DEBUG::2014-04-10 19:22:34,934::task::974::TaskManager.Task::(_decref) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::ref 1 aborting False
>Thread-1228::INFO::2014-04-10 19:22:34,936::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1228::DEBUG::2014-04-10 19:22:34,936::task::1168::TaskManager.Task::(prepare) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1228::DEBUG::2014-04-10 19:22:34,936::task::579::TaskManager.Task::(_updateState) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::moving from state preparing -> state finished
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1228::DEBUG::2014-04-10 19:22:34,937::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1228::DEBUG::2014-04-10 19:22:34,938::task::974::TaskManager.Task::(_decref) Task=`eef0619f-b05d-4261-9bf9-285515b6c1b3`::ref 0 aborting False
>Thread-1229::DEBUG::2014-04-10 19:22:37,880::task::579::TaskManager.Task::(_updateState) Task=`9f93b2f9-f282-4c70-806f-c410c4a79ffb`::moving from state init -> state preparing
>Thread-1229::INFO::2014-04-10 19:22:37,881::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1229::INFO::2014-04-10 19:22:37,881::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582014', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365995', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331164', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557151', 'lastCheck': '7.6', 'valid': True}}
>Thread-1229::DEBUG::2014-04-10 19:22:37,881::task::1168::TaskManager.Task::(prepare) Task=`9f93b2f9-f282-4c70-806f-c410c4a79ffb`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582014', 'lastCheck': '4.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365995', 'lastCheck': '4.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331164', 'lastCheck': '4.1', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557151', 'lastCheck': '7.6', 'valid': True}}
>Thread-1229::DEBUG::2014-04-10 19:22:37,882::task::579::TaskManager.Task::(_updateState) Task=`9f93b2f9-f282-4c70-806f-c410c4a79ffb`::moving from state preparing -> state finished
>Thread-1229::DEBUG::2014-04-10 19:22:37,882::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1229::DEBUG::2014-04-10 19:22:37,882::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1229::DEBUG::2014-04-10 19:22:37,882::task::974::TaskManager.Task::(_decref) Task=`9f93b2f9-f282-4c70-806f-c410c4a79ffb`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:40,313::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:40,320::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000498854 s, 738 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:22:43,643::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:43,649::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000462445 s, 1.4 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:43,778::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:43,786::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000302237 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:43,814::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:43,820::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000216383 s, 3.1 MB/s\n'; <rc> = 0
>Thread-1233::DEBUG::2014-04-10 19:22:45,055::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [33d74f3d]
>Thread-1233::DEBUG::2014-04-10 19:22:45,055::task::579::TaskManager.Task::(_updateState) Task=`49a1e0d3-d9b6-4608-a9bc-e625f7f7a725`::moving from state init -> state preparing
>Thread-1233::INFO::2014-04-10 19:22:45,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1233::INFO::2014-04-10 19:22:45,056::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1233::DEBUG::2014-04-10 19:22:45,056::task::1168::TaskManager.Task::(prepare) Task=`49a1e0d3-d9b6-4608-a9bc-e625f7f7a725`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1233::DEBUG::2014-04-10 19:22:45,056::task::579::TaskManager.Task::(_updateState) Task=`49a1e0d3-d9b6-4608-a9bc-e625f7f7a725`::moving from state preparing -> state finished
>Thread-1233::DEBUG::2014-04-10 19:22:45,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1233::DEBUG::2014-04-10 19:22:45,057::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1233::DEBUG::2014-04-10 19:22:45,057::task::974::TaskManager.Task::(_decref) Task=`49a1e0d3-d9b6-4608-a9bc-e625f7f7a725`::ref 0 aborting False
>Thread-1234::DEBUG::2014-04-10 19:22:45,065::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [33d74f3d]
>Thread-1234::DEBUG::2014-04-10 19:22:45,065::task::579::TaskManager.Task::(_updateState) Task=`03f34209-62d5-48ee-885a-75111c504563`::moving from state init -> state preparing
>Thread-1234::INFO::2014-04-10 19:22:45,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1234::DEBUG::2014-04-10 19:22:45,066::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6536aed-a933-47c8-a774-0b536e14f196`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1234::DEBUG::2014-04-10 19:22:45,066::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1234::DEBUG::2014-04-10 19:22:45,067::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1234::DEBUG::2014-04-10 19:22:45,067::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`f6536aed-a933-47c8-a774-0b536e14f196`::Granted request
>Thread-1234::DEBUG::2014-04-10 19:22:45,067::task::811::TaskManager.Task::(resourceAcquired) Task=`03f34209-62d5-48ee-885a-75111c504563`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1234::DEBUG::2014-04-10 19:22:45,067::task::974::TaskManager.Task::(_decref) Task=`03f34209-62d5-48ee-885a-75111c504563`::ref 1 aborting False
>Thread-1234::INFO::2014-04-10 19:22:45,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1234::DEBUG::2014-04-10 19:22:45,070::task::1168::TaskManager.Task::(prepare) Task=`03f34209-62d5-48ee-885a-75111c504563`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1234::DEBUG::2014-04-10 19:22:45,070::task::579::TaskManager.Task::(_updateState) Task=`03f34209-62d5-48ee-885a-75111c504563`::moving from state preparing -> state finished
>Thread-1234::DEBUG::2014-04-10 19:22:45,070::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1234::DEBUG::2014-04-10 19:22:45,071::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1234::DEBUG::2014-04-10 19:22:45,071::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1234::DEBUG::2014-04-10 19:22:45,071::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1234::DEBUG::2014-04-10 19:22:45,071::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1234::DEBUG::2014-04-10 19:22:45,071::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1234::DEBUG::2014-04-10 19:22:45,072::task::974::TaskManager.Task::(_decref) Task=`03f34209-62d5-48ee-885a-75111c504563`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:22:50,328::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:22:50,335::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000662317 s, 556 kB/s\n'; <rc> = 0
>Thread-1237::DEBUG::2014-04-10 19:22:53,063::task::579::TaskManager.Task::(_updateState) Task=`ed4f64ae-ed6c-43b5-b639-5799e022c308`::moving from state init -> state preparing
>Thread-1237::INFO::2014-04-10 19:22:53,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1237::INFO::2014-04-10 19:22:53,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462445', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302237', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216383', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662317', 'lastCheck': '2.7', 'valid': True}}
>Thread-1237::DEBUG::2014-04-10 19:22:53,064::task::1168::TaskManager.Task::(prepare) Task=`ed4f64ae-ed6c-43b5-b639-5799e022c308`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462445', 'lastCheck': '9.4', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000302237', 'lastCheck': '9.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000216383', 'lastCheck': '9.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662317', 'lastCheck': '2.7', 'valid': True}}
>Thread-1237::DEBUG::2014-04-10 19:22:53,064::task::579::TaskManager.Task::(_updateState) Task=`ed4f64ae-ed6c-43b5-b639-5799e022c308`::moving from state preparing -> state finished
>Thread-1237::DEBUG::2014-04-10 19:22:53,064::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1237::DEBUG::2014-04-10 19:22:53,065::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1237::DEBUG::2014-04-10 19:22:53,065::task::974::TaskManager.Task::(_decref) Task=`ed4f64ae-ed6c-43b5-b639-5799e022c308`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:22:53,659::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:22:53,665::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000561862 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:22:53,794::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:22:53,802::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000299033 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:22:53,828::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:22:53,834::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000318154 s, 2.1 MB/s\n'; <rc> = 0
>Thread-1239::DEBUG::2014-04-10 19:22:55,145::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1239::DEBUG::2014-04-10 19:22:55,156::task::579::TaskManager.Task::(_updateState) Task=`4a2335f2-8be9-464a-b367-e6526646dc87`::moving from state init -> state preparing
>Thread-1239::INFO::2014-04-10 19:22:55,156::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1239::INFO::2014-04-10 19:22:55,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1239::DEBUG::2014-04-10 19:22:55,157::task::1168::TaskManager.Task::(prepare) Task=`4a2335f2-8be9-464a-b367-e6526646dc87`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1239::DEBUG::2014-04-10 19:22:55,157::task::579::TaskManager.Task::(_updateState) Task=`4a2335f2-8be9-464a-b367-e6526646dc87`::moving from state preparing -> state finished
>Thread-1239::DEBUG::2014-04-10 19:22:55,157::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1239::DEBUG::2014-04-10 19:22:55,157::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1239::DEBUG::2014-04-10 19:22:55,157::task::974::TaskManager.Task::(_decref) Task=`4a2335f2-8be9-464a-b367-e6526646dc87`::ref 0 aborting False
>Thread-1240::DEBUG::2014-04-10 19:22:55,166::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1240::DEBUG::2014-04-10 19:22:55,166::task::579::TaskManager.Task::(_updateState) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::moving from state init -> state preparing
>Thread-1240::INFO::2014-04-10 19:22:55,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1240::DEBUG::2014-04-10 19:22:55,167::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`871e6288-7540-42d8-94f0-4853a6cb1b78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1240::DEBUG::2014-04-10 19:22:55,167::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1240::DEBUG::2014-04-10 19:22:55,168::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1240::DEBUG::2014-04-10 19:22:55,168::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`871e6288-7540-42d8-94f0-4853a6cb1b78`::Granted request
>Thread-1240::DEBUG::2014-04-10 19:22:55,169::task::811::TaskManager.Task::(resourceAcquired) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1240::DEBUG::2014-04-10 19:22:55,169::task::974::TaskManager.Task::(_decref) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::ref 1 aborting False
>Thread-1240::INFO::2014-04-10 19:22:55,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1240::DEBUG::2014-04-10 19:22:55,171::task::1168::TaskManager.Task::(prepare) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::task::579::TaskManager.Task::(_updateState) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::moving from state preparing -> state finished
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1240::DEBUG::2014-04-10 19:22:55,172::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1240::DEBUG::2014-04-10 19:22:55,173::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1240::DEBUG::2014-04-10 19:22:55,173::task::974::TaskManager.Task::(_decref) Task=`6da01fab-6c7c-45fd-a50b-fbf60f854097`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:00,342::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:00,349::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000554172 s, 664 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:23:03,675::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:03,682::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000532873 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:03,810::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:03,815::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000353992 s, 1.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:03,842::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:03,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000266911 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1245::DEBUG::2014-04-10 19:23:05,259::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3bae4b09]
>Thread-1245::DEBUG::2014-04-10 19:23:05,259::task::579::TaskManager.Task::(_updateState) Task=`a4ebfe7a-ddb5-43f7-9c04-bab4a764bbc7`::moving from state init -> state preparing
>Thread-1245::INFO::2014-04-10 19:23:05,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1245::INFO::2014-04-10 19:23:05,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1245::DEBUG::2014-04-10 19:23:05,260::task::1168::TaskManager.Task::(prepare) Task=`a4ebfe7a-ddb5-43f7-9c04-bab4a764bbc7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1245::DEBUG::2014-04-10 19:23:05,260::task::579::TaskManager.Task::(_updateState) Task=`a4ebfe7a-ddb5-43f7-9c04-bab4a764bbc7`::moving from state preparing -> state finished
>Thread-1245::DEBUG::2014-04-10 19:23:05,260::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1245::DEBUG::2014-04-10 19:23:05,260::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1245::DEBUG::2014-04-10 19:23:05,260::task::974::TaskManager.Task::(_decref) Task=`a4ebfe7a-ddb5-43f7-9c04-bab4a764bbc7`::ref 0 aborting False
>Thread-1246::DEBUG::2014-04-10 19:23:05,268::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [3bae4b09]
>Thread-1246::DEBUG::2014-04-10 19:23:05,269::task::579::TaskManager.Task::(_updateState) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::moving from state init -> state preparing
>Thread-1246::INFO::2014-04-10 19:23:05,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1246::DEBUG::2014-04-10 19:23:05,269::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`68a642ce-acca-4b69-b7b3-8fce14700737`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1246::DEBUG::2014-04-10 19:23:05,269::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1246::DEBUG::2014-04-10 19:23:05,270::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1246::DEBUG::2014-04-10 19:23:05,270::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`68a642ce-acca-4b69-b7b3-8fce14700737`::Granted request
>Thread-1246::DEBUG::2014-04-10 19:23:05,270::task::811::TaskManager.Task::(resourceAcquired) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1246::DEBUG::2014-04-10 19:23:05,270::task::974::TaskManager.Task::(_decref) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::ref 1 aborting False
>Thread-1246::INFO::2014-04-10 19:23:05,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1246::DEBUG::2014-04-10 19:23:05,272::task::1168::TaskManager.Task::(prepare) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::task::579::TaskManager.Task::(_updateState) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::moving from state preparing -> state finished
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1246::DEBUG::2014-04-10 19:23:05,273::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1246::DEBUG::2014-04-10 19:23:05,274::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1246::DEBUG::2014-04-10 19:23:05,274::task::974::TaskManager.Task::(_decref) Task=`57ee3c00-f4ae-403a-bfe0-4879b8410e96`::ref 0 aborting False
>Thread-1247::DEBUG::2014-04-10 19:23:08,240::task::579::TaskManager.Task::(_updateState) Task=`ca2626a2-ab6f-4e6c-ad30-0005daf00eb4`::moving from state init -> state preparing
>Thread-1247::INFO::2014-04-10 19:23:08,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1247::INFO::2014-04-10 19:23:08,241::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532873', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353992', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266911', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554172', 'lastCheck': '7.9', 'valid': True}}
>Thread-1247::DEBUG::2014-04-10 19:23:08,241::task::1168::TaskManager.Task::(prepare) Task=`ca2626a2-ab6f-4e6c-ad30-0005daf00eb4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532873', 'lastCheck': '4.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353992', 'lastCheck': '4.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000266911', 'lastCheck': '4.4', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554172', 'lastCheck': '7.9', 'valid': True}}
>Thread-1247::DEBUG::2014-04-10 19:23:08,241::task::579::TaskManager.Task::(_updateState) Task=`ca2626a2-ab6f-4e6c-ad30-0005daf00eb4`::moving from state preparing -> state finished
>Thread-1247::DEBUG::2014-04-10 19:23:08,241::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1247::DEBUG::2014-04-10 19:23:08,241::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1247::DEBUG::2014-04-10 19:23:08,242::task::974::TaskManager.Task::(_decref) Task=`ca2626a2-ab6f-4e6c-ad30-0005daf00eb4`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:10,356::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:10,363::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000458114 s, 803 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:23:13,691::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:13,697::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000562752 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:13,823::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:13,830::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000332931 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:13,855::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:13,860::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000309871 s, 2.2 MB/s\n'; <rc> = 0
>Thread-1251::DEBUG::2014-04-10 19:23:15,349::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1251::DEBUG::2014-04-10 19:23:15,350::task::579::TaskManager.Task::(_updateState) Task=`c32c9a25-75e9-4fcd-a5fe-56d098144d08`::moving from state init -> state preparing
>Thread-1251::INFO::2014-04-10 19:23:15,350::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1251::INFO::2014-04-10 19:23:15,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1251::DEBUG::2014-04-10 19:23:15,351::task::1168::TaskManager.Task::(prepare) Task=`c32c9a25-75e9-4fcd-a5fe-56d098144d08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1251::DEBUG::2014-04-10 19:23:15,351::task::579::TaskManager.Task::(_updateState) Task=`c32c9a25-75e9-4fcd-a5fe-56d098144d08`::moving from state preparing -> state finished
>Thread-1251::DEBUG::2014-04-10 19:23:15,351::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1251::DEBUG::2014-04-10 19:23:15,351::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1251::DEBUG::2014-04-10 19:23:15,351::task::974::TaskManager.Task::(_decref) Task=`c32c9a25-75e9-4fcd-a5fe-56d098144d08`::ref 0 aborting False
>Thread-1252::DEBUG::2014-04-10 19:23:15,359::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1252::DEBUG::2014-04-10 19:23:15,360::task::579::TaskManager.Task::(_updateState) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::moving from state init -> state preparing
>Thread-1252::INFO::2014-04-10 19:23:15,360::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1252::DEBUG::2014-04-10 19:23:15,360::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b08bd779-2d95-48b0-b7d9-8bb42796d961`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1252::DEBUG::2014-04-10 19:23:15,361::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1252::DEBUG::2014-04-10 19:23:15,361::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1252::DEBUG::2014-04-10 19:23:15,361::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`b08bd779-2d95-48b0-b7d9-8bb42796d961`::Granted request
>Thread-1252::DEBUG::2014-04-10 19:23:15,361::task::811::TaskManager.Task::(resourceAcquired) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1252::DEBUG::2014-04-10 19:23:15,362::task::974::TaskManager.Task::(_decref) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::ref 1 aborting False
>Thread-1252::INFO::2014-04-10 19:23:15,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1252::DEBUG::2014-04-10 19:23:15,364::task::1168::TaskManager.Task::(prepare) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1252::DEBUG::2014-04-10 19:23:15,364::task::579::TaskManager.Task::(_updateState) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::moving from state preparing -> state finished
>Thread-1252::DEBUG::2014-04-10 19:23:15,365::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1252::DEBUG::2014-04-10 19:23:15,365::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1252::DEBUG::2014-04-10 19:23:15,365::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1252::DEBUG::2014-04-10 19:23:15,365::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1252::DEBUG::2014-04-10 19:23:15,365::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1252::DEBUG::2014-04-10 19:23:15,366::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1252::DEBUG::2014-04-10 19:23:15,366::task::974::TaskManager.Task::(_decref) Task=`0453c571-9dbe-444e-8253-9a35be1cc8f3`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:20,370::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:20,377::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000528869 s, 696 kB/s\n'; <rc> = 0
>Thread-1255::DEBUG::2014-04-10 19:23:23,419::task::579::TaskManager.Task::(_updateState) Task=`6fbc8263-243e-4854-9b80-a7680745aa61`::moving from state init -> state preparing
>Thread-1255::INFO::2014-04-10 19:23:23,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1255::INFO::2014-04-10 19:23:23,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562752', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332931', 'lastCheck': '9.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309871', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528869', 'lastCheck': '3.0', 'valid': True}}
>Thread-1255::DEBUG::2014-04-10 19:23:23,420::task::1168::TaskManager.Task::(prepare) Task=`6fbc8263-243e-4854-9b80-a7680745aa61`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562752', 'lastCheck': '9.7', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000332931', 'lastCheck': '9.6', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309871', 'lastCheck': '9.6', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528869', 'lastCheck': '3.0', 'valid': True}}
>Thread-1255::DEBUG::2014-04-10 19:23:23,420::task::579::TaskManager.Task::(_updateState) Task=`6fbc8263-243e-4854-9b80-a7680745aa61`::moving from state preparing -> state finished
>Thread-1255::DEBUG::2014-04-10 19:23:23,420::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1255::DEBUG::2014-04-10 19:23:23,420::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1255::DEBUG::2014-04-10 19:23:23,421::task::974::TaskManager.Task::(_decref) Task=`6fbc8263-243e-4854-9b80-a7680745aa61`::ref 0 aborting False
>Thread-65::DEBUG::2014-04-10 19:23:23,710::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:23,716::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000403446 s, 1.6 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:23,839::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:23,846::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000317837 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:23,868::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:23,873::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00029254 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1257::DEBUG::2014-04-10 19:23:25,482::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1257::DEBUG::2014-04-10 19:23:25,491::task::579::TaskManager.Task::(_updateState) Task=`a95d80e0-5a58-4f3c-b363-b8874a291d88`::moving from state init -> state preparing
>Thread-1257::INFO::2014-04-10 19:23:25,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1257::INFO::2014-04-10 19:23:25,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1257::DEBUG::2014-04-10 19:23:25,492::task::1168::TaskManager.Task::(prepare) Task=`a95d80e0-5a58-4f3c-b363-b8874a291d88`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1257::DEBUG::2014-04-10 19:23:25,492::task::579::TaskManager.Task::(_updateState) Task=`a95d80e0-5a58-4f3c-b363-b8874a291d88`::moving from state preparing -> state finished
>Thread-1257::DEBUG::2014-04-10 19:23:25,492::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1257::DEBUG::2014-04-10 19:23:25,492::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1257::DEBUG::2014-04-10 19:23:25,492::task::974::TaskManager.Task::(_decref) Task=`a95d80e0-5a58-4f3c-b363-b8874a291d88`::ref 0 aborting False
>Thread-1258::DEBUG::2014-04-10 19:23:25,500::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1258::DEBUG::2014-04-10 19:23:25,501::task::579::TaskManager.Task::(_updateState) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::moving from state init -> state preparing
>Thread-1258::INFO::2014-04-10 19:23:25,501::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1258::DEBUG::2014-04-10 19:23:25,501::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`17832fd5-0b21-4480-8340-b09be998255c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1258::DEBUG::2014-04-10 19:23:25,501::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1258::DEBUG::2014-04-10 19:23:25,502::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1258::DEBUG::2014-04-10 19:23:25,502::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`17832fd5-0b21-4480-8340-b09be998255c`::Granted request
>Thread-1258::DEBUG::2014-04-10 19:23:25,502::task::811::TaskManager.Task::(resourceAcquired) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1258::DEBUG::2014-04-10 19:23:25,502::task::974::TaskManager.Task::(_decref) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::ref 1 aborting False
>Thread-1258::INFO::2014-04-10 19:23:25,504::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1258::DEBUG::2014-04-10 19:23:25,504::task::1168::TaskManager.Task::(prepare) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::task::579::TaskManager.Task::(_updateState) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::moving from state preparing -> state finished
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1258::DEBUG::2014-04-10 19:23:25,505::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1258::DEBUG::2014-04-10 19:23:25,506::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1258::DEBUG::2014-04-10 19:23:25,506::task::974::TaskManager.Task::(_decref) Task=`9e765430-83e7-4744-b17f-1de87a40d108`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:30,384::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:30,391::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00051995 s, 708 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:23:33,719::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:23:33,736::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:23:33,737::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-65::DEBUG::2014-04-10 19:23:33,743::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=42754144408ad66b2173860dca8edb52e9ff4601']
>Thread-65::DEBUG::2014-04-10 19:23:33,745::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-65::INFO::2014-04-10 19:23:33,745::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_imageNS already registered
>Thread-65::INFO::2014-04-10 19:23:33,745::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76_volumeNS already registered
>Thread-65::DEBUG::2014-04-10 19:23:33,751::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:33,757::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000366067 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:33,854::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:33,861::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000329903 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:33,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:33,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000252056 s, 2.7 MB/s\n'; <rc> = 0
>Thread-1267::DEBUG::2014-04-10 19:23:35,598::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1267::DEBUG::2014-04-10 19:23:35,598::task::579::TaskManager.Task::(_updateState) Task=`1cb75502-422b-443a-a75d-a5949576e257`::moving from state init -> state preparing
>Thread-1267::INFO::2014-04-10 19:23:35,598::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1267::INFO::2014-04-10 19:23:35,599::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1267::DEBUG::2014-04-10 19:23:35,599::task::1168::TaskManager.Task::(prepare) Task=`1cb75502-422b-443a-a75d-a5949576e257`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1267::DEBUG::2014-04-10 19:23:35,599::task::579::TaskManager.Task::(_updateState) Task=`1cb75502-422b-443a-a75d-a5949576e257`::moving from state preparing -> state finished
>Thread-1267::DEBUG::2014-04-10 19:23:35,599::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1267::DEBUG::2014-04-10 19:23:35,599::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1267::DEBUG::2014-04-10 19:23:35,599::task::974::TaskManager.Task::(_decref) Task=`1cb75502-422b-443a-a75d-a5949576e257`::ref 0 aborting False
>Thread-1268::DEBUG::2014-04-10 19:23:35,607::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1268::DEBUG::2014-04-10 19:23:35,608::task::579::TaskManager.Task::(_updateState) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::moving from state init -> state preparing
>Thread-1268::INFO::2014-04-10 19:23:35,608::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1268::DEBUG::2014-04-10 19:23:35,608::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d98884fb-0df0-46e6-a676-4ce999c7046f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1268::DEBUG::2014-04-10 19:23:35,608::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1268::DEBUG::2014-04-10 19:23:35,609::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1268::DEBUG::2014-04-10 19:23:35,609::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`d98884fb-0df0-46e6-a676-4ce999c7046f`::Granted request
>Thread-1268::DEBUG::2014-04-10 19:23:35,609::task::811::TaskManager.Task::(resourceAcquired) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1268::DEBUG::2014-04-10 19:23:35,609::task::974::TaskManager.Task::(_decref) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::ref 1 aborting False
>Thread-1268::INFO::2014-04-10 19:23:35,611::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1268::DEBUG::2014-04-10 19:23:35,611::task::1168::TaskManager.Task::(prepare) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1268::DEBUG::2014-04-10 19:23:35,611::task::579::TaskManager.Task::(_updateState) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::moving from state preparing -> state finished
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1268::DEBUG::2014-04-10 19:23:35,612::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1268::DEBUG::2014-04-10 19:23:35,613::task::974::TaskManager.Task::(_decref) Task=`fad7c441-6492-483a-b4c2-284e8292b0be`::ref 0 aborting False
>Thread-1269::DEBUG::2014-04-10 19:23:38,610::task::579::TaskManager.Task::(_updateState) Task=`6975db09-534d-4c80-8d3b-1b5a10bbf3a4`::moving from state init -> state preparing
>Thread-1269::INFO::2014-04-10 19:23:38,610::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1269::INFO::2014-04-10 19:23:38,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366067', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329903', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252056', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051995', 'lastCheck': '8.2', 'valid': True}}
>Thread-1269::DEBUG::2014-04-10 19:23:38,611::task::1168::TaskManager.Task::(prepare) Task=`6975db09-534d-4c80-8d3b-1b5a10bbf3a4`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366067', 'lastCheck': '4.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000329903', 'lastCheck': '4.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000252056', 'lastCheck': '4.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00051995', 'lastCheck': '8.2', 'valid': True}}
>Thread-1269::DEBUG::2014-04-10 19:23:38,611::task::579::TaskManager.Task::(_updateState) Task=`6975db09-534d-4c80-8d3b-1b5a10bbf3a4`::moving from state preparing -> state finished
>Thread-1269::DEBUG::2014-04-10 19:23:38,611::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1269::DEBUG::2014-04-10 19:23:38,611::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1269::DEBUG::2014-04-10 19:23:38,611::task::974::TaskManager.Task::(_decref) Task=`6975db09-534d-4c80-8d3b-1b5a10bbf3a4`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:40,393::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:23:40,399::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:23:40,401::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-67::DEBUG::2014-04-10 19:23:40,406::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain4', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'ROLE=Regular', 'SDUUID=65eafe2b-4fa9-4ea1-a869-7deb5afd4654', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=d5b04c0ffb4939e87efd5be54d476995b5304923']
>Thread-67::DEBUG::2014-04-10 19:23:40,408::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-67::INFO::2014-04-10 19:23:40,408::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_imageNS already registered
>Thread-67::INFO::2014-04-10 19:23:40,408::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 65eafe2b-4fa9-4ea1-a869-7deb5afd4654_volumeNS already registered
>Thread-67::DEBUG::2014-04-10 19:23:40,413::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:40,419::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000521945 s, 705 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:23:43,768::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:43,774::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000481231 s, 1.4 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:43,870::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:43,878::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000384916 s, 1.7 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:43,896::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:43,901::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255416 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1277::DEBUG::2014-04-10 19:23:45,712::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1277::DEBUG::2014-04-10 19:23:45,713::task::579::TaskManager.Task::(_updateState) Task=`499dd923-5056-4d28-a9a6-eee6a627ef1b`::moving from state init -> state preparing
>Thread-1277::INFO::2014-04-10 19:23:45,713::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1277::INFO::2014-04-10 19:23:45,713::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1277::DEBUG::2014-04-10 19:23:45,714::task::1168::TaskManager.Task::(prepare) Task=`499dd923-5056-4d28-a9a6-eee6a627ef1b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1277::DEBUG::2014-04-10 19:23:45,714::task::579::TaskManager.Task::(_updateState) Task=`499dd923-5056-4d28-a9a6-eee6a627ef1b`::moving from state preparing -> state finished
>Thread-1277::DEBUG::2014-04-10 19:23:45,714::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1277::DEBUG::2014-04-10 19:23:45,714::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1277::DEBUG::2014-04-10 19:23:45,714::task::974::TaskManager.Task::(_decref) Task=`499dd923-5056-4d28-a9a6-eee6a627ef1b`::ref 0 aborting False
>Thread-1278::DEBUG::2014-04-10 19:23:45,723::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1278::DEBUG::2014-04-10 19:23:45,723::task::579::TaskManager.Task::(_updateState) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::moving from state init -> state preparing
>Thread-1278::INFO::2014-04-10 19:23:45,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1278::DEBUG::2014-04-10 19:23:45,724::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59267b0f-5f78-4fd7-84b3-cb228395e464`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1278::DEBUG::2014-04-10 19:23:45,724::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1278::DEBUG::2014-04-10 19:23:45,724::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1278::DEBUG::2014-04-10 19:23:45,724::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`59267b0f-5f78-4fd7-84b3-cb228395e464`::Granted request
>Thread-1278::DEBUG::2014-04-10 19:23:45,725::task::811::TaskManager.Task::(resourceAcquired) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1278::DEBUG::2014-04-10 19:23:45,725::task::974::TaskManager.Task::(_decref) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::ref 1 aborting False
>Thread-1278::INFO::2014-04-10 19:23:45,727::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1278::DEBUG::2014-04-10 19:23:45,727::task::1168::TaskManager.Task::(prepare) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::task::579::TaskManager.Task::(_updateState) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::moving from state preparing -> state finished
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1278::DEBUG::2014-04-10 19:23:45,728::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1278::DEBUG::2014-04-10 19:23:45,729::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1278::DEBUG::2014-04-10 19:23:45,729::task::974::TaskManager.Task::(_decref) Task=`cc5cb65b-6799-43be-a4c8-b2b6bb2d50bc`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:23:50,427::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:23:50,434::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.00048442 s, 760 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:23:53,793::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:23:53,800::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00049347 s, 1.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:23:53,887::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:23:53,894::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000321165 s, 2.1 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:23:53,910::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:23:53,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000265815 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1281::DEBUG::2014-04-10 19:23:54,093::task::579::TaskManager.Task::(_updateState) Task=`20810ea6-8b27-44df-9784-4c8219423473`::moving from state init -> state preparing
>Thread-1281::INFO::2014-04-10 19:23:54,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1281::INFO::2014-04-10 19:23:54,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049347', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321165', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265815', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048442', 'lastCheck': '3.7', 'valid': True}}
>Thread-1281::DEBUG::2014-04-10 19:23:54,094::task::1168::TaskManager.Task::(prepare) Task=`20810ea6-8b27-44df-9784-4c8219423473`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049347', 'lastCheck': '0.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000321165', 'lastCheck': '0.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000265815', 'lastCheck': '0.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048442', 'lastCheck': '3.7', 'valid': True}}
>Thread-1281::DEBUG::2014-04-10 19:23:54,094::task::579::TaskManager.Task::(_updateState) Task=`20810ea6-8b27-44df-9784-4c8219423473`::moving from state preparing -> state finished
>Thread-1281::DEBUG::2014-04-10 19:23:54,095::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1281::DEBUG::2014-04-10 19:23:54,095::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1281::DEBUG::2014-04-10 19:23:54,095::task::974::TaskManager.Task::(_decref) Task=`20810ea6-8b27-44df-9784-4c8219423473`::ref 0 aborting False
>Thread-1283::DEBUG::2014-04-10 19:23:55,844::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1283::DEBUG::2014-04-10 19:23:55,850::task::579::TaskManager.Task::(_updateState) Task=`fa124a0e-4b87-4dbe-afec-43f45378b486`::moving from state init -> state preparing
>Thread-1283::INFO::2014-04-10 19:23:55,850::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1283::INFO::2014-04-10 19:23:55,850::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1283::DEBUG::2014-04-10 19:23:55,850::task::1168::TaskManager.Task::(prepare) Task=`fa124a0e-4b87-4dbe-afec-43f45378b486`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1283::DEBUG::2014-04-10 19:23:55,851::task::579::TaskManager.Task::(_updateState) Task=`fa124a0e-4b87-4dbe-afec-43f45378b486`::moving from state preparing -> state finished
>Thread-1283::DEBUG::2014-04-10 19:23:55,851::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1283::DEBUG::2014-04-10 19:23:55,851::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1283::DEBUG::2014-04-10 19:23:55,851::task::974::TaskManager.Task::(_decref) Task=`fa124a0e-4b87-4dbe-afec-43f45378b486`::ref 0 aborting False
>Thread-1284::DEBUG::2014-04-10 19:23:55,859::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1284::DEBUG::2014-04-10 19:23:55,859::task::579::TaskManager.Task::(_updateState) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::moving from state init -> state preparing
>Thread-1284::INFO::2014-04-10 19:23:55,859::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1284::DEBUG::2014-04-10 19:23:55,860::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e5a25b6-9590-45d4-8d2f-aaa62bd5c7fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1284::DEBUG::2014-04-10 19:23:55,860::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1284::DEBUG::2014-04-10 19:23:55,860::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1284::DEBUG::2014-04-10 19:23:55,860::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1e5a25b6-9590-45d4-8d2f-aaa62bd5c7fd`::Granted request
>Thread-1284::DEBUG::2014-04-10 19:23:55,861::task::811::TaskManager.Task::(resourceAcquired) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1284::DEBUG::2014-04-10 19:23:55,861::task::974::TaskManager.Task::(_decref) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::ref 1 aborting False
>Thread-1284::INFO::2014-04-10 19:23:55,863::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1284::DEBUG::2014-04-10 19:23:55,863::task::1168::TaskManager.Task::(prepare) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1284::DEBUG::2014-04-10 19:23:55,863::task::579::TaskManager.Task::(_updateState) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::moving from state preparing -> state finished
>Thread-1284::DEBUG::2014-04-10 19:23:55,863::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1284::DEBUG::2014-04-10 19:23:55,864::task::974::TaskManager.Task::(_decref) Task=`ae3379a8-1c0f-4a2b-bf0b-cd3bf920c071`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:00,441::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:00,448::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000474801 s, 775 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:03,809::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:03,816::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000558622 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:03,902::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:03,909::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00034028 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:03,923::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:03,928::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000284711 s, 2.4 MB/s\n'; <rc> = 0
>Thread-1288::DEBUG::2014-04-10 19:24:05,943::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1288::DEBUG::2014-04-10 19:24:05,944::task::579::TaskManager.Task::(_updateState) Task=`a90646c9-cb21-47ef-87a4-6f8e0e716608`::moving from state init -> state preparing
>Thread-1288::INFO::2014-04-10 19:24:05,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1288::INFO::2014-04-10 19:24:05,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1288::DEBUG::2014-04-10 19:24:05,945::task::1168::TaskManager.Task::(prepare) Task=`a90646c9-cb21-47ef-87a4-6f8e0e716608`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1288::DEBUG::2014-04-10 19:24:05,945::task::579::TaskManager.Task::(_updateState) Task=`a90646c9-cb21-47ef-87a4-6f8e0e716608`::moving from state preparing -> state finished
>Thread-1288::DEBUG::2014-04-10 19:24:05,945::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1288::DEBUG::2014-04-10 19:24:05,945::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1288::DEBUG::2014-04-10 19:24:05,945::task::974::TaskManager.Task::(_decref) Task=`a90646c9-cb21-47ef-87a4-6f8e0e716608`::ref 0 aborting False
>Thread-1289::DEBUG::2014-04-10 19:24:05,953::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1289::DEBUG::2014-04-10 19:24:05,953::task::579::TaskManager.Task::(_updateState) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::moving from state init -> state preparing
>Thread-1289::INFO::2014-04-10 19:24:05,953::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1289::DEBUG::2014-04-10 19:24:05,954::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73827e87-50c0-4988-b93c-664a1f371f48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1289::DEBUG::2014-04-10 19:24:05,954::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1289::DEBUG::2014-04-10 19:24:05,954::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1289::DEBUG::2014-04-10 19:24:05,954::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`73827e87-50c0-4988-b93c-664a1f371f48`::Granted request
>Thread-1289::DEBUG::2014-04-10 19:24:05,955::task::811::TaskManager.Task::(resourceAcquired) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1289::DEBUG::2014-04-10 19:24:05,955::task::974::TaskManager.Task::(_decref) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::ref 1 aborting False
>Thread-1289::INFO::2014-04-10 19:24:05,957::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1289::DEBUG::2014-04-10 19:24:05,957::task::1168::TaskManager.Task::(prepare) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1289::DEBUG::2014-04-10 19:24:05,957::task::579::TaskManager.Task::(_updateState) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::moving from state preparing -> state finished
>Thread-1289::DEBUG::2014-04-10 19:24:05,957::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1289::DEBUG::2014-04-10 19:24:05,957::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1289::DEBUG::2014-04-10 19:24:05,958::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1289::DEBUG::2014-04-10 19:24:05,958::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1289::DEBUG::2014-04-10 19:24:05,958::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1289::DEBUG::2014-04-10 19:24:05,958::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1289::DEBUG::2014-04-10 19:24:05,958::task::974::TaskManager.Task::(_decref) Task=`c32aa9f9-b38b-4d8c-922a-70c21fd2b142`::ref 0 aborting False
>Thread-1291::DEBUG::2014-04-10 19:24:09,277::task::579::TaskManager.Task::(_updateState) Task=`8ea4a4d6-94e6-4297-bc4b-4a855c6401e5`::moving from state init -> state preparing
>Thread-1291::INFO::2014-04-10 19:24:09,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1291::INFO::2014-04-10 19:24:09,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034028', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284711', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474801', 'lastCheck': '8.8', 'valid': True}}
>Thread-1291::DEBUG::2014-04-10 19:24:09,278::task::1168::TaskManager.Task::(prepare) Task=`8ea4a4d6-94e6-4297-bc4b-4a855c6401e5`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558622', 'lastCheck': '5.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00034028', 'lastCheck': '5.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284711', 'lastCheck': '5.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474801', 'lastCheck': '8.8', 'valid': True}}
>Thread-1291::DEBUG::2014-04-10 19:24:09,278::task::579::TaskManager.Task::(_updateState) Task=`8ea4a4d6-94e6-4297-bc4b-4a855c6401e5`::moving from state preparing -> state finished
>Thread-1291::DEBUG::2014-04-10 19:24:09,278::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1291::DEBUG::2014-04-10 19:24:09,278::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1291::DEBUG::2014-04-10 19:24:09,278::task::974::TaskManager.Task::(_decref) Task=`8ea4a4d6-94e6-4297-bc4b-4a855c6401e5`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:10,455::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:10,462::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000483493 s, 761 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:13,825::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:13,831::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000527045 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:13,917::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:13,924::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000407245 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:13,936::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:13,942::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00028082 s, 2.4 MB/s\n'; <rc> = 0
>Thread-1295::DEBUG::2014-04-10 19:24:16,041::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1295::DEBUG::2014-04-10 19:24:16,042::task::579::TaskManager.Task::(_updateState) Task=`ac953c06-25ca-4610-a54f-b8be63c3c889`::moving from state init -> state preparing
>Thread-1295::INFO::2014-04-10 19:24:16,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1295::INFO::2014-04-10 19:24:16,042::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1295::DEBUG::2014-04-10 19:24:16,042::task::1168::TaskManager.Task::(prepare) Task=`ac953c06-25ca-4610-a54f-b8be63c3c889`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1295::DEBUG::2014-04-10 19:24:16,043::task::579::TaskManager.Task::(_updateState) Task=`ac953c06-25ca-4610-a54f-b8be63c3c889`::moving from state preparing -> state finished
>Thread-1295::DEBUG::2014-04-10 19:24:16,043::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1295::DEBUG::2014-04-10 19:24:16,043::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1295::DEBUG::2014-04-10 19:24:16,043::task::974::TaskManager.Task::(_decref) Task=`ac953c06-25ca-4610-a54f-b8be63c3c889`::ref 0 aborting False
>Thread-1296::DEBUG::2014-04-10 19:24:16,051::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1296::DEBUG::2014-04-10 19:24:16,051::task::579::TaskManager.Task::(_updateState) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::moving from state init -> state preparing
>Thread-1296::INFO::2014-04-10 19:24:16,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1296::DEBUG::2014-04-10 19:24:16,052::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4e4af070-c587-405e-8200-e704d90685f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1296::DEBUG::2014-04-10 19:24:16,052::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1296::DEBUG::2014-04-10 19:24:16,052::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1296::DEBUG::2014-04-10 19:24:16,053::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`4e4af070-c587-405e-8200-e704d90685f4`::Granted request
>Thread-1296::DEBUG::2014-04-10 19:24:16,053::task::811::TaskManager.Task::(resourceAcquired) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1296::DEBUG::2014-04-10 19:24:16,053::task::974::TaskManager.Task::(_decref) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::ref 1 aborting False
>Thread-1296::INFO::2014-04-10 19:24:16,056::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1296::DEBUG::2014-04-10 19:24:16,056::task::1168::TaskManager.Task::(prepare) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1296::DEBUG::2014-04-10 19:24:16,056::task::579::TaskManager.Task::(_updateState) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::moving from state preparing -> state finished
>Thread-1296::DEBUG::2014-04-10 19:24:16,056::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1296::DEBUG::2014-04-10 19:24:16,056::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1296::DEBUG::2014-04-10 19:24:16,057::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1296::DEBUG::2014-04-10 19:24:16,057::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1296::DEBUG::2014-04-10 19:24:16,057::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1296::DEBUG::2014-04-10 19:24:16,057::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1296::DEBUG::2014-04-10 19:24:16,057::task::974::TaskManager.Task::(_decref) Task=`61d7fa9c-edce-471d-ae7e-9cb37f2a172c`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:20,469::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:20,476::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000511593 s, 719 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:23,841::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:23,847::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000552722 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:23,933::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:23,940::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00032749 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:23,950::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:23,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000222612 s, 3.0 MB/s\n'; <rc> = 0
>Thread-1299::DEBUG::2014-04-10 19:24:24,463::task::579::TaskManager.Task::(_updateState) Task=`035dc9f8-3f9b-4f8e-9eb6-ac7fa4be60cc`::moving from state init -> state preparing
>Thread-1299::INFO::2014-04-10 19:24:24,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1299::INFO::2014-04-10 19:24:24,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552722', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032749', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222612', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511593', 'lastCheck': '4.0', 'valid': True}}
>Thread-1299::DEBUG::2014-04-10 19:24:24,464::task::1168::TaskManager.Task::(prepare) Task=`035dc9f8-3f9b-4f8e-9eb6-ac7fa4be60cc`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552722', 'lastCheck': '0.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032749', 'lastCheck': '0.5', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000222612', 'lastCheck': '0.5', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511593', 'lastCheck': '4.0', 'valid': True}}
>Thread-1299::DEBUG::2014-04-10 19:24:24,464::task::579::TaskManager.Task::(_updateState) Task=`035dc9f8-3f9b-4f8e-9eb6-ac7fa4be60cc`::moving from state preparing -> state finished
>Thread-1299::DEBUG::2014-04-10 19:24:24,464::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1299::DEBUG::2014-04-10 19:24:24,465::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1299::DEBUG::2014-04-10 19:24:24,465::task::974::TaskManager.Task::(_decref) Task=`035dc9f8-3f9b-4f8e-9eb6-ac7fa4be60cc`::ref 0 aborting False
>Thread-1301::DEBUG::2014-04-10 19:24:26,148::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1301::DEBUG::2014-04-10 19:24:26,161::task::579::TaskManager.Task::(_updateState) Task=`1227a74e-d1a1-4173-b3bf-4221a4de70e4`::moving from state init -> state preparing
>Thread-1301::INFO::2014-04-10 19:24:26,161::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1301::INFO::2014-04-10 19:24:26,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1301::DEBUG::2014-04-10 19:24:26,161::task::1168::TaskManager.Task::(prepare) Task=`1227a74e-d1a1-4173-b3bf-4221a4de70e4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1301::DEBUG::2014-04-10 19:24:26,161::task::579::TaskManager.Task::(_updateState) Task=`1227a74e-d1a1-4173-b3bf-4221a4de70e4`::moving from state preparing -> state finished
>Thread-1301::DEBUG::2014-04-10 19:24:26,162::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1301::DEBUG::2014-04-10 19:24:26,162::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1301::DEBUG::2014-04-10 19:24:26,162::task::974::TaskManager.Task::(_decref) Task=`1227a74e-d1a1-4173-b3bf-4221a4de70e4`::ref 0 aborting False
>Thread-1302::DEBUG::2014-04-10 19:24:26,171::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1302::DEBUG::2014-04-10 19:24:26,171::task::579::TaskManager.Task::(_updateState) Task=`0c360192-06ee-4058-b39c-c04172567785`::moving from state init -> state preparing
>Thread-1302::INFO::2014-04-10 19:24:26,171::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1302::DEBUG::2014-04-10 19:24:26,172::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1bfa206-21cc-4c6f-8c66-a6b2dab53dfa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1302::DEBUG::2014-04-10 19:24:26,172::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1302::DEBUG::2014-04-10 19:24:26,172::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1302::DEBUG::2014-04-10 19:24:26,172::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e1bfa206-21cc-4c6f-8c66-a6b2dab53dfa`::Granted request
>Thread-1302::DEBUG::2014-04-10 19:24:26,172::task::811::TaskManager.Task::(resourceAcquired) Task=`0c360192-06ee-4058-b39c-c04172567785`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1302::DEBUG::2014-04-10 19:24:26,173::task::974::TaskManager.Task::(_decref) Task=`0c360192-06ee-4058-b39c-c04172567785`::ref 1 aborting False
>Thread-1302::INFO::2014-04-10 19:24:26,174::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1302::DEBUG::2014-04-10 19:24:26,175::task::1168::TaskManager.Task::(prepare) Task=`0c360192-06ee-4058-b39c-c04172567785`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1302::DEBUG::2014-04-10 19:24:26,175::task::579::TaskManager.Task::(_updateState) Task=`0c360192-06ee-4058-b39c-c04172567785`::moving from state preparing -> state finished
>Thread-1302::DEBUG::2014-04-10 19:24:26,175::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1302::DEBUG::2014-04-10 19:24:26,175::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1302::DEBUG::2014-04-10 19:24:26,175::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1302::DEBUG::2014-04-10 19:24:26,176::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1302::DEBUG::2014-04-10 19:24:26,176::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1302::DEBUG::2014-04-10 19:24:26,176::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1302::DEBUG::2014-04-10 19:24:26,176::task::974::TaskManager.Task::(_decref) Task=`0c360192-06ee-4058-b39c-c04172567785`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:30,492::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:30,499::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000526099 s, 699 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:33,858::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:33,865::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000576188 s, 1.1 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:33,948::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:33,955::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000420236 s, 1.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:33,965::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:33,970::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000250829 s, 2.7 MB/s\n'; <rc> = 0
>Thread-1306::DEBUG::2014-04-10 19:24:36,254::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1306::DEBUG::2014-04-10 19:24:36,255::task::579::TaskManager.Task::(_updateState) Task=`2e4c7b74-23b5-4230-bd5b-df8a5416f965`::moving from state init -> state preparing
>Thread-1306::INFO::2014-04-10 19:24:36,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1306::INFO::2014-04-10 19:24:36,256::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1306::DEBUG::2014-04-10 19:24:36,256::task::1168::TaskManager.Task::(prepare) Task=`2e4c7b74-23b5-4230-bd5b-df8a5416f965`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1306::DEBUG::2014-04-10 19:24:36,256::task::579::TaskManager.Task::(_updateState) Task=`2e4c7b74-23b5-4230-bd5b-df8a5416f965`::moving from state preparing -> state finished
>Thread-1306::DEBUG::2014-04-10 19:24:36,256::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1306::DEBUG::2014-04-10 19:24:36,256::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1306::DEBUG::2014-04-10 19:24:36,256::task::974::TaskManager.Task::(_decref) Task=`2e4c7b74-23b5-4230-bd5b-df8a5416f965`::ref 0 aborting False
>Thread-1307::DEBUG::2014-04-10 19:24:36,264::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1307::DEBUG::2014-04-10 19:24:36,264::task::579::TaskManager.Task::(_updateState) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::moving from state init -> state preparing
>Thread-1307::INFO::2014-04-10 19:24:36,264::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1307::DEBUG::2014-04-10 19:24:36,265::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d0b65bc-6217-454e-af0a-d627d156eb2e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1307::DEBUG::2014-04-10 19:24:36,265::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1307::DEBUG::2014-04-10 19:24:36,265::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1307::DEBUG::2014-04-10 19:24:36,265::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`9d0b65bc-6217-454e-af0a-d627d156eb2e`::Granted request
>Thread-1307::DEBUG::2014-04-10 19:24:36,266::task::811::TaskManager.Task::(resourceAcquired) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1307::DEBUG::2014-04-10 19:24:36,266::task::974::TaskManager.Task::(_decref) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::ref 1 aborting False
>Thread-1307::INFO::2014-04-10 19:24:36,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1307::DEBUG::2014-04-10 19:24:36,268::task::1168::TaskManager.Task::(prepare) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1307::DEBUG::2014-04-10 19:24:36,268::task::579::TaskManager.Task::(_updateState) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::moving from state preparing -> state finished
>Thread-1307::DEBUG::2014-04-10 19:24:36,268::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1307::DEBUG::2014-04-10 19:24:36,268::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1307::DEBUG::2014-04-10 19:24:36,268::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1307::DEBUG::2014-04-10 19:24:36,269::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1307::DEBUG::2014-04-10 19:24:36,269::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1307::DEBUG::2014-04-10 19:24:36,269::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1307::DEBUG::2014-04-10 19:24:36,269::task::974::TaskManager.Task::(_decref) Task=`93e07ca4-26e0-4b42-926d-25bc89acf44f`::ref 0 aborting False
>Thread-1309::DEBUG::2014-04-10 19:24:39,651::task::579::TaskManager.Task::(_updateState) Task=`d57e816c-62ab-452c-9e6b-743507a32794`::moving from state init -> state preparing
>Thread-1309::INFO::2014-04-10 19:24:39,651::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1309::INFO::2014-04-10 19:24:39,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576188', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420236', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250829', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526099', 'lastCheck': '9.2', 'valid': True}}
>Thread-1309::DEBUG::2014-04-10 19:24:39,652::task::1168::TaskManager.Task::(prepare) Task=`d57e816c-62ab-452c-9e6b-743507a32794`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576188', 'lastCheck': '5.8', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420236', 'lastCheck': '5.7', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000250829', 'lastCheck': '5.7', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526099', 'lastCheck': '9.2', 'valid': True}}
>Thread-1309::DEBUG::2014-04-10 19:24:39,652::task::579::TaskManager.Task::(_updateState) Task=`d57e816c-62ab-452c-9e6b-743507a32794`::moving from state preparing -> state finished
>Thread-1309::DEBUG::2014-04-10 19:24:39,652::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1309::DEBUG::2014-04-10 19:24:39,652::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1309::DEBUG::2014-04-10 19:24:39,653::task::974::TaskManager.Task::(_decref) Task=`d57e816c-62ab-452c-9e6b-743507a32794`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:40,508::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:40,515::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000534709 s, 688 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:43,875::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:43,882::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000550671 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:43,967::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:43,982::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000287753 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:43,995::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:44,000::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000263169 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1313::DEBUG::2014-04-10 19:24:46,354::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1313::DEBUG::2014-04-10 19:24:46,354::task::579::TaskManager.Task::(_updateState) Task=`eedfcbd7-c9c5-4abe-8470-62136e84632d`::moving from state init -> state preparing
>Thread-1313::INFO::2014-04-10 19:24:46,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1313::INFO::2014-04-10 19:24:46,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1313::DEBUG::2014-04-10 19:24:46,355::task::1168::TaskManager.Task::(prepare) Task=`eedfcbd7-c9c5-4abe-8470-62136e84632d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1313::DEBUG::2014-04-10 19:24:46,355::task::579::TaskManager.Task::(_updateState) Task=`eedfcbd7-c9c5-4abe-8470-62136e84632d`::moving from state preparing -> state finished
>Thread-1313::DEBUG::2014-04-10 19:24:46,355::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1313::DEBUG::2014-04-10 19:24:46,355::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1313::DEBUG::2014-04-10 19:24:46,356::task::974::TaskManager.Task::(_decref) Task=`eedfcbd7-c9c5-4abe-8470-62136e84632d`::ref 0 aborting False
>Thread-1314::DEBUG::2014-04-10 19:24:46,363::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1314::DEBUG::2014-04-10 19:24:46,364::task::579::TaskManager.Task::(_updateState) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::moving from state init -> state preparing
>Thread-1314::INFO::2014-04-10 19:24:46,364::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1314::DEBUG::2014-04-10 19:24:46,364::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1c8a4738-2545-4556-9087-36377edcefba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1314::DEBUG::2014-04-10 19:24:46,365::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1314::DEBUG::2014-04-10 19:24:46,365::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1314::DEBUG::2014-04-10 19:24:46,365::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1c8a4738-2545-4556-9087-36377edcefba`::Granted request
>Thread-1314::DEBUG::2014-04-10 19:24:46,366::task::811::TaskManager.Task::(resourceAcquired) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1314::DEBUG::2014-04-10 19:24:46,366::task::974::TaskManager.Task::(_decref) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::ref 1 aborting False
>Thread-1314::INFO::2014-04-10 19:24:46,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1314::DEBUG::2014-04-10 19:24:46,368::task::1168::TaskManager.Task::(prepare) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1314::DEBUG::2014-04-10 19:24:46,368::task::579::TaskManager.Task::(_updateState) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::moving from state preparing -> state finished
>Thread-1314::DEBUG::2014-04-10 19:24:46,369::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1314::DEBUG::2014-04-10 19:24:46,369::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1314::DEBUG::2014-04-10 19:24:46,369::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1314::DEBUG::2014-04-10 19:24:46,369::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1314::DEBUG::2014-04-10 19:24:46,369::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1314::DEBUG::2014-04-10 19:24:46,370::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1314::DEBUG::2014-04-10 19:24:46,370::task::974::TaskManager.Task::(_decref) Task=`5caa19f4-d972-442f-a9cd-126a628cf831`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:24:50,522::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:24:50,529::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000481176 s, 765 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:24:53,892::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:24:53,898::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000550911 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:24:53,998::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:24:54,015::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000267347 s, 2.5 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:24:54,026::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:24:54,032::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000270505 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1317::DEBUG::2014-04-10 19:24:54,902::task::579::TaskManager.Task::(_updateState) Task=`de5f356c-311c-4e90-8814-3b334db7bc73`::moving from state init -> state preparing
>Thread-1317::INFO::2014-04-10 19:24:54,903::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1317::INFO::2014-04-10 19:24:54,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550911', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267347', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270505', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481176', 'lastCheck': '4.4', 'valid': True}}
>Thread-1317::DEBUG::2014-04-10 19:24:54,903::task::1168::TaskManager.Task::(prepare) Task=`de5f356c-311c-4e90-8814-3b334db7bc73`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550911', 'lastCheck': '1.0', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000267347', 'lastCheck': '0.9', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000270505', 'lastCheck': '0.9', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481176', 'lastCheck': '4.4', 'valid': True}}
>Thread-1317::DEBUG::2014-04-10 19:24:54,903::task::579::TaskManager.Task::(_updateState) Task=`de5f356c-311c-4e90-8814-3b334db7bc73`::moving from state preparing -> state finished
>Thread-1317::DEBUG::2014-04-10 19:24:54,904::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1317::DEBUG::2014-04-10 19:24:54,904::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1317::DEBUG::2014-04-10 19:24:54,904::task::974::TaskManager.Task::(_decref) Task=`de5f356c-311c-4e90-8814-3b334db7bc73`::ref 0 aborting False
>Thread-1319::DEBUG::2014-04-10 19:24:56,460::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1319::DEBUG::2014-04-10 19:24:56,461::task::579::TaskManager.Task::(_updateState) Task=`65dd074c-d43e-4dd4-a0d5-73aa749ddbd7`::moving from state init -> state preparing
>Thread-1319::INFO::2014-04-10 19:24:56,461::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1319::INFO::2014-04-10 19:24:56,461::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1319::DEBUG::2014-04-10 19:24:56,461::task::1168::TaskManager.Task::(prepare) Task=`65dd074c-d43e-4dd4-a0d5-73aa749ddbd7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1319::DEBUG::2014-04-10 19:24:56,462::task::579::TaskManager.Task::(_updateState) Task=`65dd074c-d43e-4dd4-a0d5-73aa749ddbd7`::moving from state preparing -> state finished
>Thread-1319::DEBUG::2014-04-10 19:24:56,462::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1319::DEBUG::2014-04-10 19:24:56,462::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1319::DEBUG::2014-04-10 19:24:56,462::task::974::TaskManager.Task::(_decref) Task=`65dd074c-d43e-4dd4-a0d5-73aa749ddbd7`::ref 0 aborting False
>Thread-1320::DEBUG::2014-04-10 19:24:56,470::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1320::DEBUG::2014-04-10 19:24:56,470::task::579::TaskManager.Task::(_updateState) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::moving from state init -> state preparing
>Thread-1320::INFO::2014-04-10 19:24:56,470::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1320::DEBUG::2014-04-10 19:24:56,471::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a67d7643-d4fe-41b0-925f-6c85b636883a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1320::DEBUG::2014-04-10 19:24:56,471::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1320::DEBUG::2014-04-10 19:24:56,471::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1320::DEBUG::2014-04-10 19:24:56,471::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`a67d7643-d4fe-41b0-925f-6c85b636883a`::Granted request
>Thread-1320::DEBUG::2014-04-10 19:24:56,472::task::811::TaskManager.Task::(resourceAcquired) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1320::DEBUG::2014-04-10 19:24:56,472::task::974::TaskManager.Task::(_decref) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::ref 1 aborting False
>Thread-1320::INFO::2014-04-10 19:24:56,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1320::DEBUG::2014-04-10 19:24:56,474::task::1168::TaskManager.Task::(prepare) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080564736', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1320::DEBUG::2014-04-10 19:24:56,474::task::579::TaskManager.Task::(_updateState) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::moving from state preparing -> state finished
>Thread-1320::DEBUG::2014-04-10 19:24:56,474::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1320::DEBUG::2014-04-10 19:24:56,474::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1320::DEBUG::2014-04-10 19:24:56,475::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1320::DEBUG::2014-04-10 19:24:56,475::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1320::DEBUG::2014-04-10 19:24:56,475::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1320::DEBUG::2014-04-10 19:24:56,475::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1320::DEBUG::2014-04-10 19:24:56,475::task::974::TaskManager.Task::(_decref) Task=`1357c55b-c1f2-4b97-98ad-d529ce8bb085`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:25:00,537::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:00,544::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000566837 s, 649 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:25:03,908::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:25:03,915::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000538067 s, 1.2 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:25:04,030::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:25:04,047::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00023325 s, 2.9 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:25:04,059::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:04,065::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000255532 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1324::DEBUG::2014-04-10 19:25:06,608::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1324::DEBUG::2014-04-10 19:25:06,609::task::579::TaskManager.Task::(_updateState) Task=`3da5726e-b878-4b68-8a3e-4690d69ef4e9`::moving from state init -> state preparing
>Thread-1324::INFO::2014-04-10 19:25:06,609::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1324::INFO::2014-04-10 19:25:06,610::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1324::DEBUG::2014-04-10 19:25:06,610::task::1168::TaskManager.Task::(prepare) Task=`3da5726e-b878-4b68-8a3e-4690d69ef4e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1324::DEBUG::2014-04-10 19:25:06,610::task::579::TaskManager.Task::(_updateState) Task=`3da5726e-b878-4b68-8a3e-4690d69ef4e9`::moving from state preparing -> state finished
>Thread-1324::DEBUG::2014-04-10 19:25:06,610::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1324::DEBUG::2014-04-10 19:25:06,610::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1324::DEBUG::2014-04-10 19:25:06,610::task::974::TaskManager.Task::(_decref) Task=`3da5726e-b878-4b68-8a3e-4690d69ef4e9`::ref 0 aborting False
>Thread-1325::DEBUG::2014-04-10 19:25:06,618::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1325::DEBUG::2014-04-10 19:25:06,619::task::579::TaskManager.Task::(_updateState) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::moving from state init -> state preparing
>Thread-1325::INFO::2014-04-10 19:25:06,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1325::DEBUG::2014-04-10 19:25:06,619::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1fac3326-3f57-4177-8a74-e334e0e73b4c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1325::DEBUG::2014-04-10 19:25:06,620::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1325::DEBUG::2014-04-10 19:25:06,620::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1325::DEBUG::2014-04-10 19:25:06,620::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`1fac3326-3f57-4177-8a74-e334e0e73b4c`::Granted request
>Thread-1325::DEBUG::2014-04-10 19:25:06,620::task::811::TaskManager.Task::(resourceAcquired) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1325::DEBUG::2014-04-10 19:25:06,620::task::974::TaskManager.Task::(_decref) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::ref 1 aborting False
>Thread-1325::INFO::2014-04-10 19:25:06,622::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1325::DEBUG::2014-04-10 19:25:06,622::task::1168::TaskManager.Task::(prepare) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080630272', 'isoprefix': '', 'alerts': [], 'disktotal': '910948958208', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1325::DEBUG::2014-04-10 19:25:06,623::task::579::TaskManager.Task::(_updateState) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::moving from state preparing -> state finished
>Thread-1325::DEBUG::2014-04-10 19:25:06,623::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1325::DEBUG::2014-04-10 19:25:06,623::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1325::DEBUG::2014-04-10 19:25:06,623::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1325::DEBUG::2014-04-10 19:25:06,623::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1325::DEBUG::2014-04-10 19:25:06,624::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1325::DEBUG::2014-04-10 19:25:06,624::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1325::DEBUG::2014-04-10 19:25:06,624::task::974::TaskManager.Task::(_decref) Task=`676abe9e-a2bc-443c-833e-bf1db3d66592`::ref 0 aborting False
>Thread-1327::DEBUG::2014-04-10 19:25:10,114::task::579::TaskManager.Task::(_updateState) Task=`cb864472-4eaf-4d4c-9f80-a1b2f4d9b622`::moving from state init -> state preparing
>Thread-1327::INFO::2014-04-10 19:25:10,115::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1327::INFO::2014-04-10 19:25:10,115::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538067', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023325', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255532', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566837', 'lastCheck': '9.6', 'valid': True}}
>Thread-1327::DEBUG::2014-04-10 19:25:10,115::task::1168::TaskManager.Task::(prepare) Task=`cb864472-4eaf-4d4c-9f80-a1b2f4d9b622`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538067', 'lastCheck': '6.2', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023325', 'lastCheck': '6.1', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000255532', 'lastCheck': '6.0', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000566837', 'lastCheck': '9.6', 'valid': True}}
>Thread-1327::DEBUG::2014-04-10 19:25:10,115::task::579::TaskManager.Task::(_updateState) Task=`cb864472-4eaf-4d4c-9f80-a1b2f4d9b622`::moving from state preparing -> state finished
>Thread-1327::DEBUG::2014-04-10 19:25:10,116::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1327::DEBUG::2014-04-10 19:25:10,116::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1327::DEBUG::2014-04-10 19:25:10,116::task::974::TaskManager.Task::(_decref) Task=`cb864472-4eaf-4d4c-9f80-a1b2f4d9b622`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:25:10,551::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:10,558::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000543105 s, 678 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:25:13,925::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:25:13,931::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00051602 s, 1.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:25:14,063::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:25:14,082::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290126 s, 2.3 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:25:14,093::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:14,102::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000290854 s, 2.3 MB/s\n'; <rc> = 0
>Thread-1331::DEBUG::2014-04-10 19:25:16,714::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1331::DEBUG::2014-04-10 19:25:16,715::task::579::TaskManager.Task::(_updateState) Task=`001c8b7f-de68-4f19-85d2-fc31e1ff7ced`::moving from state init -> state preparing
>Thread-1331::INFO::2014-04-10 19:25:16,715::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1331::INFO::2014-04-10 19:25:16,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1331::DEBUG::2014-04-10 19:25:16,716::task::1168::TaskManager.Task::(prepare) Task=`001c8b7f-de68-4f19-85d2-fc31e1ff7ced`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1331::DEBUG::2014-04-10 19:25:16,716::task::579::TaskManager.Task::(_updateState) Task=`001c8b7f-de68-4f19-85d2-fc31e1ff7ced`::moving from state preparing -> state finished
>Thread-1331::DEBUG::2014-04-10 19:25:16,716::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1331::DEBUG::2014-04-10 19:25:16,716::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1331::DEBUG::2014-04-10 19:25:16,716::task::974::TaskManager.Task::(_decref) Task=`001c8b7f-de68-4f19-85d2-fc31e1ff7ced`::ref 0 aborting False
>Thread-1332::DEBUG::2014-04-10 19:25:16,724::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1332::DEBUG::2014-04-10 19:25:16,724::task::579::TaskManager.Task::(_updateState) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::moving from state init -> state preparing
>Thread-1332::INFO::2014-04-10 19:25:16,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1332::DEBUG::2014-04-10 19:25:16,725::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb9e5d90-7b3d-4a45-96f2-15b5a26e9ce3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1332::DEBUG::2014-04-10 19:25:16,725::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1332::DEBUG::2014-04-10 19:25:16,725::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1332::DEBUG::2014-04-10 19:25:16,725::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`bb9e5d90-7b3d-4a45-96f2-15b5a26e9ce3`::Granted request
>Thread-1332::DEBUG::2014-04-10 19:25:16,726::task::811::TaskManager.Task::(resourceAcquired) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1332::DEBUG::2014-04-10 19:25:16,726::task::974::TaskManager.Task::(_decref) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::ref 1 aborting False
>Thread-1332::INFO::2014-04-10 19:25:16,728::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1332::DEBUG::2014-04-10 19:25:16,728::task::1168::TaskManager.Task::(prepare) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1332::DEBUG::2014-04-10 19:25:16,728::task::579::TaskManager.Task::(_updateState) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::moving from state preparing -> state finished
>Thread-1332::DEBUG::2014-04-10 19:25:16,728::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1332::DEBUG::2014-04-10 19:25:16,728::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1332::DEBUG::2014-04-10 19:25:16,729::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1332::DEBUG::2014-04-10 19:25:16,729::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1332::DEBUG::2014-04-10 19:25:16,729::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1332::DEBUG::2014-04-10 19:25:16,729::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1332::DEBUG::2014-04-10 19:25:16,729::task::974::TaskManager.Task::(_decref) Task=`8ada1267-6eb3-46aa-b008-4c9bcfab7d55`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:25:20,566::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:20,572::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000506375 s, 727 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:25:23,941::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:25:23,947::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.00050423 s, 1.3 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:25:24,097::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:25:24,104::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000334379 s, 2.0 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:25:24,120::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:24,125::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00026536 s, 2.5 MB/s\n'; <rc> = 0
>Thread-1335::DEBUG::2014-04-10 19:25:25,291::task::579::TaskManager.Task::(_updateState) Task=`5ab48efa-f799-4b4c-9bf7-a31b3e6f69b1`::moving from state init -> state preparing
>Thread-1335::INFO::2014-04-10 19:25:25,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1335::INFO::2014-04-10 19:25:25,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050423', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334379', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026536', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506375', 'lastCheck': '4.7', 'valid': True}}
>Thread-1335::DEBUG::2014-04-10 19:25:25,292::task::1168::TaskManager.Task::(prepare) Task=`5ab48efa-f799-4b4c-9bf7-a31b3e6f69b1`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050423', 'lastCheck': '1.3', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334379', 'lastCheck': '1.2', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00026536', 'lastCheck': '1.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506375', 'lastCheck': '4.7', 'valid': True}}
>Thread-1335::DEBUG::2014-04-10 19:25:25,292::task::579::TaskManager.Task::(_updateState) Task=`5ab48efa-f799-4b4c-9bf7-a31b3e6f69b1`::moving from state preparing -> state finished
>Thread-1335::DEBUG::2014-04-10 19:25:25,293::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1335::DEBUG::2014-04-10 19:25:25,293::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1335::DEBUG::2014-04-10 19:25:25,293::task::974::TaskManager.Task::(_decref) Task=`5ab48efa-f799-4b4c-9bf7-a31b3e6f69b1`::ref 0 aborting False
>Thread-1337::DEBUG::2014-04-10 19:25:26,805::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1337::DEBUG::2014-04-10 19:25:26,805::task::579::TaskManager.Task::(_updateState) Task=`c27837fc-e708-497d-9a24-3088abf52ffc`::moving from state init -> state preparing
>Thread-1337::INFO::2014-04-10 19:25:26,805::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1337::INFO::2014-04-10 19:25:26,805::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1337::DEBUG::2014-04-10 19:25:26,806::task::1168::TaskManager.Task::(prepare) Task=`c27837fc-e708-497d-9a24-3088abf52ffc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1337::DEBUG::2014-04-10 19:25:26,806::task::579::TaskManager.Task::(_updateState) Task=`c27837fc-e708-497d-9a24-3088abf52ffc`::moving from state preparing -> state finished
>Thread-1337::DEBUG::2014-04-10 19:25:26,806::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1337::DEBUG::2014-04-10 19:25:26,806::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1337::DEBUG::2014-04-10 19:25:26,806::task::974::TaskManager.Task::(_decref) Task=`c27837fc-e708-497d-9a24-3088abf52ffc`::ref 0 aborting False
>Thread-1338::DEBUG::2014-04-10 19:25:26,814::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1338::DEBUG::2014-04-10 19:25:26,814::task::579::TaskManager.Task::(_updateState) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::moving from state init -> state preparing
>Thread-1338::INFO::2014-04-10 19:25:26,814::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1338::DEBUG::2014-04-10 19:25:26,815::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e28bf397-22e3-4808-a682-82b41d4d16a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1338::DEBUG::2014-04-10 19:25:26,815::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1338::DEBUG::2014-04-10 19:25:26,815::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1338::DEBUG::2014-04-10 19:25:26,815::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`e28bf397-22e3-4808-a682-82b41d4d16a3`::Granted request
>Thread-1338::DEBUG::2014-04-10 19:25:26,815::task::811::TaskManager.Task::(resourceAcquired) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1338::DEBUG::2014-04-10 19:25:26,816::task::974::TaskManager.Task::(_decref) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::ref 1 aborting False
>Thread-1338::INFO::2014-04-10 19:25:26,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1338::DEBUG::2014-04-10 19:25:26,818::task::1168::TaskManager.Task::(prepare) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139080695808', 'isoprefix': '', 'alerts': [], 'disktotal': '910949089280', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1338::DEBUG::2014-04-10 19:25:26,818::task::579::TaskManager.Task::(_updateState) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::moving from state preparing -> state finished
>Thread-1338::DEBUG::2014-04-10 19:25:26,818::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1338::DEBUG::2014-04-10 19:25:26,818::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1338::DEBUG::2014-04-10 19:25:26,819::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1338::DEBUG::2014-04-10 19:25:26,819::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1338::DEBUG::2014-04-10 19:25:26,819::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1338::DEBUG::2014-04-10 19:25:26,819::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1338::DEBUG::2014-04-10 19:25:26,819::task::974::TaskManager.Task::(_decref) Task=`742f9dc6-f323-486f-9973-fe09e77d2b11`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:25:30,581::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:30,588::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000513036 s, 717 kB/s\n'; <rc> = 0
>Thread-1341::DEBUG::2014-04-10 19:25:33,418::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1d434f69]
>Thread-1341::DEBUG::2014-04-10 19:25:33,425::task::579::TaskManager.Task::(_updateState) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::moving from state init -> state preparing
>Thread-1341::INFO::2014-04-10 19:25:33,425::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='dbec8cee-b5e4-4011-9dd5-7c122389a878', spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', imgUUID='ca8224e3-4aff-4e35-87f6-c12059aeb202', postZero='false', force='false')
>Thread-1341::DEBUG::2014-04-10 19:25:33,426::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202`ReqID=`b52480f6-ce65-402c-aa4e-2f88be163279`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1526' at 'deleteImage'
>Thread-1341::DEBUG::2014-04-10 19:25:33,426::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202' for lock type 'exclusive'
>Thread-1341::DEBUG::2014-04-10 19:25:33,426::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202' is free. Now locking as 'exclusive' (1 active user)
>Thread-1341::DEBUG::2014-04-10 19:25:33,426::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202`ReqID=`b52480f6-ce65-402c-aa4e-2f88be163279`::Granted request
>Thread-1341::DEBUG::2014-04-10 19:25:33,427::task::811::TaskManager.Task::(resourceAcquired) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_resourcesAcquired: Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202 (exclusive)
>Thread-1341::DEBUG::2014-04-10 19:25:33,427::task::974::TaskManager.Task::(_decref) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::ref 1 aborting False
>Thread-1341::DEBUG::2014-04-10 19:25:33,427::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`e5d593a2-011e-433b-b63d-5df1282f7e5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1527' at 'deleteImage'
>Thread-1341::DEBUG::2014-04-10 19:25:33,427::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' for lock type 'shared'
>Thread-1341::DEBUG::2014-04-10 19:25:33,427::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free. Now locking as 'shared' (1 active user)
>Thread-1341::DEBUG::2014-04-10 19:25:33,428::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878`ReqID=`e5d593a2-011e-433b-b63d-5df1282f7e5f`::Granted request
>Thread-1341::DEBUG::2014-04-10 19:25:33,428::task::811::TaskManager.Task::(resourceAcquired) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_resourcesAcquired: Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878 (shared)
>Thread-1341::DEBUG::2014-04-10 19:25:33,428::task::974::TaskManager.Task::(_decref) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::ref 1 aborting False
>Thread-1341::DEBUG::2014-04-10 19:25:33,568::task::736::TaskManager.Task::(_save) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b.temp
>Thread-1341::DEBUG::2014-04-10 19:25:33,637::taskManager::68::TaskManager::(scheduleJob) scheduled job deleteImage_ca8224e3-4aff-4e35-87f6-c12059aeb202 for task 25272c28-b513-4f48-8b10-d532026aed1b 
>Thread-1341::INFO::2014-04-10 19:25:33,638::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
>Thread-1341::DEBUG::2014-04-10 19:25:33,638::task::1163::TaskManager.Task::(prepare) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::Prepare: 1 jobs exist, move to acquiring
>Thread-1341::DEBUG::2014-04-10 19:25:33,638::task::579::TaskManager.Task::(_updateState) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::moving from state preparing -> state acquiring
>Thread-1341::DEBUG::2014-04-10 19:25:33,639::task::736::TaskManager.Task::(_save) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b.temp
>Thread-1341::DEBUG::2014-04-10 19:25:33,741::task::579::TaskManager.Task::(_updateState) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::moving from state acquiring -> state queued
>Thread-1341::DEBUG::2014-04-10 19:25:33,742::task::736::TaskManager.Task::(_save) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b.temp
>Thread-1341::DEBUG::2014-04-10 19:25:33,843::taskManager::50::TaskManager::(_queueTask) queuing task: 25272c28-b513-4f48-8b10-d532026aed1b
>Thread-1341::DEBUG::2014-04-10 19:25:33,844::taskManager::56::TaskManager::(_queueTask) task queued: 25272c28-b513-4f48-8b10-d532026aed1b
>Thread-2::DEBUG::2014-04-10 19:25:33,844::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1
>Thread-1341::DEBUG::2014-04-10 19:25:33,845::task::1165::TaskManager.Task::(prepare) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::returning
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:33,846::threadPool::205::Misc.ThreadPool.WorkerThread::(run) Task: 25272c28-b513-4f48-8b10-d532026aed1b running: <bound method Task.commit of <storage.task.Task instance at 0x7fcc78175680>> with: None
>Thread-1341::DEBUG::2014-04-10 19:25:33,846::task::974::TaskManager.Task::(_decref) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::ref 0 aborting False
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:33,847::task::1176::TaskManager.Task::(commit) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::committing task: 25272c28-b513-4f48-8b10-d532026aed1b
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:33,849::task::579::TaskManager.Task::(_updateState) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::moving from state queued -> state running
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:33,852::task::736::TaskManager.Task::(_save) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b.temp
>Thread-65::DEBUG::2014-04-10 19:25:33,957::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:25:33,963::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000449911 s, 1.5 MB/s\n'; <rc> = 0
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,030::task::889::TaskManager.Task::(_runJobs) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::Task.run: running job 0: deleteImage_ca8224e3-4aff-4e35-87f6-c12059aeb202: <function <lambda> at 0x7fcc6c0e67d0> (args: () kwargs: {})
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,030::task::315::TaskManager.Task::(run) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::Job.run: running deleteImage_ca8224e3-4aff-4e35-87f6-c12059aeb202: <function <lambda> at 0x7fcc6c0e67d0> (args: () kwargs: {}) callback None
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,030::task::579::TaskManager.Task::(_updateState) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::moving from state running -> state finished
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,031::task::736::TaskManager.Task::(_save) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::_save: orig /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b temp /rhev/data-center/f721168f-5edd-4f5f-8976-591eb93f960e/mastersd/master/tasks/25272c28-b513-4f48-8b10-d532026aed1b.temp
>Thread-64::DEBUG::2014-04-10 19:25:34,121::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:34,128::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:25:34,130::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::ERROR::2014-04-10 19:25:34,131::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:25:34,134::lvm::386::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-64::DEBUG::2014-04-10 19:25:34,139::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000260575 s, 2.6 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:25:34,141::lvm::309::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dbec8cee-b5e4-4011-9dd5-7c122389a878' (cwd None)
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,246::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202': < ResourceRef 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202', isValid: 'True' obj: 'None'>, 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878': < ResourceRef 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', isValid: 'True' obj: 'None'>}
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,247::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,247::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202'
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,247::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202' (0 active users)
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,247::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202' is free, finding out if anyone is waiting for it.
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,247::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ca8224e3-4aff-4e35-87f6-c12059aeb202', Clearing records.
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,248::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878'
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,248::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' (0 active users)
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,248::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878' is free, finding out if anyone is waiting for it.
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,248::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.dbec8cee-b5e4-4011-9dd5-7c122389a878', Clearing records.
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,249::task::897::TaskManager.Task::(_runJobs) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::Task.run: exit - success: result True
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,249::task::974::TaskManager.Task::(_decref) Task=`25272c28-b513-4f48-8b10-d532026aed1b`::ref 0 aborting False
>25272c28-b513-4f48-8b10-d532026aed1b::DEBUG::2014-04-10 19:25:34,249::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0
>Thread-66::DEBUG::2014-04-10 19:25:34,287::lvm::309::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found\n  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878\n'; <rc> = 5
>Thread-66::WARNING::2014-04-10 19:25:34,288::lvm::391::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "dbec8cee-b5e4-4011-9dd5-7c122389a878" not found', '  Skipping volume group dbec8cee-b5e4-4011-9dd5-7c122389a878']
>Thread-66::DEBUG::2014-04-10 19:25:34,289::lvm::428::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-66::DEBUG::2014-04-10 19:25:34,304::fileSD::137::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:25:34,305::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-66::DEBUG::2014-04-10 19:25:34,310::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=2', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'ROLE=Master', 'SDUUID=dbec8cee-b5e4-4011-9dd5-7c122389a878', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4bd0381d565b816a926dbe800ee5d03a0660be0f']
>Thread-66::DEBUG::2014-04-10 19:25:34,311::fileSD::558::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-66::INFO::2014-04-10 19:25:34,311::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_imageNS already registered
>Thread-66::INFO::2014-04-10 19:25:34,312::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dbec8cee-b5e4-4011-9dd5-7c122389a878_volumeNS already registered
>Thread-66::DEBUG::2014-04-10 19:25:34,317::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:34,323::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00023154 s, 2.9 MB/s\n'; <rc> = 0
>Thread-1347::DEBUG::2014-04-10 19:25:35,191::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1347::DEBUG::2014-04-10 19:25:35,192::task::579::TaskManager.Task::(_updateState) Task=`85b20c24-762c-4628-84ac-4074c8a08f38`::moving from state init -> state preparing
>Thread-1347::INFO::2014-04-10 19:25:35,192::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-1347::DEBUG::2014-04-10 19:25:35,192::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-1347::DEBUG::2014-04-10 19:25:35,192::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 25272c28-b513-4f48-8b10-d532026aed1b
>Thread-1347::DEBUG::2014-04-10 19:25:35,192::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '25272c28-b513-4f48-8b10-d532026aed1b'}
>Thread-1347::DEBUG::2014-04-10 19:25:35,192::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'25272c28-b513-4f48-8b10-d532026aed1b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '25272c28-b513-4f48-8b10-d532026aed1b'}}
>Thread-1347::INFO::2014-04-10 19:25:35,193::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'25272c28-b513-4f48-8b10-d532026aed1b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '25272c28-b513-4f48-8b10-d532026aed1b'}}}
>Thread-1347::DEBUG::2014-04-10 19:25:35,193::task::1168::TaskManager.Task::(prepare) Task=`85b20c24-762c-4628-84ac-4074c8a08f38`::finished: {'allTasksStatus': {'25272c28-b513-4f48-8b10-d532026aed1b': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '25272c28-b513-4f48-8b10-d532026aed1b'}}}
>Thread-1347::DEBUG::2014-04-10 19:25:35,193::task::579::TaskManager.Task::(_updateState) Task=`85b20c24-762c-4628-84ac-4074c8a08f38`::moving from state preparing -> state finished
>Thread-1347::DEBUG::2014-04-10 19:25:35,193::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1347::DEBUG::2014-04-10 19:25:35,193::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1347::DEBUG::2014-04-10 19:25:35,193::task::974::TaskManager.Task::(_decref) Task=`85b20c24-762c-4628-84ac-4074c8a08f38`::ref 0 aborting False
>Thread-1348::DEBUG::2014-04-10 19:25:35,261::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1348::DEBUG::2014-04-10 19:25:35,262::task::579::TaskManager.Task::(_updateState) Task=`03c13ce6-5ac6-4c82-a4d2-ebff014719f8`::moving from state init -> state preparing
>Thread-1348::INFO::2014-04-10 19:25:35,262::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='25272c28-b513-4f48-8b10-d532026aed1b', spUUID=None, options=None)
>Thread-1348::DEBUG::2014-04-10 19:25:35,262::taskManager::161::TaskManager::(clearTask) Entry. taskID: 25272c28-b513-4f48-8b10-d532026aed1b
>Thread-1348::DEBUG::2014-04-10 19:25:35,296::taskManager::166::TaskManager::(clearTask) Return.
>Thread-1348::INFO::2014-04-10 19:25:35,296::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-1348::DEBUG::2014-04-10 19:25:35,297::task::1168::TaskManager.Task::(prepare) Task=`03c13ce6-5ac6-4c82-a4d2-ebff014719f8`::finished: None
>Thread-1348::DEBUG::2014-04-10 19:25:35,297::task::579::TaskManager.Task::(_updateState) Task=`03c13ce6-5ac6-4c82-a4d2-ebff014719f8`::moving from state preparing -> state finished
>Thread-1348::DEBUG::2014-04-10 19:25:35,297::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1348::DEBUG::2014-04-10 19:25:35,297::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1348::DEBUG::2014-04-10 19:25:35,297::task::974::TaskManager.Task::(_decref) Task=`03c13ce6-5ac6-4c82-a4d2-ebff014719f8`::ref 0 aborting False
>Thread-1349::DEBUG::2014-04-10 19:25:36,912::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1349::DEBUG::2014-04-10 19:25:36,912::task::579::TaskManager.Task::(_updateState) Task=`3eb08be9-36ee-467d-a0c2-29db5bef9304`::moving from state init -> state preparing
>Thread-1349::INFO::2014-04-10 19:25:36,913::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1349::INFO::2014-04-10 19:25:36,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1349::DEBUG::2014-04-10 19:25:36,913::task::1168::TaskManager.Task::(prepare) Task=`3eb08be9-36ee-467d-a0c2-29db5bef9304`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1349::DEBUG::2014-04-10 19:25:36,913::task::579::TaskManager.Task::(_updateState) Task=`3eb08be9-36ee-467d-a0c2-29db5bef9304`::moving from state preparing -> state finished
>Thread-1349::DEBUG::2014-04-10 19:25:36,913::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1349::DEBUG::2014-04-10 19:25:36,913::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1349::DEBUG::2014-04-10 19:25:36,914::task::974::TaskManager.Task::(_decref) Task=`3eb08be9-36ee-467d-a0c2-29db5bef9304`::ref 0 aborting False
>Thread-1350::DEBUG::2014-04-10 19:25:36,921::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1350::DEBUG::2014-04-10 19:25:36,922::task::579::TaskManager.Task::(_updateState) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::moving from state init -> state preparing
>Thread-1350::INFO::2014-04-10 19:25:36,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1350::DEBUG::2014-04-10 19:25:36,922::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`faf53aa3-a2a7-40d2-90b3-f5478967107e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2562' at 'getStoragePoolInfo'
>Thread-1350::DEBUG::2014-04-10 19:25:36,923::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'shared'
>Thread-1350::DEBUG::2014-04-10 19:25:36,923::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'shared' (1 active user)
>Thread-1350::DEBUG::2014-04-10 19:25:36,923::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`faf53aa3-a2a7-40d2-90b3-f5478967107e`::Granted request
>Thread-1350::DEBUG::2014-04-10 19:25:36,923::task::811::TaskManager.Task::(resourceAcquired) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (shared)
>Thread-1350::DEBUG::2014-04-10 19:25:36,923::task::974::TaskManager.Task::(_decref) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::ref 1 aborting False
>Thread-1350::INFO::2014-04-10 19:25:36,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1350::DEBUG::2014-04-10 19:25:36,926::task::1168::TaskManager.Task::(prepare) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::finished: {'info': {'spm_id': 2, 'master_uuid': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'name': 'NFS_shyu', 'version': '3', 'domains': 'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'NFS', 'master_ver': 7, 'lver': 0}, 'dominfo': {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '22e307a4-41f0-4c25-8c1a-ef6aa5117e2b': {'status': 'Attached', 'isoprefix': '', 'alerts': []}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'status': 'Active', 'diskfree': '139081678848', 'isoprefix': '', 'alerts': [], 'disktotal': '910949023744', 'version': 3}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'status': 'Active', 'diskfree': '76828114944', 'isoprefix': '', 'alerts': [], 'disktotal': '84551925760', 'version': 3}}}
>Thread-1350::DEBUG::2014-04-10 19:25:36,926::task::579::TaskManager.Task::(_updateState) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::moving from state preparing -> state finished
>Thread-1350::DEBUG::2014-04-10 19:25:36,926::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1350::DEBUG::2014-04-10 19:25:36,926::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1350::DEBUG::2014-04-10 19:25:36,926::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1350::DEBUG::2014-04-10 19:25:36,927::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1350::DEBUG::2014-04-10 19:25:36,927::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1350::DEBUG::2014-04-10 19:25:36,927::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1350::DEBUG::2014-04-10 19:25:36,927::task::974::TaskManager.Task::(_decref) Task=`33d466c8-7ef9-4238-a40b-c47eefc8e281`::ref 0 aborting False
>Thread-1352::DEBUG::2014-04-10 19:25:40,498::task::579::TaskManager.Task::(_updateState) Task=`6396e03b-2536-4c53-8041-e38f0866627b`::moving from state init -> state preparing
>Thread-1352::INFO::2014-04-10 19:25:40,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1352::INFO::2014-04-10 19:25:40,498::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449911', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260575', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023154', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513036', 'lastCheck': '9.9', 'valid': True}}
>Thread-1352::DEBUG::2014-04-10 19:25:40,498::task::1168::TaskManager.Task::(prepare) Task=`6396e03b-2536-4c53-8041-e38f0866627b`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000449911', 'lastCheck': '6.5', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000260575', 'lastCheck': '6.3', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023154', 'lastCheck': '6.2', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513036', 'lastCheck': '9.9', 'valid': True}}
>Thread-1352::DEBUG::2014-04-10 19:25:40,499::task::579::TaskManager.Task::(_updateState) Task=`6396e03b-2536-4c53-8041-e38f0866627b`::moving from state preparing -> state finished
>Thread-1352::DEBUG::2014-04-10 19:25:40,499::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1352::DEBUG::2014-04-10 19:25:40,499::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1352::DEBUG::2014-04-10 19:25:40,499::task::974::TaskManager.Task::(_decref) Task=`6396e03b-2536-4c53-8041-e38f0866627b`::ref 0 aborting False
>Thread-67::DEBUG::2014-04-10 19:25:40,596::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:40,604::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000496016 s, 742 kB/s\n'; <rc> = 0
>Thread-65::DEBUG::2014-04-10 19:25:43,974::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1/f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-65::DEBUG::2014-04-10 19:25:43,981::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n658 bytes (658 B) copied, 0.000375088 s, 1.8 MB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:25:44,159::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2/55cb7668-7c5e-4553-b263-c6f3f86b358f/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-64::DEBUG::2014-04-10 19:25:44,165::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.00031171 s, 2.2 MB/s\n'; <rc> = 0
>Thread-66::DEBUG::2014-04-10 19:25:44,332::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1/dbec8cee-b5e4-4011-9dd5-7c122389a878/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-66::DEBUG::2014-04-10 19:25:44,338::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n671 bytes (671 B) copied, 0.000254192 s, 2.6 MB/s\n'; <rc> = 0
>Thread-1355::DEBUG::2014-04-10 19:25:45,404::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1cb38793]
>Thread-1355::DEBUG::2014-04-10 19:25:45,405::task::579::TaskManager.Task::(_updateState) Task=`4a067c6c-fe03-48ae-83d7-8c8193490022`::moving from state init -> state preparing
>Thread-1355::INFO::2014-04-10 19:25:45,405::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-1355::DEBUG::2014-04-10 19:25:45,406::taskManager::102::TaskManager::(getAllTasksStatuses) Entry.
>Thread-1355::DEBUG::2014-04-10 19:25:45,406::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {}
>Thread-1355::INFO::2014-04-10 19:25:45,406::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}}
>Thread-1355::DEBUG::2014-04-10 19:25:45,406::task::1168::TaskManager.Task::(prepare) Task=`4a067c6c-fe03-48ae-83d7-8c8193490022`::finished: {'allTasksStatus': {}}
>Thread-1355::DEBUG::2014-04-10 19:25:45,406::task::579::TaskManager.Task::(_updateState) Task=`4a067c6c-fe03-48ae-83d7-8c8193490022`::moving from state preparing -> state finished
>Thread-1355::DEBUG::2014-04-10 19:25:45,406::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1355::DEBUG::2014-04-10 19:25:45,407::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1355::DEBUG::2014-04-10 19:25:45,407::task::974::TaskManager.Task::(_decref) Task=`4a067c6c-fe03-48ae-83d7-8c8193490022`::ref 0 aborting False
>Thread-1356::DEBUG::2014-04-10 19:25:45,415::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [1cb38793]
>Thread-1356::DEBUG::2014-04-10 19:25:45,416::task::579::TaskManager.Task::(_updateState) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::moving from state init -> state preparing
>Thread-1356::INFO::2014-04-10 19:25:45,416::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', options=None)
>Thread-1356::DEBUG::2014-04-10 19:25:45,417::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2815b2dc-4bff-41d2-9d6e-c478743b026e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '615' at 'spmStop'
>Thread-1356::DEBUG::2014-04-10 19:25:45,417::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-1356::DEBUG::2014-04-10 19:25:45,417::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-1356::DEBUG::2014-04-10 19:25:45,417::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`2815b2dc-4bff-41d2-9d6e-c478743b026e`::Granted request
>Thread-1356::DEBUG::2014-04-10 19:25:45,418::task::811::TaskManager.Task::(resourceAcquired) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-1356::DEBUG::2014-04-10 19:25:45,418::task::974::TaskManager.Task::(_decref) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::ref 1 aborting False
>Thread-1356::DEBUG::2014-04-10 19:25:45,418::sp::343::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process
>Thread-1356::DEBUG::2014-04-10 19:25:45,418::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`43f5dbe5-bb76-46d1-b25d-4fd9ad1cd8e8`::Request was made in '/usr/share/vdsm/storage/sp.py' line '345' at '_shutDownUpgrade'
>Thread-1356::DEBUG::2014-04-10 19:25:45,419::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-1356::DEBUG::2014-04-10 19:25:45,419::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-1356::DEBUG::2014-04-10 19:25:45,419::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`43f5dbe5-bb76-46d1-b25d-4fd9ad1cd8e8`::Granted request
>Thread-1356::DEBUG::2014-04-10 19:25:45,419::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1356::DEBUG::2014-04-10 19:25:45,420::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1356::DEBUG::2014-04-10 19:25:45,420::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1356::DEBUG::2014-04-10 19:25:45,420::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1356::DEBUG::2014-04-10 19:25:45,420::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-1356::DEBUG::2014-04-10 19:25:45,421::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-1356::DEBUG::2014-04-10 19:25:45,421::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NFS_shyu_domain3', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=7', 'POOL_DESCRIPTION=NFS_shyu', 'POOL_DOMAINS=22e307a4-41f0-4c25-8c1a-ef6aa5117e2b:Attached,f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76:Active,55cb7668-7c5e-4553-b263-c6f3f86b358f:Active,dbec8cee-b5e4-4011-9dd5-7c122389a878:Active,65eafe2b-4fa9-4ea1-a869-7deb5afd4654:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=f721168f-5edd-4f5f-8976-591eb93f960e', 'REMOTE_PATH=10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'ROLE=Master', 'SDUUID=f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=4fd61f80149bdedd8d026a349ccec6158827b8a2']
>Thread-1356::DEBUG::2014-04-10 19:25:45,461::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-1356::INFO::2014-04-10 19:25:45,462::clusterlock::255::SANLock::(release) Releasing cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-1356::DEBUG::2014-04-10 19:25:45,482::clusterlock::266::SANLock::(release) Cluster lock for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 successfully released
>Thread-1356::INFO::2014-04-10 19:25:45,482::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None
>Thread-1356::DEBUG::2014-04-10 19:25:45,482::task::1168::TaskManager.Task::(prepare) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::finished: None
>Thread-1356::DEBUG::2014-04-10 19:25:45,482::task::579::TaskManager.Task::(_updateState) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::moving from state preparing -> state finished
>Thread-1356::DEBUG::2014-04-10 19:25:45,482::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1356::DEBUG::2014-04-10 19:25:45,483::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1356::DEBUG::2014-04-10 19:25:45,483::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1356::DEBUG::2014-04-10 19:25:45,483::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1356::DEBUG::2014-04-10 19:25:45,483::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1356::DEBUG::2014-04-10 19:25:45,483::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1356::DEBUG::2014-04-10 19:25:45,484::task::974::TaskManager.Task::(_decref) Task=`c7e63edd-8717-4f02-8cb6-57579095ed8d`::ref 0 aborting False
>Thread-1357::DEBUG::2014-04-10 19:25:46,601::task::579::TaskManager.Task::(_updateState) Task=`dbfcd5be-329b-4f2f-8ad3-1a941faf707f`::moving from state init -> state preparing
>Thread-1357::INFO::2014-04-10 19:25:46,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1357::INFO::2014-04-10 19:25:46,602::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375088', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031171', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254192', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496016', 'lastCheck': '6.0', 'valid': True}}
>Thread-1357::DEBUG::2014-04-10 19:25:46,602::task::1168::TaskManager.Task::(prepare) Task=`dbfcd5be-329b-4f2f-8ad3-1a941faf707f`::finished: {'f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375088', 'lastCheck': '2.6', 'valid': True}, '55cb7668-7c5e-4553-b263-c6f3f86b358f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031171', 'lastCheck': '2.4', 'valid': True}, 'dbec8cee-b5e4-4011-9dd5-7c122389a878': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254192', 'lastCheck': '2.3', 'valid': True}, '65eafe2b-4fa9-4ea1-a869-7deb5afd4654': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496016', 'lastCheck': '6.0', 'valid': True}}
>Thread-1357::DEBUG::2014-04-10 19:25:46,602::task::579::TaskManager.Task::(_updateState) Task=`dbfcd5be-329b-4f2f-8ad3-1a941faf707f`::moving from state preparing -> state finished
>Thread-1357::DEBUG::2014-04-10 19:25:46,602::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1357::DEBUG::2014-04-10 19:25:46,602::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1357::DEBUG::2014-04-10 19:25:46,602::task::974::TaskManager.Task::(_decref) Task=`dbfcd5be-329b-4f2f-8ad3-1a941faf707f`::ref 0 aborting False
>Thread-1359::DEBUG::2014-04-10 19:25:46,684::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132]
>Thread-1359::DEBUG::2014-04-10 19:25:46,685::task::579::TaskManager.Task::(_updateState) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::moving from state init -> state preparing
>Thread-1359::INFO::2014-04-10 19:25:46,685::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', hostID=2, scsiKey='f721168f-5edd-4f5f-8976-591eb93f960e', remove=False, options=None)
>Thread-1359::DEBUG::2014-04-10 19:25:46,685::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`128ca66f-b56b-4aca-b396-93029aa7fb34`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1111' at 'disconnectStoragePool'
>Thread-1359::DEBUG::2014-04-10 19:25:46,685::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' for lock type 'exclusive'
>Thread-1359::DEBUG::2014-04-10 19:25:46,686::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free. Now locking as 'exclusive' (1 active user)
>Thread-1359::DEBUG::2014-04-10 19:25:46,686::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.f721168f-5edd-4f5f-8976-591eb93f960e`ReqID=`128ca66f-b56b-4aca-b396-93029aa7fb34`::Granted request
>Thread-1359::DEBUG::2014-04-10 19:25:46,686::task::811::TaskManager.Task::(resourceAcquired) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::_resourcesAcquired: Storage.f721168f-5edd-4f5f-8976-591eb93f960e (exclusive)
>Thread-1359::DEBUG::2014-04-10 19:25:46,686::task::974::TaskManager.Task::(_decref) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::ref 1 aborting False
>Thread-1359::DEBUG::2014-04-10 19:25:46,687::resourceManager::197::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`9b0a0a83-1f09-4c1d-b935-095dbcd1dc5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1119' at '_disconnectPool'
>Thread-1359::DEBUG::2014-04-10 19:25:46,687::resourceManager::541::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-1359::DEBUG::2014-04-10 19:25:46,687::resourceManager::600::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-1359::DEBUG::2014-04-10 19:25:46,687::resourceManager::237::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`9b0a0a83-1f09-4c1d-b935-095dbcd1dc5e`::Granted request
>Thread-1359::INFO::2014-04-10 19:25:46,687::sp::711::Storage.StoragePool::(disconnect) Disconnect from the storage pool f721168f-5edd-4f5f-8976-591eb93f960e
>Thread-1359::INFO::2014-04-10 19:25:46,688::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::DEBUG::2014-04-10 19:25:46,688::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76
>Thread-65::INFO::2014-04-10 19:25:46,688::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 (id: 2)
>Thread-65::DEBUG::2014-04-10 19:25:48,691::clusterlock::207::SANLock::(releaseHostId) Host id for domain f9b3c82f-87e3-4cc8-8dda-b2721b4b4d76 released successfully (id: 2)
>Thread-1359::INFO::2014-04-10 19:25:48,692::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::DEBUG::2014-04-10 19:25:48,693::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 55cb7668-7c5e-4553-b263-c6f3f86b358f
>Thread-64::INFO::2014-04-10 19:25:48,693::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f (id: 2)
>Thread-67::DEBUG::2014-04-10 19:25:50,610::fileSD::222::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2/65eafe2b-4fa9-4ea1-a869-7deb5afd4654/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-67::DEBUG::2014-04-10 19:25:50,617::fileSD::222::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n368 bytes (368 B) copied, 0.000400782 s, 918 kB/s\n'; <rc> = 0
>Thread-64::DEBUG::2014-04-10 19:25:50,694::clusterlock::207::SANLock::(releaseHostId) Host id for domain 55cb7668-7c5e-4553-b263-c6f3f86b358f released successfully (id: 2)
>Thread-1359::INFO::2014-04-10 19:25:50,694::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::DEBUG::2014-04-10 19:25:50,695::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for dbec8cee-b5e4-4011-9dd5-7c122389a878
>Thread-66::INFO::2014-04-10 19:25:50,695::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 (id: 2)
>Thread-66::DEBUG::2014-04-10 19:25:52,696::clusterlock::207::SANLock::(releaseHostId) Host id for domain dbec8cee-b5e4-4011-9dd5-7c122389a878 released successfully (id: 2)
>Thread-1359::INFO::2014-04-10 19:25:52,696::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::DEBUG::2014-04-10 19:25:52,696::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 65eafe2b-4fa9-4ea1-a869-7deb5afd4654
>Thread-67::INFO::2014-04-10 19:25:52,696::clusterlock::197::SANLock::(releaseHostId) Releasing host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 (id: 2)
>Thread-67::DEBUG::2014-04-10 19:25:54,697::clusterlock::207::SANLock::(releaseHostId) Host id for domain 65eafe2b-4fa9-4ea1-a869-7deb5afd4654 released successfully (id: 2)
>Thread-1359::DEBUG::2014-04-10 19:25:54,698::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-1359::DEBUG::2014-04-10 19:25:54,698::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-1359::DEBUG::2014-04-10 19:25:54,699::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-1359::DEBUG::2014-04-10 19:25:54,699::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-1359::INFO::2014-04-10 19:25:54,699::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True
>Thread-1359::DEBUG::2014-04-10 19:25:54,699::task::1168::TaskManager.Task::(prepare) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::finished: True
>Thread-1359::DEBUG::2014-04-10 19:25:54,699::task::579::TaskManager.Task::(_updateState) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::moving from state preparing -> state finished
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.f721168f-5edd-4f5f-8976-591eb93f960e': < ResourceRef 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', isValid: 'True' obj: 'None'>}
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::615::ResourceManager::(releaseResource) Trying to release resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e'
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::634::ResourceManager::(releaseResource) Released resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' (0 active users)
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::640::ResourceManager::(releaseResource) Resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e' is free, finding out if anyone is waiting for it.
>Thread-1359::DEBUG::2014-04-10 19:25:54,700::resourceManager::648::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.f721168f-5edd-4f5f-8976-591eb93f960e', Clearing records.
>Thread-1359::DEBUG::2014-04-10 19:25:54,701::task::974::TaskManager.Task::(_decref) Task=`078b8b3f-b64b-45dd-880f-9a0707bd6146`::ref 0 aborting False
>Thread-1360::DEBUG::2014-04-10 19:25:54,836::BindingXMLRPC::167::vds::(wrapper) client [10.66.4.132] flowID [37d92ffd]
>Thread-1360::DEBUG::2014-04-10 19:25:54,836::task::579::TaskManager.Task::(_updateState) Task=`e6577108-64e0-4ec6-bf92-30d69fc1e3fa`::moving from state init -> state preparing
>Thread-1360::INFO::2014-04-10 19:25:54,836::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='f721168f-5edd-4f5f-8976-591eb93f960e', conList=[{'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs2', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf', 'port': ''}, {'connection': '10.66.90.121:/vol/S3/libvirtmanual/shyu_rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e', 'port': ''}, {'connection': '10.66.4.135:/mnt/rhevm_nfs/rhevm_nfs1', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f', 'port': ''}], options=None)
>Thread-1360::DEBUG::2014-04-10 19:25:54,837::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs2' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:54,898::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs2' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:54,935::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.90.121:_vol_S3_libvirtmanual_shyu__rhevm__nfs1' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:54,963::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.66.4.135:_mnt_rhevm__nfs_rhevm__nfs1' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:54,994::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-1360::DEBUG::2014-04-10 19:25:54,994::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-1360::DEBUG::2014-04-10 19:25:54,995::misc::809::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-1360::DEBUG::2014-04-10 19:25:54,995::misc::811::SamplingMethod::(__call__) Got in to sampling method
>Thread-1360::DEBUG::2014-04-10 19:25:54,995::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:55,006::iscsiadm::91::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
>Thread-1360::DEBUG::2014-04-10 19:25:55,006::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-1360::DEBUG::2014-04-10 19:25:57,051::multipath::112::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-1360::DEBUG::2014-04-10 19:25:57,150::multipath::112::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-1360::DEBUG::2014-04-10 19:25:57,150::lvm::510::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,151::lvm::512::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,151::lvm::521::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,151::lvm::523::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,151::lvm::541::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,152::lvm::543::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-1360::DEBUG::2014-04-10 19:25:57,152::misc::819::SamplingMethod::(__call__) Returning last result
>Thread-1360::INFO::2014-04-10 19:25:57,152::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-1360::DEBUG::2014-04-10 19:25:57,152::task::1168::TaskManager.Task::(prepare) Task=`e6577108-64e0-4ec6-bf92-30d69fc1e3fa`::finished: {'statuslist': [{'status': 0, 'id': '8ff86ef7-1aee-4e8a-8972-f6f347dc1ecd'}, {'status': 0, 'id': '91be9ed1-835c-4cdc-9c93-592be4f65bbf'}, {'status': 0, 'id': '3a621f65-7d4c-4e19-8f42-a133992d810e'}, {'status': 0, 'id': '46cdcaf4-01f2-41fa-9c4b-ae154da2f00f'}]}
>Thread-1360::DEBUG::2014-04-10 19:25:57,153::task::579::TaskManager.Task::(_updateState) Task=`e6577108-64e0-4ec6-bf92-30d69fc1e3fa`::moving from state preparing -> state finished
>Thread-1360::DEBUG::2014-04-10 19:25:57,153::resourceManager::939::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-1360::DEBUG::2014-04-10 19:25:57,153::resourceManager::976::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-1360::DEBUG::2014-04-10 19:25:57,153::task::974::TaskManager.Task::(_decref) Task=`e6577108-64e0-4ec6-bf92-30d69fc1e3fa`::ref 0 aborting False

Actions: View

Attachments on bug 1086210: 884913 | 884915